Senior Manager, Generative AI Test Engineering

Job LocationMountain View, CAJob CategoryJob TypeFull-TimeJob #402716Job DepartmentAdvanced Intelligence LabWe focus on developing speech recognition, advanced speech personalization, and state-of-the-art natural language understanding technology. We are dedicated to creating an advanced AI platform that handles seamless conversations across a variety of devices, as well as democratizing AI by allowing developers and IoT manufacturers to add new capabilities to Bixby.Position Summary:We’re seeking a Senior Manager for our Generative AI Test Engineering team–which will join our Quality Insights team. You will be responsible for managing a small team and for designing and implementing testing strategies and frameworks to evaluate the performance, accuracy, robustness, and safety of AI models and systems. You will collaborate closely with research teams to understand new model capabilities and translate them into robust testing plans and scenario. You will drive development and maintenance of automated testing frameworks and tools for efficient AI validation and system-level testing.Position Responsibilities:Lead of small team of Data Scientists and QA EngineersAct as a player/coach and utilize test results data to guide product development, identify opportunities, predict challenges, and inform strategic decisionsMeasure product success through metrics, identifying areas for improvement, and effectively communicating insights to stakeholdersWork closely with other functions, such as engineering, product, design, and othersRequired Skills:Bachelor’s degree in Computer Science, Computer Engineering, or equivalent combination of education, training, and experience12+ years of professional software development testing experience, including test automation frameworks and tools building2+ years of people management experienceExperience with LLMOps, model monitoring, or ML observability platformsProficiency in Python, SQL, and data visualization tools for model analyticsStrong knowledge of QA methodologies, test automation, and CI/CD integrationExperience as a mentor, tech lead or leading an engineering teamSpecial Attributes:Hands-on experience with LangChain, OpenAI API, Hugging Face models, or RAG pipelinesKnowledge of cloud platforms (AWS/GCP/Azure) for data workflows and ML deploymentFamiliarity with human-in-the-loop QA or AI-assisted testing workflowsOur total rewards programs are designed to motivate and engage exceptional talent. The base pay range for roles at this level is listed below, but may be higher or lower in other states due to geographic differentials in the labor market. Within the base pay range, individual rates depend on a number of factors—including the role’s function and location as well as the individual’s knowledge, skills, experience, education and training. This is part of our comprehensive compensation package with annual bonus eligibility and generous benefits to help you live life well.Base Pay Range$197,800 — $296,600 USDAdditional InformationDisclosure of Trade SecretsSamsung has a strict policy on trade secrets. In applying to Samsung and progressing through the recruitment process, you must not disclose any trade secrets of a current or previous employer.Essential Job FunctionsThis position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, and frequently operate standard office equipment, such as telephones and computers.Samsung Research America is committed to complying with all Federal, State and local laws related to the employment of qualified individuals with disabilities. If you are an individual with a disability and would like to request a reasonable accommodation as part of the employment selection process, please contact the recruiter or email Samsung, we believe that innovation and growth are driven by an inclusive culture and a diverse workforce. We aim to create a global team where everyone belongs and has equal opportunities, inspiring our talent to be their true selves. Together, we are building a better tomorrow for our customers, partners, and communities.Samsung Research America is committed to employing a diverse workforce, and provide Equal Employment Opportunity for all individuals regardless of race, color, religion, gender, age, national origin, marital status, sexual orientation, gender identity, status as a protected veteran, genetic information, status as a qualified individual with a disability, or any other characteristic protected by law.For more information regarding protection from discrimination under Federal law for applicants and employees, please refer to this link: Pay Transparency #J-18808-Ljbffr

Created: 2025-09-17