Senior Manager, Generative AI Test Engineering

We focus on developing speech recognition, advanced speech personalization, and state-of-the-art natural language understanding technology. We are dedicated to creating an advanced AI platform that handles seamless conversations across a variety of devices, as well as democratizing AI by allowing developers and IoT manufacturers to add new capabilities to Bixby.Position Summary:We’re seeking a Senior Manager for our Generative AI Test Engineering team–which will join our Quality Insights team. You will be responsible for managing a small team and for designing and implementing testing strategies and frameworks to evaluate the performance, accuracy, robustness, and safety of AI models and systems. You will collaborate closely with research teams to understand new model capabilities and translate them into robust testing plans and scenario. You will drive development and maintenance of automated testing frameworks and tools for efficient AI validation and system-level testing.Position Responsibilities:Lead of small team of Data Scientists and QA EngineersAct as a player/coach and utilize test results data to guide product development, identify opportunities, predict challenges, and inform strategic decisionsMeasure product success through metrics, identifying areas for improvement, and effectively communicating insights to stakeholdersWork closely with other functions, such as engineering, product, design, and othersRequired Skills:Bachelor’s degree in Computer Science, Computer Engineering, or equivalent combination of education, training, and experience12+ years of professional software development testing experience, including test automation frameworks and tools building2+ years of people management experienceExperience with LLMOps, model monitoring, or ML observability platformsProficiency in Python, SQL, and data visualization tools for model analyticsStrong knowledge of QA methodologies, test automation, and CI/CD integrationExperience as a mentor, tech lead or leading an engineering teamSpecial Attributes:Hands-on experience with LangChain, OpenAI API, Hugging Face models, or RAG pipelinesKnowledge of cloud platforms (AWS/GCP/Azure) for data workflows and ML deploymentFamiliarity with human-in-the-loop QA or AI-assisted testing workflowsOur total rewards programs are designed to motivate and engage exceptional talent. The base pay range for roles at this level is listed below, but may be higher or lower in other states due to geographic differentials in the labor market. Within the base pay range, individual rates depend on a number of factors—including the role’s function and location as well as the individual’s knowledge, skills, experience, education and training. This is part of our comprehensive compensation package with annual bonus eligibility and generous benefits to help you live life well.Base Pay Range$197,800 - $296,600 USDAdditional InformationDisclosure of Trade SecretsSamsung has a strict policy on trade secrets. In applying to Samsung and progressing through the recruitment process, you must not disclose any trade secrets of a current or previous employer.Essential Job FunctionsThis position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, and frequently operate standard office equipment, such as telephones and computers.Samsung Research America is committed to complying with all Federal, State and local laws related to the employment of qualified individuals with disabilities. If you are an individual with a disability and would like to request a reasonable accommodation as part of the employment selection process, please contact the recruiter or email Samsung, we believe that innovation and growth are driven by an inclusive culture and a diverse workforce. We aim to create a global team where everyone belongs and has equal opportunities, inspiring our talent to be their true selves. Together, we are building a better tomorrow for our customers, partners, and communities.Samsung Research America is committed to employing a diverse workforce, and provide Equal Employment Opportunity for all individuals regardless of race, color, religion, gender, age, national origin, marital status, sexual orientation, gender identity, status as a protected veteran, genetic information, status as a qualified individual with a disability, or any other characteristic protected by law.For more information regarding protection from discrimination under Federal law for applicants and employees, please refer to this link: Pay TransparencyApply for this job*indicates a required fieldFirst Name *Last Name *Email *Phone *Location (City) *Resume/CV *Enter manuallyAccepted file types: pdf, doc, docx, txt, rtfEnter manuallyAccepted file types: pdf, doc, docx, txt, rtfLinkedIn ProfileWebsiteHow did you hear about this job? * Select...Please specify details from your answer above (example: job board name, employee referrer's name, etc.) *Are you legally authorized to work in United States of America for Samsung Research America? * Select...Do you now, or will you in the future, require sponsorship for employment visa status (e.g., H-1B visa status) to work legally for Samsung Research America in United States of America? * Select...Additional Information for California Residents: * formation about what we are doing to meet the obligations of the California Consumer Privacy Act (CCPA) and California Consumer Privacy Rights Act (CPRA) other important information for California residents is available at SRA’s Job Applicant Privacy Policy . Please review the policy carefully, and if you agree to the collection, processing, use, and transfer of your personal information as described in the policy, please indicate your acceptance by selecting “Accept” from the following drop down menu.Voluntary Self-IdentificationFor government reporting purposes, we ask candidates to respond to the below self-identification pletion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file.As set forth in Samsung Research America’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows:A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.Select...Voluntary Self-Identification of DisabilityForm CC-305Page 1 of 1OMB Control Number 1250-0005Expires 04/30/2026Voluntary Self-Identification of DisabilityForm CC-305 Page 1 of 1 OMB Control Number 1250-0005 Expires 04/30/2026Why are you being asked to complete this form?We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five pleting this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at .How do you know if you have a disability?A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:Alcohol or other substance use disorder (not currently using drugs illegally)Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDSBlind or low visionCancer (past or present)Cardiovascular or heart diseaseCeliac diseaseCerebral palsyDeaf or serious difficulty hearingDiabetesDisfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disordersEpilepsy or other seizure disorderGastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndromeIntellectual or developmental disabilityMental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSDMissing limbs or partially missing limbsMobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supportsNervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilitiesPartial or complete paralysis (any cause)Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysemaShort stature (dwarfism)Traumatic brain injuryDisability Status Select...PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete. #J-18808-Ljbffr

Created: 2025-09-17