AI Tester with Automation Testing

_About the role_ As an AI Tester with Automation expertise, you will make an impact by validating the quality, performance, and reliability of next generation AI and LLM powered applications. You will be a valued member of the Quality Engineering and Assurance team and work collaboratively with AI engineers, automation architects, and cross functional stakeholders to ensure robust, scalable, and compliant AI solutions. ________________________________________ _In this role, you will:_ u2022 Design and execute automated test scripts using Python and Playwright for AI, LLM, and ML workloads. u2022 Validate LLM based applications, including prompt flows, RAG pipelines, vector search, and retrieval logic. u2022 Test multi agent orchestration workflows, including MCP/A2A protocolu2013based interactions. u2022 Conduct functional, integration, API, and data validation testing across complex ML pipelines. u2022 Collaborate with engineering teams to troubleshoot defects, optimize model behavior, and ensure compliance and accuracy of AI outputs. ________________________________________ _Work model_ At Cognizant, we strive to provide flexibility wherever possible, and we are here to support a healthy work life balance through our various wellbeing programs. Based on this roleu2019s business requirements, this is an onsite position requiring presence in Weehawken, New Jersey. The working arrangements for this role are accurate as of the date of posting and may change based on project engagement, business needs, or client requirements. ________________________________________ What you need to have to be considered 5 to 7 yrs. of QA experience with u2022 Strong programming proficiency in Python and hands on automation experience with Playwright. u2022 Working knowledge of AI/ML algorithms, including NLP, classification, clustering, and LLM evaluation. u2022 Experience with LLM development frameworks such as LangChain, LangGraph, vector databases, RAG architectures, and prompt engineering. u2022 Familiarity with multi agent AI architectures, including multi agent orchestration using MCP and A2A protocols. u2022 Strong analytical skills with a solid understanding of data modeling and data transformation using SQL. u2022 Experience testing or consuming APIs, RESTful services, and data connectors. u2022 Awareness of source code control systems such as GitLab, along with CI/CD build and deployment pipelines. ________________________________________ These will help you stand out u2022 Hands on experience with Generative AI, GPT models, or enterprise LLM deployments. u2022 Exposure to cloud platformsu2014especially Microsoft Azureu2014for AI, ML, or infrastructure workloads. u2022 Good understanding of Neo4j, knowledge graphs, or graph based reasoning for LLM workflows. u2022 Experience testing end to end AI pipelines, including data ingestion, evaluation, and observability. u2022 Ability to work in fast paced, innovative environments delivering scalable AI solutions u2022 Cognizant will only consider applicants for this position who are legally authorized to work in the United States without company sponsorship. Please note, this role is not able to offer visa transfer or sponsorship now or in the future We're excited to meet people who share our mission and can make an impact in a variety of ways. Don't hesitate to apply, even if you only meet the minimum requirements listed. Think about your transferable experiences and unique skills that make you stand out as someone who can bring new and exciting things to this role. _Salary and Other Compensation:_ Applications will be accepted until 4/17/2026. The annual salary for this position is between [$53,477/- to $92,500/-] depending on experience and other qualifications of the successful candidate. This position is also eligible for Cognizantu2019s discretionary annual incentive program, based on performance and subject to the terms of Cognizantu2019s applicable plans. _Benefits:_ Cognizant offers the following benefits for this position, subject to applicable eligibility requirements: u2022 Medical/Dental/Vision/Life Insurance u2022 Paid holidays plus Paid Time Off u2022 401(k) plan and contributions u2022 Long-term/Short-term Disability u2022 Paid Parental Leave u2022 Employee Stock Purchase PlanCognizant is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.

Created: 2026-04-27