Remote Senior ML Operations Engineer

Job Description Insight Global is seeking a qualified Senior ML Operations Engineer in support of one of our healthcare clients in Virginia Beach VA. This candidate will be help to advance current and future work applying machine learning, deep learning, and NLP to deliver better healthcare. The dayu2011tou2011day will include: Identify gaps in the ML platform and architect/build solutions that expand capability, reliability, and usability. Partner with ML scientists, data engineers, and software teams to take models from prototype to production. Design, deploy, and maintain production-grade ML & GenAI services, including monitoring and ongoing model health. Build and optimize RAG/LLM pipelines (embeddings, vector search, orchestration) and evaluation approaches (prompting vs. fine-tuning). Implement MLOps best practices (automation, CI/CD, containerization, observability, performance/cost optimization, guardrails). Streamline end-to-end data and model workflows (ingestion, preprocessing, feature engineering, training, deployment) to reduce latency and improve scalability Compensation: $100,000 to $150,000. Exact compensation may vary based on several factors, including skills, experience, and education. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: Skills and Requirements 5+ years building production software/ML systems, including 1+ years of experience with LLMs/GenAI. Proficient in Python and one major DL/LLM stack (e.g., PyTorch/Transformers); experience with LangChain/LlamaIndex, vector DBs, and cloud (AWS/Azure/GCP). Demonstrated delivery of RAG, prompt engineering, evaluation frameworks, and guardrails in production. Strength in APIs, distributed systems, and ML Ops (K8s, CI/CD, monitoring). Experience with ML platforms and ML Ops: Demonstrated experience in assessing and improving ML platforms, identifying gaps, and architecting solutions to address them. Strong familiarity with ML platform components such as data ingestion, preprocessing, feature stores, model training, deployment, and monitoring. Experience with SQL and big data platforms such as Postgres, Redshift and Snowflake Experience with Agile/Scrum methodology and best practices MUST be located in one of the following approved states: Alabama, Delaware, Florida, Georgia, Indiana, Kansas, Louisiana, Maine, Maryland, Minnesota, Nebraska, New Hampshire, North Carolina, North Dakota, Ohio, Oklahoma, Pennsylvania, South Carolina, South Dakota, Tennessee, Texas, Utah, Virginia, Washington (State), West Virginia, Wisconsin, Wyoming Previous work experience with Generative AI and ML Ops in healthcare EPIC environment Understanding of use and implementation of Vector Databases Kubernetes container orchestration experience

Created: 2026-04-04