AI Orchestration Engineer

Title: AI Orchestration EngineerLocation: Hybrid, Palo Alto, CA — Tuesday through ThursdayOverviewSage Care is a fast-growing, early-stage healthcare startup founded by exceptional leaders from Apple, Uber, Carbon Health and backed by top-tier venture capital (General Catalyst, Chelsea Clinton). With a strong customer pipeline, Sage Care is transforming healthcare by simplifying care navigation. Our platform makes it easier for patients to find the right doctor, helps providers focus on those who need them most, and ensures faster access to care—delivering better care and stronger economic outcomes at scale through harnessing the latest AI innovations.What You’ll DoWorkflow & Pipeline OrchestrationBuild and manage directed workflows (DAGs, state machines, LangGraph flows)Define how data and context move between AI models, APIs, and humans in the loopMulti-Agent CollaborationDesign coordination strategies for multiple AI agents with specialized rolesImplement arbitration logic to merge outputs, resolve conflicts, and dynamically route tasksIntegration & InfrastructureConnect AI systems with vector databases, APIs, cloud platforms, and external data sourcesHandle orchestration across distributed environments (Kubernetes, serverless)Reliability & Error HandlingImplement retries, fallbacks, and guardrails to keep workflows stableEnsure systems degrade gracefully when AI outputs are uncertain or incorrectOptimization & EvaluationTune orchestration for cost, latency, and accuracyBuild observability dashboards, logging, and metrics to measure workflow successExample Use Cases You Might Work OnRouting patient triage queries across different AI agents (diagnosis, risk scoring, recommendations)Coordinating a retrieval-augmented generation (RAG) pipeline: retriever → ranker → LLMRunning human-in-the-loop workflows where AI suggests and humans validateEnsuring continuity across multi-step processes, such as decision trees for medical protocolsWhat We’re Looking ForProgramming: Proficiency in Python, TypeScript, or Go (depending on orchestration stack)Frameworks: Experience with LangGraph, LangChain, or RayInfrastructure: Strong knowledge of Docker, Kubernetes, CI/CD pipelines, and observability tools (Prometheus, Grafana)AI/ML Understanding: Familiarity with LLMs, RAG systems, embeddings, and multi-agent patternsData Systems: Experience with vector databases (FAISS, Pinecone, Weaviate) and caching systems (Redis, Memcache)Nice to HaveHands-on experience with healthcare workflows or regulated environmentsExposure to human-in-the-loop AI systemsBackground in reliability engineering or distributed systemsWhy You’ll Love Working HereMission-driven work at the intersection of AI and healthcareCollaborative team that values curiosity, creativity, and ownershipFlexibility to experiment with the newest orchestration frameworks and AI infrastructure #J-18808-Ljbffr

Created: 2025-09-17