Principal Machine Learning Engineer
SAP - Palo Alto, CA
Apply NowJob Description
Overview We are seeking a highly skilled and driven Principal Machine Learning Engineer to design and deliver intelligent, distributed systems that power large-scale AI and large language model (LLM) capabilities. In this role, you will shape cutting-edge infrastructure, mentor world-class engineers, and bring bold ideas from concept to production"”driving meaningful impact across SAP's global ecosystem. Description As a key member of our fast-moving team, you will have the unique opportunity to define and execute the vision for AI and LLM-based systems at scale. We are looking for someone with exceptional programming expertise, deep distributed systems knowledge, and the curiosity and grit to tackle complex, ambiguous challenges. You will work across a diverse technology stack, collaborate closely with engineers and product leaders, and help set the technical direction for AI initiatives. Key Responsibilities Architect, design, and implement production systems in Go, Java and Python (full-stack experience a plus) Build and optimize backend services, databases, APIs, and LLM infrastructure Leverage technologies such as Kafka, Postgres, Hana, gRPC, and advanced LLM frameworks Mentor and guide engineers from junior to senior levels, fostering technical excellence Partner with cross-functional teams to translate business goals into scalable, high-impact solutions Minimum Qualifications Bachelor's degree in Computer Science, Mathematics, Physics, or related field, with strong programming expertise 10+ years of software engineering experience, with a track record of delivering complex systems Proven ability to work independently and lead initiatives from idea to deployment Hands-on experience with AI/ML and/or LLM systems in a production environment Expertise in distributed systems design and implementation Familiarity with CI/CD pipelines and modern development practices Strong English communication skills and ability to thrive in a global, multicultural team Preferred Qualifications Open-source contributions or significant personal technical projects Experience integrating AI capabilities into large-scale enterprise products Strong problem-solving skills and an iterative, results-oriented mindset Why Join Us Build cutting-edge AI and LLM systems used across SAP's global platform Work in a high-autonomy, trust-based environment without unnecessary bureaucracy Collaborate with top engineers in a fast-paced, impact-driven team Take ownership of projects that directly influence SAP's AI strategy and product capabilities We also emphasize a culture of inclusion, focus on health and well-being, and flexible working models to support every employee. SAP is committed to Equal Employment Opportunity and provides accessibility accommodations to applicants with disabilities. If you need accommodations to navigate our site or complete your application, please email Recruiting Operations Team: . Compensation Range Transparency: SAP provides an annualized compensation range inclusive of base salary and a variable incentive target for the career level applicable to the role. The targeted range for this position is USD 192,500 - 420,000. The actual offer will depend on education, skills, experience, scope, location, and performance. For benefits details, please refer to SAP North America Benefits. AI Usage in the Recruitment Process: For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process. Violations may result in disqualification from the hiring process. Requisition ID: 433535 | Work Area: Software-Design and Development | Expected Travel: 0 - 10% | Employment Type: Regular Full Time Note: This description reflects the responsibilities and requirements of the role as of the date shown and is subject to change without notice. #J-18808-Ljbffr
Created: 2025-10-01