Senior Principal Software Engineer for AI and Machine ...

Job Description The Senior Principal Software Engineer focusing on AI/ML Innovation is pivotal in evaluating, integrating, and optimizing advanced technologies for AI/ML infrastructure. This role emphasizes achieving low latency, high throughput, and efficient resource utilization for model training and inference at scale. You will influence strategic decisions regarding AI infrastructure offerings and lead the design and implementation of scalable orchestration for AI/ML workloads. By incorporating the latest research in generative AI and large language models, you will spearhead initiatives such as Retrieval-Augmented Generation and model fine-tuning. Ideal candidates will develop scalable, GPU-accelerated AI services using Kubernetes and Python/Go, demonstrating strong programming skills and deep expertise in deep learning frameworks, containerization, distributed systems, and parallel computing, alongside a comprehensive understanding of end-to-end AI/ML workflows. Responsibilities Evaluate, integrate, and optimize advanced technologies to enhance latency, throughput, and resource utilization for training and inference workloads. Guide strategic decisions influencing the AI infrastructure offerings. Design and implement scalable orchestration for serving and training AI/ML models, with an emphasis on model parallelism and performance. Incorporate contemporary research on generative AI and inference systems into the software stack for large language models. Lead initiatives focused on the design of Generative AI systems, including Retrieval-Augmented Generation (RAG) and fine-tuning of large language models. Design and develop scalable services and tools for supporting GPU-accelerated AI pipelines, leveraging technologies such as Kubernetes, Python/Go, and observability frameworks. Qualifications: Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, Machine Learning, or a related field (or equivalent experience). Experience with Machine Learning and Deep Learning concepts, algorithms, and models. Proficiency with orchestration and containerization tools like Kubernetes, Docker, or similar technologies. Expertise in modern container networking and storage architecture. Experience orchestrating, running, and optimizing large-scale distributed training and inference workloads. In-depth understanding of AI/ML workflows, including data processing, model training, and inference pipelines. Experience with parallel computing frameworks and paradigms. Strong programming skills and proficiency in major deep learning frameworks. Disclaimer: Certain US customer or client-facing roles may be required to comply with applicable requirements, such as immunization and occupational health mandates. The listed range for this position in the US is from: $96,800 to $251,600 per annum, with eligibility for bonuses, equity, and compensation deferral. Oracle maintains a range of salaries for its roles to reflect various factors such as knowledge, skills, experience, market conditions, and internal equity. Oracle US offers a robust benefits package that includes medical, dental, and vision insurance, disability coverage, life insurance, flexible spending accounts, 401(k) plans with company match, paid time off, and additional voluntary benefits. About Us Oracle combines data, infrastructure, applications, and expertise to drive industry innovations and enhance lives. With AI integrated into our products and services, we empower customers to build a promising future. Join a company that is leading the transformation in AI and cloud solutions. We are committed to fostering a diverse workforce and promoting opportunities for all while supporting our employees with comprehensive benefits. We encourage community engagement through volunteer programs and are committed to accessibility for candidates with disabilities throughout the recruitment process. Oracle is an Equal Employment Opportunity Employer. Qualified applicants will receive fair consideration for employment without regard to various protected characteristics in accordance with the law.

Created: 2026-03-10