Lead Software Engineer - AI and Machine Learning ...

Job Description As a Lead Software Engineer specializing in AI and Machine Learning, you will play a pivotal role in transforming cutting-edge technologies into effective AI/ML infrastructure. Your focus will be on optimizing performance metrics such as low latency, high throughput, and resource efficiency for both model training and inference at scale. You will influence key strategic decisions that shape Oracle Cloud's AI infrastructure, and you will lead the design and implementation of scalable orchestration for AI/ML workloads. This includes integrating the latest advancements in generative AI and large language models, driving initiatives like Retrieval-Augmented Generation, and enhancing model fine-tuning. The ideal candidate will excel at designing and developing scalable, GPU-accelerated AI services utilizing powerful tools such as Kubernetes, Python, and Go. Strong programming expertise, a deep understanding of deep learning frameworks, containerization, distributed systems, and parallel computing are essential. You will possess a comprehensive grasp of end-to-end AI/ML workflows. Responsibilities Evaluate, integrate, and optimize state-of-the-art technologies to enhance latency, throughput, and resource utilization for training and inference workloads. Guide strategic decisions impacting Oracle Cloud's AI infrastructure offerings. Design and implement scalable orchestration for serving and training AI/ML models, focusing on model parallelism and performance across the AI/ML stack. Research and incorporate contemporary developments in generative AI and inference systems into our software stack. Lead projects on Generative AI system design, including Retrieval-Augmented Generation and LLM fine-tuning. Develop scalable services and tools that support GPU-accelerated AI pipelines, leveraging Kubernetes, Python, Go, and observability frameworks. Qualifications Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, Machine Learning, or a related field (or equivalent experience). Experience with Machine Learning and Deep Learning concepts, algorithms, and models. Proficiency with orchestration and containerization tools like Kubernetes and Docker. Deep understanding of container networking and storage architectures. Expertise in managing and optimizing large-scale distributed training and inference workloads. Comprehensive understanding of AI/ML workflows, including data processing, model training, and inference pipelines. Experience with parallel computing frameworks and paradigms. Strong programming skills and proficiency in major deep learning frameworks. About Us Oracle is dedicated to empowering innovation that transforms industries and improves lives through our AI and cloud solutions. We cultivate a diverse workforce that embraces inclusivity and offers competitive benefits, along with opportunities for personal growth. Join us in making a difference!

Created: 2026-03-10