Principal Software Engineer for AI & ML Advancement

Job Description Are you excited about pushing the boundaries of Artificial Intelligence and Machine Learning? We invite you to become a Principal Software Engineer, where you will take a leading role in revolutionizing Oracle Cloud's AI infrastructure. This position focuses on evaluating, integrating, and optimizing advanced technologies to achieve low latency and high throughput for large-scale model training and inference tasks. Your expertise will guide our strategic direction in offering cutting-edge AI capabilities while you design innovative systems tailored to meet AI/ML demands, including the latest developments in generative AI and large language models. In this role, you will: Assess and incorporate advanced technologies to enhance latency and throughput during training and inference operations. Influence strategic decisions regarding Oracle Cloud's AI infrastructure offerings. Create scalable orchestration designs for serving and training AI/ML models, prioritizing model parallelism and performance optimization. Integrate contemporary research and techniques in generative AI and inference systems into our software framework. Lead initiatives focused on Generative AI system architecture, including Retrieval-Augmented Generation and fine-tuning of models. Develop robust services for GPU-accelerated AI pipelines using tools like Kubernetes, Python, and Go. Qualifications: Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, Machine Learning, or a related field. Experience with machine learning and deep learning concepts, algorithms, and models. Proficient in orchestration and containerization technologies such as Kubernetes and Docker. Strong understanding of AI/ML workflows, including data processing, training, and inference pipelines. Extensive expertise in managing large-scale distributed training and inference workloads, along with modern container networking. Exceptional programming skills and familiarity with prominent deep learning frameworks. This role is essential for spearheading transformative AI solutions at Oracle. Join us in a collaborative environment where your skills will help pave the way for future technological innovations.

Created: 2026-03-10