Senior Software Engineer - Model Training

Senior Software Engineer - Model TrainingJoin to apply for the Senior Software Engineer - Model Training role at AI FundSenior Software Engineer - Model Training1 day ago Be among the first 25 applicantsJoin to apply for the Senior Software Engineer - Model Training role at AI FundAbout BasetenBaseten provides the infrastructure, tooling, and expertise needed to bring great AI products to market - fast. Backed by top investors includingAbout BasetenBaseten provides the infrastructure, tooling, and expertise needed to bring great AI products to market - fast. Backed by top investors includingTHE ROLEAs a Senior Software Engineer – Model Training at Baseten, you’ll be at the forefront of building the infrastructure that powers large-scale training and fine-tuning of foundation models. You’ll design and implement distributed training systems, optimize GPU utilization, and create scalable pipelines that enable Baseten and our customers to adapt models efficiently and reliably. This role is highly technical and hands-on: you’ll own key components of our training stack, collaborate with product and infra teams to surface customer needs, and push forward the state of the art in scalable training infrastructure.ResponsibilitiesDesign, build, and maintain distributed training infrastructure for large-scale foundation modelsImplement scalable pipelines for fine-tuning and training across heterogeneous GPU/accelerator clustersOptimize training performance through techniques like FSDP, DDP, ZeRO, and mixed precision trainingContribute to frameworks and tooling that make training workflows efficient, reproducible, and developer-friendlyCollaborate with cross-functional teams (Product, Forward Deployed Engineering, Inference Infra) to ensure training systems meet real-world requirementsResearch and apply emerging techniques in training efficiency and model adaptation, and productionize them in the Baseten platformParticipate in code reviews, system design discussions, and technical deep dives to maintain a high engineering barRequirementsBachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience4+ years of experience in software engineering with a focus on ML infrastructure, distributed systems, or ML platform engineeringHands-on expertise in distributed training frameworks (FSDP, DDP, ZeRO, or similar) and ML frameworks (PyTorch, Transformers, Lightning, TRL)Strong understanding of GPU/accelerator performance optimization and scaling techniquesExperience designing and operating large-scale systems in production (cloud-native preferred)Excellent problem-solving and communication skills, with the ability to work across infrastructure and ML boundariesNICE TO HAVEExperience building APIs, SDKs, or developer tools for ML workflowsFamiliarity with cluster management and scheduling (Kubernetes, Ray, Slurm, etc.)Knowledge of parameter-efficient fine-tuning methods (LoRA, QLoRA) and evaluation pipelinesContributions to open-source distributed training or ML infra projectsExperience with cloud environments (AWS, GCP, Azure) and container orchestrationBenefitsCompetitive compensation package.This is a unique opportunity to be part of a rapidly growing startup in one of the most exciting engineering fields of our era.An inclusive and supportive work culture that fosters learning and growth.Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.Seniority levelSeniority levelMid-Senior levelEmployment typeEmployment typeFull-timeJob functionJob functionEngineering and Information TechnologyIndustriesVenture Capital and Private Equity PrincipalsReferrals increase your chances of interviewing at AI Fund by 2xGet notified about new Senior Software Engineer jobs in San Francisco, CA.San Mateo, CA $90,000.00-$150,000.00 1 year agoDirector of Engineering, Product EngineeringOakland, CA $241,000.00-$305,000.00 2 weeks agoSan Francisco, CA $200,000.00-$230,000.00 1 month agoSan Francisco, CA $159,000.00-$278,250.00 2 weeks agoSenior Software Engineer: Product GrowthSan Francisco, CA $138,900.00-$203,900.00 1 month agoSan Francisco, CA $156,000.00-$211,000.00 2 weeks agoSenior Software Engineer, Benefits - Employer ExperienceSenior Software Engineer, Workspaces - Weights & BiasesSan Francisco, CA $165,000.00-$220,000.00 3 days agoSenior Engineer - Warehouse Management SystemBrisbane, CA $140,000.00-$180,000.00 2 months agoSenior Robotics Software Engineer, Planning and ControlSan Francisco, CA $150,000.00-$260,000.00 2 months agoPrincipal Software Engineer - Video - Design Experience - (Role based in Australia, relocation provided)San Francisco, CA $135,000.00-$175,000.00 14 hours agoSenior/Staff Motor Control Software EngineerSenior UX Researcher, Developer User ExperienceSan Francisco, CA $151,000.00-$222,000.00 2 weeks agoIntermediate or Senior Civil Engineer – Land Development (Commercial) - Houston, TXSan Francisco, CA $75,000.00-$150,000.00 2 months agoSenior Technical Writer, Developer ExperienceSan Francisco, CA $140,000.00-$210,000.00 2 weeks agoSENIOR CIVIL ENGINEER - TEAM LEAD - LAND DEVELOPMENT - HOUSTON TXSan Francisco, CA $122,478.00-$208,212.00 2 days agoDelivery Consultant - Cloud Infrastructure, Cloud Platform and Migrations, AWS Professional ServicesSan Francisco, CA $118,200.00-$204,300.00 2 weeks agoDelivery Consultant - Cloud Infrastructure, Cloud Platform and Migrations, AWS Professional ServicesSan Francisco, CA $118,200.00-$204,300.00 2 weeks agoDelivery Consultant - Cloud Infrastructure, Cloud Platform and Migrations, AWS Professional ServicesSan Francisco, CA $118,200.00-$204,300.00 2 weeks agoSenior Product Manager - AI Developer Tools & SDKOakland, CA $211,200.00-$264,000.00 3 days agoDelivery Consultant - Connect, Amazon Connect Center of ExcellenceSan Francisco, CA $118,200.00-$204,300.00 2 days agoSan Francisco, CA $122,400.00-$195,500.00 3 days agoSan Francisco, CA $125,700.00-$334,600.00 2 weeks agoSan Francisco, CA $130,000.00-$200,000.00 10 months agoSan Francisco, CA $175,000.00-$230,000.00 6 months agoSenior Software Engineer, InfrastructureSan Francisco, CA $171,000.00-$258,000.00 2 weeks agoSan Francisco, CA $165,000.00-$220,000.00 4 months agoSan Francisco, CA $180,000.00-$270,000.00 2 weeks agoWe’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr

Created: 2025-09-17