ML Infrastructure Engineer

1 month ago Be among the first 25 applicantsMenlo Park, CA | On-Site | Full-Time/Direct HireLooking for ML Infra experts (Bay Area preferred) with deep experience in CUDA, GPU optimization, VLLMs, and LLM inference—pure language focus, no vision/audio.Client Opportunity | Through PhizenixPhizenix, a certified minority and women-led recruiting firm, is hiring on behalf of an AI startup pioneering diffusion-based large language models—built for faster generation, multimodal integration, and scalable enterprise deployment.Menlo Park, CA | On-Site | Full-Time/Direct HireLooking for ML Infra experts (Bay Area preferred) with deep experience in CUDA, GPU optimization, VLLMs, and LLM inference—pure language focus, no vision/audio.Client Opportunity | Through PhizenixPhizenix, a certified minority and women-led recruiting firm, is hiring on behalf of an AI startup pioneering diffusion-based large language models—built for faster generation, multimodal integration, and scalable enterprise deployment.We’re looking for a ML Infrastructure Engineer to help build the infrastructure that powers large-scale model training and real-time inference. You’ll collaborate with world-class researchers and engineers to design high-performance, distributed systems that bring advanced LLMs into production.ResponsibilitiesDesign and manage distributed infrastructure for ML training at scaleOptimize model serving systems for low-latency inferenceBuild automated pipelines for data processing, model training, and deploymentImplement observability tools to monitor performance in productionMaximize resource utilization across GPU clusters and cloud environmentsTranslate research requirements into robust, scalable system designsMust-HavesMasters or PhD in Computer Science, Engineering, or a related field (or equivalent experience)Strong foundation in software engineering, systems design, and distributed systemsExperience with cloud platforms (AWS, GCP, or Azure)Proficient in Python and at least one systems-level language (C++/Rust/Go)Hands-on experience with Docker, Kubernetes, and CI/CD workflowsFamiliarity with ML frameworks like PyTorch or TensorFlow from a systems perspectiveUnderstanding of GPU programming and high-performance infrastructureNice-to-HavesExperience with large-scale ML training clusters and GPU orchestrationKnowledge of LLM-serving tools (vLLM, TensorRT, ONNX Runtime)Experience with distributed training strategies (e.g., data/model/pipeline parallelism)Familiarity with orchestration tools like Kubeflow or AirflowBackground in performance tuning, system profiling, and MLOps best practicesAt Phizenix, we’re committed to supporting diverse and inclusive teams. This is your chance to shape the systems that power the next generation of AI innovation. Let’s build the future—together.California Pay Range: $180,000 USD - $200,000 USDSeniority levelSeniority levelNot ApplicableEmployment typeEmployment typeFull-timeJob functionIndustriesReal Estate, Financial Services, and Capital MarketsReferrals increase your chances of interviewing at PHIZENIX by 2xGet notified about new Infrastructure Engineer jobs in Menlo Park, CA.Fall 2025 Onboard Infrastructure EngineerSan Jose, CA $113,600.00-$170,400.00 2 weeks agoDublin, CA $128,000.00-$173,200.00 1 week agoPalo Alto, CA $144,000.00-$216,000.00 2 weeks agoSan Jose, CA $84,000.00-$134,000.00 1 week agoSan Jose, CA $130,000.00-$182,000.00 5 months agoFremont, CA $70,000.00-$100,000.00 2 weeks agoHayward, CA $100,000.00-$150,000.00 6 months agoSan Jose, CA $84,000.00-$134,000.00 1 month agoSunnyvale, CA $204,000.00-$247,000.00 1 month agoSan Jose, CA $82,000.00-$133,000.00 1 week agoSunnyvale, CA $168,000.00-$276,000.00 3 weeks agoPalo Alto, CA $149,500.00-$184,000.00 2 weeks agoSan Mateo, CA $157,000.00-$171,500.00 1 month agoSan Jose, CA $123,500.00-$212,850.00 1 week agoData Infrastructure Engineer, Google Fi and StoreMountain View, CA $166,000.00-$244,000.00 5 days agoPalo Alto, CA $146,000.00-$183,000.00 19 hours agoWe’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr

Created: 2025-09-17