Software Development Manager, ML Network Stack

Description Join our dynamic team as a hands-on Software Development Manager responsible for overseeing the network stack for EC2 distributed AI/ML systems. Your role will involve developing support for various frameworks and communication libraries such as NCCL, NVSHMEM, NIXL, NCCL GIN, and Perplexity kernels. We are looking for a seasoned engineering manager with extensive hands-on experience in systems programming and hardware/software co-design, alongside a solid background in networking, preferably High-Performance Computing (HPC) networking. Your familiarity with the NVIDIA stack, machine learning applications, and related frameworks will be greatly valued. You will lead a mid-sized team comprising senior, mid-level, and junior software development engineers (SDEs), guiding their efforts to ensure the successful delivery of critical functions and features for cutting-edge ML workloads. About Our Team You will become part of Annapurna Labs, a vital arm of AWS dedicated to creating hardware and software components that serve as essential building blocks for EC2 infrastructure. Every EC2 instance utilizes our custom-designed hardware, honing our expertise in developing software, systems, and chips aimed at optimizing the AWS customer experience. Diverse Experiences AWS values diverse experiences and backgrounds. We encourage candidates to apply even if they do not meet all qualifications or skills listed in the job description. If your career path has been unique or includes alternative experiences, we want to hear from you. Work/Life Balance We prioritize work-life harmony, believing that success should never come at the cost of personal time. Our work culture promotes flexibility, supporting you both at work and at home. Mentorship & Career Growth We are committed to being the Earth's Best Employer, continuously enhancing our performance bar. Here, you will find abundant resources for knowledge-sharing, mentorship, and professional development to help you grow into a more well-rounded professional. Basic Qualifications 3+ years of experience managing engineering teams. In-depth knowledge of engineering practices across software/hardware/network development lifecycle: coding standards, code reviews, source control management, build processes, testing, certification, and live site operations. Experience collaborating with product or program management teams. 3+ years of experience in C, C++, or Rust development. 5+ years of hands-on engineering experience with a commitment to maintaining active programming skills. Preferred Qualifications Proven experience in effective communication with users, technical teams, and senior leadership to gather requirements, articulate software product features, and define product strategy. Experience in recruiting, hiring, mentoring, and coaching Software Engineers to elevate their skills and enhance team productivity. Amazon is an equal opportunity employer and is committed to fostering a diverse work environment. We invite applicants from all backgrounds to apply. Location-specific job duties for this position include safe and cooperative work practices with employees, supervisors, and staff, maintaining excellence under stress, and effective and respectful communication to ensure exceptional customer service. While we consider applicants with arrest and conviction records, we uphold standards that ensure trustworthiness and professionalism, essential for safeguarding our operations and reputation. Our inclusive culture empowers Amazonians to achieve the best outcomes for our customers. If you need workplace accommodations during the application or hiring process, please reach out for support. The base salary range for this position is as follows: USA, CA, Cupertino: 212,700.00 - 287,700.00 USD annually USA, WA, Seattle: 184,900.00 - 250,200.00 USD annually

Created: 2026-03-10