Engineering Manager II, AI Model Foundations

OverviewEngineering Manager II, AI Model Foundations at Box. Join to apply for the Engineering Manager II, AI Model Foundations role at Box.Box (NYSE BOX) is the leader in Intelligent Content Management. Our platform enables organizations to fuel collaboration, manage the entire content lifecycle, secure critical content, and transform business workflows with enterprise AI. Box is headquartered in Redwood City, CA, with offices across the United States, Europe, and Asia.Why Box Needs YouArtificial Intelligence is transforming how organizations work with content. Box AI brings powerful large language models to the Box Content Cloud so customers can uncover insights, extract metadata, automate workflows, get answers to critical questions, and create content securely. The Model Foundations team sits at the core of this vision by defining how we rigorously evaluate LLMs and Box AI Agents for enterprise-grade quality, reliability, and trust. You will lead the team that builds methodology, datasets, and processes to measure model performance across real-world enterprise scenarios, partner with model providers, and collaborate with Box executives and platform teams to turn evaluation into product improvement.What You'll DoLead and mentor a team of ML engineers to design, build, and operationalize an evaluation framework for Box AI Agents and foundational LLMs.Define representative enterprise datasets and metrics; develop grading approaches that assess accuracy, safety, grounding, and usability.Pioneer and evangelize LLM evaluation methodology tailored to enterprise content management use cases.Collaborate with AI Platform teams to translate evaluation results into roadmap decisions and measurable agent improvements.Partner with model providers (e.g., OpenAI, Google, Anthropic) to share findings and influence model capabilities for enterprise needs.Track AI research and industry trends to continuously evolve our evaluation strategy and tooling.Work with senior leadership (CEO, CTO) to set priorities and a clear one-year roadmap for Model Foundations.Manage and coordinate the team’s on-call rotation to ensure timely and effective incident response, participate in escalated on-call incidents, and drive improvements to minimize disruptions.Who You AreWe are an AI-first company. This means you approach your work with a growth mindset and find ways to leverage AI to help make faster, smarter decisions that will 10X your impact at Box.7+ years in machine learning or applied AI, including 2+ years managing engineers with a track record of coaching, hiring, and performance development.Practical experience evaluating and deploying ML systems at scale; you’ve designed metrics, datasets, or pipelines that informed product decisions.Strong analytical problem solver who works confidently with large, complex datasets and ambiguous problem spaces.Proficient in at least one programming language (e.g., Python, C++, Java, or R) and familiar with modern ML frameworks (e.g., PyTorch, TensorFlow, scikit-learn, NumPy, pandas).Excellent communicator who collaborates effectively across product, research, and platform teams and with external partners.Bachelor’s degree in Computer Science or a related field (or equivalent practical experience).Preferred Experience with LLMs and RAG; depth in IR/NLP/query understanding; familiarity with Vertex AI, AWS Bedrock/SageMaker; exposure to Kubernetes-based systems.Preferred Proven roadmap planning where short-term wins ladder into a long-term vision.Additional InformationBox lives its values, with community and in-person collaboration being a core part of our culture. Boxers are expected to work from their assigned office a minimum of 3 days per week. The recruiter will share more during the hiring process. EEO statements and accommodations information are provided to applicants as part of our equal opportunity commitment.Equal OpportunityWe are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, or any other protected ground. Box provides reasonable accommodations to applicants with disabilities during the application process.For details on privacy and pay, see our Personnel Privacy Notice and Pay Transparency provisions where pensationUnited States Pay Range: $231,000 - $288,500 USD. This role is eligible for equity and benefits. Base salary is dependent on knowledge, skill, experience, and location. #J-18808-Ljbffr

Created: 2025-09-18