Sr Engineering Program Manager, Apple Intelligence Evaluations

Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other's ideas stronger. That happens because every one of us shares a belief that we can make something wonderful and share it with the world, changing lives for the better. It's the diversity of our people and their thinking that inspires the innovation that runs through everything we do. When we bring everybody in, we can do the best work of our lives. Here, you'll do more than join something - you'll add something. We're looking for a Sr Engineering Program Manager with a proven track record of leading highly cross-functional Software and ML initiatives. In this role, you'll own the evaluation plans for Apple's foundation models or the AI features built on them, partnering with world-class teams across Research, Engineering, Privacy, and Data Science. You'll thrive in a fast-moving environment, and your work will ensure that products reaching over 1 billion customers meet the quality bar Apple users expect and love. If you're excited by a new technology space and by delivering phenomenal products with a great team, we want to hear from you. Own the evaluation plan for foundation models or AI features, including scope, metrics, timelines and launch-readiness criteria Partner with product, research, data science and engineering teams to define evaluation requirements, methodologies, and tooling Drive multiple complex workstreams at once with clear dependencies and critical path. Manage risks, resolve conflicts and keep stakeholders aligned Manage annotation and data collection operations to deliver high-quality evaluation data on schedule Partner with engineering, privacy, and legal teams to ensure our data strategy is not only world-class, but also aligns with Apples core values Synthesize technical complexity into clear, actionable communications for executive leadershipBachelors or Masters degree in EE, CS, CE, or equivalent 5+ years of experience managing large-scale, ML-powered and software programs across large organizations Proven program management, analytical, and cross-functional leadership skills, with experience driving data-driven decision-making and process improvements Excellent written and verbal communication skills, including presentation, negotiation, and the ability to communicate abstract ideas clearly Strong problem-solving skills with attention to details Direct program management experience with Generative AI or Large Language Models (LLMs) is highly desired Familiarity with LLM evaluation practices Experience analyzing product data to assess quality and identify opportunities. Experience shipping AI features in a consumer product Comfortable in a fast-paced, ambiguous environment, with curiosity and the ability to quickly learn new technical concepts Solid understanding of how ML systems are built, evaluated and released