Principal Product Manager - Foundry Inferencing & Training (CoreAI - multiple roles)

Microsoft

Redmond, WA

JOB DETAILS
SALARY
$142,800–$274,800 Per Year
SKILLS
Artificial Intelligence (AI), Automation, Background Investigation, Cloud Computing, Communication Skills, Continuous Improvement, Data Management, Data Science, Distributed Computing, Ecosystems, GPU (Graphics Processing Unit), Government Requirements, Improvement Metrics, Integrated Circuits (ICs), Leadership, Metrics, Microsoft Product Family, Presentation/Verbal Skills, Product Design, Product Management, Product Planning, Product Strategy, Project Management Software, Risk Management, Scientific Research, Software Engineering, Technical Leadership, Vehicle Fleets, Writing Skills
LOCATION
Redmond, WA
POSTED
3 days ago

Microsoft Foundry sits at the center of Microsoft’s AI strategy, powering how models are trained, evaluated, launched, and operated at global scale. Within CoreAI, the AI Models & Training organization is responsible for the platforms, infrastructure, and execution systems that turn cutting‑edge research into reliable, production‑ready AI capabilities.

We are looking for several Principal Product Managers to define our model ecosystem and offerings, to design product shape for inferencing and training. These roles operate at the intersection of model training, inference, experimentation, infrastructure, and developer platforms, and partner closely with engineering, research, data science, and leadership to deliver impact at scale. 

These are highly cross‑functional roles, best suited for product leaders who thrive in ambiguity, bring strong technical fluency, and can translate complex systems into clear strategy, priorities, and outcomes. 

Responsibilities

Product Strategy & Ownership 

  • Own product strategy and roadmap across AI model training, inference, experimentation, and platform enablement, balancing near‑term delivery with long‑term scale 
  • Maintain end‑to‑end accountability from concept through launch, iteration, and measurable impact 

Model Lifecycle & Platform Enablement 

  • Drive initiatives across the AI model lifecycle, partnering with engineering and research to bring new capabilities from research into production 
  • Enable internal teams and customers to access, integrate, and adopt models through high‑quality platform experiences 

Execution, Velocity & Operating Rigor 

  • Lead complex, multi‑quarter initiatives with high visibility, managing dependencies, risks, and tradeoffs across teams 
  • Improve execution velocity by reducing friction in planning, experimentation, launches, and iteration cycles 

Experimentation, Metrics & Continuous Improvement 

  • Define and track metrics for efficiency, performance, reliability, and adoption, using experimentation and data to drive decisions 
  • Identify opportunities for automation, simplification, and continuous improvement as systems scale 

Cross‑Functional Leadership & Communication 

  • Act as a connective leader across engineering, data science, research, infrastructure, and go‑to‑market teams 
  • Influence senior stakeholders through clear decision framing, executive‑ready narratives, and data‑backed recommendations 

Qualifications

Required Qualifications 

  • Bachelor’s Degree and 8+ years of experience in product management, technical program management, software engineering, or related technical fields (or equivalent experience) 

Other Requirements 

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: 
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. 

Preferred Qualifications 

  • Proven ability to lead product strategy and execution in highly technical, ambiguous, cross‑functional environments 
  • Strong technical fluency and ability to partner deeply with engineering, infrastructure, or research teams 
  • Excellent written and verbal communication skills, including executive‑level influence 
  • 10+ years of experience delivering large‑scale platforms, cloud services, or AI‑powered products 
  • Experience with AI/ML platforms, model training systems, inference infrastructure, or experimentation frameworks 
  • Familiarity with cloud infrastructure and distributed systems (e.g., GPUs, compute fleets, data pipelines) 
  • Track record of launching and scaling complex products with measurable business or platform impact 
  • Ability to operate as a force multiplier in fast‑paced, high‑stakes environments 

Product Management IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

About the Company

M

Microsoft

DO WHAT YOU LOVE
Make your mark on the world’s most used technologies. Develop the next hit mobile application. Pioneer a startup that could be the next big thing. At Microsoft, you choose your path.

Headquartered in Redmond, Washington, Microsoft is a top innovator in both the consumer and enterprise technology industry. Just a few of the many things our products do are unleash creativity, connect businesses, and make learning more fun. But our continued success is based on one thing: our employees. We hire amazing, talented people and give them the opportunities—and the tools—to succeed.

WHY MICROSOFT?
As a Microsoft employee, you’re surrounded by a diverse group of the smartest people in your field. This fosters new ideas, better business results, and creates a dynamic work environment. In the office, you’re constantly challenged and supported by your colleagues. Every day holds something new and exciting.

We also offer unparalleled depth and breadth of career opportunities. As an industry leader in multiple fields, working for Microsoft means being able to do whatever you feel passionate about—and being able to make an impact in that field. From day one, we give our employees significant responsibility. This means that you’ll know that you directly contributed to something that has a positive impact on people worldwide. Whether you choose to work in management, dive deep into the newest technology, or explore multiple professions, you’ll find everything you need at Microsoft to drive your career—and to make a difference.

WE GET IT – YOU’RE MORE THAN YOUR JOB
Everyone works differently and is motivated by different things. We also understand that there’s more to you than your job. That’s why we offer competitive pay and a wide assortment of benefits-- to help you make the most of life at work and away from it.

GET THE BALL ROLLING
COMPANY SIZE
10,000 employees or more
INDUSTRY
Computer Software
FOUNDED
1975
WEBSITE
http://www.microsoft.com