$139,900–$274,800 Per Year
A/B Testing, Artificial Intelligence (AI), Background Investigation, Best Practices, Cloud Computing, Coaching, Computer Engineering, Computer Science, Cross-Functional, Data Science, Econometrics, Ecosystems, Electrical Engineering, Electronic Publishing, Government Requirements, Integrated Circuits (ICs), MCP - Microsoft Certified Professional, Mentoring, Metrics, Microsoft Product Family, Microsoft Windows Azure, Open Source, Patents, Power Generation, Predictive Modeling, Product Development, Product Engineering, Product Lifecycle, Product Strategy, Publications, Reliability Engineering, Reporting Dashboards, Requirements Management, Statistics, Team Building, Team Lead/Manager, Technical Leadership, Thought Leadership, User Interface Design, User Interface/Experience (UI/UX)
Overview: CoreAI sits at the center of Microsoft’s mission to redefine how software is built and experienced, providing the foundational platforms, services, and developer experiences that power the next generation of AI-driven applications. As part of CoreAI, the Experimentation Platform (ExP) enables trustworthy, high-scale online experimentation that accelerates product learning and drives progress across Microsoft’s AI ecosystem. You will play a pivotal role in shaping the technical direction of systems that help teams ship better AI experiences faster by providing the experimentation capabilities needed to evaluate, refine, and safely deploy new innovations.
In this role, you will:
- Push the envelope on online experimentation methodology and agent evaluations, advancing the state-of-the-art by connecting product development needs, latest science techniques and platform opportunities
- Contribute to one of the highest-scale experimentation platforms on the planet
- Collaborate closely with backend engineers, data scientists, site reliability engineers (SREs), and product managers to gather requirements, iterate on features, and deliver seamless, end-to-end user experiences.
- Collaborate closely with designers, UI-experts, science leaders and engineers to ensure clear, actionable dashboards and visualizations that empower users to make trustworthy science-informed decisions.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
- Collaborate with and bridge the gaps between researchers (e.g., across CoreAI, Microsoft Research [MSR] and open source communities) to translate applied research into differentiated, production-quality features
- Provide technical guidance and deep industry insight, advising cross-functional teams on the adoption of cutting-edge AI tools, technologies, and methodologies to ensure successful experimentation programs and uphold the highest standards of quality and scientific rigor.
- Ensure teams develop and apply advanced subject matter expertise across a diverse set of specialized tools and methods, driving measurable business outcomes and elevating the scope and impact of Microsoft’s experimentation initiatives.
- Interface with experimentation partners across Microsoft to translate requirements into platform capabilities and lower barriers requiring advanced subject matter expertise.
- Provide mentorship and coaching to less experienced and mid-level team members by sharing expertise to build team capabilities and guiding team members in projects, and their careers
Qualifications
Required Minimum Qualifications:
Bachelors Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research) OR Masters Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) OR equivalent experience.
Other Requirements
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred Qualifications:
- Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research)
- Experience with Agent based architectures, frameworks and technologies (such as MCP, A2A protocol, or Azure AI Foundry)
- 3+ years of experience developing and deploying products or systems at multiple points in the product cycle from ideation to shipping as part of a product team.
- Proven track record designing and scaling online experimentation platforms that support high‑velocity A/B and multivariate testing across complex, multi‑team product ecosystems, including governance, guardrails, and causal inference best practices.
- Demonstrated thought leadership in product measurement strategy, with the ability to define north‑star metrics, architect measurement frameworks, and influence senior product and engineering leaders on how to interpret ambiguous or noisy data at scale.
- 5+ years experience creating publications (e.g., patents, libraries, peer-reviewed academic papers).
Applied Sciences IC5 - The typical base pay range for this role across the U.S. is USD $139,900 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.
M
Microsoft
DO WHAT YOU LOVE
Make your mark on the world’s most used technologies. Develop the next hit mobile application. Pioneer a startup that could be the next big thing. At Microsoft, you choose your path.
Headquartered in Redmond, Washington, Microsoft is a top innovator in both the consumer and enterprise technology industry. Just a few of the many things our products do are unleash creativity, connect businesses, and make learning more fun. But our continued success is based on one thing: our employees. We hire amazing, talented people and give them the opportunities—and the tools—to succeed.
WHY MICROSOFT?
As a Microsoft employee, you’re surrounded by a diverse group of the smartest people in your field. This fosters new ideas, better business results, and creates a dynamic work environment. In the office, you’re constantly challenged and supported by your colleagues. Every day holds something new and exciting.
We also offer unparalleled depth and breadth of career opportunities. As an industry leader in multiple fields, working for Microsoft means being able to do whatever you feel passionate about—and being able to make an impact in that field. From day one, we give our employees significant responsibility. This means that you’ll know that you directly contributed to something that has a positive impact on people worldwide. Whether you choose to work in management, dive deep into the newest technology, or explore multiple professions, you’ll find everything you need at Microsoft to drive your career—and to make a difference.
WE GET IT – YOU’RE MORE THAN YOUR JOB
Everyone works differently and is motivated by different things. We also understand that there’s more to you than your job. That’s why we offer competitive pay and a wide assortment of benefits-- to help you make the most of life at work and away from it.
GET THE BALL ROLLING