Data Scientist III

Data Scientist III, Experimentation Science 
 

Chewy is looking for a Data Scientist III to join the Experimentation Platform (A/B testing) to join our team in Bellevue, WA or Boston, MA. Our platform supports hundreds of active internal users across multiple teams and organizations, enabling rigorous A/B testing to drive new customer experiences. In this role, you will play a key role in crafting and advancing measurement best practices and advanced methodologies across the business. This is a high-impact, high-visibility position that plays a meaningful role in how Chewy measures and implements customer-facing changes. You'll work cross-functionally with teams across the business, gaining exposure to diverse domains and influencing decision-making at the highest levels. Join a collaborative, fast-paced team where you'll tackle new challenges daily, contribute to meaningful outcomes, and grow alongside a platform that’s central to Chewy’s core business strategy. 
 

What You'll Do: 

• Apply statistical methodologies to design and analyze online experiments (e.g., A/B/n, MAB, holdouts). 

• Develop relevant surrogate metrics for faster and more accurate experimentation considering full customer journey and tradeoffs.  

• Build out and operationalize causal inference models to calculate annualized incremental lift. Build models to measure long-term impact using high value actions. 

• Develop robust holdout design to measure aggregate impact, long term impact, and novelty effect 

• Support experimentation platform users with guidance on test setup, metric selection, and hypothesis framing. 

• Ensure quality of data and computation by developing monitoring and alerting mechanisms to catch spillovers and bias and provide guidance on step-wise identification of root-causes. 

• Define and operationalize experimentation best practices, statistical and scientific methodologies and scalable frameworks for creating, monitoring, and learning from experiments. 

• Build AI agents to optimize experiment workflows and knowledge retrieval.  
   

Qualifications: 

• Bachelor’s degree in a quantitative field (e.g., Statistics, Mathematics, Data Science, Economics, Computer Science) or related experience.  

• 5+ years Data Science experience. 

• 4+ years of experience with A/B testing, preferably within an e-commerce environment. 

• 4+ years of experience with causal inference techniques or modeling long-term treatment effects (Diff-in-diff, Propensity Score Matching, Causal Forest, etc...). 

• Strong foundational knowledge in statistics (e.g., hypothesis testing, confidence intervals, variance reduction). 

• Advanced object-oriented programming in Python.  

• Advanced knowledge of SQL.  

• Experience communicating insights to non-technical audiences. 

• Familiarity with using LLMs and AI Agents to automate data and analytical workflows.