JOB SUMMARY:
The Manager, Experimentation and Advanced Analytics conducts advanced analysis of digital customer behavior and business performance to identify and evaluate opportunities that improve revenue, conversion, engagement, and the guest experience across Universal Destinations & Experiences. This role supports optimization and experimentation initiatives across Universal Orlando Resort (UOR), Universal Studios Hollywood (USH), Universal Studios Japan (USJ), and new ventures, requiring an understanding of distinct business objectives, guest behaviors, market dynamics, operating models, and analytical nuances. Thid role serves as a technical and analytical subject matter expert for experimentation and optimization, applying advanced statistical methods and leveraging SQL, Adobe Analytics, Customer Journey Analytics (CJA), Adobe Experience Platform (AEP), Real-Time CDP (RTCDP), Snowflake, Databricks, Tableau, and Power BI to translate complex test results into actionable recommendations for global and destination-level stakeholders.
MAJOR RESPONSIBILITIES:
- Global Experimentation, Testing & Advanced Analytics
- Lead the analytical measurement and evaluation of optimization initiatives across UOR, USH, USJ, and new ventures, including pricing tests, email tests, digital experience tests, marketing tests, and other controlled experiments.
- Quantify the potential financial impact of optimization opportunities across destinations, develop analytical approaches to estimate expected value, and prioritize the experimentation backlog based on revenue potential, business impact, feasibility, and strategic priorities.
- Apply statistical and experimental design methodologies to evaluate performance, incremental impact, statistical significance, and business value, accounting for differences in customer behavior, market conditions, seasonality, product structures, and business objectives.
- Develop measurement approaches that provide consistency across destinations while allowing for local business requirements and market-specific nuances; provide recommendations regarding implementation, continued testing, or additional optimization.
- Data Extraction, Preparation & Technical Analysis
- Use advanced SQL and enterprise data platforms, including Snowflake and Databricks, to extract, integrate, manipulate, validate, and analyze large and complex datasets across multiple destinations and business areas.
- Integrate digital behavioral data from Adobe Analytics with transactional, customer, pricing, marketing, and other enterprise data sources to develop comprehensive analyses of customer behavior and business performance.
- Navigate variations in data structures, taxonomies, business rules, tracking implementations, and reporting practices across destinations while maintaining analytical consistency and rigor.
- Develop reusable datasets, queries, methodologies, and processes that improve the scalability and efficiency of global optimization analysis and troubleshoot data or performance anomalies.
- Digital Analytics, Measurement & Visualization
- Apply advanced Adobe Analytics and Customer Journey Analytics (CJA) capabilities to analyze cross-channel customer behavior, journeys, segmentation, conversion, engagement, and marketing performance across multiple destinations.
- Use AEP and RTCDP to develop and size actionable audience segments, assess addressable opportunity, and inform targeting experimentation, and optimization priorities across UOR, USH, USJ, and new ventures.
- Develop and maintain Tableau and Power BI dashboards, analytical tools, and data visualizations that provide visibility into test performance, optimization opportunities, customer behavior, and key business outcomes for global and destination-level stakeholders.
- Establish and monitor key performance metrics and build measurement approaches that enable comparison and knowledge-sharing across destinations while appropriately accounting for local market and business differences.
- Transform complex analytical outputs into clear visualizations and compelling data stories for technical and non-technical audiences.
- Global Business Partnership & Analytical Leadership
- Serve as a subject matter expert in experimentation, optimization analytics, digital measurement, and test interpretation across UDX.
- Partner with global and destination-level Marketing, Digital, Pricing/Revenue, Product, Technology, and other stakeholders to identify opportunities and establish analytical approaches.
- Develop an understanding of the unique strategic priorities, guest segments, commercial models, market dynamics, and operating environments of UOR, USH, USJ, and new ventures, adapting recommendations accordingly.
- Present findings and recommendations to stakeholders and leadership and facilitate the sharing of testing methodologies, learnings, and optimization best practices across destinations.
- Understand and actively participate in Environmental, Health & Safety responsibilities by following established UDX policy, procedures, training, and team member involvement activities.
- Perform other duties as assigned.
QUALIFICATIONS:
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skills, and/or abilities (KSAs) required.
- Advanced proficiency in SQL, including the ability to query, join, transform, and analyze large and complex datasets.
- Advanced proficiency with Adobe Analytics and Customer Journey Analytics (CJA), including segmentation, calculated metrics, customer journey analysis, conversion analysis, and digital performance measurement.
- Experience leveraging Adobe Experience Platform (AEP) and Real-Time CDP (RTCDP) to develop, size, and analyze customer audiences and support targeting, experimentation, and optimization use cases.
- Strong experience using Snowflake and Databricks to access, prepare, manipulate, and analyze enterprise-scale datasets.
- Advanced proficiency with Tableau and/or Power BI, with demonstrated ability to develop scalable reporting solutions and communicate complex analytical findings to technical and non-technical audiences.
- Strong knowledge of experimental design, A/B and multivariate testing, statistical significance, confidence intervals, test/control methodologies, and performance measurement.
- Demonstrated experience analyzing complex tests or experiments and translating results into actionable business recommendations.
- Ability to apply common analytical methodologies across multiple businesses while recognizing and adapting to differences in market conditions, customer behavior, operating models, data structures, and strategic priorities.
- Strong critical thinking and problem-solving skills with the ability to work through complex and ambiguous analytical problems independently.
- Demonstrated ability to build effective relationships and work across geographically dispersed, cross-functional teams.
- Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.
- Consistent attendance is a job requirement.
EDUCATION:
- Bachelor's degree in Statistics, Data Science, Analytics, Economics, Econometrics, Mathematics, Computer Science, Business Analytics, or a related quantitative field required. Master's degree in a quantitative discipline preferred.
EXPERIENCE:
- 5+ years of hands-on experience in advanced analytics, experimentation, optimization, data science, digital analytics, or a related quantitative discipline; or an equivalent combination of education and experience.
- Experience conducting complex experimentation and test analysis, including pricing, marketing, email, digital experience, or similar testing, strongly preferred.
- Experience supporting multiple business units, markets, destinations, or geographies and adapting analytical approaches to differing business needs is preferred.
Your talent, skills and experience will be rewarded with a competitive compensation package.
Universal Orlando Resort. Here you can.