Data Scientist, Core Experimentation
OpenAI
Use the employer link to read the full source listing and submit your application.
Listing data may include public employer ATS feeds and Jobs by Adzuna.
Before you apply
The decision-making details job seekers want first
We pulled the strongest signals from the listing so you can quickly judge fit, compensation, and what the company expects before opening the full source post.
Compensation
Salary & market context
314% above the BLS national median
BLS national median: $74,680
- $293K - $325K
Requirements
Top requirements
- The ideal candidate combines deep statistical expertise with strong systems intuition and hands-on experience building or operating experimentation platforms at scale.
- In this role, you will: - Drive the statistical direction and technical strategy for OpenAI’s experimentation platform - Design and improve experimentation methodologies used across product and research teams - Build pragmatic solutions to real-world experimentation challenges, balancing rigor with operational simplicity - Improve the reliability and trustworthiness of experiment results, including detection and prevention of bias, logging issues, and data quality failures - Developscalable analytical systems and pipelines in Python and distributed compute environments - Partner with engineers and product teams to improve experiment design, metric quality, and decision-making practices - Lead investigations into complex experimentation anomalies and measurement failures - Establish best practices for experimentation governance, interpretation, and statistical correctness - Mentor other data scientists and raising the overall technical bar for experimentation and causal inference You might thrive in this role if you have: - Experience building, scaling, or operating experimentation platforms at a large technology company - Deep expertise in statistics, causal inference, and online experimentation methodology - Strong understanding of practical experimentation challenges in production systems - Experience with areas such as variance reduction, CUPED, sequential testing, SRM detection, metric design, or heterogeneous effects - Strong coding and systems skills in Python and large-scale data processing frameworks (e.g.
- Spark) - Experience designing analytical data models and scalable experimentation pipelines - Ability to communicate complex statistical concepts clearly to technical and non-technical audiences - Track record of influencing technical strategy through hands-on technical leadership - Experience in large-scale product experimentation, ML experimentation, ranking systems, marketplace systems, or similar high-scale experimentation domains is highly valued Workplace & Location This role is based in Bellevue.
- AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
Perks & setup
Benefits candidates care about
- Compensation Range: $293K - $325K USD About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.
Why candidates care
Benefits & perks
- Compensation Range: $293K - $325K USD About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.
Start here
Requirements
- The ideal candidate combines deep statistical expertise with strong systems intuition and hands-on experience building or operating experimentation platforms at scale.
- In this role, you will: - Drive the statistical direction and technical strategy for OpenAI’s experimentation platform - Design and improve experimentation methodologies used across product and research teams - Build pragmatic solutions to real-world experimentation challenges, balancing rigor with operational simplicity - Improve the reliability and trustworthiness of experiment results, including detection and prevention of bias, logging issues, and data quality failures - Developscalable analytical systems and pipelines in Python and distributed compute environments - Partner with engineers and product teams to improve experiment design, metric quality, and decision-making practices - Lead investigations into complex experimentation anomalies and measurement failures - Establish best practices for experimentation governance, interpretation, and statistical correctness - Mentor other data scientists and raising the overall technical bar for experimentation and causal inference You might thrive in this role if you have: - Experience building, scaling, or operating experimentation platforms at a large technology company - Deep expertise in statistics, causal inference, and online experimentation methodology - Strong understanding of practical experimentation challenges in production systems - Experience with areas such as variance reduction, CUPED, sequential testing, SRM detection, metric design, or heterogeneous effects - Strong coding and systems skills in Python and large-scale data processing frameworks (e.g.
- Spark) - Experience designing analytical data models and scalable experimentation pipelines - Ability to communicate complex statistical concepts clearly to technical and non-technical audiences - Track record of influencing technical strategy through hands-on technical leadership - Experience in large-scale product experimentation, ML experimentation, ranking systems, marketplace systems, or similar high-scale experimentation domains is highly valued Workplace & Location This role is based in Bellevue.
- AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity.
Responsibilities
What you'll do
- About the Role We are hiring a Staff-level Data Scientist to help lead the evolution of OpenAI’s core experimentation platform.
- You’ll work on some of the hardest problems in online experimentation: sample ratio mismatch detection, variance reduction, bias mitigation, metric design, triggered analysis, heterogeneous treatment effects, sequential testing, and experimentation in complex ML systems.
- In this role, you will: - Drive the statistical direction and technical strategy for OpenAI’s experimentation platform - Design and improve experimentation methodologies used across product and research teams - Build pragmatic solutions to real-world experimentation challenges, balancing rigor with operational simplicity - Improve the reliability and trustworthiness of experiment results, including detection and prevention of bias, logging issues, and data quality failures - Developscalable analytical systems and pipelines in Python and distributed compute environments - Partner with engineers and product teams to improve experiment design, metric quality, and decision-making practices - Lead investigations into complex experimentation anomalies and measurement failures - Establish best practices for experimentation governance, interpretation, and statistical correctness - Mentor other data scientists and raising the overall technical bar for experimentation and causal inference You might thrive in this role if you have: - Experience building, scaling, or operating experimentation platforms at a large technology company - Deep expertise in statistics, causal inference, and online experimentation methodology - Strong understanding of practical experimentation challenges in production systems - Experience with areas such as variance reduction, CUPED, sequential testing, SRM detection, metric design, or heterogeneous effects - Strong coding and systems skills in Python and large-scale data processing frameworks (e.g.
- We use a hybrid work model and value in-person collaboration for technical design, iteration, and cross-functional partnership.
Role snapshot
About the role
About the Team
The Statsig team at OpenAI https://openai.com?utm_source=chatgpt.com builds and operates the experimentation platform that powers product development, measurement, and decision-making across the company. We partner closely with product, engineering, and infrastructure teams to ensure experiments are trustworthy, statistically rigorous, and scalable to the needs of frontier AI products.
Our mission is to help teams make better decisions through reliable experimentation. We care deeply about statistical correctness, pragmatic solutions, and building systems that researchers and engineers can trust at massive scale. The team operates at the intersection of experimentation methodology, data infrastructure, causal inference, and product analytics.
We are looking for experienced experimentation experts who want to shape the future of experimentation in the AI era.
Source text