Arena

4 weeks ago

Data Scientist

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 22 hours agoStatus: Live

Job Summary

Data Scientist focused on experimentation, causal inference, and retention analytics to optimize user engagement and product growth. Design and analyze A/B tests, apply causal methods, build retention frameworks, and develop scalable data pipelines using PySpark and SQL to deliver actionable insights and dashboards for cross-functional teams.

Location: San Francisco

Workplace: Hybrid

Employment Type: Full time

Job Function: Data Science & Machine Learning

Key Responsibilities

•Design, implement, and analyze A/B tests, multi-armed bandits, and quasi-experimental methods to measure the impact of product changes
•Apply causal inference techniques (difference-in-differences, propensity score matching, synthetic control, regression discontinuity) to estimate treatment effects in non-randomized settings
•Collaborate with product, engineering, and marketing teams to define hypotheses, success metrics, and statistical power requirements
•Develop retention measurement frameworks (cohort analysis, survival analysis, churn prediction) and track core engagement metrics (DAU/WAU/MAU, rolling retention, N-day retention)
•Build and maintain scalable data pipelines (using PySpark, SQL, big data tools) and develop automated dashboards (Tableau, Looker, Metabase) to monitor experiment performance and retention trends

Pay and Benefits

Salary: USD 150,000 - 350,000 annually

Equity and Bonus:Equity

Perks:Health InsuranceWellness StipendEquity

Key Requirements

•3+ years of experience in data science, analytics, or experimentation
•Strong background in statistics and causal inference (hypothesis testing, Bayesian methods, experimental design)
•Hands-on experience with SQL and Python (Pandas, NumPy, SciPy, StatsModels, Scikit-learn)
•Proficiency in experimentation tools (e.g., Optimizely, Statsig, Eppo, or custom in-house systems)
•Experience defining and analyzing retention metrics (DAU/WAU/MAU, cohort retention, churn)

Experience:AiMachine learningAnalyticsData science

Skills:PythonSQLPandasNumPySciPyStatsModelsScikit-learnPySparkTableauLookerMetabaseDatabricksAWS EMRBigQueryA/B testingCausal inference

Tech Stack:PythonSQLPandasNumPySciPyStatsModelsScikit-learnPySparkTableauLookerMetabaseDatabricksAWS EMRBigQuery

Company Brief

Arena

LMArena operates a community-driven platform for evaluating and benchmarking large language models via crowdsourced pairwise comparisons and leaderboards, used by researchers and AI labs to measure real-world model performance. ([linkedin.com](https://www.linkedin.com/company/lmarena?utm_source=openai))

Industry: Developer Tools

Company Size: Small (11 to 50 employees)

Growth: Scaleup

Valuation: Unicorn (USD 1B+)

Funding: Series A

Headquarters: San Francisco, United States

Founded: 2025

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Arena

4 weeks ago

Data Scientist

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 22 hours agoStatus: Live

Job Summary

Location: San Francisco

Workplace: Hybrid

Employment Type: Full time

Job Function: Data Science & Machine Learning

Key Responsibilities

•Design, implement, and analyze A/B tests, multi-armed bandits, and quasi-experimental methods to measure the impact of product changes
•Apply causal inference techniques (difference-in-differences, propensity score matching, synthetic control, regression discontinuity) to estimate treatment effects in non-randomized settings
•Collaborate with product, engineering, and marketing teams to define hypotheses, success metrics, and statistical power requirements
•Develop retention measurement frameworks (cohort analysis, survival analysis, churn prediction) and track core engagement metrics (DAU/WAU/MAU, rolling retention, N-day retention)
•Build and maintain scalable data pipelines (using PySpark, SQL, big data tools) and develop automated dashboards (Tableau, Looker, Metabase) to monitor experiment performance and retention trends

Pay and Benefits

Salary: USD 150,000 - 350,000 annually

Equity and Bonus:Equity

Perks:Health InsuranceWellness StipendEquity

Key Requirements

•3+ years of experience in data science, analytics, or experimentation
•Strong background in statistics and causal inference (hypothesis testing, Bayesian methods, experimental design)
•Hands-on experience with SQL and Python (Pandas, NumPy, SciPy, StatsModels, Scikit-learn)
•Proficiency in experimentation tools (e.g., Optimizely, Statsig, Eppo, or custom in-house systems)
•Experience defining and analyzing retention metrics (DAU/WAU/MAU, cohort retention, churn)

Experience:AiMachine learningAnalyticsData science

Skills:PythonSQLPandasNumPySciPyStatsModelsScikit-learnPySparkTableauLookerMetabaseDatabricksAWS EMRBigQueryA/B testingCausal inference

Tech Stack:PythonSQLPandasNumPySciPyStatsModelsScikit-learnPySparkTableauLookerMetabaseDatabricksAWS EMRBigQuery

Company Brief

Arena

Industry: Developer Tools

Company Size: Small (11 to 50 employees)

Growth: Scaleup

Valuation: Unicorn (USD 1B+)

Funding: Series A

Headquarters: San Francisco, United States

Founded: 2025

Website LinkedIn