Data Scientist

Science Logic
United States
Workplace: RemoteFull timeUSD 140,000 - 165,000 annuallyFunction: Data Science & Machine LearningExperience: 3+ yearsEducation: bachelorsSkills: ["Experiment design","Evaluation and measurement","Analysis","Visualization","Collaboration"]

Build and run an evaluation-driven LLM system for reliable responses and robust agent behavior using locally hosted language models. Define “good” for non-deterministic outputs, create regression and golden-set harnesses, and design LLM-as-judge and retrieval evaluation. Also develop production forecasting, anomaly detection, and early-warning signals from operational telemetry, partnering with data science, ML/inference, frontend, and product under enterprise security constraints.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Science Logic
Science Logic
1 month ago

Data Scientist

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 15 hours agoStatus: Live

Job Summary

Build and run an evaluation-driven LLM system for reliable responses and robust agent behavior using locally hosted language models. Define “good” for non-deterministic outputs, create regression and golden-set harnesses, and design LLM-as-judge and retrieval evaluation. Also develop production forecasting, anomaly detection, and early-warning signals from operational telemetry, partnering with data science, ML/inference, frontend, and product under enterprise security constraints.
Location: United States
Workplace: Remote
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Design and own LLM and agent evaluation harnesses using golden sets, regression suites, and rubric-based scoring.
  • •Build LLM-as-judge pipelines and define response-quality metrics such as groundedness, hallucination rate, relevance, and instruction following.
  • •Conduct adversarial and robustness testing (prompt injection, jailbreaks, tool misuse) and feed failure modes into guardrails and regression coverage.
  • •Evaluate retrieval quality and analyze multi-step agent trajectories, including routing and intent classification quality.
  • •Build and ship production predictive and trend models from operational telemetry (forecasting, anomaly detection, early-warning signals) and wire signals into the LLM/agent layer.

Pay and Benefits

Salary: USD 140,000 - 165,000 annually
Equity and Bonus:Equity
Perks:Health InsuranceDentalVision401kPaid LeaveParental LeavePet Insurance

Key Requirements

  • •3+ years in data science, ML, or applied quantitative analysis.
  • •Bachelor's or Master's in Data Science, Computer Science, Statistics, Mathematics, or related field (or equivalent experience).
  • •Strong applied statistics and the ability to design sound experiments and significance tests on noisy outputs.
  • •Experience building, deploying, and monitoring predictive or time-series models in production (forecasting, anomaly detection, or trend analysis) including recalibration.
  • •Proficiency in Python, with strong SQL and comfort querying large analytical datasets, plus demonstrated experience improving LLM/NLP systems and evaluation.
Experience:3+ yearsIT operationsAIOpsNOCMLLLMEnterprise software
Education:Bachelor's
Skills:Experiment designEvaluation and measurementAnalysisVisualizationCollaboration
Tech Stack:PythonSQLLLMNLPRetrievalAgentic systemsAIOps

Company Brief

Science Logic
Provides an AI-driven IT operations management (ITOM) platform that delivers monitoring, event correlation, and automation to help enterprises detect, diagnose, and resolve infrastructure and application issues across hybrid and multi-cloud environments.
Industry: SaaS
Company Size: Enterprise (1,001+ employees)
Growth: Established Company
Funding: Private Equity Backed
Headquarters: Reston, United States
Founded: 2003
WebsiteLinkedIn