210–285 UNKNOWN / year

Base Labs Research Scientist - RL Environments

Machine learningHybrid — San Francisco, New York
Published on 2026-11-20
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.

About this role

Design and study open reinforcement-learning environments that help models learn and reliably demonstrate useful capabilities. Develop tasks, rewards, verifiers, and evaluation methods, then run experiments to measure learning, transfer, and failure modes.

About the company

Baseten is an inference cloud that helps companies run and scale AI models in production with flexible infrastructure and developer tooling.

The team

Base Labs research lab; aligned with Training and Post-Training.

What you'll do

  • Identify model capabilities and failure modes to study.
  • Design tasks, rewards, and verifiers; test solvability and detect shortcuts or grading weaknesses.
  • Develop scalable methods for generating, calibrating, and quality-checking environments.
  • Run RL experiments comparing curricula, task mixtures, and reward designs; evaluate transfer to unseen tasks.
  • Build rigorous, reproducible evaluations and investigate unexpected results.
  • Collaborate with safety researchers on reward hacking and misalignment.
  • Release environments, datasets, training recipes, and research findings.

What we're looking for

  • Depth in a relevant area such as reinforcement learning, model evaluation, agent systems, synthetic data, or experimental methodology.
  • Ability to implement environments, run experiments, and inspect failures in detail.
  • Evidence of strong research skills through a paper, open-source project, or experimental investigation.

Nice to have

  • Experience with LLM training.
  • Experience building tools or projects used by other researchers.
  • PhD or prior Research Scientist title is not required.

Benefits

  • Meaningful equity
  • Flexible PTO
  • Paid parental leave
  • Medical, dental, and vision coverage for U.S. employees and dependents
  • Company-facilitated 401(k) for U.S. employees
  • Fertility and family-building stipend
View original job post