170K–170K USD / year
Lead Engineer, AI Quality
AIRemote — India
Published on 2026-09-30
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.
About this role
Circle is seeking a Lead Engineer to oversee the AI Quality engineering team, focusing on measuring and improving the quality of AI-powered features. The role involves building infrastructure for evaluation, observability, and diagnostics of AI systems, while also managing a growing team.
About the company
Circle is a technology company that provides a platform for building community-driven spaces, focusing on enabling creators and teams to engage and collaborate effectively. They offer tools for marketplace solutions, enhancing user experience through design and advanced technology.
The team
AI Quality engineering team
Stack
Ruby on RailsPython
What you'll do
- Build and own evaluation infrastructure for AI agents
- Diagnose quality breakdowns in AI systems
- Develop datasets for evaluation
- Run experiments on prompts and models
- Lead the AI Quality engineering team
- Collaborate with AI Core engineering
What we're looking for
- 7+ years of experience in production software development
- Experience with LLM-powered agents
- Proficiency in Ruby on Rails / Python
- Experience with ML/AI evaluation infrastructure
- Knowledge of designing datasets and annotation workflows
- Ability to thrive in a dynamic environment
Nice to have
- Experience with evaluation frameworks
- Familiarity with structured experiments in AI
Benefits
- U.S.-benchmarked compensation
- Equity in the company
- 35 days of paid time off