170K–170K USD / year
Lead Engineer, AI Quality
AIRemote — United Kingdom
Published on 2026-09-30
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.
About this role
The Lead Engineer for AI Quality will be responsible for building evaluation frameworks and diagnosing issues in AI-powered features. This hands-on player-coach role involves leading a team to ensure the efficiency and reliability of AI systems.
About the company
Circle is a technology company that provides a platform for building community-driven spaces, focusing on enabling creators and teams to engage and collaborate effectively. They offer tools for marketplace solutions, enhancing user experience through design and advanced technology.
The team
AI Quality engineering team
Stack
Ruby on RailsPython
What you'll do
- Build and own evaluation infrastructure.
- Diagnose quality breakdowns in AI agents.
- Grow datasets for AI evaluation.
- Run experiments across prompts and models.
- Lead and manage the AI Quality engineering team.
- Collaborate closely with AI Core engineering.
What we're looking for
- 7+ years of experience in production software.
- Experience with LLM-powered agents.
- Knowledge of evaluation infrastructure for ML/AI systems.
- Experience designing datasets for ML/AI evaluation.
- Ability to learn fast and experiment in a dynamic environment.
- Strong alignment with company values.
- Proficient in English at CEFR Level C2.
Benefits
- U.S.-benchmarked compensation.
- Equity in the company.
- 35 days of paid time off annually.