200K–250K USD / year
Senior AI Developer
AIRemote — United States
Published on 2026-11-06
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.
About this role
Build and improve ClickUp’s AI quality evaluation systems, agent harness, and production AI capabilities. The role combines hands-on LLM development with scalable backend and platform engineering, focused on reliable, secure, customer-facing AI.
About the company
ClickUp is a work management platform that combines tasks, docs, goals, and collaboration tools for teams running projects across functions.
Stack
PythonGoTypeScriptKubernetesDockerAWSGCPAzure
What you'll do
- Own AI evaluations, including golden datasets, automated scorers, regression detection, and quality tracking.
- Build and evolve the core agent harness and self-improvement loops for agents and prompts.
- Benchmark models and manage model selection, routing, and fallback strategies across providers.
- Develop scalable AI platform services, APIs, and backend systems for AI features.
- Build infrastructure for model serving, monitoring, logging, and automated evaluation.
- Promote privacy, security, and compliance in AI systems.
- Collaborate with product, frontend, and data teams to deliver user-focused AI experiences.
What we're looking for
- 5+ years of software engineering experience, including 2+ years building production LLM or ML systems.
- Production experience building LLM evaluation systems, including judge calibration and offline and online evaluations.
- Strong experiment design and statistical rigor, including A/B testing and analysis of noisy results.
- Experience applying AI models to customer-facing products and managing multiple LLMs.
- Expertise in backend engineering, distributed systems, and cloud-native technologies.
- Strong programming skills in Python, Go, TypeScript, or similar languages.
- Experience with orchestration frameworks or workflow engines.
- Familiarity with search and retrieval technologies.
Nice to have
- Background in data science, applied science, or machine learning engineering.
- Experience with Braintrust, LangSmith, Weave, Arize, or in-house evaluation tools.
- Experience with model routing, AI gateways, or inference optimization.
Benefits
- Equity
- 401(k)
- Health, dental, and vision insurance
- Paid parental leave
- Flexible paid time off
- Wellness and professional development stipends