245K–295K USD / year
Engineering Manager, Provider Ecosystem
Engineering managerRemote — United States
Published on 2026-09-28
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.
About this role
Lead OpenRouter’s Provider Ecosystem team, which integrates and manages the models, endpoints, and inference providers available through its routing platform. This is a hands-on leadership role combining team growth and technical ownership with external provider partnerships.
About the company
OpenRouter is a unified API that routes requests across large language model providers so developers can access, switch, and scale models without lock-in or complex multi-provider integrations.
The team
Provider Ecosystem team, reporting to the VPE.
Stack
TypeScriptCloudflare WorkersPostgreSQLClickHouseGCPVercel
What you'll do
- Hire, develop, and lead engineers; set the team roadmap and stay involved in code reviews and incidents.
- Own provider adapters, endpoint lifecycle, and routing; lead provider integrations and day-zero launches.
- Expand support for multimodal, realtime, and batch inference.
- Own evaluations and inference-quality benchmarks, using results to inform routing and provider feedback.
- Represent OpenRouter’s technical needs in work with labs and inference providers.
What we're looking for
- 4+ years of engineering management experience, including building or scaling a team during rapid growth.
- Strong foundation in distributed systems, API design, and LLM inference, including streaming, tool calling, prompt caching, quantization, throughput, and latency trade-offs.
- Hands-on coding experience and comfort using AI-assisted development tools.
- Able to lead technical partner discussions and integrations externally.
- Data-driven approach to benchmarks, evaluations, and production telemetry.
- Proven ability to recruit and retain strong engineers.
- High agency, clear communication, and a pragmatic approach suited to a lean engineering organization.
Nice to have
- Experience at an inference provider, model lab, or GPU cloud, or building products across multiple LLM APIs.
- Experience with routing, load balancing, evaluations, or benchmarking.
- Experience shipping multimodal APIs or realtime and batch inference.
- Experience with vendor security and compliance reviews, including NDA, DPA, or SOC 2.
- Existing OpenRouter user or AI infrastructure/developer tooling side projects.