161K–261K USD / year
Senior Software Engineer, AI Gateway
BackendRemote — United States
Published on 2026-10-15
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.
About this role
Join Docker to design and implement core systems for the AI Gateway, focusing on model routing and secure infrastructure. Work on critical capabilities that improve AI agent development and maintain performance and reliability as traffic scales.
About the company
Docker is a software platform that enables developers to automate the deployment, scaling, and management of applications using containerization technology. The company serves a wide range of industries by providing tools and services that facilitate development and operational efficiencies.
The team
ENG-MCP & AI Gateway
Stack
GoRustDockerKubernetesMicroservices
What you'll do
- Design and implement core systems for AI Gateway
- Build infrastructure for model selection and routing
- Develop APIs for OpenAI-compatible interfaces
- Lead architectural decisions and mentor engineers
What we're looking for
- 6+ years of backend engineering experience
- Deep knowledge of distributed systems and cloud-native infrastructure
- Experience with secure, high-throughput services
- Fluency in Go and/or Rust
Nice to have
- Experience with OpenAI or similar LLM APIs
- Familiarity with RAG architectures and vector databases
- Experience with policy engines and observability frameworks
Benefits
- Generous PTO and quarterly Whaleness Days
- Technology stipend for workspace support
- Annual learning and development stipend
- 16 weeks paid parental leave