170K–276K USD / year

Staff Software Engineer, AI Gateway

BackendRemote — United States
Published on 2026-10-15
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.

About this role

The Staff Software Engineer for the AI Gateway will set technical direction and solve complex problems related to model orchestration and secure infrastructure for AI applications. The role involves hands-on contributions and collaboration with engineering leadership to shape the product's technical strategy.

About the company

Docker is a software platform that enables developers to automate the deployment, scaling, and management of applications using containerization technology. The company serves a wide range of industries by providing tools and services that facilitate development and operational efficiencies.

The team

Engineering, ENG-MCP & AI Gateway

Stack

GoRustAPI designDistributed systemsCloud-native infrastructure

What you'll do

  • Set technical direction for core systems powering the AI Gateway
  • Identify and drive fixes for gaps in infrastructure and tooling
  • Act as the expert for secure credential storage and policy enforcement
  • Mentor other engineers and raise the team's technical bar

What we're looking for

  • 8+ years of backend engineering experience
  • Specialization in distributed systems and cloud-native infrastructure
  • Experience building secure, high-throughput services
  • Fluency in Go and/or Rust

Nice to have

  • Experience with OpenAI or LLM APIs
  • Familiarity with RAG architectures or agent frameworks
  • Understanding of OAuth 2.1 and cloud IAM systems

Benefits

  • Generous PTO and designated Whaleness Days
  • Technology stipend of US$100 net per month
  • Equity for all full-time employees
  • 16 weeks of paid parental leave after six months
View original job post