320K–485K USD / year
Staff + Sr. Software Engineer, Scaling
AIHybrid — New York City, NY; San Francisco, CA; Seattle, WA
Published on 2026-09-28
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.
About this role
The Staff + Sr. Software Engineer will work on the Inference team responsible for building and scaling systems that serve AI models to millions of users. The role involves designing distributed systems, intelligent request routing, and optimizing compute efficiency while supporting research efforts.
About the company
Anthropic builds reliable and interpretable AI systems, including the Claude family of models, for businesses and developers. The company focuses on AI safety research and practical AI assistants for enterprise and consumer use.
The team
Inference team
Stack
distributed systemsmachine learning systemsKubernetescloud infrastructureAWSGCPAzurePython
What you'll do
- Design, build, and maintain distributed systems for serving AI models
- Develop adaptive systems for real-time events
- Implement load balancing and traffic management systems
- Maximize compute efficiency across the cloud fleet
- Build production-grade deployment pipelines
- Support infrastructure for next-generation AI models
- Integrate new AI accelerator platforms
What we're looking for
- Significant software engineering experience with distributed systems
- Results-oriented and flexible
- Willingness to work beyond job description
- Desire to learn about machine learning systems
- Thrives in a technical excellence environment
- Concern for societal impacts of work
Nice to have
- Experience with high-performance distributed systems
- Experience deploying machine learning systems at scale
- Familiarity with LLM inference optimization
- Experience with load balancing systems