235K–295K EUR / year
Senior Software Engineer, Inference
AIHybrid — Dublin, IE
Published on 2026-10-13
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.
About this role
The Senior Software Engineer will work on the Inference team responsible for building critical systems for AI model deployment. The role demands expertise in distributed systems, optimizing inference performance, and managing diverse AI hardware across various cloud platforms.
About the company
Anthropic builds reliable and interpretable AI systems, including the Claude family of models, for businesses and developers. The company focuses on AI safety research and practical AI assistants for enterprise and consumer use.
The team
Inference team
Stack
PythonRustKubernetesAWSGCP
What you'll do
- Design intelligent routing algorithms
- Autoscale compute fleet for dynamic workloads
- Build deployment pipelines for model releases
- Integrate new AI accelerator platforms
- Contribute to new inference features
- Support inference for new model architectures
- Analyze observability data for performance tuning
- Manage multi-region deployments
What we're looking for
- Significant software engineering experience
- Experience with distributed systems
- Results-oriented with flexibility
- Willingness to learn about machine learning systems
Nice to have
- Experience with load balancing and request routing
- Background in LLM inference optimization
- Familiarity with batching and caching strategies
Benefits
- Competitive compensation
- Equity donation matching
- Generous vacation and parental leave
- Flexible working hours