127K–254K USD / year
Senior Software Engineer – AI Infrastructure
AIRemote — United States
Published on 2026-10-15
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.
About this role
Build and operate production infrastructure for AI agent systems at scale. The role focuses on reliable, observable, high-performance services for model inference, orchestration, and execution.
About the company
Kraken is a leading cryptocurrency exchange that provides a platform for buying, selling, and trading a diverse range of digital assets. The company focuses on compliance, security, and innovative financial solutions to serve both individual and institutional clients.
The team
AI Infrastructure team, partnering closely with the Agent Systems team.
Stack
Rust
What you'll do
- Build high-performance Rust services for inference, orchestration, and execution.
- Design scalable infrastructure for high-throughput workloads and millions of users.
- Develop production ML infrastructure and MLOps patterns for model deployment, evaluation, and monitoring.
- Establish observability, guardrails, and failure handling for agent workflows.
- Optimize inference and orchestration latency, throughput, and cost.
- Turn experimental prototypes into reliable production systems.
What we're looking for
- 5+ years building and operating high-scale production systems.
- Strong Rust and systems-level programming skills.
- Deep knowledge of distributed systems, reliability engineering, and performance optimization.
- Experience with high-throughput or millions-of-users production services.
- Familiarity with production ML infrastructure, model serving, or MLOps.
- Experience designing observability, monitoring, and failure recovery systems.
Nice to have
- Experience building infrastructure for agent-based or LLM-powered systems.
- Background in high-performance networking, asynchronous systems, or low-latency architectures.
- Experience with container orchestration and cloud-native infrastructure.
- Familiarity with evaluation frameworks and model performance monitoring at scale.
- Experience in 0-to-1 or platform-building teams.
Benefits
- Bonus program
- Equity program
- Wellness allowance
- Medical, dental, and vision coverage
- 401(k)