Senior Software Engineer - Dev Platform

About this role

Build and operate Kraken’s internal AI Gateway, providing engineers with governed access to LLM providers. The role covers provider integrations, routing, access controls, usage and cost visibility, and reliable production operations.

About the company

Kraken is a leading cryptocurrency exchange that provides a platform for buying, selling, and trading a diverse range of digital assets. The company focuses on compliance, security, and innovative financial solutions to serve both individual and institutional clients.

The team

Dev Platform team, working on the AI Gateway.

Stack

What you'll do

• Build model and provider integrations, routing policies, budgets, rate limits, and usage reporting.
• Design APIs, SDKs, and self-service onboarding tools for internal engineers.
• Help teams migrate LLM workloads to the gateway.
• Implement access control, key management, and audit logging with Security.
• Instrument latency, errors, token usage, and costs.
• Own features from design through production and support service reliability with SRE.
• Document the platform, help internal users debug issues, and incorporate feedback.

What we're looking for

• Experience building and operating production APIs and distributed backend or platform services.
• Strong skills in a backend language such as Rust, Python, or TypeScript.
• Working knowledge of LLM APIs, including authentication, streaming, token accounting, rate limits, and provider failures.
• Experience with observability, CI/CD, and containers; familiarity with Kubernetes and a major cloud provider.
• Ability to design well-documented APIs and communicate clearly.

Nice to have

• Experience with API gateways, proxies, or traffic management.
• Experience with LLM routing, caching, evaluation, or cost controls.
• Familiarity with OAuth, OIDC, or RBAC.
• Open-source infrastructure or developer-platform contributions.