141K–231K USD / year
Senior Software Engineer, Reliability
DevOpsRemote — United States
Published on 2026-11-17
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.
About this role
Own reliability improvements for Temporal Cloud and build an AI-powered Reliability Agent to help SREs investigate and triage issues. The role combines distributed-systems engineering, incident response, operational practices, and safe agent-assisted automation.
About the company
Temporal is a durable execution platform for running reliable workflows and long-running business processes. It helps engineering teams build fault-tolerant applications without custom state machines.
The team
Reliability team within Compute and Core Engineering, Foundations; reports to Tushar Roy.
What you'll do
- Drive measurable, end-to-end reliability improvements across Temporal Cloud.
- Build and evolve an agent that uses telemetry, incidents, runbooks, deployments, and service history to support triage.
- Design agent workflows with human oversight, escalation, auditability, and safeguards.
- Lead incident response and post-incident reviews, and track corrective actions.
- Define SLOs, alerting thresholds, operational readiness criteria, and escalation paths.
- Run gamedays and expand chaos testing.
- Maintain reliability scorecards and improve observability standards.
- Lead load, performance, and capacity testing.
What we're looking for
- Strong fundamentals in distributed systems, concurrency, performance, and fault-tolerant design.
- Experience building or operating complex systems under high load and partial failure.
- Experience building AI-powered tools, agents, or production automation.
- Track record of reliability improvements across services or engineering teams.
- Hands-on incident response and post-incident review experience.
- Experience with gamedays, chaos testing, load testing, capacity planning, scorecards, or observability programs.
- Sound judgment balancing reliability, agent autonomy, safety, customer impact, and delivery speed.
- Clear communication, stakeholder alignment, mentoring, and willingness to participate in an on-call rotation.
Nice to have
- Experience operating multi-tenant systems and protecting against noisy-neighbor behavior.
- Experience building internal platforms or reliability tooling.
- Familiarity with LLM observability, agent evaluation, retrieval-augmented generation, or workflow orchestration.
- Open-source contributions in infrastructure, distributed systems, AI, or reliability engineering.
Benefits
- Equity
