141K–231K USD / year

Senior Software Engineer, Reliability

DevOpsRemote — United States
Published on 2026-11-17
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.

About this role

Own reliability improvements for Temporal Cloud and build an AI-powered Reliability Agent to help SREs investigate and triage issues. The role combines distributed-systems engineering, incident response, operational practices, and safe agent-assisted automation.

About the company

Temporal is a durable execution platform for running reliable workflows and long-running business processes. It helps engineering teams build fault-tolerant applications without custom state machines.

The team

Reliability team within Compute and Core Engineering, Foundations; reports to Tushar Roy.

What you'll do

  • Drive measurable, end-to-end reliability improvements across Temporal Cloud.
  • Build and evolve an agent that uses telemetry, incidents, runbooks, deployments, and service history to support triage.
  • Design agent workflows with human oversight, escalation, auditability, and safeguards.
  • Lead incident response and post-incident reviews, and track corrective actions.
  • Define SLOs, alerting thresholds, operational readiness criteria, and escalation paths.
  • Run gamedays and expand chaos testing.
  • Maintain reliability scorecards and improve observability standards.
  • Lead load, performance, and capacity testing.

What we're looking for

  • Strong fundamentals in distributed systems, concurrency, performance, and fault-tolerant design.
  • Experience building or operating complex systems under high load and partial failure.
  • Experience building AI-powered tools, agents, or production automation.
  • Track record of reliability improvements across services or engineering teams.
  • Hands-on incident response and post-incident review experience.
  • Experience with gamedays, chaos testing, load testing, capacity planning, scorecards, or observability programs.
  • Sound judgment balancing reliability, agent autonomy, safety, customer impact, and delivery speed.
  • Clear communication, stakeholder alignment, mentoring, and willingness to participate in an on-call rotation.

Nice to have

  • Experience operating multi-tenant systems and protecting against noisy-neighbor behavior.
  • Experience building internal platforms or reliability tooling.
  • Familiarity with LLM observability, agent evaluation, retrieval-augmented generation, or workflow orchestration.
  • Open-source contributions in infrastructure, distributed systems, AI, or reliability engineering.

Benefits

  • Equity
View original job post