Senior AI Engineer - Grafana AI/ML

About this role

Build and ship AI-powered features that help users detect, triage, and resolve incidents using observability data. Develop and iterate on LLM- and agent-powered workflows, partnering with product, design, and data colleagues to deliver scalable solutions for real user needs.

About the company

Grafana Labs builds open-source and commercial observability tools for metrics, logs, and traces, centered on Grafana dashboards. It helps teams monitor infrastructure and applications and investigate incidents.

The team

Grafana AI teams

Stack

What you'll do

• Build high-performance AI features for incident detection, triage, and resolution
• Prototype, test, and iterate on LLM- and agent-powered workflows with user feedback
• Integrate agentic components with internal tools, alerting systems, runbooks, and developer workflows
• Own AI solutions through delivery, ensuring they are scalable and maintainable
• Collaborate with data analysts, product managers, and designers

What we're looking for

• Experience with LLMs, prompt engineering, and GenAI applications
• Track record of delivering production software used by customers
• Experience in cloud-native environments such as AWS, GCP, or Azure
• Experience using observability tools to troubleshoot system behavior
• Strong production software engineering skills and ability to work independently
• Comfort with rapid experimentation, ambiguity, and cross-functional collaboration

Nice to have

• Experience with agent frameworks or multi-agent workflows
• Familiarity with Kubernetes, Docker, Terraform, or similar tools
• Familiarity with model fine-tuning
• Experience building observability tooling

Benefits

• Restricted Stock Units (RSUs)
• 30 days of annual leave, including three Grafana shutdown days
• Company-funded budget for AI coding assistants
• Access to frontier models from OpenAI, Anthropic, and Google
• In-person onboarding