Salary not listed
Lead Product Manager, Agent Platform
ProductOn-site — New York City, Palo Alto, California
Published on 2026-10-29
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.
About this role
Lead the product direction for Pylon’s agent platform, supporting both internal teams building and operating agents and customers integrating their own agents. The role spans developer infrastructure, agent evaluation, secure integrations, and regulatory-grade observability, with hands-on coding expected.
About the company
Pylon is a B2B customer support and success platform built for SaaS teams. It helps companies manage customer conversations, SLAs, and account workflows in one place.
The team
Agent Platform
Stack
MCPAPIsLLMsRAGEmbeddingsVector databasesSQL
What you'll do
- Set the strategy and roadmap for agent platform capabilities, including orchestration, retrieval, evaluations, observability, and guardrails.
- Help internal teams build, test, deploy, and monitor production agents using shared tools and patterns.
- Enable customer agents to work with Pylon through MCP servers, APIs, permissions, and documentation.
- Build evaluation datasets, benchmarks, and regression checks, with human review for regulated decisions.
- Ensure agent actions are traceable and explainable, and protect sensitive borrower data.
- Make build-versus-buy decisions and manage model and platform tradeoffs involving cost, latency, and quality.
- Write and ship code, build agents on the platform, and support customers with GTM and Account Management.
- Help hire and grow the team.
What we're looking for
- 4+ years of product management experience and experience owning a developer platform, infrastructure product, or API.
- Production experience shipping LLM agents or agent tooling, including tool use, MCP, orchestration, and structured outputs.
- Knowledge of LLM evaluations, retrieval and RAG, model selection, prompt and context engineering, and fine-tuning tradeoffs.
- Familiarity with tracing, guardrails, prompt injection, and protection of sensitive data.
- Able to code in a production codebase, prototype, and discuss architecture with engineers.
- Experience building 0-to-1 enterprise software in a regulated industry.
- Able to use SQL and define metrics for agent quality and platform adoption.
- Willing to work onsite in New York City or Palo Alto.
Nice to have
- Engineering background.
- Mortgage or fintech infrastructure experience.
- Experience with document understanding, including OCR, extraction, or classification.