200K–400K USD / year
Product Manager, Inference Experience
ProductHybrid — San Francisco, New York
Published on 2026-11-11
These details were extracted automatically from the original listing. They may not be complete or fully up to date — it's worth checking the original job post.
About this role
Own the product experience for building, deploying, and operating AI models on Baseten. Shape inference products that help developers discover and evaluate models, optimize performance, and run workloads reliably in production.
About the company
Baseten is an inference cloud that helps companies run and scale AI models in production with flexible infrastructure and developer tooling.
The team
EPD, Product
Stack
PyTorchTensorRT-LLMvLLMSGLangNVIDIA Dynamo
What you'll do
- Set product strategy and roadmap for inference offerings, focused on developer adoption and business impact
- Improve model discovery, evaluation, deployment, and management across APIs, SDKs, CLI, and console
- Partner with inference engineers and researchers to turn technical advances into customer-facing capabilities
- Prioritize models, workloads, and customer needs
- Partner with GTM and leadership on pricing, packaging, launches, and commercialization
- Gather feedback from developers and customers
What we're looking for
- 10+ years building and shipping AI/ML products or platforms
- Technical background in software engineering, ML engineering, research, or equivalent hands-on experience
- Hands-on experience building or deploying models with relevant inference frameworks
- Strong understanding of model serving, GPU economics, and quality, latency, throughput, and cost tradeoffs
- Strong developer product instincts and ability to make complex technology approachable
- Track record leading cross-functional initiatives that drive measurable adoption or revenue growth
Nice to have
- Experience deploying models or building infrastructure and ML infrastructure products
- Experience designing tools used from both a terminal and a console
- Past experience as a software developer
Benefits
- Meaningful equity
- 100% medical, dental, and vision coverage for U.S. employees and dependents
- Flexible PTO and company-wide winter break
- Paid parental leave
- Fertility and family-building stipend
- Company-facilitated 401(k) for U.S. employees