Staff Product Manager, Inference
Apply NowWho You Are:
- 8+ years in product management, at a senior or staff level, ideally having owned a developer-facing API, platform, or AI/ML product.
- Technical depth. You can reason about model serving, routing, latency, and quality tradeoffs, and earn the trust of strong engineers. You don't need to write code, but you need to understand systems well enough to make good tradeoffs.
- Infrastructure and tradeoff sense. You've owned a product where cost, performance, and vendor or provider tradeoffs were central, and you can keep a product current as the landscape shifts.
- Cross-functional influence. LiveKit's engineering teams operate with high autonomy. You influence through clarity, trust, and good judgment, not process or hierarchy.
- Communication as a superpower. You write clearly, present well, and can move between a board-level strategy conversation and a detailed technical discussion with an engineering lead.
- Comfort with ambiguity. We're a small product team at a fast-growing company. You'll figure out what matters, prioritize ruthlessly, and move quickly without perfect information.
Nice to Have:
- Built a model gateway, inference API, model-provider product, or AI/ML platform
- Familiarity with model benchmarking and how both performance and quality are measured (e.g. TTFT)
- Familiarity with the STT, TTS, LLM, and realtime model space and top providers
- Background at a developer tools, API infrastructure, or AI/ML company
- Familiarity with voice AI, real-time communication, or telephony
- Experience with usage-based pricing models and cost or margin optimization