Hi, How Can We Help You?
  • OFFICES: MIAMI-SÃO PAULO
  • | Ai Powered U.S. Immigration Visa Hub

Technical Program Manager, Inference

May 29, 2025

Technical Program Manager, Inference

  • Anywhere

Responsibilities:
Lead end-to-end program management for model bring-up and deployment, coordinating between research, infrastructure, and platform teams
Manage complex technical programs involving model optimization, capacity planning, and multi-cloud deployment strategies
Drive cross-functional initiatives for major launches, collaborating with partner-facing teams to ensure external dependencies are met
Track and communicate critical metrics including capacity utilization, latency targets, and reliability SLOs across different serving platforms
Navigate technical trade-offs between performance, cost, and reliability, helping teams make informed decisions about inference optimizations
Coordinate with research teams to understand upcoming model architectures and prepare infrastructure accordingly
Lead technical discussions around serving strategies for different model families and deployment platforms
Partner with engineering teams to improve inference reliability and help meet our SLA targets
Create and maintain comprehensive documentation of deployment processes, capacity models, and technical decisions
You may be a good fit if you:
Have several years of experience in technical program management, with a track record of successfully delivering complex infrastructure or ML systems
Possess deep technical knowledge that allows you to engage meaningfully with ML researchers and infrastructure engineers
Have experience with large-scale distributed systems and understand the challenges of serving ML models in production
Are comfortable working with multiple cloud platforms and hardware accelerators
Excel at translating between technical teams and stakeholders, making complex trade-offs understandable
Have experience managing programs with significant external dependencies and multiple stakeholder groups
Can thrive in ambiguous situations, bringing structure to complex technical challenges
Have strong analytical skills and can work with performance metrics, capacity models, and cost optimization
Are passionate about AI technology and interested in the challenges of deploying frontier models at scale
Have excellent written and verbal communication skills, with the ability to influence without authority

Avatar of Frank Rizzo

Author: Frank Rizzo

**Ai Powered U.S. Immigration Portal to help foreign nationals navigate the visa issuance system for immigrant and non-immigrant prospective clients inside and outside the United States.**