Full job description
Infrastructure Engineer
San Francisco, CA · On-site · Full-time
Compensation: $150,000–$250,000 + up to 1% equity
About the Company
A seed-stage LLM interpretability and context-optimization company building custom machine learning models that analyze and compress token contexts before they reach the underlying model — delivering roughly 50% inference cost reduction, lower latency, and higher accuracy for the enterprises and scale-ups integrating LLMs into their products. Venture-backed, with strong early traction (~1,000 customers within its first seven months).
Founded 2025 · 1–10 people · Industry: AI Tools / LLM infrastructure
The Role
Own the full multi-region GPU infrastructure stack end to end as the sole infra hire — global low-latency serving, multi-cloud and on-premise deployments, reliability, and cost efficiency. Your work sits directly in the critical path of live customer traffic. This is a high-ownership, in-person role at a fast-moving early-stage team, working a 996 pace (9am–9pm, six days a week) in San Francisco.
What you’ll be doing
Own the full infrastructure stack end to end across multi-region GPU deployments, major public clouds, and on-premise enterprise environments.
Build and maintain super low-latency GPU serving infrastructure that sits in the critical path of live customer traffic.
Manage multi-cloud deployments, including cloud marketplace integrations and provider relationships.
Design and iterate on deployment, scaling, reliability, and cost-efficiency systems as the sole infra owner.
Support on-premise deployments for enterprise clients and ensure performance and reliability at each site.
Research and adopt new infrastructure solutions continuously as the stack and customer base grow.
Tech stack: AWS, GCP, Terraform, Docker, CI/CD, GPU/ML inference infrastructure
Requirements
Own cloud systems serving compression API end-to-end
Build and operate global low-latency high-throughput GPU ML inference infrastructure
Work with AWS, Terraform, Docker and CI/CD
Have built and operated production infrastructure at a startup or larger company
Learn new solutions and technologies quickly
Improve and research infrastructure solutions continuously
Based in or willing to relocate to San Francisco to work in person at the hacker house
Willingness to work startup hours in a 996-style environment (9am–9pm, six days a week)
Green Flags
Quick learner who grasps products and systems fast
Experience building for performance and reliability at scale
Research and product focus mindset
High ownership mentality
Startup-minded operator who prioritizes learning and growth over work-life balance
GPU infrastructure experience in production
First infra hire at a startup
Background at an infrastructure company
Red Flags
Infra scope limited to model training pipelines only
20+ years of experience with a slow-moving, process-heavy background
Prioritizes work-life balance as a primary requirement
No production infra ownership
Why Join
Sole infra owner with full-stack ownership from day one, directly in the critical path of live customer traffic.
Well-funded seed-stage company with strong early traction and an experienced backer base.
Significant equity, housing and food provided at the SF hacker house, visa sponsorship, laundry and cleaning, company off-sites, infinite DoorDash, and health & dental.
Details
Location: San Francisco, CA
Work policy: In person (SF hacker house); 996 pace — 9am–9pm, six days a week
Compensation: $150,000–$250,000 + up to 1% equity
Visa sponsorship: Available (H-1B, O-1, OPT)
Employment type: Full-time
