Machine Learning - Model Serving Job at Alexander Chapman, San Jose, CA

MFZ5Q2pTOWptbGxJVU5abGtjbkZOMWRuMWc9PQ==
  • Alexander Chapman
  • San Jose, CA

Job Description

We are working with a company building intuitive, voice-first AI systems that blend natural interaction with powerful model performance. Founded by leaders from Meta, Oculus, and Google, they’re creating a new class of consumer devices powered by speech, vision, and LLMs.

The Role

You’ll help optimize and scale the inference stack, working across model serving, performance tuning, and deployment to support real-time, multimodal AI.

What You’ll Do

  • Improve serving systems for LLMs, speech, and vision models.
  • Optimize throughput, latency, and cost using advanced techniques like batching, caching, and kernel tuning.
  • Extend frameworks like VLLM or SGLang to push the limits of performance.
  • Collaborate with training teams to deploy faster, lighter models.
  • Experiment with compilers and hardware backends to boost efficiency.

What We’re Looking For

  • Strong experience with PyTorch or similar ML frameworks.
  • Deep knowledge of model serving and systems performance.
  • Skilled in low-level debugging, bottleneck analysis, and server optimization.
  • Familiar with VLLM, Ray, or deploying inference workloads at scale.
  • Comfortable owning complex infrastructure projects end to end.
  • Background in computer science or related field from a top-tier university (e.g. Stanford, MIT, Ivy League).
  • Experience at a top tech company (e.g. FAANG) or a successful, high-growth startup.

They’re looking for curious, impact-driven engineers ready to push what’s possible with real-time AI.

Job Tags

Similar Jobs

Phoenix Children's

Clinical Nurse - PICU Job at Phoenix Children's

 ...be considered. If you are a new grad, please apply to the RN-New Grad opening. This position works in collaboration with the healthcare team, patient and family to promote patient health through delivery of professional nursing care appropriate to patients age and... 

Luxury Bath NJPA

Entry Level Marketing Job at Luxury Bath NJPA

 ...-level, we provide ALL training and no experience is necessary. Our goal is to build your...  ...knowledge of business, communications, marketing, and sales. This position is perfect...  ...Whether you are a student looking for a paid internship or a laborer looking for a change, this... 

AMR

Paramedic Basic Job at AMR

 ...94.83 - $112,102.00 depending on experience *Relocation Assistance potentially available for FULL TIME...  ...preferably in healthcare. Included Benefits Paid Shift Differentials. Enhanced Holiday Pay. Paid Training. Paid Wellness Days. Generous PTO... 

H-E-B Grocery Company, LP

Drug - Night Stocker - Part Time Job at H-E-B Grocery Company, LP

 ...Night Stocker, you'll become part of a highly-functioning team in the Grocery or Drug Store department, watching out for each other, working to meet...  ...Because you'll be stocking for a large footp Night, Stocker, Part Time, Drug, Retail, Grocery H-E-B Grocery Company, LP

Riot Hospitality Group

Barback Job at Riot Hospitality Group

 ...bringing to life a new, innovative, and exclusive fine-dining supper club located in Old Town's Entertainment District that blends...  ...House, CAKE, Cottontail Lounge / Living Room / WET Deck, Maya Day+Night, Shiv Supper Club, Kauboi, Allegra, and F-Sixteen. Our...