Machine Learning Engineer, Principal - Model Factory (Hiring Immediately) Job at d-Matrix, Santa Clara, CA

MjFPSmdTcGltbHhOVWR0Z2tjbkZNRlpxMWc9PQ==
  • d-Matrix
  • Santa Clara, CA

Job Description

At d-Matrix , we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration.

We value humility and believe in direct communication. Our team is inclusive , and our differing perspectives allow for better solutions. We are seeking individuals passionate about tackling challenges and are driven by execution. Ready to come find your playground? Together , we can help shape the endless possibilities of AI.

Location:

Hybrid, working onsite at our Santa Clara, Ca headquarters 3-5 days per week.

Job Title: Machine Learning Engineer, Principal - d-Matrix Model Factory

What You Will Do:

d-Matrix is a pioneering company specializing in data center AI inferencing solutions. Utilizing innovative in-memory computing techniques, d-Matrix develops cutting-edge hardware and software platforms designed to enhance the efficiency and scalability of generative AI applications.

The Model Factory team at d-Matrix is at the heart of cutting-edge AI and ML model development and deployment. We focus on building, optimizing, and deploying large-scale machine learning models with a deep emphasis on efficiency, automation, and scalability for the d-Matrix hardware. If you’re excited about working on state-of-the-art AI architectures , model deployment , and optimization , this is the perfect opportunity for you!

What You Will Bring:

  1. Design, build, and optimize machine learning deployment pipelines for large-scale models.
  2. Implement and enhance model inference frameworks.
  3. Develop automated workflows for model development, experimentation, and deployment.
  4. Collaborate with research, architecture, and engineering teams to improve model performance and efficiency.
  5. Work with distributed computing frameworks (e.g., PyTorch/XLA, JAX, TensorFlow, Ray) to optimize model parallelism and deployment.
  6. Implement scalable KV caching and memory-efficient inference techniques for transformer-based models.
  7. Monitor and optimize infrastructure performance across different levels of custom hardware hierarchy - cards, servers, and racks, which are powered by the d-Matrix custom AI chips.
  8. Ensure best practices in ML model versioning, evaluation, and monitoring.

Required Qualifications:

  1. BS in Computer Science with 15+ or MS in Computer Science preferred with 10+ years of strong programming skills in Python and experience with ML frameworks like PyTorch, TensorFlow, or JAX.
  2. Hands-on experience with model optimization, quantization, and inference acceleration.
  3. Deep understanding of Transformer architectures, attention mechanisms, and distributed inference (Tensor Parallel, Pipeline Parallel, Sequence Parallel).
  4. Knowledge of quantization (INT8, BF16, FP16) and memory-efficient inference techniques.
  5. Solid grasp of software engineering best practices, including CI/CD, containerization (Docker, Kubernetes), and MLOps.
  6. Strong problem-solving skills and ability to work in a fast-paced, iterative development environment.

Preferred Qualifications:

  1. Experience working with cloud-based ML pipelines (AWS, GCP, or Azure).
  2. Experience with LLM fine-tuning, LoRA, PEFT, and KV cache optimizations.
  3. Contributions to open-source ML projects or research publications.
  4. Experience with low-level optimizations using CUDA, Triton, or XLA.

Why Join Model Factory?

  1. Work at the intersection of AI software and custom AI hardware , enabling cutting-edge model acceleration.
  2. Collaborate with world-class engineers and researchers in a fast-moving AI-driven environment.
  3. Freedom to experiment, innovate, and build scalable solutions.
  4. Competitive compensation, benefits, and opportunities for career growth.

This role is ideal for a self-motivated engineer interested in applying advanced memory management techniques in the context of large-scale machine learning inference. If you’re passionate about implementing and optimizing machine learning models for custom Silicon, and are excited to explore cutting-edge solutions in model inference, we encourage you to apply.

Equal Opportunity Employment Policy

d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication and a willingness to embrace challenges and learn together every day.

#J-18808-Ljbffr

Job Tags

Full time, Immediate start, 3 days per week,

Similar Jobs

First Student

School Bus Driver Job at First Student

 ...create and implement the most advanced training and technology the transportation industry has to offer. Now Hiring Part-Time School Bus Drivers for Pine Bush School District, in Pine Bush, NY! As a First Student Part-Time School Bus Driver, you will play a vital role... 

Liedtka Logistics

CDL A Regional Owner Operator Driver Job at Liedtka Logistics

 ...Offer: Annual gross income $150,000 to $200,000 Regional routes home on the weekend Most loads drop & hook Discounted parts and tires PrePass at a reduced cost Driver referral bonus program Fuel cards, trip advances Weekly settlements ... 

Koch Industries

Material Handling Technician Job at Koch Industries

 ...Your Job Georgia-Pacific is seeking Material Handling Technicians at our Rincon, GA facility to work in a high energy and dynamic organization. The Material Handling Technician will learn, apply, and teach the equipment theory of operation and the operational processes... 

I3 INFOTEK INC

Calibration Technician Job at I3 INFOTEK INC

 ...pressure standards Experience working with; Auto Claves, Ovens, Tunnels, HVAC Systems, Pressure Machines, Flow Meters. Must be hands on and able to hit the ground running without extensive training - Sterile Finish is a plus Degree: No Degree needed... 

Floyd Lee Locums

Locum Tenens Nurse Anesthetist (CRNA) - $200 per hour Job at Floyd Lee Locums

 ...Floyd Lee Locums is seeking a CRNA Anesthesia for a locum tenens job in Pittsburgh, Pennsylvania. Job Description & Requirements ~ Specialty: Anesthesia ~ Discipline: CRNA ~ Duration: 13 weeks ~40 hours per week ~ Shift: 11 hours, days ~ Employment Type...