Data First Jobs

Haystack

Principal Machine Learning Engineer

Full Time · In Office · USA

Posted Jul 25, 2026

Work Options
Job Type
Position Group

We're working with a leading technology firm at the forefront of artificial intelligence innovation, developing cutting-edge machine learning solutions that redefine industry standards. This company prides itself on pushing the boundaries of AI, creating impactful products that influence a wide range of applications and industries.

The Role

  • Design and evolve critical large-scale ML systems across training, inference, evaluation, and infrastructure
  • Set technical standards and shape ML system development across the organization
  • Architect and build large-scale ML systems spanning data, training, evaluation, inference, and deployment
  • Design reproducible, high-performance training pipelines on GPU infrastructure
  • Implement evaluation pipelines for performance, robustness, safety, and bias
  • Own production deployment and collaborate with application engineering for ML system integration

What You'll Need

  • Strong background in deep learning and transformer-based architectures
  • Artificial Intelligence (AI) experience is required
  • Hands-on experience training, fine-tuning, or deploying large-scale ML models in production
  • Proficiency with at least one modern ML framework (e.g., PyTorch, JAX)
  • Experience with distributed training and inference frameworks
  • Strong software engineering fundamentals and experience with GPU optimization

What's On Offer

  • Comprehensive medical, dental, and vision insurance
  • Savings plan options
  • Generous paid time off (PTO)
  • Opportunity to work 100% remotely

Apply via Haystack today!

Mention you found this on Data First Jobs — it helps us bring you more roles like this.

Principal Machine Learning Engineer

Haystack

Like this role? Get carefully selected jobs like it, twice a week, straight to your inbox.

Free, no spam. Unsubscribe anytime.