Data First Jobs

Haystack

ML Engineer

Full Time · In Office · New York, New York (USA)

Posted Aug 30, 2026

Work Options
Skills
Job Type
Position Group

We're hiring on behalf of a Haystack partner!

  • The Role
  • • Architect and lead the delivery of production-grade AI systems leveraging agentic frameworks, RAG, and LLM orchestration.
  • • Own the technical vision for a multi-agent ecosystem, including pipeline orchestration engines, embedding/vectorization strategies, and knowledge retrieval systems.
  • • Lead a team of engineers in building autonomous AI pipelines for complex document processing.
  • • Drive build-vs-buy decisions for the AI toolchain and establish scalable prompt engineering patterns.
  • • Implement core agentic components and build embedding pipelines for document intelligence.
  • • Own CI/CD pipelines, containerized deployments, and define observability for AI systems.
  • What You'll Need
  • • Bachelor's or advanced degree in computer science, engineering, or equivalent experience.
  • • 10+ years of professional software engineering experience, with 3+ years in technical leadership or mentoring.
  • • Deep expertise in LLM orchestration, RAG architectures, and agentic patterns.
  • • Strong proficiency in Python (FastAPI, async/await) and solid experience with Java (Spring Boot).
  • • Proven experience in delivering production AI systems with robust observability and error recovery.
  • • Experience with document intelligence, including NLP and structured extraction from unstructured text.
  • What's On Offer
  • • Competitive salary
  • • Opportunity to build custom agent frameworks and contribute to greenfield AI initiatives.
  • • Lead and mentor a talented team of AI/ML, backend, and full-stack engineers.
  • • Work with cutting-edge AI technologies in a leading global financial services company.

Apply via Haystack today!

Mention you found this on Data First Jobs — it helps us bring you more roles like this.

ML Engineer

Haystack

Like this role? Get carefully selected jobs like it, twice a week, straight to your inbox.

Free, no spam. Unsubscribe anytime.