Forward Deployed Machine Learning Engineer

This is a Fully Remote Job

About Our Client:

Our client operates in the AI data infrastructure sector, focusing on creating a secure marketplace and data lab for high-quality model-training data. The organization addresses challenges related to licensing sensitive, real-world datasets to vetted AI teams while ensuring governance, privacy, intellectual property, and security protections. It has secured $65 million in funding, including a $55 million Series A round, employs around 80 people, and is experiencing rapid growth after meeting its annual targets ahead of schedule.

About the Opportunity:

The FORWARD DEPLOYED MACHINE LEARNING ENGINEER role is the first dedicated position within the Benchmarks and Evaluations vertical. This role partners with leadership, researchers, and early enterprise customers to establish the technical foundation for evaluating foundation models across various domains and modalities. It combines hands-on machine learning evaluation, backend infrastructure development, and customer-facing delivery, offering a high level of ownership and impact within the organization.

Responsibilities:

• Define, design, and build production benchmarks and evaluations with customers and internal researchers.
• Develop and maintain backend infrastructure including data pipelines, execution environments, storage, and orchestration.
• Create sandboxed environments for agentic evaluations involving tools, code execution, and multi-step tasks.
• Manage engineering aspects of customer engagements from technical scoping through to production delivery.
• Identify repeatable evaluation patterns and infrastructure gaps to develop scalable products.
• Navigate ambiguity effectively with strong technical judgment and clear written communication.

Requirements:

• Minimum of 4 years of engineering experience, including hands-on machine learning model evaluation.
• Proven experience deploying end-to-end ML evaluation or benchmark systems to production under tight customer timelines.
• Strong knowledge of ML evaluation frameworks and benchmark design, including methods like LLM-as-judge.
• Experience managing backend and infrastructure systems such as large-scale data pipelines, execution environments, storage, and orchestration.
• Customer-facing engineering experience managing enterprise stakeholders.
• Degree in computer science, physics, or a related technical field.
• Unrestricted U.S. work authorization without visa sponsorship.

Pay Range and Compensation Package:

• $170K-$270K base salary.
• Competitive equity.

Benefits & Perks:

Comprehensive benefits provided by a well-capitalized, high-growth company.

Equal Opportunity Statement: Our client is an equal opportunity employer. They celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, or national origin.

Note:

TalentHop is a recruitment partner of this role. Please note that all employment decisions, including candidate assessment, interviews, hiring, compensation, and employment terms, are made exclusively by the hiring employer.