ML Engineer

About The Company

CreatorIQ is a leading operating system designed to facilitate creator‑led growth, trusted by over 1,300 global brands and agencies. Our mission is to make businesses more human and humans more impactful by providing a comprehensive platform that unifies creator marketing efforts across paid, owned, earned, commerce, and community channels into a seamless, enterprise‑grade ecosystem. Recognized for our innovation and excellence, CreatorIQ has earned numerous accolades, including being named a Fastest‑Growing Company in North America on the Deloitte Technology Fast 500™ for four consecutive years, and being rated as a Leader by G2 and IDC MarketScape. Our company operates with a flexible work model combining in‑person and remote work, fostering collaboration, innovation, and adaptability. Headquartered in Los Angeles, with offices in Austin, New York, San Francisco, London, Manila, and Warsaw, we are committed to building an inclusive environment that values diversity, equity, and inclusion.

About The Role

We are seeking a highly skilled and experienced Senior MLOps Engineer with a focus on Applied AI to join our Product Innovations team. In this pivotal role, you will serve as the technical lead for applied MLOps initiatives, bridging the gap between experimental data science and scalable, production‑ready solutions. Your primary responsibilities will include designing and implementing annotation and measurement pipelines, optimizing ground truth generation, and establishing evaluation criteria to benchmark models effectively. You will play a critical role in ensuring our model deployment processes are efficient, compliant, and robust. Collaborating closely with data scientists and engineering teams, you will help develop and integrate measurement loops within our cloud infrastructure, ensuring automation, observability, and cost efficiency. This role offers an exciting opportunity to influence the strategic direction of our AI and machine learning initiatives, ensuring that our products are innovative, scalable, and impactful.

Qualifications

• Deep experience in setting up annotation workstreams using tools such as Label Studio, Scale AI, or custom solutions
• Proven expertise in applied MLOps practices, including model monitoring, versioning, evaluation, and deployment in production environments
• Strong proficiency in Python programming, including scripting, API integration, and automation
• Solid understanding of model optimization trade-offs related to performance, latency, and cost
• Experience working within cloud environments such as AWS (Sagemaker, S3) and GCP (Vertex AI)
• Knowledge of data pipeline architecture and infrastructure automation
• Excellent collaboration and communication skills, with the ability to work effectively across teams
• Demonstrated ability to translate complex technical concepts into practical solutions
• Degree in Computer Science, Data Science, Engineering, or related field; advanced degrees preferred

Responsibilities

• Architect and implement annotation and measurement pipelines, including human‑in‑the‑loop and auto‑annotation workflows
• Establish confidence metrics and Inter‑Annotator Agreement (IAA) standards to ensure high‑quality ground truth data
• Create and maintain golden datasets for model benchmarking and evaluation
• Develop evaluation criteria and benchmarking processes to inform model selection and deployment decisions
• Implement applied MLOps standards, including model‑as‑a‑judge frameworks, deterministic PII scrubbing, and compliance protocols
• Collaborate with data science teams to develop strategies for generative AI models and optimize model performance
• Integrate measurement and evaluation loops into cloud infrastructure (AWS, GCP) to automate model lifecycle management
• Work closely with engineering teams to ensure seamless deployment, monitoring, and observability of models in production
• Continuously seek opportunities to improve cost‑efficiency, scalability, and robustness of AI systems

Benefits

• Opportunity to work with talented, collaborative, and passionate professionals
• Comprehensive onboarding and ongoing training via our dedicated learning platform
• Surprise meal stipends and support for remote work setup
• Work/life harmony benefits including 15 days of vacation, floating and set holidays, wellness allowance, and paid parental leave
• Whole health package covering medical, dental, vision, life, and disability insurance
• 401(k) plan (for U.S. employees) to support long-term financial planning
• Home office stipend to enhance your remote working environment

Equal Opportunity

CreatorIQ is committed to fostering an inclusive and equitable work environment where everyone can thrive. We celebrate diversity in all its forms and are dedicated to providing equal employment opportunities regardless of race, ethnicity, gender, sexual orientation, age, religion, disability, or any other characteristic protected by law. We believe that embracing our differences enhances our innovation, collaboration, and overall success. Join us in building a workplace where everyone feels valued, respected, and empowered to contribute their best.