We are seeking a Data Scientist / ML Engineer to migrate and modernize Dataiku (DSS) data science and ML workflows to Databricks, focusing on scalable data pipelines, ML lifecycle management, and MLOps.
Key Responsibilities:
Migrate Dataiku projects, recipes, scenarios, and models to Databricks.
Rebuild data pipelines, feature engineering, model training, and scoring workflows using Databricks, Spark/PySpark, Python, and SQL.
Develop scalable Lakehouse, Delta Lake, and ML pipelines.
Implement MLflow for experiment tracking, model registry, and deployment.
Implement CI/CD, automated retraining, monitoring, and data quality practices.
Optimize distributed processing for performance and cost.
Collaborate with Data Scientists, Data Engineers, and platform teams; document and provide knowledge transfer.
Required Skills:
5+ years Data Science / Analytics / ML Engineering.
Strong hands-on experience with Dataiku DSS and Databricks.
Strong Python, PySpark, SQL, and Apache Spark skills.
Experience with MLflow / MLOps and data/ML platform migration.
Experience with AWS, Azure, or GCP.
Preferred:
Delta Lake, Feature Stores, Streaming
Git, GitHub, CI/CD, Azure DevOps
Airflow / Databricks Workflows
Data governance, security, and enterprise data platforms

Data Scientist

Similar Data Science Jobs