Data Engineer

We are working with a company that specialises in developing robust data engineering assets and migrating complex data systems, supporting analytics and reporting for critical business functions.

The Role

• Develop, test, and maintain ETL and data engineering pipelines for data ingestion and downstream analytics.
• Collaborate with stakeholders to translate business requirements into scalable, production-ready data pipelines.
• Build and maintain pipelines across AWS, Databricks, and Snowflake environments.
• Enhance existing legacy data engineering jobs as part of modernization and migration efforts.
• Create and maintain comprehensive technical documentation, specifications, and operational support materials.
• Troubleshoot pipeline issues, resolve defects, and ensure data job reliability within expected service levels.

What You'll Need

• Hands-on experience developing ETL, ELT, or data engineering pipelines in production environments.
• Strong experience with Databricks, Spark-based processing, and modern data pipeline development.
• Proficiency with AWS cloud services and Snowflake data platforms.
• Experience with infrastructure-as-code practices, specifically Terraform.
• Practical experience implementing CI/CD practices using Concourse, GitHub Actions, or similar tools.
• Ability to write clear technical specifications, documentation, and support materials.

What's On Offer

• Opportunity to support critical data modernization and migration initiatives.
• Collaborate with diverse teams including engineers, analysts, and reporting specialists.
• Engage in projects with significant impact on analytics and reporting capabilities.
• A role focused on developing and delivering core data assets.

Apply via Haystack today!