Senior Data Engineer

We're hiring on behalf of a Haystack partner!

The Role

• Build and support highly available data pipelines across batch/distributed and real-time processing to enable analytics at scale.
• Translate strategic needs into working solutions by partnering across teams to define requirements, implement data governance and retention practices, and improve standards and reliability.
• Drive operational excellence through automation, monitoring, documentation, performance analysis, and root-cause resolution.
• Design, develop, test, and support data pipelines that enable continuous data processing for data exploration, preparation, and real-time business analytics.

What You'll Need

• Bachelor’s degree in Computer Science, Management Information Systems, or related discipline.
• 2+ years of professional industry experience with software development.
• 5+ years working with SQL platforms.
• 2+ years working with (or strong exposure to) NoSQL platforms.
• 5+ years working with Spark and/or the Hadoop ecosystem (e.g., Hadoop, YARN, MapReduce, Pig, Hive).
• Proficiency in Java, Scala, or C#, plus strong debugging, troubleshooting, and performance tuning.

What's On Offer

• Contribute to building enterprise data services that power analytics and decision-making.
• Opportunity to work on real-time business analytics.
• Collaborate with cross-functional teams.

Apply via Haystack today!