Mandatory
Build scalable and fault-tolerant streaming applications using Apache Spark Structured Streaming, AWS Flink, and Apache Kafka.

Role Summary
We are seeking an experienced Lead Streaming Data Engineer to design, develop, and lead the implementation of large-scale real-time data processing platforms. The ideal candidate should possess strong expertise in Apache Spark, AWS Flink, and Kafka Streaming, along with proficiency in Python or Java. The candidate will be responsible for technical leadership, architecture decisions, mentoring team members, and ensuring successful delivery of streaming data solutions.

Key Responsibilities
Lead the architecture, design, and implementation of real-time data processing pipelines.
Build scalable and fault-tolerant streaming applications using Apache Spark Structured Streaming, AWS Flink, and Apache Kafka.
Define technical standards, best practices, and coding guidelines for the team.
Collaborate with business stakeholders, architects, product owners, and engineering teams.
Optimize streaming applications for performance, reliability, scalability, and cost efficiency.
Drive solution design reviews, code reviews, and production readiness assessments.
Mentor and guide development teams across onshore and offshore locations.
Troubleshoot complex production issues and provide technical leadership during critical incidents.
Ensure adherence to security, governance, and compliance requirements

Lead Streaming Data Engineer

Similar Engineering Jobs