We are looking for an experienced Data Engineer with strong expertise in real-time data processing, Kafka, Flink, Python/PySpark, and GCP.
🔹 Key Responsibilities
• Design and implement scalable data engineering solutions
• Build and maintain real-time streaming pipelines using Apache Kafka & Apache Flink
• Develop data processing solutions using Python & PySpark
• Work with databases including Oracle, MySQL, MSSQL & MongoDB
• Develop solutions using SQL, Stored Procedures & Data Modeling
• Build and optimize data platforms on GCP
• Support automation, reliability, monitoring, and operational improvements
• Collaborate with internal teams and stakeholders to deliver data solutions
🔹 Required Skills
✅ Apache Kafka & Apache Flink
✅ Python & PySpark
✅ SQL & Data Modeling
✅ GCP – BigQuery, Cloud Storage, Dataflow, Dataproc
✅ Oracle / MySQL / MSSQL / MongoDB
✅ Terraform
✅ Iceberg / Hudi / Delta
✅ Data Analytics & Big Data technologies
⭐ Nice to Have
• AWS – DMS, Glue, Athena, Textract
• Presto & Query Optimization
• Jenkins, Jira & Confluence
• Palantir Foundry
• Linux / RHEL / CentOS scripting
• Statistics / NumPy / PyMC3

Data Engineer – Kafka | GCP

Similar Engineering Jobs