Senior Data Engineer

• Senior Data Engineer
• New York, NY (Onsite - 5 Days/Week)

Overview

• Seeking a Senior Data Engineering Manager with 9-14 years of experience to lead data engineering initiatives for a large-scale financial data exchange platform. This role is 60% Data Engineering and 40% Python or Java Development.
• Must-Have Skills
• PySpark & Apache Spark
• AWS Glue ETL & AWS EMR
• Snowflake
• Python & Java
• AWS Cloud Infrastructure
• Data Structures & Algorithms
• Data Lake, ETL Pipelines
• Apache Airflow & Control-M
• Responsibilities
• Design and manage scalable ETL pipelines for Data Lake and Snowflake.
• Build data ingestion, transformation, and aggregation workflows.
• Automate reporting and analytics processes.
• Optimize large-scale data processing on AWS.
• Collaborate with cross-functional teams to ensure data quality and performance.