Senior Data Engineer

Job Summary Senior Data Engineer

• Design, build, and maintain data pipelines for extracting, transforming, and loading data using medallion architecture (Bronze/Silver/Gold layers).
• Collaborate with Power BI Developers to ensure data is structured, documented, and accessible for analytics and reporting.
• Establish AWS S3 data lake architecture and configure with appropriate security controls.
• Develop data pipelines to integrate data from SaaS-based HSE systems, MES via REST API, and other sources.
• Implement Change Data Capture (CDC) pipelines using AWS DMS or Azure Data Factory.
• Build and enhance data transformations (Bronze-to-Silver, Silver-to-Gold) using AWS Glue or Azure Data Factory.
• Configure AWS Glue Data Catalog with metadata and security tags.
• Connect to enterprise reference data sources and build batch-centric data products.
• Implement data quality checks, monitoring dashboards, and orchestration workflows (e.g., AWS Step Functions).
• Document data lineage, schema, and pipeline architecture for transparency and compliance.
• Monitor data pipeline health, troubleshoot issues, and optimize performance.
• Support data governance, security compliance reviews, and adhere to data sharing standards.
• Respond to ad-hoc data requests and collaborate with Power BI Developers on model requirements and data quality.
• Required technical skills: Python, SQL (Expert); AWS S3/Data Lake, PySpark/AWS Glue, Parquet (Advanced); AWS Lambda, DMS/CDC, REST API, Git, Databricks, Microsoft Fabric, Data Products (Intermediate).
• Preferred: GMP experience.
• Location: 50% onsite in Indianapolis, IN; local travel expenses covered.

Experience: 10-11 years overall, 8+ years as Data Engineer.