🚀 Sr. Data Platform Engineer
📍 Location: Hybrid – Minneapolis, MN
💼 Job Type: Contract
🌟 Overview
We are seeking a highly skilled Sr. Data Platform Engineer to join a cutting-edge Azure Data Analytics Platform team. This role focuses on building, optimizing, and supporting enterprise-scale data ingestion pipelines, metadata-driven frameworks, and cloud-native analytics solutions.
The ideal candidate will have extensive hands-on experience with Azure Synapse Analytics, PySpark, T-SQL, Azure Data Lake (ADLS Gen2), Azure SQL Database, Azure DevOps CI/CD, and Delta Lake, along with a proven track record of designing, deploying, and supporting production-grade data engineering solutions.
This is an excellent opportunity for a senior engineer who enjoys solving complex data engineering challenges, optimizing large-scale data platforms, and working across the full data lifecycle in Azure.

📩 Interested candidates? Send me your updated resume or connect with me to learn more! - [email protected]
🛠️ Key Responsibilities📥 Source Onboarding
Design and develop metadata-driven ingestion pipelines for REST APIs, SFTP, network file shares, vendor exports, and telemetry feeds.
Build scalable data ingestion solutions using Azure Synapse Pipelines and PySpark notebooks.
Land raw data into Azure Data Lake Storage Gen2 (ADLS Gen2) and promote data through Bronze, Silver, and Gold (Medallion) layers.
🗄️ Data Engineering & Data Products
Develop Delta Lake tables and Serverless SQL Views supporting analytics and downstream applications.
Implement business rules and data transformations for curated enterprise datasets.
Build reusable, scalable, and high-performance data engineering solutions.
🐍 Python & Azure Container Apps
Develop and maintain containerized Python extraction jobs.
Implement API integrations using managed identities.
Build structured logging and monitoring capabilities.
Support YAML-based CI/CD deployments.
🔍 Troubleshooting & Optimization
Investigate pipeline failures, Spark execution issues, data quality problems, and performance bottlenecks.
Perform root cause analysis and implement long-term fixes.
Optimize Spark jobs, SQL queries, and incremental loading strategies.
⚙️ Platform Enhancement
Improve shared metadata-driven orchestration frameworks.
Refactor reusable Synapse notebook libraries.
Enhance enterprise data platform capabilities and automation.
✅ Required Qualifications
✔️ 5+ years of hands-on Data Engineering experience
✔️ Strong production experience with:
Azure Synapse Analytics
PySpark
T-SQL
Azure Data Lake Storage Gen2 (ADLS Gen2)
Azure SQL Database
Delta Lake
Serverless SQL Pools
Azure DevOps
✔️ Experience building and supporting production data pipelines
✔️ Performance tuning of Spark and SQL workloads
✔️ Metadata-driven pipeline development
✔️ Production deployment and CI/CD experience
✔️ Strong debugging and troubleshooting skills
✔️ Excellent communication and collaboration skills
⭐ Preferred Qualifications
➕ Azure Data Explorer (KQL)
➕ Azure Container Apps
➕ Docker
➕ Logic Apps
➕ Infrastructure as Code (Bicep)
➕ Power BI (DirectQuery)
➕ Azure Data Engineer Associate Certification
➕ Azure Solutions Architect Certification
➕ Experience working in Government, Aviation, Transportation, Utilities, or other regulated industries

Data Platform Engineer - Minnesota Local H1, GC and USC (W2 role)

Similar Engineering Jobs

Senior Machine Learning Engineer, ML Efficiency

Data Platform Engineer

Construction Manager - Data Center Design, Engineering, & Construction

Data Developer

ML Engineer (Coding Agent Experience) (Train AI Models Part Time!)

Data Engineer with Data Mining & Python || W2 Only || Remote