Role Summary
Seeking a Technology Lead – Azure Data Factory (ADF) & Azure Databricks Operations with 8–10+ years of data operations experience for a 6-month contract in Philadelphia, PA (local candidates highly preferred; relocation accepted if ready by Day 1).
The lead will oversee onshore data operations across the Azure data platform, act as the escalation owner for P1/P2 incidents, and drive EDWH/BI pipeline reliability.
Key responsibilities include troubleshooting Databricks job and pipeline failures, root cause analysis, developing Runbooks/SOPs, managing SLAs, and leading incident/change coordination. Note: Virtual interview process.

Key Responsibilities
* Data Platform Operations & Escalations: Lead onshore Azure data platform operations, serving as primary escalation owner for P1/P2 incidents, security compliance, and change coordination.
* Pipeline & Databricks Troubleshooting: Analyze and resolve Databricks job/pipeline failures, perform deep root cause analysis (RCA), and maintain high system availability/MTTR targets.
* Incident, Problem & Change Management: Oversee queue management, backlog prioritization, ServiceNow change requests, and release management across enterprise EDWH/BI workloads.
* Operations Governance & SOPs: Develop, update, and maintain Runbooks, SOPs, and operational metrics reporting for continuous service improvement.
* Cross-Functional Leadership: Coordinate across multi-disciplinary engineering, business, and operations teams to streamline enterprise data integration workflows.

Required Skills
* Core Experience: 8–10+ years of experience in data operations with a dedicated focus on Azure Databricks, Enterprise Data Warehousing (EDWH), and Business Intelligence (BI).
* Azure Integration Stack: Strong hands-on experience with Azure Data Factory (ADF), Databricks pipeline operations, execution troubleshooting, and monitoring.
* Operational Excellence: Demonstrated expertise in Root Cause Analysis (RCA), Runbook/SOP creation, SLA management, and P1/P2 incident resolution.
* Education & Certifications: 6+ minimum years required; relevant Azure Data Engineer or Databricks certifications preferred.

Azure Databricks Consultant with Azure Data Factory

Similar Other Jobs