Principal Data Engineer for Databricks

Avanciers Incorporated is hiring a Principal Data Engineer for Databricks for one of our clients.

Role: Principal Data Engineer for Databricks

Location: Warren, NJ (2-3 days in-office)

Contract

Exp. Needed 12+ Years

Job ID: AV28559

Jd

• Lead the architecture and delivery of scalable enterprise data platforms using Azure Databricks, Delta Lake, Unity Catalog, and Lakehouse architecture.
• Design and optimize batch and real-time data pipelines using Apache Spark/PySpark or Scala, advanced SQL, and ETL/ELT frameworks.
• Leverage Azure Data Factory, ADLS Gen2, Synapse Analytics, Key Vault, Azure Monitor, and Log Analytics for secure and reliable data solutions.
• Establish CI/CD, coding standards, data governance, security, lineage, quality, performance, and cost-optimization practices using Azure DevOps.
• Provide technical leadership, mentoring, stakeholder collaboration, and roadmap development across engineering, architecture, analytics, and data science teams.

Our Commitment to Diversity and Inclusion

Avanciers Incorporated is an equal opportunity employer committed to creating an inclusive and accessible workplace. We welcome applications from all qualified individuals regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, or any other protected characteristic. We are committed to providing accessible employment practices that comply with the Accessibility for Ontarians with Disabilities Act (AODA).

Important Information for Applicants

• Only candidates selected for an interview will be contacted
• Proof of qualifications may be requested
• Background checks may be conducted as part of the hiring process

Avanciers Incorporated thanks all applicants for their interest; however, only those selected for an interview will be contacted.

Avanciers Incorporated

Follow us on LinkedIn