Lead Data Engineer

Lead Data Engineer

• Join a forward-thinking organization at the forefront of data innovation, where your expertise will directly impact business growth and technological advancement. As a Lead Data Engineer, you will spearhead the design, development, and optimization of scalable data pipelines and ETL/ELT workflows, utilizing cutting-edge technologies such as Azure Databricks, PySpark, SQL, and Delta Lake. Lead a talented team of data engineers, mentor best practices, and develop secure, high-quality data solutions to meet complex organizational needs. This is an exceptional opportunity to work within a company that values innovation, growth, and career development, providing a vibrant environment to elevate your skills and make a tangible impact.
• Required Skills:
• Extensive experience with Azure Databricks platform (3+ years)
• Strong proficiency in Python, PySpark, SQL, and Delta Lake
• Proven ability to lead and mentor data engineering teams
• Deep understanding of data warehouse analysis, data modeling, and ETL/ELT development
• Knowledge of security and governance best practices utilizing Unity Catalog, Azure RBAC, and data access controls
• Nice to Have Skills:
• Experience with Power BI and MicroStrategy architecture
• Certifications such as Databricks Data Engineer Professional or Associate
• Strong background in data security, compliance, and governance
• Familiarity with automation and CI/CD pipelines using Azure DevOps, Git, and Terraform
• Experience with migrating legacy data to modern platforms
• Preferred Education and Experience:
• Bachelor’s degree in computer science, information systems, or a related field
• Minimum of 5 years of professional experience in data warehousing and data pipeline development
• Other Requirements:
• Ability to work onsite at the corporate location
• Willingness to travel up to 20% via airplane or vehicle
• Excellent communication skills—verbal and written
• Capable of working in fast-paced environments and adapting to changing priorities
• Eager to lead innovative data initiatives and shape the future of data engineering? Apply now and become part of a company dedicated to growth, learning, and making a difference through data excellence.
• Associate Staffing is an Equal Opportunity Employer and does not discriminate against any employee or applicant for employment based on race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity, or any other protected status under applicable law. We are committed to creating a diverse and inclusive work environment and welcome applicants from all backgrounds to apply for open positions with our company.