Databricks Data Engineer

Robert Half is partnering with a well-known brand seeking an experienced Data Engineer (Databricks focused)) that’s investing heavily in building out scalable data pipelines. This is a hands-on role focused on data transformation and modeling, not just maintaining reports or legacy ETL. You’d be partnering closely with business teams to drive analytics and decision-making within the financial service industry. This position requires deep knowledge and production experience within Databricks.

Responsibilities:

• Demonstrated production experience in Databricks.
• Develop and maintain data transformation workflows using Python and SQL
• Model and structure data to support analytics, reporting, and business intelligence use cases
• Partner with business stakeholders to translate requirements into technical data solutions
• Improve data quality, reliability, and performance across data pipelines
• Support integration of data from multiple internal and external sources
• Contribute to evolving best practices around data architecture, governance, and scalability
• Troubleshoot and resolve data issues, ensuring consistency and accuracy across environments
• Requirements:
• 2+ years production experience with Databricks (required).
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 4+ years of experience in data engineering or similar role
• Experience building data pipelines using Apache Spark / PySpark within Databricks
• Experience with Delta Lake, data lakes, and lakehouse architecture
• Python (data processing / ETL development)
• SQL (advanced querying, data modeling)
• Proven experience building end-to-end data pipelines
• Strong understanding of data modeling concepts
• Experience working with large datasets and distributed data systems
• Ability to work cross-functionally and communicate with non-technical stakeholders
• Databricks certified preferred.
• Other:
• Position is full time with full benefits
• Position is Hybrid with 2 days onsite in Irvine