Data Engineer II

About The Company

Our company is a leading innovator in data solutions, dedicated to transforming complex data into actionable insights for a diverse range of industries. We focus on leveraging cutting-edge technologies and methodologies to build scalable, reliable, and secure data infrastructures that empower organizations to make informed decisions. Our commitment to excellence, continuous learning, and fostering a collaborative environment positions us as a top choice for professionals seeking growth in the data engineering domain.

About The Role

The Data Engineer II role is a vital technical position responsible for designing, developing, and maintaining robust data infrastructure and pipelines that support seamless data integration, transformation, and analysis. This role requires a proactive individual with strong expertise in cloud-based data storage, data modeling, and pipeline automation. The successful candidate will collaborate with cross-functional teams to optimize data workflows, ensure data quality and governance, and implement scalable solutions aligned with business objectives. As part of the data services team, you will be instrumental in improving the efficiency and reliability of our data systems, contributing to strategic initiatives, and mentoring junior team members. This position offers flexibility regarding full-time or part-time engagement, with a competitive salary package commensurate with experience and expertise.

Qualifications

• Proficiency in Python and SQL for data processing and query optimization
• Experience with PySpark and additional languages such as Scala, Java, or Bash
• Strong knowledge of relational databases (PostgreSQL, MySQL, Oracle)
• Experience with modern data warehouses (Snowflake, Amazon Redshift, Google BigQuery)
• Familiarity with data lakes (Amazon S3, Azure Data Lake) and lakehouse architectures (Delta Lake, Apache Iceberg)
• Hands-on experience with Apache Spark, Databricks, and real-time data streaming tools like Kafka
• Experience with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform
• Understanding of data governance frameworks, compliance standards (GDPR, HIPAA), and related tools
• Knowledge of pipeline monitoring tools such as Apache Airflow
• Strong problem-solving skills and the ability to troubleshoot complex technical issues
• Experience with version control systems like Git and DevOps practices for CI/CD pipelines
• Excellent communication and collaboration skills

Responsibilities

• Design and develop database schemas for complex data models, optimizing for query performance and scalability
• Implement and maintain automated data validation and quality checks to ensure data integrity and accuracy
• Collaborate with cross-functional teams to maintain data consistency and enforce data governance policies
• Develop, optimize, and automate scalable ETL workflows to integrate diverse data sources efficiently
• Create and refine data transformation processes to enhance data usability for analytical purposes
• Build and monitor data pipelines for continuous data flow, ensuring high availability and reliability
• Optimize query performance and resource utilization within cloud data warehouses and lakes
• Conduct root cause analysis for pipeline failures and implement corrective actions
• Write complex, modular, and efficient SQL and Python scripts for data processing tasks
• Maintain version control and automate deployment processes to ensure seamless updates and releases
• Evaluate new tools and technologies to improve workflow efficiency and data system performance
• Apply data governance and security best practices across all data systems and workflows
• Proactively identify and implement security enhancements to protect sensitive data

Benefits

• Paid holidays and paid time off
• Employer-sponsored retirement contributions
• Health Savings Account contributions
• Comprehensive health, vision, and dental insurance coverage
• Profit sharing and annual bonuses based on company performance
• Flexible work arrangements, including remote work options
• Access to professional development and training programs
• Life insurance, short-term and long-term disability insurance
• Employee assistance programs to support mental and emotional well-being

Equal Opportunity

Our company is committed to fostering an inclusive environment and is proud to be an equal opportunity employer. We do not discriminate based on race, color, religion, gender, gender identity or expression, sexual orientation, national origin, age, disability, or any other protected status. We believe diversity drives innovation and are dedicated to providing equal employment opportunities to all qualified candidates.