Senior Data Engineer

Job Summary

We are seeking a highly experienced and hands-on Senior Data Engineer to join our Data Engineering teams. You will play a key role in supplementing existing capacity, upgrading our data architecture, and ensuring the highest quality, performance, and cost-efficiency of our data platforms. The work is focused on critical deliverables for personal investment, personal wealth, and comprehensive data analytics, while preparing the platform for a larger strategic move in the future.

location: Malvern, Pennsylvania

job type: Solutions

salary: $66.40 - 71.40 per hour

work hours: 8am to 5pm

education: Bachelors

Responsibilities

• Design, build, and maintain high-performance ETL/ELT data pipelines using Python and PySpark.
• Apply expert-level coding skills to develop and manage data processing jobs leveraging PySpark for distributed computing across large-scale datasets.
• Take full ownership of the data workflow, including getting data from multiple sources, scrubbing, and validating data to ensure the highest quality.
• Write and optimize complex, performant SQL queries for data extraction, integrity checks, and performance tuning.
• Contribute to platform modernization by exploring and increasing the adoption of AI/ML, including using tools like Copilot and Claude for acceleration, and building models to fill data gaps or improve systems.
• Collaborate with data architects by proposing ideas and great questions, taking ownership as the expert on data, pipelines, and systems.
• Implement DevOps practices for the automated deployment and orchestration of Python applications and data pipelines (e.g., using Docker, Jenkins, Terraform).
• Hands on experience with SQL and complex performance tuning.

Qualifications

Programming: Expert-level proficiency in Python, including libraries like Pandas and NumPy.

Designing: Designing data pipelines for the data coming from multiple sources

Data Processing: Solid hands-on experience with PySpark for building scalable data workflows

Data Querying: Expert-level knowledge of writing complex SQL queries (Oracle or Snowflake), with proven ability to perform performance tuning on large datasets and complex database code.

Cloud Platform: Robust experience with AWS cloud services and associated data services, specifically:

AWS Glue (ETL)

S3

Lambda

Redshift

DynamoDB, Athena, ECS, EventBridge, OpenSearch, RDS

ETL & Data Management: Robust proficiency in ETL/ELT methodologies and tools, as well as Data Quality, Data Validation, and Anomaly Detection techniques.

Scripting: Working experience with scripting and automation using Unix and Python.

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact [email protected].

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.

Any consideration of a background check would be an individualized assessment based on the applicant or employee's specific record and the duties and requirements of the specific job.