ETL SDET

• Job Title: ETL SDET
• Location: Halifax, Canada
• Job Type: Contract

Job Description :

Work Experience: 7-10 Years

• The SDET (Software Development Engineer in Test) is responsible for ensuring the quality and reliability of ETL processes and data integration workflows.
• This role involves designing and implementing automated tests to validate data transformation and migration, as well as collaborating with data engineers and developers to identify and resolve data quality issues.
• The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity.

Minimum Qualification: At least 8 years of IT experience with minimum 5 years of experience in below skills:

Tech Skills:

• Proficiency in ETL Testing and developing automation framework & testcases in at least one scripting language.
• Strong SQL skills, with experience in handling big data using ETL tools (e.g. Informatica).
• Mandatory work experience with PySpark.
• Testing experience in cloud environment (AWS) S3, SSS, Glue, EMR, Data Catalog, Crawler, SQS, ETL Jobs, Event Bridge.
• Athena, Redshift Spectrum Databases.? AWS Commands for running the jobs, file process, and movements.
• Experience with Test Automation and DevOps practices in ETL and Cloud Systems.
• Work experience in a Big Data ecosystem processing data in data lakehouse.
• Experience providing testing oversight in the Agile team.
• Hands-on experience in large-scale test data generation, preparation, validation, and reconciliation, including working with Big Data and high-volume datasets across complex testing scenarios.
• Should have excellent business communication to interact with Business teams and cross-functional teams.

Responsibilities:

• Review requirements, specifications, and technical design documents to understand and feedback.
• Experience in developing and implementing test strategies for complex initiatives.
• Estimate, prioritize, plan and coordinate testing activities.
• Create an automation test framework.
• Design, develop and execute automation scripts.
• Identify, record, document thoroughly and track bugs.
• Strong problem-solving skills, troubleshooting, and root cause analysis skills.
• Perform thorough regression testing when bugs are resolved.
• Develop and apply testing processes for new and existing features to meet client needs.
• Liaise with cross functional teams to identify system requirements.