ETL Testing

Hello All,

Greetings from Tesslogs!

We are seeking an experienced ETL Testing (Data Engineer) with strong expertise in Data Validation, ETL Testing, AWS Cloud, Databricks, Python, and SQL.

• Client: Infosys
• Exp: 5 years
• Notice period: Immediate
• Location: New York City

• Key Responsibilities
• Develop and maintain automated testing solutions for ETL pipelines and cloud data migration.
• Validate data integrity, transformation logic, and ETL processes during migration to AWS and Databricks.
• Collaborate with Product Owners, Solution Architects, Developers, QA Engineers, and Scrum Masters to define and execute test strategies.
• Design and implement test automation integrated with DevOps/CI/CD pipelines.
• Support DevSecOps initiatives by automating unit, integration, and system testing.
• Create reusable automation frameworks for data validation and regression testing.
• Analyze and troubleshoot complex data quality issues and identify root causes.
• Execute SQL-based data validation and reconciliation across source and target systems.
• Promote quality engineering best practices and continuous improvement across the SDLC.
• Contribute to development activities and support cross-functional engineering initiatives.
• Required Skills & Experience
• Strong experience in ETL Testing and Data Engineering.
• Expertise in SQL, relational databases, and data validation techniques.
• Hands-on experience with Python and automated testing frameworks.
• Working knowledge of PySpark and Databricks.
• Experience in data profiling, data mapping, and data integration.
• Experience developing automation for data pipelines.
• Strong knowledge of GitHub and CI/CD implementation.
• Experience with AWS Cloud services including:
• Amazon S3
• Amazon RDS
• AWS Lambda
• Amazon SQS
• Amazon SNS
• Amazon MSK (Managed Streaming for Apache Kafka)
• Experience testing REST APIs using Postman.
• Strong analytical and problem-solving skills.
• Preferred Skills
• Experience working in Agile/Scrum environments.
• Knowledge of DevOps and DevSecOps practices.
• Experience with cloud migration and modernization projects.
• Ability to collaborate effectively with cross-functional teams.

• Best Regards,
• Gahana
• [email protected]