Data Engineer

Greetings!

Iris’s leading financial client is looking for Data Engineer to join their team at Toronto, ON(Hybrid) location.

• Job Title: Data Engineer
• Location: Toronto, ON(Hybrid)
• Duration: Long Term

Job Description:

• Foundation & Feature Engineering: Lead the foundational setup of Python/PySpark development environments, actively managing complex package dependencies and virtual environments using Conda/Anaconda.
• Pipeline Development: Design, build, and deploy net-new data pipelines focused heavily on feature engineering and data preparation to feed downstream machine learning and analytics use cases.
• Code Translation: Analyze and reverse-engineer existing SAS programs (developed by business users and data scientists) to accurately extract business rules, data transformations, and calculations.
• Platform Modernization: Translate extracted SAS logic into efficient, scalable, and functionally equivalent PySpark code.
• Performance Tuning: Optimize PySpark code for performance, scalability, and maintainability within distributed data processing environments.
• Stakeholder Collaboration: Collaborate closely with business users and data scientists to clarify requirements, validate feature outputs, and resolve discrepancies during the migration process.
• Quality Assurance: Perform robust unit testing, data reconciliation, and automated validation to ensure absolute data parity between legacy SAS outputs and the new PySpark pipelines.
• Documentation: Document technical designs, code lineage, testing results, and migration methodologies for future team scaling.

• Required Qualifications
• 5+ years of hands-on experience in data engineering, data pipeline development, or building data platforms.
• Strong programming expertise in Python and PySpark for distributed data processing.
• Proven experience building data pipelines specifically for feature engineering, data curation, and advanced data preparation.
• Ability to read, interpret, and reverse-engineer legacy SAS code (such as SAS data steps, procedures, and macros) to extract complex business logic. (Note: Deep SAS development experience is a plus, but the ability to translate it is the core requirement).
• Experience establishing and managing Python environments, ensuring reproducibility, and handling library dependencies using Anaconda/Conda.
• Advanced SQL skills and experience working with large-scale structured datasets.
• Experience with code migration, platform modernization, or translating legacy codebases into modern open-source stacks.
• Strong analytical, problem-solving, and communication skills, with a track record of successfully interfacing directly with business stakeholders.

• About Iris Software Inc.
• With 4,000+ associates and offices in India, U.S.A. and Canada, Iris Software delivers technology services and solutions that help clients complete fast, far-reaching digital transformations and achieve their business goals. A strategic partner to Fortune 500 and other top companies in financial services and many other industries, Iris provides a value-driven approach - a unique blend of highly-skilled specialists, software engineering expertise, cutting-edge technology, and flexible engagement models. High customer satisfaction has translated into long-standing relationships and preferred-partner status with many of our clients, who rely on our 30+ years of technical and domain expertise to future-proof their enterprises. Associates of Iris work on mission-critical applications supported by a workplace culture that has won numerous awards in the last few years, including Certified Great Place to Work in India; Top 25 GPW in IT & IT-BPM; Ambition Box Best Place to Work, #3 in IT/ITES; and Top Workplace NJ-USA.