- Job Title: Ab Initio Data Engineer
- Location: Berkeley Heights, NJ (5 days onsite, flexible to support weekends)
- Type: Contract (C2C/W2)
- Interview Process: Video
- Experience Level: 7+ years ETL, 5+ years Ab Initio
- Job Description:
- Position Overview
- We are seeking Ab Initio Data Engineers to design and implement high‑performance, event‑driven data pipelines for a large credit card processing system. The role requires deep expertise in the Ab Initio ecosystem (GDE, EME, Conduct>It), strong SQL, and large‑volume data processing skills.
- Key Responsibilities
- Design, develop, and maintain complex ETL graphs using Ab Initio GDE
- Architect end‑to‑end data integration solutions across RDBMS, mainframe, flat files, message queues
- Optimize graph performance (parallelism, partitioning, layout tuning, checkpointing)
- Lead development using Ab Initio components: Co>Operating System, EME, Conduct>It, Data Profiler, Continuous Flows
- Own metadata management and data lineage within EME
- Design and implement CDC (Change Data Capture) and near‑real‑time pipelines
- Troubleshoot production job failures, perform RCA, and implement fixes with minimal downtime
- Define coding standards, review peer graphs, enforce best practices
- Mentor junior/mid‑level Ab Initio developers
- Collaborate with architects, DBAs, and analysts to translate requirements into technical design
- Required Qualifications
- Bachelor’s in Computer Science, Engineering, or related field
- 7+ years ETL development, 5+ years Ab Initio experience
- Strong hands‑on expertise with GDE, Co>Op, EME, Conduct>It
- Deep understanding of parallel processing, partitioning, MFS
- Strong SQL skills with DB2
- Experience with Unix/Linux shell scripting
- Solid understanding of data warehousing concepts (dimensional modeling, SCDs, star/snowflake schemas)
- Experience with Kafka
- Strong debugging and performance‑tuning skills
- Preferred Qualifications
- Experience with mainframe data integration (COBOL copybooks, VSAM, flat files)
- Exposure to Kubernetes, OpenShift
- Familiarity with Hadoop/Spark ecosystems and hybrid ETL architectures
- Knowledge of API‑based or streaming integration (Kafka)
- Prior experience as a technical lead or client‑facing architect
- Soft Skills / Leadership
- Strong analytical and problem‑solving skills
- Ability to lead design discussions and drive consensus
- Effective mentorship and knowledge‑sharing
- Clear communication with technical and business stakeholders
Mention you found this on Data First Jobs — it helps us bring you more roles like this.
Ab Initio Data Engineers – Berkeley Heights, NJ (Onsite, Contract)
Envision Technology Solutions
Similar Engineering Jobs
View all Engineering jobs→Dotmatics
Senior Data Analytics Engineer
New
RemoteRemote
JPC TECHNO INC
Machine Learning Engineer II- Premium
New
Phoenix, Arizona (USA)
Tata Consultancy Services
Power BI Developer
New
Toronto, Ontario (Canada)$100,000 - $120,000
Veolia | North America
Senior Mechanical Commissioning Engineer (Data Center)
New
Richmond, Virginia (USA)
Digital Biz Tech
BI Developer
New
Portsmouth, New Hampshire (USA)
Intuition IT – Intuitive Technology Recruitment
Data Engineer
New
Raleigh, North Carolina (USA)
Like this role? Get carefully selected jobs like it, twice a week, straight to your inbox.
Free, no spam. Unsubscribe anytime.