Hadoop and PySpark Data Engineer

• Role: Hadoop and PySpark Data Engineer
• Location: Charlotte, NC, Jacksonville, FL, Jersey City, NJ, Newark, DE, Plano, TX(Hybrid)
• Full Time
• Job Description
• In the assigned Job Role of Technology Consultant 2, your Area Of Responsibility will be as below:

• ⦁ Contribute to the requirements elicitation process by documenting assigned parts of business requirements, in line with guidance provided
• ⦁ Facilitate software application design discussions, and document design decisions to guide the technical team towards building software solutions
• ⦁ Participate in coding and integrate new features or updates into existing applications, with a focus on maintaining system stability
• ⦁ Conduct code reviews, do changes to the codebase and maintain code repositories
• ⦁ Implement test strategies, analyse results, and coordinate bug fixes to uphold the software quality standards
• ⦁ Develop user training programs, documentation, and support frameworks to ensure a smooth transition to new software applications
• ⦁ Actively participate in resolving production issues and recommend preventive strategies to enhance system reliability
• ⦁ Maintain detailed records of code, testing techniques, and support activities to enrich the knowledge base and assist other similar projects

Your contribution to the team:

• ⦁ A collaborative spirit and excellent communication skills.
• ⦁ The ability to handle end to end SDLC phases from requirement gathering to implementation.
• ⦁ A knack for translating complex requirements into actionable development tasks.
• ⦁ A passion for design and hands-on coding experience
• ⦁ A proactive approach to testing, troubleshooting, and refining our applications.
• ⦁ The ability to work with cross-functional teams and do software integration.
• Required Skill and Experience
• Experience in data warehousing architectural approaches.
• Sound understanding and experience with Hadoop ecosystem (Cloudera).
• Experience in working with a Big Data implementation in production environment.
• Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting.
• Experience in orchestration tool like Autosys, Airflow.
• Sound knowledge of relational databases (SQL) and experience with large SQL based systems.
• Understanding of Agile methodologies and technologies
• Preferred Skill and Experience
• Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.
• Knowledge and experience with Cloud and containerization technologies
• Experience with data visualization tools like Tableau"
• Additional Details
• Estimated annual compensation range for candidate based in the Jersey City, NJ will be $82,419 to $126,600
• EEO/About Us
• Benefits
• Along with competitive pay, as a full-time employee you are also eligible for the following benefits:
• Medical/Dental/Vision/Life Insurance
• Long-term/Short-term Disability
• Health and Dependent Care Reimbursement Accounts
• Insurance (Accident, Critical Illness , Hospital Indemnity, Legal)
• 401(k) plan and contributions depend