GCP Data Engineer

Job Description

• Python, Pyspark, GCP, ETL - Big Data/Data Warehousing, Data Analytics, SQL, Git (GitHub, Git Lab, Bit Bucket, SVN)
• 5 years of hands-on software development experience with Big Data \& Analytics solutions GCP Cloud - Big Query, Airflow, DataProc, PubSub, Hadoop Hive, Spark, Python, shell scripting, Strong experience in designing, developing, and optimizing data pipelines for large-scale data processing, transformation, and analysis using Big Data and GCP technologies.
• Proficiency in SQL and database systems, with experience in designing and optimizing data models for performance and scalability.
• Experience of building event processing pipelines with Kafka or GCP PubSub.
• Design and development experience with Airflow, PubSub Kafka, Git, Jenkins is desirable. Knowledge of distributed (multi-tiered) systems, algorithms \& relational databases.
• Strong Object-Oriented Programming skills and design patterns.
• Experience with CICD pipelines, Automated test frameworks, and source code management tools (XLR, Jenkins, Git).
• established for Big Data Looks proactively beyond the obvious for continuous improvement opportunities.
• Communicates effectively with product and cross functional team. Willingness to learn new technologies and leverage them to their optimal potential. Understanding of various SDLC methodologies, familiarity with Agile \& scrum ceremonies.
• Certifications in cloud platform (GCP Professional Data Engineer) is a plus.