Senior Data Engineer

• Senior Data Engineer (Orlando, FL)
• Optomi, in partnership with a leading organization in the entertainment industry, is looking for an experienced Senior Data Engineer to join their team! The Senior Data Engineer will design, develop, enhance, and implement systems for multiple analytical applications. This role will involve maintaining and enhancing data acquisition processes, data validation processes, ETL/ELT data pipelines, and overall process notification methods. The Senior Data Engineer will participate in data requirements gathering, source-to-target mapping, data validation scripting and review, developing and monitoring ETL/ELT data pipelines, and producing datasets as input to science models and visualizations.

What the right candidate will enjoy:

• Working on-site in a collaborative environment Monday through Thursday!
• Opportunity for contract extension beyond the initial 10 months!
• Exposure to cutting-edge technologies like Snowflake, Python, and Apache Flink!
• Being part of a dynamic data engineering team focused on quality deliverables!

Experience of the right candidate have:

• 5+ years of experience with ELT/ETL development using SQL and Python.
• 2+ years of experience with frameworks such as Apache Flink, Beam, or Kafka Streams.
• Strong understanding of database design and experience with platforms like PostgreSQL or Snowflake.
• Experience in a multi-environment DevOps setup, including code promotion and management.
• Proficiency in source control tools like GitLab or GitHub.
• Knowledge of cloud-based big data technologies such as Snowflake or Databricks.
• Experience with Infrastructure as Code, Docker, Kubernetes, and AWS.

Responsibilites of the right candidate:

• Design, develop, and maintain systems for multiple analytical applications.
• Enhance data acquisition, validation, and pipeline processes.
• Participate in data requirements gathering, source-to-target mapping, and data validation scripting.
• Monitor and maintain ETL/ELT pipelines and produce datasets for science models and visualizations.
• Communicate progress to project leadership and participate in technical reviews to ensure quality deliverables.
• Apply business domain knowledge to assigned deliverables.