About The Role
We are building a hybrid data platform that bridges an on-premises big data cluster with Google Cloud Platform and we need an engineer who can own this integration end to end This role is central to establishing a repeatable production grade pattern for multitenant data platform architecture starting with GCP as the first cloud tenant on an existing on-prem Cloudera cluster You will configure the foundational infrastructure service accounts Iceberg table formats metadata catalog integration via Apache Gravitino and role based access controls

Key Responsibilities
Configure and provision the on-premises Cloudera cluster environment including service account creation role definitions and permission structures for multitenant access
Design and implement Apache Iceberg table structures optimized for hybrid on-prem cloud workloads
Integrate the Iceberg REST Catalog IRC with Apache Gravitino to establish a unified metadata layer across on-prem and GCP environments
Establish GCP as a production tenant on the existing on-prem Cloudera cluster validating the end-to-end architecture pattern
Define and enforce data access governance including role-based permissions and service account security policies across both environments
Drive the full lifecycle from environment setup through to production deployment
Publish comprehensive documentation and architectural blueprints covering cross platform interoperability best practices vendor recommendations and access patterns for hybrid data lake implementations

Experience in data platform engineering
Handson experience with Google Cloud Platform GCP
Experience with on-premises Cloudera big data clusters
Experience with Apache Iceberg table format
Experience with Iceberg REST Catalog IRC
Experience with Apache Gravitino for metadata catalog integration
Experience with service account creation and role-based access control in hybrid environments

GCP Data Platform Engineer

Similar Engineering Jobs