Senior GCP Data Consultant – BigQuery & Airflow

Keyhole Software is hiring Senior GCP Data Engineers with strong experience in BigQuery, Apache Airflow, and cloud-based data pipelines to support a long-term enterprise healthcare client engagement. This consulting role is ideal for experienced data engineers who can quickly learn an established environment, independently implement complex data pipelines and loading logic, and contribute thoughtful design recommendations when needed.

• Title: Senior GCP Data Engineer Consultant
• Location: Remote within the United States
• Eligibility: Candidates must be authorized to work and reside in the United States. No Corp-to-Corp (C2C) or Contract-to-Hire (C2H). At this time, Keyhole Software is unable to provide visa sponsorship.

• About the Role
• Keyhole Software is seeking experienced Senior GCP Data Engineers to join our team. Our consultants are full-time members of Keyhole Software, working across a variety of long-term client engagements throughout their careers.

For this engagement, you’ll join a client-led engineering initiative focused on complex data migration, extraction, transformation, and loading. You’ll work within established architectural patterns while bringing the experience and judgment to independently design solutions, navigate complex table structures and business rules, and improve implementation approaches when appropriate.

The environment is centered on Google Cloud Platform, with BigQuery and Apache Airflow serving as core technologies. You may also work with Dataflow, Google Cloud Storage, Cloud SQL, Pub/Sub, Terraform, and relational databases such as Microsoft SQL Server and PostgreSQL.

• A genuine enthusiasm for using AI throughout the software development lifecycle is important to this position. Our most successful consultants are incorporating AI-assisted development into their daily workflows to improve productivity, accelerate troubleshooting, understand complex systems, strengthen documentation, and solve engineering problems. We’re looking for someone who embraces these tools thoughtfully while continuing to exercise sound technical judgment.
• If you enjoy solving complex data problems, building reliable cloud pipelines, and working directly with experienced client teams, we’d love to talk with you.

• Your Responsibilities
• Design, build, test, and maintain scalable data pipelines and data-loading processes in Google Cloud Platform.
• Develop and optimize data workflows using BigQuery and Apache Airflow.
• Implement established client architecture and engineering patterns while identifying opportunities to improve reliability, performance, and maintainability.
• Analyze complex source tables, data relationships, transformations, and loading requirements.
• Develop and support data extraction, transformation, migration, and validation processes.
• Troubleshoot pipeline failures, data-quality issues, performance bottlenecks, and production defects.
• Partner with client engineers and stakeholders to clarify requirements and translate them into reliable technical solutions.
• Contribute sound design recommendations based on prior experience building cloud data platforms and pipelines.
• Write clean, maintainable, well-tested code and participate in collaborative GitHub-based development workflows.
• Create clear technical documentation for pipelines, data flows, operational processes, and design decisions.
• Work independently, manage priorities effectively, and become productive within an established client environment quickly.
• Leverage AI-powered development tools to improve analysis, implementation, testing, documentation, troubleshooting, and delivery while exercising sound engineering judgment.
• Contribute to a collaborative Keyhole consulting culture by sharing knowledge and supporting fellow consultants.
• Required Qualifications
• 7+ years of professional data engineering, data platform, or related software engineering experience.
• Strong production experience with Google Cloud Platform and BigQuery.
• Hands-on experience building and orchestrating production data pipelines with Apache Airflow.
• Demonstrated ability to independently design and implement complex data pipelines, transformations, and loading processes.
• Advanced SQL skills and experience working with complex relational data structures and large datasets.
• Experience with data migration, data integration, ETL/ELT, and data validation.
• Experience optimizing cloud data pipelines and queries for performance, reliability, and cost.
• Proficiency with Git and collaborative development workflows, including pull requests and code reviews.
• Strong software engineering fundamentals, including maintainable code, automated testing, debugging, and source control.
• Demonstrated ability to quickly learn an existing architecture, follow established patterns, and contribute with limited ramp-up time.
• Strong analytical and problem-solving skills with the ability to troubleshoot issues across data, pipeline, and infrastructure layers.
• Excellent communication skills and the ability to work directly with technical and non-technical stakeholders.
• Comfortable taking direction from a client team, working independently, and adapting to changing priorities.
• Demonstrated experience using AI-assisted development tools such as GitHub Copilot, ChatGPT, Claude, Cursor, or similar as part of everyday technical work.
• Preferred Qualifications
• Experience with GCP Dataflow and Google Cloud Storage.
• Experience with Cloud SQL, PostgreSQL, or Microsoft SQL Server.
• Experience with Google Cloud Pub/Sub or another event-streaming platform.
• Experience provisioning cloud infrastructure with HashiCorp Terraform.
• Experience with Python, Java, or another language commonly used for data engineering.
• Experience working with healthcare data or in a healthcare enterprise environment.
• Experience supporting data platforms that handle sensitive or regulated information.
• Experience working as a consultant or in client-facing technical roles.
• Familiarity with AWS data services such as Redshift, S3, and Kinesis.
• Relevant Google Cloud certifications, such as Professional Data Engineer.

• Why Join Keyhole Software?
• At Keyhole Software, you’ll enjoy the best of both worlds: the stability of full-time employment and the variety of working on diverse, long-term client projects.
• Dynamic Opportunities: Work on challenging enterprise projects that keep your technical skills sharp while offering variety across industries and technologies.
• Collaboration and Support: Join a team of experienced developers, architects, data engineers, and consultants who are available to collaborate and share expertise across engagements.
• Long-Term Growth: Develop your career with opportunities to learn new technologies, expand your consulting skills, and work across multiple client engagements.
• Knowledge-Sharing Culture: Be part of a team that values knowledge transfer, technical education, and leaving client teams stronger and more self-sufficient.
• Comprehensive Benefits: Enjoy competitive pay, health insurance options, a 401(k) plan, and more.

At Keyhole Software, you’re not just taking on a project. You’re joining a team that’s committed to your success, development, and long-term satisfaction.

• What We Offer
• Competitive Compensation: Compensation based on experience and qualifications
• Comprehensive Benefits Package:
• Medical insurance (traditional and HDHP options)
• Dental and vision insurance
• FSA and dependent care options
• Life and disability insurance
• 401(k) with discretionary employer contributions
• Supplemental insurance options
• Collaborative Team Environment: Access to a highly experienced consulting network for ongoing growth and support.