Role: Principal Java Data Engineer with Spec-Driven Development (SDD) & AI
Location: Toronto/Vancouver, Canada (Remote)
Job Type: 12 Months Contract
Job Description:
• Lead and guide the design and implementation of scalable distributed systems based on Java microservices
• Engineer and optimize data pipelines using solutions like Apache Hudi, Apache Trino, Azure ADLS
• Collaborate cross-functionally with product, analytics, and AI teams to ensure data is a strategic asset
• Principal Software Data Engineer with at least 10 years of professional experience in software or data engineering, including a minimum of 4 years focused on data pipelines (batch and streaming)
• Proven experience driving technical direction and mentoring engineers while delivering complex, high-scale solutions as a hands-on contributor
• Strong understanding of event-driven architectures and distributed systems, with hands-on experience implementing resilient, low-latency pipelines
• Practical experience with cloud platforms (AWS, Azure, or GCP) and containerized deployments for data workloads
• Fluency in data quality practices and CI/CD integration, including schema management, automated testing, and validation frameworks (e.g., dbt, Great Expectations)
• Operational excellence in observability, with experience implementing metrics, logging, tracing, and alerting for data pipelines using modern tools
• Solid foundation in data governance and performance optimization, ensuring reliability and scalability across batch and streaming environments
• Proven experience with Lakehouse architectures and related technologies, including Apache Hudi, Azure ADLS Gen2, HDFS, and other big data technologies (Trino, Databricks, Spark)
• Strong collaboration and communication skills, with the ability to influence stakeholders and evangelize modern data practices within your team and organization.