Principal Data Engineer with Spec-Driven Development (SDD) & AI

• Role: Principal Data Engineer with Spec-Driven Development (SDD) & AI
• Location: Toronto/Vancouver, Canada (Remote)
• Job Type: 12 Months Contract

Job Description:

• • Mandatory Skill: Spec-Driven Development (SDD) is Must with AI
• • Principal Data Engineer with at least 10 years of professional experience in software or data engineering, including a minimum of 4 years focused on streaming and real-time data systems
• • Proven experience driving technical direction and mentoring engineers while delivering complex, high-scale solutions as a hands-on contributor
• • Deep expertise in streaming and real-time data technologies, including frameworks such as Apache Kafka, Flink, and Spark Streaming
• • Strong understanding of event-driven architectures and distributed systems, with hands-on experience implementing resilient, low-latency pipelines
• • Practical experience with cloud platforms (AWS, Azure, or GCP) and containerized deployments for data workloads
• • Fluency in data quality practices and CI/CD integration, including schema management, automated testing, and validation frameworks (e.g., dbt, Great Expectations)
• • Strong analytical and problem-solving mindset
• • Ability to learn quickly and adapt to new technologies, even when uncomfortable
• • Self-starter who thrives with minimal supervision and collaborates effectively as a team player
• • Excellent organizational and critical-thinking skills
• • Comfortable leveraging AI tools to accelerate development