- Spark Scala Developer
- Mississauga, Ontario | Calgary, Alberta
Required Qualifications:
- At least 6 years of Information Technology experience
- 6+ years of experience in Big Data technologies.
- Strong expertise in:
- Apache Spark (Core, SQL, DataFrames, RDDs)
- Scala programming
- PySpark
- Hands-on experience with:
- Kafka (real-time streaming)
- Hadoop ecosystem (HDFS, Hive, Impala)
- NoSQL Databases (HBase, MongoDB, Couchbase)
- Strong understanding of distributed computing concepts and data processing frameworks.
- Experience in building ETL/data pipelines for large-scale datasets.
- Proficiency in SQL and data modeling.
Preferred Qualifications:
- Hands-on experience with data lakes, data warehouses, and scalable ETL pipeline design, including batch and real-time processing architecture.
- Strong understanding and practical exposure to Agile software development methodologies (Scrum) and SDLC practices.
- Proven experience in Banking domain, supporting use cases such as fraud detection, risk analytics, regulatory reporting, and customer insights.
- Excellent analytical, problem-solving, and communication skills, with the ability to translate business requirements into scalable technical solutions.
- Demonstrated ability to work effectively in cross-functional, multi-stakeholder environments, collaborating with Business, Data Engineering, and Architecture teams.
- Experience with real-time data streaming frameworks such as Kafka and Spark Streaming for low-latency processing.
- Understanding data modeling concepts (dimensional modeling, snowflake schemas) to support analytics workloads.
- Experience and desire to work in a global delivery environment.
Mention you found this on Data First Jobs — it helps us bring you more roles like this.
Big Data Developer
Avance Consulting
Similar Engineering Jobs
View all Engineering jobs→Collins Aerospace
Data Engineer (Hybrid)
New
Cedar Rapids, Iowa (USA)
Northland Power Inc.
Data Engineer/Architect
New
Toronto, Ontario (Canada)
CLEAR
Senior Software Engineer, Data
New
New York, New York (USA)
Jobright.ai
Machine Learning Engineer, Model Development — Entry Level
New
USA
Jobright.ai
Data Engineer (Early Career) (Canada)
New
Canada
Bevertec
Senior Machine Learning Engineer
New
RemoteCanada
Like this role? Get carefully selected jobs like it, twice a week, straight to your inbox.
Free, no spam. Unsubscribe anytime.