data engineer

Overview

Languages

English

Education

• Bachelor's degree
• or equivalent experience
• Information technology
• Data modelling/warehousing and database administration
• Computer technology/computer systems technology

Experience

2 years to less than 3 years

On site

Work must be completed at the physical location. There is no option to work remotely.

Work setting

• Information technology (IT) infrastructure
• Information technology (IT) service provider
• Fast moving consumer goods (FMCG)

Responsibilities

Tasks

• Assess and troubleshoot applications software
• Build predictive models
• Communicate the business and technical benefits of the analytic solution to both business and technical audiences
• Conduct business and technical studies to aid in decisions on system implementation or migration
• Conduct research regarding availability and suitability of data
• Confer with clients to identify requirements
• Coordinate the development, installation, integration and operation of computer-based systems
• Data Science
• Design methods of collecting and processing data to answer specific research questions
• Develop data mapping methods
• Develop process and network models to optimize architecture
• Develop queries and logic to generate reports
• Discover trends and patterns within large amounts of information
• Document data access rules
• Document technical requirements to ensure that products, processes and solutions meet business requirements
• Extract information from unstructured sets of data
• Highlight key data sources and the methodology to be used on a specific project
• Prepare plan to maintain software
• Provide advice on the selection of automated anomaly detection systems
• Research data collection and administration policy
• Synthesize technical information through creation of data visualization
• Upgrade and maintain software
• Use ensemble modelling to combine multiple algorithms to obtain better predictive performance
• Design and develop database
• Design, develop and implement information systems business solutions
• Provide advice on information systems strategy, policy, management and service delivery
• Assess physical and technical security risks to data, software and hardware
• Operate database management systems to analyze data
• Develop and implement data administration policy, standards and models
• Develop policies, procedures and contingency plans to minimize the effects of security breaches
• Lead and co-ordinate teams of information systems professionals in the development of software and integrated information systems, process control software and other embedded software control systems
• Develop and implement policies and procedures throughout the software development life cycle
• Research and document data requirements, data collection and administration policy, and data access rules
• Conduct reviews to assess quality assurance practices, software products and information systems
• Develop policies and procedures for network access and usage and for the backup and recovery of data
• Lead and co-ordinate teams of data administrators in the development and implementation of data policies, standards and models
• Write scripts related to stored procedures and triggers
• Resolve conflict situations
• JavaScript Object Notation (JSON)
• Usability testing
• Operate automatic or other testing equipment to ensure product quality
• Conduct tests and perform security and quality controls
• Execute and document results of software application tests and information and telecommunication systems tests

Experience and specialization

Computer and technology knowledge

• Advanced Business Application Programming (ABAP)
• Agile
• Cloud
• Development and operations (DevOps)
• Excel Visual Basic for Applications (VBA)
• IBM DataStage
• Informatica
• Information Technology Infrastructure Library (ITIL)
• Internet of things (IoT)
• Jira
• Machine Learning
• Mainframe
• Matrix Laboratory (MATLAB)
• Microsoft Visual Studio
• Shell script
• TERADATA
• Data Warehouse
• DB2
• Linux
• C
• Environment - Client/Server
• Unix
• C++
• Erwin
• COBOL
• JavaOS
• MS Access
• MS SQL Server
• Networking software
• Networking hardware
• HTML
• MS Windows
• Networking security
• XML Technology (XSL,XSD,DTD)
• Servers
• Java
• Oracle Solaris
• JavaScript
• Security software
• MySQL
• Oracle
• Object-Oriented programming languages
• Visual Basic
• Project management software
• Programming software
• HTML editing software
• Visual C++ / MFC
• Website creation and management software
• Web service design
• .NET
• SQL
• Mapping and data visualization software
• Database software
• Programming languages
• Software development
• Development of computer applications
• Data analysis software
• MS Office
• Spreadsheet
• Enterprise resource planning (ERP) software
• Amazon Web Services (AWS)
• Git
• React.js
• Scala
• Python
• Soap
• XML
• Android Studio
• Apache Ant
• Apache Flex
• Apache Tomcat
• Atlassian Confluence
• Big data
• Bootstrap
• SAP BI BusinessObjects
• Firewall
• Firmware development
• GitHub
• Hibernate
• IntelliJ IDEA
• Manual Testing
• Microservices
• MS Active Directory
• MS Visual Studio Code (VS Code)
• Oracle Aconex
• Performance testing
• Postman
• Protractor
• Software quality assurance
• TypeScript
• Ubuntu
• Unix Shell Scripting
• Virtual Storage Access Method (VSAM)
• Visualforce
• Vue.js
• Electronic mail
• MS Excel
• MS Outlook

Area of work experience

• Project implementation
• Information technology (IT) service delivery
• Design
• Quality assurance or control

Area of specialization

• System integration
• Technical support
• Testing
• Business methods analysis

Additional information

Security and safety

• Criminal record check

Work conditions and physical capabilities

• Ability to work independently
• Fast-paced environment
• Work under pressure
• Tight deadlines
• Repetitive tasks
• Attention to detail

Personal suitability

• Accurate
• Client focus
• Efficient interpersonal skills
• Excellent oral communication
• Excellent written communication
• Initiative
• Judgement
• Organized
• Team player
• Flexibility
• Adaptability
• Accountability
• Dedication
• Innovation
• Analytical
• Proactive
• Quick learner

Benefits

Health benefits

• Dental plan
• Health care plan
• Vision care benefits

Financial benefits

• Group insurance benefits

Other benefits

• Paid time off (volunteering or personal days)