About the position
We are looking for a Data Engineer to join our team in Cape Town, on an initial 12-month contract, onsite.
The Data Engineer will work within the Business Intelligence team of the information technology division and will be responsible to work closely with our Financial services division for the design, development and implementation of scalable and robust processes, in accordance with specified guidelines.
This role includes extracting, transforming, and consolidating data, developing and maintaining a data platform that will ensure optimal performance and stability.
This position requires strong problem-solving skills, technical expertise in BI tools and SQL, and excellent communication abilities to effectively support users and maintain high service standards.
KEY RESPONSIBILTIES:
- Design, develop, optimize, and maintain data architecture and data pipelines that adhere to ETL principles and business goals.
- Develop complex queries and data solutions using SQL and SSIS according to defined architectural standards.
- Assist in the design and implementation of data pipelines from a variety of data sources and support the maintenance thereof.
- Ingest large, complex data sets that meet functional and non-functional requirements.
- Enable the business to solve the problem of working with large volumes of data in diverse formats, and in doing so, enable innovative solutions.
- Build bulk and delta data patterns for optimal extraction, transformation, and loading of data.
- Engineer data in the appropriate formats for downstream consumption for analytics or Enterprise applications.
- Work with various stakeholders to understand data requirements and apply technical knowledge of data management to solve key business problems.
- Provide support in the operational environment with all relevant support teams for data services.
- Support test and deployment of new services and features.
Education Background:
- Bachelor’s degree in computer science, Business Informatics or equivalent.
Profession Experience:
- Minimum of 3 years of relevant data engineering experience, preferably within the retail sector.
- Experience in credit and credit risk will be advantageous.
Skills:
- Expertise with SQL, SSIS and data analysis and experience with at least one programming language (Python).
- Knowledge of working with DBT would be advantageous.
- Experience developing and maintaining data warehouses in big data solutions.
- Worked with BI tools such as Power BI, Tableau, Pyramid or others.
- Conceptual knowledge of data and analytics, such as dimensional modelling, ETL, ELT, reporting tools, data governance, data warehousing, and structured and unstructured data.
- Knowledge and experience regarding cloud technologies, Python and Databrick will be advantageous.
Desired Skills:
