About the position
Are you passionate about building world-class data platforms that process millions of records and power real-time insights?
We're looking for a Data Engineer who thrives on solving complex data challenges, designing scalable data solutions, and working with cutting-edge cloud technologies. If you enjoy turning raw data into meaningful business value while working with modern Azure data platforms, this opportunity is for you.
What You'll Be Doing
As a Data Engineer, you'll own the end-to-end data lifecycle—from ingestion to transformation, governance, and delivery.
Design & Build Enterprise Data Pipelines
- Architect and develop scalable, high-performance batch and real-time data pipelines.
- Build solutions using technologies such as Microsoft Fabric, Azure Data Factory, Databricks, Apache Spark, Python, PySpark, and Ab Initio.
- Deliver structured, semi-structured, and unstructured data into enterprise Data Lakes and Data Warehouses.
- Implement DataOps practices including automation, orchestration, testing, and CI/CD.
- Develop APIs and services that enable secure, real-time data access.
Engineer Modern Cloud Data Platforms
- Design and optimise enterprise Azure-based data platforms.
- Work across technologies including Microsoft Fabric, Azure Synapse, Databricks, SAS, and hybrid environments.
- Implement Infrastructure as Code (IaC).
- Drive platform performance, scalability, reliability, and observability.
- Evaluate and introduce new technologies that enhance the data ecosystem.
Champion Data Quality & Governance
- Build automated data quality, validation, reconciliation, and auditing frameworks.
- Ensure data lineage and metadata management across enterprise platforms.
- Partner with governance and security teams to enforce best practices and POPIA compliance.
- Investigate and resolve data quality issues through profiling and root cause analysis.
Collaborate Across the Business
- Partner with Data Scientists, Architects, Analysts, and Software Engineers to deliver business-driven solutions.
- Own delivery of data engineering initiatives from concept through deployment.
- Provide technical support for complex production issues.
- Participate in Agile ceremonies including sprint planning and backlog refinement.
Drive Innovation
- Continuously improve engineering standards, tools, and processes.
- Mentor junior engineers and share technical knowledge.
- Stay ahead of emerging technologies in cloud, big data, and AI.
- Help shape the future of enterprise data engineering.
RequirementsMinimum Requirements
- Undergraduate Degree in IT, Computer Science, Engineering, or a related field.
- 2–5 years' experience within a Data Engineering, Business Intelligence, or Data Platform environment.
- Experience working within Agile delivery teams.
Technical Skills
You'll have strong experience with several of the following:
- Microsoft Azure
- Microsoft Fabric
- Azure Data Factory
- Databricks
- Python & PySpark
- Apache Spark
- Ab Initio
- Azure Synapse
- SQL
- CI/CD pipelines
- DataOps
- Infrastructure as Code (IaC)
- Data Warehousing & Data Lakes
- Kafka, Azure Event Hub, or other streaming technologies
- Data modelling, ETL/ELT, metadata and data lineage
- Cloud-native data engineering practices
Ready to build the future of data?
If you're excited by cloud engineering, big data, automation, and creating platforms that enable smarter business decisions, we'd love to hear from you. Apply today and help shape the next generation of enterprise data solutions.
Desired Skills:
- Databricks
- Microsoft Azure
- Microsoft Fabric
- Python & PySpark
Desired Qualification Level:
About The Employer:
