About the position
Psybergate is an IT company that builds bespoke software solutions and provides highly skilled resources to its clients.
We are looking for a Data Engineer to join our financial services client based in Centurion.
A Data Engineer designs, builds, and maintains data infrastructure, pipelines, and integrations to ensure efficient data collection, storage, processing and consumption. They help to optimise databases, ensure data quality, and support analysts, developers, and business users by providing clean, structured data for BI and ML. Their role includes managing and maintaining cloud or on-premise data platforms, implementing best practices, and ensuring data security and accessibility.
What you will be doing:
- Build strong professional relationships with stakeholders, including, business, analysts, engineers, architects, and developers.
- Advise on data and analytic solutions that meet business requirements and collaborate on technical implementations.
- Support and maintain production and non-production of database systems and platforms.
- Assist data engineers, developers, and architects with database design and peer reviews.
- Create and maintain data products and domains across various sources and consumers.
- Develop and maintain pipelines to integrate data into the data platform.
- Automate data infrastructure deployment and configuration following CI/CD principles, monitoring, logging, and alerting.
- Optimize databases by writing efficient queries, defining schemas, and improving performance.
- Implement solutions for operational reporting, BI, analytics, and machine learning.
- Assist with model development, preprocessing, feature engineering, tuning, and MLOps.
- Apply governance standards, including data security, ML, SDLC, change, incident, and release management.
- Document data artefacts and solutions for stakeholders.
- Maintain and evolve the data platform to be scalable, secure, high-performing, and reliable.
- Guide and support junior team members through mentorship and training.
- Stay updated on data platforms, database systems, tools, and industry trends.
- Research emerging technologies, architectures, and data, analytics and ML solutions.
What we are looking for:
- Completed relevant IT/Computer Science/Engineering degree or Diploma or other related fields
- 8 years of technical working experience in the major data platforms such as SQL, PostgreSQL, Oracle, RDS, and their tooling.
- 4 years hands-on working experience with AWS cloud, AWS data and analytics services such as S3, Athena, Glue, RDS, Redshift, Lake formation. Sagemaker, Lambda, etc.
- Some experience an advantage in AI platforms like AWS AI, Azure AI, Google AI, OpenAI, Anthropic, Meta.
- Strong technical, analytical, proactive and problem-solving skills.
- Comprehensive knowledge and experience of data systems, development and operations.
Please note that if you do not hear from us within 3 weeks, consider your application unsuccessful.
Desired Skills:
- SQL
- PostgresSQL
- Oracle
- AWS
- RDS
