About the position
About the Role
We are seeking a highly experienced Senior Data Engineer to design, build, and optimise scalable cloud-native data platforms and near-real-time data pipelines on Google Cloud Platform (GCP). The ideal candidate has deep expertise in highly parallelised distributed processing solutions.
Key Responsibilities
- Design scalable GCP data pipelines.
- Build near-real-time and batch processing solutions.
- Develop highly parallelised distributed pipelines.
- Implement Cloud Run and GKE workloads.
- Design streaming architectures using Pub/Sub and Dataflow.
- Optimise performance, scalability and cost.
Qualifications
- Relevant degree. Google Cloud Professional Data Engineer certification advantageous.
Required Skills Experience
- 8+ years data engineering experience. Expertise in BigQuery, Cloud Storage, Dataflow, Cloud Composer, Cloud Run, GKE, Dataproc, Pub/Sub, dbt, Python and SQL. Strong experience with distributed processing, event-driven architectures and near-real-time pipelines.
Complementary Skills
- Azure, AWS, Power BI, Looker, Apache Spark, Terraform, microservices and event-driven architectures.
Desired Skills:
- Systems Analysis
- Complex Problem Solving
- Programming/configuration
- Critical Thinking
- Time Management
