About the position
ENVIRONMENT:
Our client, a leading financial services organisation, is seeking a Databricks Solution Architect who will lead the design of their target enterprise data platform during the programme’s Definition phase. They will assess the current data landscape, define the target Databricks Lakehouse architecture and prepare the technical documentation needed for architecture review, procurement and implementation approval.
DUTIES:
- Assess existing source systems, data platforms and integration patterns, and identify constraints, risks and dependencies.
- Define the target Databricks Lakehouse architecture, including workspace design, storage, batch and streaming ingestion, transformation, data layers and downstream consumption.
- Produce the data architecture vision, high-level data model, source-to-consumption data flow diagrams and Logical Architectural Design.
- Define requirements for access control, data classification, lineage, auditability and data quality. Contribute to the Cloud Risk Assessment and propose controls.
- Evaluate design options across security, performance, scalability, cost and operational support. Present the recommended design at architecture reviews and document decisions.
- Contribute to the scope of work, RFP and technical evaluation criteria, and define implementation dependencies, sequencing and readiness requirements.
REQUIREMENTS:
Minimum requirements:
- At least 10 years of enterprise data architecture experience, with hands-on Databricks Lakehouse delivery and ownership of architecture decisions.
- Practical experience with Databricks, Delta Lake, Unity Catalog, SQL and Python or PySpark. Azure Databricks experience is preferred.
- Experience designing cloud data platforms and multi-source integration, and producing logical architecture designs, data models and integration diagrams.
- A bachelor’s degree or equivalent in a quantitative or computing-related field.
- A relevant certification, such as Databricks Certified Data Engineer Professional, Microsoft Certified Azure Solutions Architect Expert or Databricks Platform Administrator Accreditation.
- At least three comparable projects delivered in the past five years, with client references and contact details for validation.
Advantageous experience:
- Integration with Microsoft Fabric, SQL Server, SAP S/4HANA or Power BI.
- Experience with Kafka, Confluent, StreamSets, Apache NiFi, Informatica, Talend or Denodo.
- Experience supporting architecture governance, cloud risk assessments, RFPs or technical supplier evaluations.
Desired Skills:
- Databricks
- Solution
- Architect