Data Engineer (DataLake) - All levels

Capco is hiring a Data Engineer (Intermediate/Senior) to design and implement reusable data ingestion and transformation pipelines within a Data Lake or Lakehouse implementation programme. The role collaborates with Data Architects, Business Analysts, BI developers, and client technology teams.

The engineer will develop batch, CDC, and streaming ingestion pipelines; implement Bronze, Silver, and Gold data layers; build reusable pipelines and data products; and add data quality, reconciliation, validation, and monitoring controls. The role also supports migration, integration testing, UAT, production release, knowledge transfer, and BAU handover.

Develop batch, CDC, and/or streaming data ingestion pipelines from multiple source systems.

Implement Bronze, Silver, and Gold data layers with cleansing, transformation, and standardisation.

Develop reusable data pipelines and support data product implementation.

Implement data quality, reconciliation, validation, and monitoring controls.

Support migration, integration testing, UAT, production release, knowledge transfer, and BAU handover.

4+ years of experience in data engineering or related roles.

Strong experience with Databricks, Azure, SQL, Python/PySpark, ETL/ELT, Delta Lake, data modelling, data quality, and CI/CD.

Experience with financial services, particularly asset management or large-scale data transformation, is advantageous.

Experience delivering end-to-end enterprise data transformation from source ingestion through governed data products and business reporting.

Experience in asset management, fintech, or another regulated industry is preferred.