Senior Data Engineer (Cloud, Data Integration & Migration)

Role Overview

Workplace

• The position is hybrid and based in London, England.

Key Responsibilities

• Design, develop, and maintain scalable ETL and ELT pipelines.
• Build integrations across cloud, on-premise, and third-party systems.
• Design and implement data migrations covering extraction, transformation, validation, reconciliation, and cutover.
• Perform data profiling, root cause analysis, and data quality assessments.
• Develop and optimise data warehouse, data lake, and lakehouse solutions.
• Produce source-to-target mappings, transformation rules, and technical documentation.
• Support data governance, security, and compliance requirements.
• Work with stakeholders to understand requirements and deliver effective solutions.
• Troubleshoot complex data issues and implement sustainable solutions.

Essential Experience

• Candidates must be eligible for UK Security Clearance and must hold or be able to obtain SC clearance.
• Demonstrable experience in data engineering and delivery of complex data migration and integration projects.
• Strong experience working with large and complex datasets.
• Experience working across AWS and Microsoft Azure environments.
• Excellent SQL development, optimisation, and troubleshooting skills.

Databases and SQL

• Hands-on experience with PostgreSQL, MySQL, Microsoft SQL Server, Oracle, Amazon Redshift, and Amazon Athena is required.

AWS Technologies

• Practical experience with AWS Glue, Amazon Athena, Amazon Redshift, Amazon S3, AWS Lambda, AWS Step Functions, and Amazon QuickSight is required.

Microsoft Azure Technologies

• Practical experience with Microsoft Fabric, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, and Azure SQL is required.

Data Engineering Knowledge

• Strong knowledge of ETL and ELT design patterns, data integration architectures, data warehousing, data lake and lakehouse architectures, and data modelling.
• Strong knowledge of data profiling, data quality management, data validation, and reconciliation.

Benefits

• Benefits include private medical cover, 25 days paid holiday, life assurance, a group pension plan, flexible benefits, and LinkedIn Learning access.

Other Information