Senior Data Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
Key Skills for This Role
Full Job Posting
What you'll be doing
Designing and building scalable data pipelines that ingest healthcare data from multiple providers into trusted research environments and data platforms.
Developing and maintaining data transformation logic in Python to create high-quality, curated and research-ready datasets.
Contributing to complex, shared codebases while following engineering best practices including code reviews, testing and clean coding standards.
Collaborating with data scientists, epidemiologists, software engineers and product teams to understand requirements and deliver impactful data solutions.
Processing large-scale healthcare datasets and implementing robust data quality, validation and governance controls.
Transforming and harmonising healthcare data into common data models such as OMOP and FHIR to support research and analytical use cases.
Creating reusable, scalable and maintainable data products that enable efficient consumption by multiple stakeholders.
Communicating effectively with technical and non-technical stakeholders to translate complex requirements into practical engineering solutions.
Producing clear and comprehensive technical documentation covering data pipelines, transformation logic, architecture and operational processes.
Supporting the design, scoping and implementation of data flows across the wider healthcare data ecosystem.
Leveraging cloud and big data technologies, including Azure, Databricks, Spark and Data Lakes, to deliver high-performing data solutions.
Adopting and promoting data engineering best practices, healthcare data standards and continuous improvement across the team.
Keeping abreast of emerging trends, technologies and standards within healthcare, research and data engineering to drive innovation and excellence.
Requirements
- To succeed in tis role you will need to demonstrate some of the following:
- Proven Data Engineering experience within complex, large-scale data environments.
- Experience designing, building and maintaining scalable, reliable data pipelines that process large volumes of data from multiple sources.
- Experience working with healthcare data across academia, healthcare, life sciences, health technology or related sectors.
- Knowledge of healthcare data standards and common data models, including OMOP and/or FHIR.
- Experience transforming and remodelling data between different Common Data Models (CDMs).
- Understanding of healthcare terminologies and ontologies, including SNOMED CT, ICD-10 and Read Codes.
- Experience contributing to shared codebases and developing reusable, maintainable data solutions.
- Proficiency in Python and software engineering best practices.
- Good command-line and Unix/Linux skills.
- Experience working with cloud platforms, ideally Microsoft Azure.
- Experience using technologies such as Spark, Databricks and data lake architectures.
- Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake.
- Experience with containerisation and orchestration technologies, including Docker and Kubernetes.
- Experience using Git/GitHub and working within collaborative development environments.
- Experience working within Agile delivery teams.
Benefits
- Competitive base salary from £74,000 per annum
- Generous Pension Scheme – We invest in your future with employer contributions of up to 12%
- 30 Days Holiday pro rata + Bank Holidays – Enjoy a generous holiday allowance with the flexibility to take bank holidays when it suits you
- Enhanced Parental Leave – Supporting you during life’s biggest moments
- Cycle to Work Scheme – Save 25-39% on a new bike and accessories through salary sacrifice
- Home & Tech Savings – Get up to 8% off on IKEA and Currys products, spreading the cost over 12 months through salary sacrifice
- EV Scheme – Save up to 40% on a brand new electric vehicle all-inclusive package through salary sacrifice
- £1,000 Employee Referral Bonus – Know someone amazing? Get rewarded for bringing them on board!
- Wellbeing Support – Access to Mental Health First Aiders, plus 24/7 online GP services and an Employee Assistance Programme for you and your family
- A Great Place to Work – We have a lovely Central London office in Holborn, and offer flexible and remote working arrangements
You may work remotely from anywhere within the UK, with occasional travel to London.
We recommend you apply as soon as possible as occasionally due to high volumes of applications, we need to close our postings early.
At Our Future Health, we recognise the importance of having a diverse workforce and ensuring that all candidates, regardless of their background, have equitable access to our application process. We proactively encourage applicants who identify as having a disability, neurodiversity, or long-term health conditions to let us know if they require any reasonable adjustments as part of their application process.
If you do require any reasonable adjustments, please email us at talent@ourfuturehealth.org.uk
About Our Future Health
UK charity running a health research programme that recruits adult volunteers to improve disease prevention, detection and treatment.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Our Future Health
Senior Product Designer - FTC - Immediate start
, GBR
Director of Data Operations and Governance
London, GBR
Our Future Health is seeking a Director of Data Operations and Governance to lead data operations, governance, quality, and delivery across a large health research programme. The role manages teams and external partners,
Staff Software Engineer - Data Platforms
London, GBR
Our Future Health is seeking a Staff Software Engineer to build shared capabilities for large-scale data platforms handling sensitive health and research data. The role combines hands-on engineering, architecture, techni
Senior Data Scientist - (Privacy & Security Controls)
London, GBR
Senior Agile Coach
London, GBR
Senior Product Designer - FTC - Immediate start
, GBR
Director of Data Operations and Governance
London, GBR
Staff Software Engineer - Data Platforms
London, GBR
Staff Analytics Platform Engineer
London, GBR
Engineering Manager
London, GBR
Director of Data Operations and Governance
London, GBR
Senior Data Scientist - (Privacy & Security Controls)
London, GBR