Senior Data Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
Role Overview
Octopus Energy is hiring a Senior Data Engineer for its Flexibility team.
The Flexibility team develops products and tools that support demand shifting, renewable energy use, and grid balancing.
The role is the team’s first full-time data engineering position and carries technical ownership for its data capability.
Key Skills for This Role
Full Job Posting
Role overview
Octopus Energy is hiring a Senior Data Engineer for its Flexibility team.
The Flexibility team develops products and tools that support demand shifting, renewable energy use, and grid balancing.
The role is the team’s first full-time data engineering position and carries technical ownership for its data capability.
What you will do
- Establish the team’s data capability and lead its data engineering technical direction.
- Represent the team to the cross-team data community and upskill data-literate backend engineers.
- Build greenfield data engineering systems in a newly established AWS environment.
- Create high-quality data processing and warehousing foundations for future projects.
- Maintain critical data applications and implement improvements for scalability, robustness, and operational efficiency.
- Interface with the Databricks data warehouse.
- Own platform improvements that expand team capabilities and increase system stability.
What you will have
- Strong aptitude with SQL, Python, and the AWS data stack is essential.
- Ability to shape needs into requirements and design scalable solutions.
- Ability to understand new domains quickly and visualize data effectively.
- Ownership across multiple projects and tools, with a commitment to knowledge sharing and documentation.
- Experience with scalable databases and APIs such as Django or FastAPI is a major plus.
- Experience with Kubernetes, Docker, Spark, monitoring tools, Airflow, or dbt is advantageous.
- Energy domain knowledge is desirable.
Core data stack
- Python is the main programming language.
- Databricks Spark is used for data processing.
- Databricks, dbt, and SQL are used for data modeling and analytics.
- Streamlit supports data applications and visualizations.
- Airflow supports job scheduling and tracking.
- CircleCI supports continuous deployment.
- Parquet and Delta formats on S3 support data lake storage.
- Terraform defines infrastructure.
- Kubernetes supports data services and task orchestration.
- Datadog, Grafana, and Prometheus support platform monitoring.
- Django supports custom databases and frameworks.
- Postgres and Aurora support relational databases.
About Octopus Energy
Octopus Energy develops technology and products supporting a fair, clean, and simple energy system.
Octopus Energy Group operates across multiple continents and businesses focused on energy transformation.
About octoenergy
Technology-led energy supply and services provider.
Visit company websiteApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at octoenergy
Data Analyst (Credit)
London, GBR
Octopus Energy is seeking a Data Analyst to support credit risk decisions for customers facing payment difficulties. The role combines SQL-driven analysis, BI reporting, fraud prevention, machine learning policy developm
Product Manager - Global Mobile
London, GBR
Octopus Energy is looking for a Product Manager to own key areas of its global mobile app and deliver customer-focused features across multiple markets. The role requires 3+ years of product management experience, meanin
Backend Engineer
London, GBR
Octopus Energy is hiring mid-level Backend Engineers for its Devices and Low Carbon Tech teams. The work covers Python and Django backend development, device and platform integrations, scalable architecture, automation,
Data Engineer
London, GBR
Octopus Energy Generation is looking for a Data Engineer to own data flows from source systems to decision-ready outputs. The role covers Databricks pipelines and models, Python automation, dashboards, API integrations,
Senior Software Engineer - AI Solutions
London, GBR
Octopus Energy is seeking a Senior Software Engineer to help establish a safe, scalable AI capability and build central developer tools and production gates. The role requires strong Python/Django backend engineering, AI
Legal Counsel
London, GBR
Octopus Energy is seeking a qualified UK Legal Counsel to advise its rapidly growing global energy business. The role covers corporate transactions, commercial contracts, compliance, international expansion, and external
Data Analyst (Credit)
London, GBR
Product Manager - Global Mobile
London, GBR
Backend Engineer
London, GBR
Data Engineer
London, GBR
Senior Software Engineer - AI Solutions
London, GBR
Legal Counsel
London, GBR