linkedin
Data Engineer
Habitat Energy
, UAE
Mid
Hybrid
PythonData PipelinesRelational Database DesignAWSTerraformKubernetes
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
PythonData PipelinesRelational Database Design
About the Role
Habitat Energy seeks a Data Engineer to join their Austin team, supporting data engineering infrastructure, writing well-structured code, and ensuring data quality. Requires 3+ years of Python experience and building data pipelines.
Key Skills for This Role
PythonData PipelinesRelational Database DesignAWSTerraformKubernetes
Responsibilities
- Contribute to the design, development, implementation and continuous improvement of data engineering tools, workflows, processes, and platforms
- Develop clean, maintainable, well documented code that adheres to best practices
- Support best coding practices within Habitat's software, machine learning, and data science teams
- Enhance data engineering knowledge within the software team
- Continuously enhance data quality across multiple dimensions such as accuracy, availability, performance, and accessibility
- Provide backup/escalation to the tech on call team
- Communicate effectively across Software and Data Science teams
Requirements
- 3+ years of Python experience
- 3+ years of working in technical teams, building data pipelines, delivering productionised code, building/maintaining live applications, developing tooling and improving backtesting frameworks
- Experience in applying relational database design
- Proficiency with Orchestration and IaC in AWS (e.g., Terraform, Kubernetes, RabbitMQ, Airflow, Prefect), Git, containerisation (Docker), database management (e.g., Postgres, Alembic)
- Fluent in Python and its wider numerical ecosystem (e.g., Pandas, NumPy, Polars, Pydantic)
- 2+ years of orchestrating machine learning workflows (nice to have)
- Experience with OSS data warehousing tooling and management (nice to have)
- Cloud infrastructure experience (nice to have)
- Experience with monitoring frameworks (e.g., Prometheus) (nice to have)
- Experience archiving data to Parquet on S3 and creating tools for API/Grafana queries (nice to have)
- Experience centralising diverse datasets for analytics, visualisation and machine learning (nice to have)
- Familiarity with time series forecasting and/or optimisation (nice to have)
Full Job Posting
Company Description
- Habitat Energy is a fast growing technology company focussed on the physical and financial optimisation of energy storage and renewable generation assets globally.
- Our rapidly growing team of 130+ people in Austin, TX, Oxford, UK, and Melbourne, Australia.
Your responsibilities will include
- Supporting Data Engineering Infrastructure: Contribute to the design, development, implementation and continuous improvement of our data engineering tools, workflows, processes, and platforms.
- Writing Well Structured Code: Develop clean, maintainable, well documented code that adheres to best practices.
- Enhance data engineering knowledge: Improve expertise within the software team.
- Data Quality Management: Continuously enhance data quality across multiple dimensions.
- Providing backup/escalation to the tech on call team.
- Communicating effectively across Software and Data Science teams.
Requirements
- 3+ years of Python experience
- 3+ years of working in technical teams, building data pipelines, delivering productionised code, building/maintaining live applications, developing tooling and improving backtesting frameworks
- Experience in applying relational database design
- Proficiency with Orchestration and IaC in AWS (e.g., Terraform, Kubernetes, RabbitMQ, Airflow, Prefect), Git, containerisation (Docker), database management (e.g., Postgres, Alembic)
- Fluent in Python and its wider numerical ecosystem (e.g., Pandas, NumPy, Polars, Pydantic)
- 2+ years of orchestrating machine learning workflows (nice to have)
- Experience with OSS data warehousing tooling and management (nice to have)
- Cloud infrastructure experience (nice to have)
- Experience with monitoring frameworks (e.g., Prometheus) (nice to have)
- Experience archiving data to Parquet on S3 and creating tools for API/Grafana queries (nice to have)
- Experience centralising diverse datasets for analytics, visualisation and machine learning (nice to have)
- Familiarity with time series forecasting and/or optimisation (nice to have)
Additional Information
- We operate a hybrid working model with at least 2 days in our office in Austin.
- We value diversity and our environment is supportive, challenging and focused on the consistent delivery of high quality, meaningful work.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career