pinpoint
Senior Data Engineer
Kharon
London, GBR
Full-time
Senior · 5+ years experience
Hybrid
GBP 95000-115000 yearly / year
Discovered 2 weeks ago
AWS DatabricksAWSPythonPandasPySparkNotebooks
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
AWS DatabricksAWSPython
Key Skills for This Role
AWS DatabricksAWSPythonPandasPySparkNotebooks
Full Job Posting
RESPONSIBILITIES:
- Help build large-scale distributed automated data processing systems and data lakes, while optimizing for both computational and storage efficiency on AWS Databricks.
- Create data pipelines, infrastructure, and overall workflow orchestration to pull data from a diverse set of data sources into the Kharon Data Lake.
- Build systems to track, monitor and validate the quality of data coming into or going out of Kharon Data Lake.
- Collaborate with engineers, architects, and data scientists to implement scalable solutions to solve complex problems.
- Interact and develop with internal and external APIs.
- Work with product and business teams to define novel and critical metrics for the business.
- Follow good engineering practices like documentation, diagrams, and unit/validation tests
- Take full responsibilities for the development, deployment, adoption monitoring and maintenance of the data systems and services you build.
QUALIFICATIONS:
- 5+ years of experience, not including internships as a software engineer or a data engineer and a strong passion to learn.
- BS/MS in Computer Science or equivalent experience in related fields.
- Experience in Python, Pandas, PySpark, and Notebooks.
- SQL knowledge and experience working with relational databases including schema design, access patterns, query performance optimization, etc.
- Experience with data pipeline technologies like AWS Glue, Airflow, Kafka, or other cloud based equivalence.
- Experience with ETL and data warehousing like Databricks, Snowflake, or equivalent.
- Container-based deployment experience using Docker and Kubernetes.
- Strong verbal and written communication skills.
- Experience working with or data modeling for graph databases like Neo4J, Neptune, etc.
- API experience using FastAPI, Flask, Spring Boot or equivalent.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Kharon
Account Manager
Denver, USA
Discovered YesterdayFull-time
AI Engineer
Denver, USA
Discovered 1 weeks agoFull-time
Senior Manager, Accounting (CPA)
Denver, USA
Discovered 1 weeks agoFull-time
Senior Live Video Producer
, USA
Discovered 2 weeks agoFull-time
Senior Manager, Accounting
Denver, USA
Discovered 2 weeks agoFull-time
Partner Operations Manager
Denver, USA
Discovered 2 weeks agoFull-time
Senior Financial Systems Administrator
Denver, USA
Discovered 2 weeks agoFull-time
Field Marketing Manager
New York City, USA
Discovered 2 weeks agoFull-time