pinpoint
Senior Data Engineer
Transform
London, GBR
Full-time
Senior
Hybrid
Discovered 2 weeks ago
Azure DatabricksMedallion ArchitectureAzure Data FactoryPythonAirflowAzure SQL
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
Azure DatabricksMedallion ArchitectureAzure Data Factory
Key Skills for This Role
Azure DatabricksMedallion ArchitectureAzure Data FactoryPythonAirflowAzure SQL
Full Job Posting
Key Responsibilities
- Managing quality of own and teams’ outputs
- Delivering data engineering on a range of complex marketing and research processes
- Working with clients to understand needs, and best implement that with our available technology solutions
- Working with a range of data sources such as CRM, sales, research and HR data.
- Building Single Customer Views, CDPs or Data Warehouses/Data Lakes to merge disparate data sets for marketing or sales activation
- Building and configuring data ingestion methods from APIs, flat files, streaming, public data sources and survey data
Skills, Knowledge and Expertise
- Must have experience of using Azure Databricks and Medallion architecture
- Expert experience with Azure Data Factory or Python/Airflow and a range of associated libraries for data processing and manipulation
- Experience with a range of database technologies including data lakes such as Azure SQL, SQL Server, Azure Data Lake, PostgreSQL, Snowflake, MySQL, Cosmos DB or Mongo DB
- Understanding of Azure DevOps and CI/CD processes
- Knowledge of data warehouse or data lakes with SCVs or in conjunction with CDP platforms
- Knowledge of data ingestion of streaming data using Databricks and Pyspark
- Understanding and application of statistical methods
- Ability to lead, and to work well as part of, a team using the agile methodology
- Palantir Foundry (Pipeline Builder) experience
- Knowledge of ELT/ETL tools such as Informatica DEI/BDM and Talend would be beneficial
- Experience of mentoring junior to mid-level Data Engineers would be beneficial
Our culture and our benefits
- Being one team; looking out for each other as a team
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Transform
Senior/Lead Data Solutions Architect
London, GBR
Discovered 1 weeks agoFull-time
Senior Enterprise Architect
London, GBR
Discovered 1 weeks agoFull-time
Senior Service Designer
London, GBR
Discovered 1 weeks agoFull-time
Senior Business Analyst
London, GBR
Discovered 2 weeks agoFull-time
Principal Delivery Manager
London, GBR
Discovered 2 weeks agoFull-time
Senior Product Manager
Manchester, GBR
Discovered 2 weeks agoFull-time