Data Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Artefact is hiring a Data Engineer to craft and maintain robust data pipelines using Python and SQL. The role involves building data pipelines, managing databases, integrating cloud services, and working with Spark and Kafka.
Key Skills for This Role
Responsibilities
- Building and optimising data pipelines to facilitate seamless data flow across systems and platforms
- Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions
- Leveraging cloud services such as MS Azure, GCP, and AWS to architect and deploy scalable data solutions
- Collaborating with teams to integrate machine learning models into data pipelines for enhanced data processing
- Implementing and working with Spark and Kafka for real time data processing and analytics
Requirements
- Bachelor's degree in machine learning, mathematics, computer science, or related fields
- Proficiency in Python, SQL, and database management
- Experience with Data Pipelines ETL, Cloud Services (MS Azure, GCP preferred), ML Modeling, Spark & Kafka
- Proven problem solving skills and a solution oriented mindset
- Excellent communication skills to collaborate effectively within teams and with stakeholders
- Strong business acumen with an interest in business facing roles
- Adaptability and a start up mentality to thrive in a dynamic environment
Full Job Posting
About Artefact
- Artefact is a new generation of data service providers specialising in data consulting and data driven digital marketing.
- It is dedicated to transforming data into business impact across the entire value chain of organisations.
- Our Data consulting team has more than 400 consultants covering all Artefact's offers.
What you will be doing?
- As a Data Engineer, your role involves crafting and maintaining robust data pipelines, utilising Python and SQL, to ensure efficient extraction, transformation, and loading (ETL) of data.
- Building and optimising data pipelines to facilitate seamless data flow across systems and platforms.
- Managing databases, ensuring their integrity, and implementing data storage and retrieval solutions.
- Leveraging cloud services such as MS Azure, GCP, and AWS to architect and deploy scalable data solutions.
- Collaborating with teams to integrate machine learning models into data pipelines for enhanced data processing.
- Implementing and working with Spark and Kafka for real time data processing and analytics.
What we are looking for?
- A Bachelor's degree in machine learning, mathematics, computer science, or related fields
- Proficiency in Python, SQL, and database management.
- Experience with Data Pipelines ETL, Cloud Services (MS Azure, GCP preferred), ML Modeling, Spark & Kafka.
- Proven problem solving skills and a solution oriented mindset.
- Excellent communication skills to collaborate effectively within teams and with stakeholders.
- Strong business acumen with an interest in business facing roles.
- Adaptability and a start up mentality to thrive in a dynamic environment.
- Candidates with similar skill sets and experiences have excelled in technology firms or consultancy firms.
- Successful candidates often possess Computer Science, Electronics, and Communication Engineering degrees.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Artefact
Director, AI Engineering
Montreal, CAN
Artefact is looking for a Director of AI Engineering to lead a team of AI/ML engineers and managers, driving production-grade AI solutions from classical ML to LLM-powered applications. You will define context engineerin
Director, AI & Data Science
Montreal, CAN
Artefact seeks a Director of AI & Data Science to lead a team of AI/ML engineers, driving production-grade AI solutions from classical ML to LLM applications. The role involves AI/ML solution architecture, context engine
Data Consultant
Abu Dhabi Emirate, UAE
Artefact is seeking a Data Consultant to manage projects and drive business growth in data consulting. The ideal candidate has a blend of business and data knowledge, with experience in management consultancy and digital
Data Scientist
, UAE
Artefact is hiring a Data Scientist to drive data-driven transformation for clients. The role involves conducting data projects, collaborating with teams, and building client relationships. Candidates need a Master's deg
Data Engineer (Palantir)
Dubai, UAE
About us: Artefact is a new generation of a data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of o