Data Engineer (Inception)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Inception, a G42 company, seeks a Data Engineer to build and maintain data infrastructure supporting AI solutions. You will design scalable data pipelines, manage storage solutions, and collaborate with data scientists.
Key Skills for This Role
Responsibilities
- Design, construct, install, test, and maintain highly scalable data pipelines with a focus on machine learning models and analytics
- Work closely with data scientists, ML engineers, and stakeholders to ensure data is accessible, consistent, and reliable
- Develop and maintain APIs for data access and manipulation, and integrate with external data services
- Manage and optimize data storage solutions, including relational databases, Search Engines like Elasticsearch and NoSQL databases
- Implement processes to monitor data quality and ensure production data is accurate and available
- Collaborate with ML engineers to assist in data related technical issues and provide architectural guidance
- Ensure compliance with data security and privacy policies
- Maintain clear and up to date documentation including data dictionaries, metadata, and architectural diagrams
Requirements
- Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience
- 7+ years of experience in a Data Engineering role
- Proficiency in SQL and programming languages like Python and Scala
- Hands on experience with big data technologies like Hadoop, Spark and Flink
- Familiarity with machine learning frameworks such as TensorFlow, PyTorch, or similar
- Strong understanding of data warehousing concepts, ETL processes, and data modeling
- Experience with API development and integration with data services
- Experience with cloud platforms like Azure, AWS, GCP
- Knowledge in DevOps, CI/CD methods, Kubernetes, Agent memory, Connectors, RAG, Evaluation Hub, GitOps
- Experience with real time data processing
Full Job Posting
Overview
- As a Data Engineer at Inception, you will be responsible for building and maintaining the infrastructure that supports data collection, processing, and storage.
- Reporting to the Lead Data Engineer or Principal Data Engineering, you will work closely with data scientists, analysts, and other stakeholders to ensure that data systems are reliable, scalable, and secure.
Your key responsibilities
- Design, construct, install, test, and maintain highly scalable data pipelines with a focus on machine learning models and analytics.
- Work closely with data scientists, ML engineers, and stakeholders to ensure that data is accessible, consistent, and reliable for ongoing projects.
- Develop and maintain APIs for data access and manipulation, and integrate with external data services as needed.
- Manage and optimize data storage solutions, including relational databases, Search Engines like Elasticsearch and NoSQL databases, to support the requirements of machine learning models.
- Implement processes to monitor data quality and ensure production data is always accurate and available for key stakeholders.
- Collaborate with ML engineers to assist in data related technical issues and provide architectural guidance and solutions.
- Ensure compliance with data security and privacy policies.
- Maintain clear and up to date documentation including data dictionaries, metadata, and architectural diagrams.
Skills and attributes for success
- Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience.
- 7+ years of experience in a Data Engineering role.
- Proficiency in SQL and programming languages like Python and Scala.
- Hands on experience with big data technologies like Hadoop, Spark and Flink.
- Familiarity with machine learning frameworks such as TensorFlow, PyTorch, or similar.
- Strong understanding of data warehousing concepts, ETL processes, and data modeling.
- Experience with API development and integration with data services.
- Experience with cloud platforms like Azure, AWS, GCP.
- Knowledge in DevOps, CI/CD methods, Kubernetes, Agent memory, Connectors, RAG, Evaluation Hub, GitOps.
- Experience with real time data processing.
Technical stack
- Programming Languages: Python, Java, Scala, SQL, Bash
- Big Data Technologies: Hadoop, Spark, Flink
- Databases: MySQL, PostgreSQL, MongoDB, Cassandra, HBase, Redis
- Cloud Platforms: Azure
- API Development: RESTful APIs, GraphQL, OpenAPI
- Data Services: Kafka, RabbitMQ
- Containers: Docker, Kubernetes
What Working At Inception Offers
- Culture: An open, diverse and inclusive environment with a global vision that encourages personal growth and focuses on ground breaking, industry first innovations.
- Career: Outstanding learning, development & growth opportunities via structured training programs and innovative, high tech projects.
- Work Life: A hybrid work policy to strike the perfect balance between office and home.
- Rewards: A competitive remuneration package with a host of perks including healthcare, education support, leave benefits and more.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Inception42
Vice President - International Delivery
Abu Dhabi, UAE
Inception, a G42 company, seeks a VP of International Delivery to lead the execution of complex AI product and platform deployments across global customer environments. The role involves leading international delivery po
Lead Applied Scientist
Abu Dhabi, UAE
Inception is seeking a visionary Lead Applied Scientist to spearhead advanced AI research and guide teams in developing deep-learning and generative AI solutions. The role involves architecting next-generation AI systems
Senior Applied Scientist
Abu Dhabi, UAE
Inception, a G42 company, seeks a Senior Applied Scientist to develop deep-learning and generative AI algorithms for the Oil and Gas sector in Abu Dhabi. You will design AI models, collaborate with product teams, and pro
Applied Scientist
Abu Dhabi, UAE
Inception seeks an Applied Scientist to develop deep-learning and generative AI algorithms for computer vision, NLP, and audio processing. You will collaborate with product teams to integrate AI into real-world applicati
Senior Applied Scientist
Abu Dhabi, UAE
Inception is seeking a Senior Applied Scientist with a proven track record to develop deep-learning and generative AI algorithms for the Oil and Gas sector. The role involves pioneering research in computer vision, NLP,
Senior Applied Scientist
Abu Dhabi, UAE
Inception is seeking a Senior Applied Scientist to develop efficient deep-learning and generative AI algorithms. The role involves pioneering research in computer vision, NLP, and audio signal processing, and collaborati
Security Architect
Abu Dhabi, UAE
Inception, a G42 company, is seeking a Security Architect to join their AI-focused team in Abu Dhabi. The role involves designing and implementing security architectures for AI products. The description lacks specific re
Director - Research and Development
Abu Dhabi, UAE
Inception is seeking a Director of R&D in Applied AI to lead applied AI research, directing multiple flagship programs including foundation language models and multi-agent systems. The role requires a proven track record
Vice President - International Delivery
Abu Dhabi, UAE
Lead Applied Scientist
Abu Dhabi, UAE
Senior Applied Scientist
Abu Dhabi, UAE
Applied Scientist
Abu Dhabi, UAE
Senior Applied Scientist
Abu Dhabi, UAE
Senior Applied Scientist
Abu Dhabi, UAE
Security Architect
Abu Dhabi, UAE
Director - Research and Development
Abu Dhabi, UAE