Data Engineer

About Inception42

Role Overview

Responsibilities

• Develop and deploy AI agents using Azure Agent Foundry, OpenAI, LangChain, and N8N.
• Build RAG pipelines, embeddings, vector database integrations, and knowledge graph solutions.
• Design and maintain scalable data pipelines, ETL/ELT workflows, and data architectures.
• Build APIs and data services for AI and analytics workloads and optimize ML workflows on Azure Databricks and Azure Fabric.
• Ensure data quality, reliability, governance, and compliance across systems.
• Collaborate with data scientists, ML engineers, and product teams to deliver intelligent features.
• Support MLOps and DevOps processes, including CI/CD, model lifecycle management, and containerized deployments.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field.
• At least 3 years of experience in data engineering, AI engineering, or ML engineering roles.
• Experience delivering scalable AI or data solutions in cloud environments, with Azure preferred.
• Strong proficiency in Python, SQL, PySpark, and machine learning or AI frameworks.
• Experience with Azure Agent Foundry, OpenAI APIs, LLMOps, RAG systems, and vector databases.
• Hands-on experience with Azure Databricks, Azure cloud services, and data platforms.
• Knowledge of big data tools such as Spark, Hadoop, or Flink and modern SQL or NoSQL storage.
• Experience with REST or GraphQL APIs, Kafka or RabbitMQ, and Docker or Kubernetes.
• Strong understanding of data modeling, ETL, data quality, problem-solving, communication, and collaboration.

Working at Inception42

• The organization offers an open, diverse, and inclusive environment with structured training, learning and development opportunities, and high-tech projects.
• The remuneration package includes healthcare, education support, leave benefits, and other benefits.