Senior Data Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Cander seeks a Senior Data Engineer to architect defense-grade Data Lakehouse infrastructure for AI-driven supply chain intelligence. You will lead Workstream 1, integrating SAP S/4HANA, Ariba, and unstructured data, building high-performance pipelines for generative AI and real-time analytics.
Key Skills for This Role
Responsibilities
- Design and deploy defense grade Data Lakehouse architectures as the Single Source of Truth for AI driven Supply Chain Intelligence
- Lead the technical execution of Workstream 1: Data & Platform Foundations, integrating SAP S/4HANA, Ariba, and unstructured data
- Architect and deploy ingestion pipelines for high volume transactional data from ERP systems
- Build connectors for external market intelligence feeds (e.g., S&P Global, Orbis, EcoVadis)
- Design and implement a standardized procurement data model and taxonomy
- Engineer pipelines to ingest, process, and transform unstructured technical data into vector ready formats for RAG
- Manage and optimize Vector Databases (e.g., Weaviate) for high speed retrieval
- Establish data lineage and traceability protocols for Model Based Systems Engineering
- Implement Role Based Access Control, audit logging, and data redaction policies for compliance
- Deploy automated data quality frameworks for Bill of Materials completeness and cost accuracy
- Optimize data pipelines for on premise GPU clusters and air gapped environments
- Operate within a structured Sprint Zero environment to ensure data lineage, security, and governance
Requirements
- 5+ years of experience in Data Engineering
- At least 2 years focused on building pipelines for Machine Learning or Generative AI applications in an enterprise setting
- Expert proficiency in Python, SQL, and modern data engineering frameworks including Apache Spark, Kafka, and Airflow
- Strong experience extracting data from complex ERP environments, specifically SAP S/4HANA and SAP Ariba
- Deep understanding of Data Lakehouse architectures (Databricks/Delta Lake), Relational Databases (PostgreSQL), and Vector Databases (Weaviate/Milvus)
- Experience building pipelines for RAG applications
Full Job Posting
Company Overview
- Headquartered in Abu Dhabi, specializes in AI powered supply chain solutions integrating SAP, Ariba, and unstructured data.
- Focuses on architecting ultra secure data lakehouses for real time analytics and generative AI in defense and technical sectors.
Job Summary
- Seeking a Senior Data Engineer to architect and develop core data infrastructure for AI driven transformation.
- Lead Workstream 1: Data & Platform Foundations, integrating SAP S/4HANA, Ariba, and unstructured data.
- Build high performance pipelines for Intelligent Supply Chain forecasting and generative AI tools.
Key Responsibilities
- Design and deploy defense grade Data Lakehouse architectures as Single Source of Truth for AI driven Supply Chain Intelligence.
- Lead technical execution of Workstream 1, mapping enterprise systems and integrating unstructured data.
- Architect ingestion pipelines for high volume transactional data from SAP S/4HANA, Ariba, and PLM.
- Build connectors for external market intelligence feeds (S&P Global, Orbis, EcoVadis).
- Design and implement standardized procurement data model and taxonomy.
- Engineer pipelines for unstructured technical data into vector ready formats for RAG.
- Manage and optimize Vector Databases (e.g., Weaviate) for high speed retrieval.
- Establish data lineage and traceability protocols for MBSE and Digital Thread.
- Implement RBAC, audit logging, and data redaction for export control compliance.
- Deploy automated data quality frameworks for BOM completeness and cost accuracy.
- Optimize data pipelines for on premise GPU clusters and air gapped environments.
- Operate within Sprint Zero environment for data lineage, security, and governance.
Qualifications And Experience
- 5+ years in Data Engineering, with 2+ years in ML/GenAI pipeline building.
- Expert proficiency in Python, SQL, Apache Spark, Kafka, Airflow.
- Strong experience with SAP S/4HANA and SAP Ariba; familiarity with SAP BTP a plus.
- Deep understanding of Data Lakehouse (Databricks/Delta Lake), PostgreSQL, Vector Databases (Weaviate/Milvus).
- Experience building pipelines for RAG applications.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at cander
Senior Backend Engineer
Abu Dhabi, UAE
Cander is seeking a Senior Backend Engineer to architect and develop production-grade application infrastructure for AI-driven transformation. The role involves designing secure, high-performance backend systems for AI a
Senior QA Automation Engineer
Abu Dhabi, UAE
We are seeking a Senior QA Automation Engineer to lead validation and verification strategies for AI transformation initiatives. You will define rigorous standards for non-deterministic AI systems, creating automated tes
Senior Data Scientist
Abu Dhabi, UAE
A defense-focused AI company in Abu Dhabi seeks a Senior Data Scientist to lead development and deployment of generative AI and NLP solutions for engineering and supply chain applications. The role requires 5+ years of e
Senior Data Engineer
Abu Dhabi, UAE
Cander seeks a Senior Data Engineer to architect defense-grade Data Lakehouse architectures for AI-driven supply chain intelligence in Abu Dhabi. Requires 5+ years data engineering experience, expertise in Python, SQL, S
Senior Backend Engineer
Abu Dhabi, UAE
Cander seeks a Senior Backend Engineer in Abu Dhabi to architect and develop production-grade backend systems for AI-driven transformation. The role involves designing secure, high-performance microservices for AI agent
Senior Data Scientist
Abu Dhabi, UAE
Cander is seeking a Senior Data Scientist to lead AI initiatives for defense applications, developing production-grade generative AI, NLP, and predictive models. The role involves deploying LLMs, RAG pipelines, and time-
Senior Data Engineer
Abu Dhabi, UAE
Cander seeks a Senior Data Engineer to architect and develop core data infrastructure for AI-driven supply chain solutions. The role involves designing defense-grade Data Lakehouse architectures, integrating SAP S/4HANA
Senior Data Scientist
Abu Dhabi, UAE
We are seeking a Senior Data Scientist to lead the development and deployment of AI initiatives for defense capabilities. You will design and deploy generative AI, NLP, and predictive models to transform unstructured dat
Senior Backend Engineer
Abu Dhabi, UAE
Senior QA Automation Engineer
Abu Dhabi, UAE
Senior Data Scientist
Abu Dhabi, UAE
Senior Data Engineer
Abu Dhabi, UAE
Senior Backend Engineer
Abu Dhabi, UAE
Senior Data Scientist
Abu Dhabi, UAE
Senior Data Engineer
Abu Dhabi, UAE
Senior Data Scientist
Abu Dhabi, UAE