{bc}
linkedin

Data Engineer (Python)

Olik Global
Abu Dhabi, UAE
Contract
Senior
Onsite
3 weeks ago
PythonPandasNumPyAirflowBigQuerySQL
Free

Job Fit Check

Base Career helps you apply smarter for this job.

?%
Ready to Scan

Key skills for this role

PythonPandasNumPy
Smart Apply

Full Job Posting

Role Overview

  • Build the data backbone of the MRO Inventory Optimization solution — ingestion, cleansing, transformation, and the optimization logic that turns raw SAP material master and inventory data into actionable outputs.
  • You'll own pipelines from source through to the analytics and application layers.

Must Have — technical depth expected

  • Python: Production grade code, modular design, packaging, logging, config management, unit testing (pytest); strong grasp of data structures and performance
  • Pandas / NumPy: Vectorized transformations, joins/merges, groupby/aggregation, handling large datasets, deduplication, type coercion, working with messy real world MRO/master data
  • Airflow: Authoring DAGs, operators/sensors, scheduling and backfills, task dependencies, retries/SLAs, idempotent pipeline design, parameterization
  • BigQuery: Writing performant SQL, partitioning/clustering, cost aware querying, loading/exporting data, working with nested/repeated fields
  • SQL: Advanced joins, window functions, CTEs, aggregation, query optimization across relational and warehouse engines
  • API development: Building and consuming REST APIs (FastAPI/Flask), request validation, pagination, integration with upstream systems (e.g., SAP sourced data via CPI/OData)

Good to Have

  • PySpark (distributed transforms)
  • ML basics (forecasting/classification relevant to inventory optimization — EOQ, demand forecasting, slow moving/obsolete stock detection)
  • Data quality frameworks (Great Expectations or similar)
  • Docker, CI/CD

Scope of Work

  • Data ingestion from SAP material master and inventory feeds (via API/OData) and other sources into the warehouse
  • Data cleansing and master data processing — standardizing material descriptions, deduplication, classification, handling incomplete records
  • Build and orchestrate ETL pipelines (Airflow → BigQuery), ensuring reliability, idempotency, and data lineage
  • Implement inventory optimization logic (reorder points, safety stock, EOQ, criticality/ABC analysis, obsolescence flags)
  • Develop backend services / APIs exposing processed data to the UI and BI layers

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Olik Global