linkedin
Senior Data Engineer
International Development Company (IDC)
Abu Dhabi, UAE
Full-time
Mid-Senior
Onsite
Discovered Today
Data engineeringEnterprise data platformsData ingestion and integrationBatch processingReal-time and streaming processingData transformation pipelines
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
Data engineeringEnterprise data platformsData ingestion and integration
Key Skills for This Role
Data engineeringEnterprise data platformsData ingestion and integrationBatch processingReal-time and streaming processingData transformation pipelines
Full Job Posting
Core responsibilities
- Design, build, and manage enterprise data products and datasets according to architecture, governance, security, and data-sharing standards.
- Develop and maintain scalable batch, real-time, and streaming ingestion, integration, and transformation pipelines.
- Engineer and optimize data solutions for performance, reliability, scalability, and reusability.
- Design and maintain logical and physical data models for analytics, AI, and business consumption.
- Implement data quality, validation, monitoring, and observability frameworks.
- Administer orchestration, metadata management, cataloging, lineage, and access-control services.
- Develop APIs, data virtualization, and data-sharing services for secure enterprise data access.
- Monitor and troubleshoot platform operations, pipelines, and resource utilization.
- Maintain technical documentation, standards, and operational runbooks.
- Collaborate with architects, governance teams, data scientists, and business stakeholders.
- Drive automation and adoption of modern data engineering practices.
- Support upgrades, testing, deployment, releases, onboarding, access provisioning, and knowledge transfer.
Governance and operational expectations
- Comply with enterprise data management, information security, governance, and software development policies and procedures.
- Participate in audits, compliance reviews, and assessments related to data platform operations and governance.
- Identify and escalate data quality, security, compliance, and operational risks and recommend corrective actions.
- Support change, release, and environment management across development, testing, and production environments.
Continuous improvement
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career