Data Platform Engineer - Security (m/f/d)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Halian seeks a Data Platform Engineer (Security) in Abu Dhabi to design and maintain scalable, real-time data platforms for security operations. The role involves building high-throughput pipelines, integrating with SIEM/SOAR, and managing cyber data lakes.
Key Skills for This Role
Responsibilities
- Design and implement real time data ingestion pipelines for security events
- Integrate pipelines with SIEM platforms (e.g., Splunk, Sentinel, QRadar) and SOAR tools
- Develop and maintain threat intelligence correlation engines to support SOC operations
- Design and manage a centralized cyber data lake for security logs, incident data, and forensic records
- Build robust ETL/ELT processes for structured and unstructured security data
- Optimize performance and cost efficiency of cloud based data platforms
- Enable advanced analytics capabilities for threat detection, incident response, and behavioral analytics
- Ensure data platforms meet internal security policies and regulatory requirements
- Support audit requests and forensic investigations with reliable data access
Requirements
- Bachelor’s or Master’s degree in Data Engineering, Computer Science, Information Systems or related field
- 8–10 years of experience in data engineering / big data platforms and cloud based data architecture (Azure / AWS)
- Hands on experience working with high volume, real time data pipelines and security or operational data systems
- Experience in cybersecurity or SOC environments (highly preferred)
- Strong expertise in Azure Data Services (Data Factory, Synapse, Event Hub, etc.) and Databricks (mandatory experience preferred)
- Experience with streaming technologies (Kafka, Spark Streaming, or equivalent) and SIEM/SOAR integrations
- Proficiency in SQL, Python, or Scala
- Microsoft Certified: Azure Data Engineer Associate (preferred)
- Databricks Certified Data Engineer Professional (preferred)
Full Job Posting
Role Purpose
- The Data Platform Engineer (Cybersecurity) is responsible for designing, building, and maintaining scalable, real time data platforms that support security operations, threat intelligence, and cyber forensics.
- This role focuses on developing high throughput data pipelines, integrating with SIEM/SOAR systems, and creating data lake architectures that enable advanced analytics, incident investigations, and audit readiness.
- The position plays a critical role in ensuring that security data is reliable, structured, and actionable for SOC and risk teams.
Key Responsibilities
- Real Time Security Data Pipelines: Design and implement real time data ingestion pipelines for security events
- Integrate pipelines with SIEM platforms (e.g., Splunk, Sentinel, QRadar) and SOAR tools and security monitoring systems
- Ensure high availability, scalability, and low latency data processing
- Handle large scale event streaming and log ingestion from diverse sources
- Threat Intelligence Correlation Engine: Develop and maintain threat intelligence correlation engines to support SOC operations
- Integrate external and internal threat feeds to enrich security events and improve detection accuracy
- Enable real time correlation and contextualization of threats
- Work closely with SOC teams to refine detection logic and use cases
- Cyber Data Lake Architecture: Design and manage a centralized cyber data lake for security logs, incident data, forensic and audit records
- Ensure the platform supports scalable storage and retrieval, data retention and lifecycle policies, and compliance with regulatory and audit requirements
- Optimize data structures for investigations, reporting and analytics, and machine learning use cases
- Data Engineering & Platform Optimization: Build robust ETL/ELT processes for structured and unstructured security data
Qualifications & Experience
- Bachelor’s or Master’s degree in Data Engineering, Computer Science, Information Systems or related field
- 8–10 years of experience in data engineering / big data platforms and cloud based data architecture (Azure / AWS)
- Hands on experience working with high volume, real time data pipelines and security or operational data systems
- Experience in cybersecurity or SOC environments (highly preferred)
- Exposure to regulated industries (banking/financial services) is an advantage
Technical Skills
- Strong expertise in Azure Data Services (Data Factory, Synapse, Event Hub, etc.) and Databricks (mandatory experience preferred)
- Experience with streaming technologies (Kafka, Spark Streaming, or equivalent) and SIEM/SOAR integrations
- Proficiency in SQL, Python, or Scala
- Knowledge of data lake architectures (Delta Lake, Lakehouse models) and security data schemas and log formats
- Familiarity with cloud platforms (Azure, AWS) and data governance and security best practices
Certifications (Mandatory / Preferred)
- Microsoft Certified: Azure Data Engineer Associate
- Databricks Certified Data Engineer Professional
Soft Skills
- Strong analytical and problem solving capabilities
- Ability to manage large scale data environments
- Effective collaboration with cybersecurity and SOC teams
- Strong documentation and communication skills
Ideal Candidate Profile
- Experienced data engineer with strong cloud and streaming expertise
- Proven ability to handle high volume, real time security data
- Familiar with SOC operations and cybersecurity data use cases
- Capable of designing platforms that support analytics, investigations, and compliance
- Strong balance of engineering depth and operational reliability
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Halian | Managed Services, Recruitment Agency & Contract Staffing
Finance Data Analytics & Automation Consultant (m/f/d)
Dubai, UAE
A six-month, full-time project assignment for a hands-on Finance Data Analytics & Automation Consultant in Dubai. You will partner with the Group Finance Director to build an automated, data-led, AI-enabled reporting env
AI Business Analyst (m/f/d)
Abu Dhabi Emirate, UAE
A leading organization is seeking a Technical Business Systems Analyst to bridge business and technology. The role involves translating stakeholder requirements into technical deliverables, working with development and Q
Senior Frontend Designer (m/f/d)
Abu Dhabi Emirate, UAE
We are seeking a Senior Frontend Designer to design, build, and maintain modern, responsive web applications. The role combines deep frontend expertise with backend contributions using Node.js and Python. Requires 6+ yea
Conversational AI Engineer
Abu Dhabi Emirate, UAE
Halian is hiring a Conversational AI Engineer for a 1-year extendable contract in Abu Dhabi. The role requires 5+ years of Python experience, expertise in Prompt Engineering and RAG, and experience with Azure OpenAI Serv
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE
Halian is seeking a Navigation Engineer to develop autonomous navigation capabilities for Unmanned Ground Vehicles (UGVs). The role involves designing planning and control algorithms, mathematical modeling, and integrati
Document Controller (m/f/d)
Abu Dhabi Emirate, UAE
Halian is seeking a Document Controller for a sustainable urban development project in Abu Dhabi. The role involves managing document control systems, ensuring compliance with standards, and supporting project teams. Can
Finance Manager UAE (m/f/d)
Abu Dhabi Emirate, UAE
Our client is seeking a Finance Manager to lead the finance function of the UAE entity, ensuring accurate financial reporting, statutory compliance, and effective treasury management. The role requires 8-12 years of expe
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE
Halian is seeking a Navigation Engineer to develop autonomous navigation capabilities for Unmanned Ground Vehicles (UGVs) in Abu Dhabi. The role involves designing planning and control algorithms, mathematical modeling,
Finance Data Analytics & Automation Consultant (m/f/d)
Dubai, UAE
AI Business Analyst (m/f/d)
Abu Dhabi Emirate, UAE
Senior Frontend Designer (m/f/d)
Abu Dhabi Emirate, UAE
Conversational AI Engineer
Abu Dhabi Emirate, UAE
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE
Document Controller (m/f/d)
Abu Dhabi Emirate, UAE
Finance Manager UAE (m/f/d)
Abu Dhabi Emirate, UAE
Engineer - Navigation (m/f/d)
Abu Dhabi Emirate, UAE