Senior Data Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Responsibilities As a Senior Data Engineer, you will be responsible for developing and maintaining data systems to support the company's strategic goals. Your role will encompass a range of activities focused on data pipeline development, data quality, and cross-functional collaboration.
Key Skills for This Role
Full Job Posting
Responsibilities
- As a Senior Data Engineer, you will be responsible for developing and maintaining data systems to support the company's strategic goals.
- Your role will encompass a range of activities focused on data pipeline development, data quality, and cross-functional collaboration.
- **Data Pipeline Architecture and Development:**
- Design, construct, install, test, and maintain highly scalable data pipelines with a focus on machine learning models and analytics.
- **Data Integration:**
- Work closely with data scientists, ML engineers, and stakeholders to ensure that data is accessible, consistent, and reliable for ongoing projects.
- **API and Data Services:**
- Develop and maintain APIs for data access and manipulation, and integrate with external data services as needed.
- **Data Storage:**
- Manage and optimize data storage solutions for both structured and unstructured data, where structured data includes relational databases and unstructured data includes Text, Image, Audio and Video, Search Engines like Elasticsearch, and NoSQL databases, to support the requirements of machine learning models.
- Understand data engines and structure to effectively design solutions for transactional, analytics, and search purposes.
- **Data Quality and Governance:**
- Implement processes to monitor data quality and ensure production data is always accurate and available for key stakeholders.
- **Collaboration and Support:**
- Collaborate with ML engineers to assist in data-related technical issues and provide architectural guidance and solutions.
- **Security and Compliance:**
- Ensure compliance with data security and privacy policies.
- **Documentation:**
- Maintain clear and up-to-date documentation, including data dictionaries, metadata, and architectural diagrams.
Skills And Attributes For Success
- Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience
- 8+ years of experience in a Data Engineering role
- Proficiency in programming languages including Python, Java, and Scala; experience managing large-scale data at Terabyte to Petabyte scale
- Hands-on experience with big data technologies like Hadoop, Spark, and Flink
- Familiarity with machine learning frameworks such as TensorFlow, PyTorch, or similar
- Strong understanding of data warehousing concepts, ETL processes, and data modeling
- Experience with API development and integration with data services
- Experience with cloud platforms like Azure/AWS/GCP, VMware and other
- Knowledge of DevOps, CI/CD methods, and containerization technologies like Docker or Kubernetes
- Cloud & Infrastructure: Hands-on experience with AWS services (S3, Redshift, Glue, Lambda) as the primary cloud platform, with a strong focus on security and scalability
- BI & Visualization: Experience with business intelligence tools such as Metabase for data visualization, reporting, and enabling self-serve analytics
- Data Governance & Cataloging: Familiarity with metadata management and data catalog tools (e.g., OpenMetadata) to support data discoverability and governance initiatives
- Experience with real-time / streaming data processing
- Good to have fintech experience
Technical Stack
- **Programming Languages**
: Python, Java, Scala, SQL, Bash
- **Big Data Technologies**
: Hadoop, Spark, Flink
- **Unstructured Data**
: Text, Image, Audio & Video
- **Databases**
: MySQL, PostgreSQL, MongoDB, Cassandra, HBase, Redis
- **Cloud Platforms**
- : Azur, GCP, AWS and similar
- **API Development**
: RESTful APIs, GraphQL, OpenA
- **PIData Services**
- : Kafka, Rabbit
- **MQContainers**
- : Docker, Kubernetes
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Boundless
AI Engineering Lead – LLM Engineering, AI Development & Intelligent Automation
Dubai, UAE
Our client, a global financial services group, seeks an experienced AI Engineering Lead to establish LLM Engineering capability and accelerate AI-powered software development. You will define standards, architecture, too
Data & AI Modeler
Dubai, UAE
Our client, a global financial services group, seeks a Data & AI Modeler to own the design, implementation, and governance of enterprise data models supporting AI systems, BI, analytics, and ML. You will design scalable
Head of Finance | FX & CFDs
Dubai, UAE
Boundless seeks a Head of Finance for a global regulated financial services group in FX, CFDs, and digital assets. The role leads financial management, reporting, planning, and controls across multiple entities. Requires
AI Social Media Specialist
Dubai, UAE
A financial services group seeks an AI-focused Digital Marketing Executive to drive AI use across social media, content creation, campaign optimization, and automation. Requires 4+ years digital marketing experience and
AI Product Analyst
Dubai, UAE
Boundless is seeking an AI Product Analyst for a global regulated financial services group in Dubai. The role drives analytics for AI-powered products, automation, and customer intelligence platforms, partnering with Pro
Quant AI Specialist
Dubai, UAE
Boundless is seeking a Quant AI Specialist for a global regulated financial services group in Dubai. The role applies quantitative research, machine learning, and AI to solve trading, risk management, and market analytic
Recruitment Specialist (Arabic Speaker)
Dubai, UAE
Boundless is seeking a Recruitment Specialist (Arabic Speaker) to manage full-cycle recruitment, workforce planning, and talent sourcing. The role involves partnering with senior leadership, managing ATS, and contributin
Head of Litigation (Barrister)
Dubai, UAE
Our client, a globally regulated financial services group, seeks a Head of Litigation (Barrister) to join the in-house Legal team. The role involves strategic legal advisory across regulated brokerage, payments, and digi
AI Engineering Lead – LLM Engineering, AI Development & Intelligent Automation
Dubai, UAE
Data & AI Modeler
Dubai, UAE
Head of Finance | FX & CFDs
Dubai, UAE
AI Social Media Specialist
Dubai, UAE
AI Product Analyst
Dubai, UAE
Quant AI Specialist
Dubai, UAE
Recruitment Specialist (Arabic Speaker)
Dubai, UAE
Head of Litigation (Barrister)
Dubai, UAE