Senior Data Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Design, develop, and maintain scalable data pipelines for the efficient collection, storage, and processing of large datasets. Develops and design best practices around data collection and maintain orchestration of data flows, for batch, near-real time data.
Key Skills for This Role
Full Job Posting
Overview
- Design, develop, and maintain scalable data pipelines for the efficient collection, storage, and processing of large datasets.
- Develops and design best practices around data collection and maintain orchestration of data flows, for batch, near-real time data.
- Participates in evaluation and deployment of big data tools, relevant to the development.
- Ability to identify different platforms, techniques, and methodology used in big data platforms, and demonstrate for various system in the organization.
- Optimize and tune data systems for performance and reliability.
- Develop and implement data models and schemas to support business intelligence and analytics needs.
- Monitor and troubleshoot data pipelines to ensure smooth and efficient operation.
- Stay up-to-date with the latest advancements in data engineering and incorporate them into our data infrastructure.
- Document data engineering architectures and follow best practices.
Qualifications
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
- 5+ years of experience as a Data Engineer or similar role.
- Strong programming skills in Python.
- Experience with UNIX system administration using command line.
- Experience with data processing frameworks such as Airflow, Airbyte, DBT, Hadoop, Spark, Hive, and Kafka, Proficiency in SQL and experience with relational databases.
- Knowledge of data modeling, ETL processes, and data warehousing solutions.
- Knowledge of Structuring data in various schemas suitable for a data lake, warehouse, or marts.
- Experience in implementing scalable, reliable, and efficient data storage solutions with PostgreSQL, MinIO.
- Experience in enhancing the performance of big data applications, including optimizing system operations.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at BBI
Project Manager
الرياض, KSA
BBI is seeking an experienced Project Manager to lead AI-driven initiatives. The role requires 5+ years of project management experience with Agile and Scrum methodologies. The position is remote and involves managing sc
Data Strategy Consultant
Dubai, UAE
BBI is seeking a Senior Data Strategy Consultant to lead data strategy, governance, and analytics projects for clients. Requires 3+ years of experience in data management, DAMA or NDMO knowledge, and bilingual communicat
Senior Big Data Engineer
الرياض, KSA
Responsibilities: Design, implement, and optimize data pipelines for batch and real-time data processing using Cloudera (Hadoop, Hive, Spark, Impala) and Informatica (PowerCenter, Cloud Data Integration) Build data ext
Senior Data Modeler
الرياض, KSA
Responsibilities: Develop and maintain conceptual, logical, and physical data models using data modeling tools. Collaborate with stakeholders, business analysts, and Data Engineer teams to gather business requirements
Oracle ADF/Application Support Engineer
Doha, QAT
Qualifications: eSTR software development and operational support. Minor development changes (Oracle ADF forms, APIs, etc.) Break-fixes and certificate renewals. Onsite Oracle ADF expert (permanent Qatar resident req
Sales - Account Lead
الرياض, KSA
Overview A strategic and results-driven sales professional responsible for leading business growth within a defined portfolio of named accounts. The Account Lead owns the end-to-end sales cycle, develops long-term client
Project Manager
الرياض, KSA
Data Strategy Consultant
Dubai, UAE
Senior Big Data Engineer
الرياض, KSA
Senior Data Modeler
الرياض, KSA
Oracle ADF/Application Support Engineer
Doha, QAT
Sales - Account Lead
الرياض, KSA