Data Engineer (3-5 Yrs)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Data Pipeline Architecture and Development: Architect and optimize scalable data storage solutions, including data lakes, warehouses, and NoSQL databases, suppor.
Key Skills for This Role
Full Job Posting
Data Pipeline Architecture And Development
- Architect and optimize scalable data storage solutions, including data lakes, warehouses, and NoSQL databases, supporting large-scale analytics.
- Design and maintain efficient data pipelines using technologies such as Apache Spark, Kafka, Fabric Data Factory, and Airflow, based on cross-functional team requirements.
Data Integration And Etl
- Develop robust ETL processes for reliable data ingestion, utilizing tools like SSIS, ADF, and custom Python scripts to ensure data quality and streamline workflows.
- Optimize ETL performance through techniques like partitioning and parallel processing.
Data Modeling And Schema Design
- Define and implement data models and schemas for structured and semi-structured sources, ensuring consistency and efficiency while collaborating with data teams to optimize performance.
Data Governance, Security, and Compliance
- Establish and enforce data governance policies, ensuring data quality, security, and compliance with regulations, using tools like Microsoft SQL Server.
- Implement access controls, encryption, and auditing to protect sensitive data and collaborate with IT to address vulnerabilities.
Infrastructure Management And Optimization
- Manage and optimize cloud and on-prem infrastructure for data processing, monitor system performance, and implement disaster recovery enhancements.
- Leverage automation for provisioning, configuration, and deployment to improve operational efficiency.
Team Leadership And Mentorship
- Provide technical leadership, mentoring team members in best practices and cloud technologies, while aligning data engineering initiatives with strategic goals.
Skills Required
- Bachelor s degree or higher in Software Engineering, Computer Science, Engineering, or a related field.
- 3-5 years of experience in data engineering, with a proven history of designing and implementing complex data infrastructure.
- Proficient in Python, Scala, or Java, with experience in scalable, distributed systems.
- Strong knowledge of cloud computing platforms and related services like AWS Glue, Azure Data Factory, or Google Dataflow.
- Expertise in data modeling, schema design, and SQL query optimization for both relational and NoSQL databases.
- Excellent communication and leadership skills, with the ability to collaborate effectively with cross-functional teams and stakeholders.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Sol Analytics
Data Scientist
United Arab Emirates, UAE
Engage clients, develop and implement analytics projects, utilizing data analytics tools, with strong problem-solving and leadership skills required.
Data Scientist, Loyalty Exp
United Arab Emirates, UAE
Engage clients for analytics projects, identify growth opportunities, lead loyalty management initiatives, and utilize data analytics tools for impactful solutions.
Data Scientist, MMM Exp (8+ Yrs)
United Arab Emirates, UAE
The role involves leading marketing mix modeling projects, utilizing advanced analytics, and providing actionable insights to enhance client marketing effectiveness.
Data Analyst, Loyalty
Dubai, UAE
Data Collection, Management, and Analysis: Collect, clean, and organize data using Microsoft tools like SQL Server, Excel, and Power Query, ensuring data integrity through SSIS....