Senior Data Engineer - Python & Microservices
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
GSSTech Group is seeking a Senior Python Data Engineer with expertise in microservices architecture, data engineering, and backend API development in Dubai. The role involves building scalable Python-based applications, designing REST APIs, and performing complex data transformations.
Key Skills for This Role
Responsibilities
- Design, develop, and maintain scalable Python based web frameworks and backend services
- Develop robust RESTful APIs using Python frameworks such as FastAPI, Flask, or Django
- Build and maintain microservices based applications supporting enterprise data platforms
- Design and implement data transformation pipelines for data ingestion, processing, and enrichment
- Develop backend systems to efficiently serve datasets through APIs and other interfaces
- Collaborate with cross functional teams to deliver scalable and secure data driven applications
- Design and maintain relational and NoSQL database schemas
- Develop efficient ETL processes for enterprise data requirements
- Optimize application and database performance to ensure scalability and reliability
- Implement asynchronous programming techniques using asyncio
- Participate in code reviews and contribute to software engineering best practices
- Troubleshoot, debug, and resolve production issues across applications and data pipelines
Requirements
- Strong hands on expertise in Core Python
- Experience building enterprise grade Python applications
- Hands on experience with Python web frameworks (FastAPI, Flask, or Django)
- Strong experience with microservices architecture
- Experience with data transformation pipelines and ETL processes
- Experience with relational databases (PostgreSQL, MySQL) and NoSQL (MongoDB)
- Experience with ORM frameworks (SQLAlchemy, Django ORM)
- Proficiency in SQL and Shell Scripting
- Experience with Git and version control
- Experience with CI/CD pipelines
Full Job Posting
Overview
- We are looking for an experienced Senior Python Data Engineer with strong expertise in Python development, microservices architecture, data engineering, and backend API development. The ideal candidate will have hands on experience building scalable Python based applications and data services, desig
Key Responsibilities
- Design, develop, and maintain scalable Python based web frameworks and backend services.
- Develop robust RESTful APIs using Python frameworks such as FastAPI, Flask, or Django.
- Build and maintain microservices based applications supporting enterprise data platforms.
- Design and implement data transformation pipelines for data ingestion, processing, and enrichment.
- Develop backend systems to efficiently serve datasets through APIs and other interfaces.
- Collaborate with cross functional teams to deliver scalable and secure data driven applications.
- Design and maintain relational and NoSQL database schemas.
- Develop efficient ETL (Extract, Transform, Load) processes for enterprise data requirements.
- Optimize application and database performance to ensure scalability and reliability.
- Implement asynchronous programming techniques using asyncio and optimize concurrent connections and I/O operations.
- Ensure data integrity, consistency, and quality across data transformation pipelines.
- Participate in code reviews and contribute to software engineering best practices.
Required Technical Skills Core Python Development
- Strong hands on expertise in Core Python.
- Experience building enterprise grade Python applications.
- Strong understanding of Python programming concepts, object oriented programming, asynchronous programming (asyncio), concurrent connections handling, I/O optimization techniques, clean code and software design principles.
Python Web Frameworks
- Hands on experience with one or more of the following: FastAPI, Flask, Django, Pyramid.
- Strong understanding of RESTful API development, routing, authentication mechanisms, testing frameworks, database integrations, framework architecture and scalability.
Microservices Architecture
- Strong experience with microservices based application design, service oriented architectures, API integrations, distributed systems, enterprise backend services.
- Knowledge of API Gateways, service communication patterns, scalable backend architectures.
Security & API Management
- Experience implementing OAuth, JWT Authentication, API Security Best Practices, authorization mechanisms, encryption standards, secure API development practices.
Data Engineering & Data Transformations
- Strong hands on experience with data transformation pipelines, ETL processes, data cleansing and enrichment, data aggregation techniques, data quality and integrity management.
- Experience in dataset preparation, data processing workflows, enterprise data platforms.
Database Management
- Experience working with relational databases: PostgreSQL, MySQL, SQL Server (preferred).
- NoSQL databases: MongoDB, Redis (good to have).
- Strong knowledge of database schema design, performance optimization, transactions management, efficient data retrieval techniques.
ORM Frameworks
- Hands on experience with SQLAlchemy, Django ORM.
- Ability to perform CRUD operations, query optimization, transaction handling, data modelling.
DevOps & CI/CD
- Experience with CI/CD pipeline development and maintenance, Git based workflows, version control best practices, branching strategies, code reviews, production deployments.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at GSSTech Group
Sr. Oracle EBS Techno-Functional Consultant (Finance & HR)
Dubai, UAE
GSSTech Group is seeking a Senior Oracle EBS Techno-Functional Consultant with 70% technical and 30% functional expertise in Oracle ERP Finance and HR modules. The role involves designing, customizing, and supporting Ora
Application Support Specialist - Open Finance & APIs
Dubai, UAE
GSSTech Group is seeking an Application Support Specialist with hands-on experience in Open Finance/Open Banking APIs to support business-critical applications in Dubai. The role involves monitoring API integrations, tro
Finacle Application Support Lead - Core Banking
Dubai, UAE
GSSTech Group is looking for an experienced Finacle Application Support Lead to manage production support for Finacle Core Banking platforms. The role involves incident management, root cause analysis, stakeholder coordi
Junior Project Manager - IT Delivery (Banking)
Dubai, UAE
GSSTech Group seeks a motivated Associate Project Manager to support IT and digital transformation projects in a banking environment. The role involves coordinating cross-functional teams, tracking delivery milestones, a
Senior Project Analyst - (Banking)
, UAE
GSSTech Group is seeking a Senior Project Analyst / PMO Analyst to support technology and business transformation initiatives. The role involves project management, PMO governance, reporting, stakeholder coordination, an
Senior IT Project Manager - Banking & Agile Delivery
Dubai, UAE
GSSTech Group seeks an experienced Senior IT Project Manager to lead complex technology and business transformation initiatives in a large enterprise environment. The role requires strong expertise in project planning, e
Application Support Specialist - Open Finance & APIs
Dubai, UAE
GSSTech Group seeks an Application Support Specialist with Open Finance/Open Banking API experience for an onsite role in Dubai. The role involves Level 2 support, monitoring API integrations, troubleshooting production
HR Manager - IT Staffing
Dubai, UAE
Lead HR function, manage compliance, employee relations, and workforce planning; requires strong knowledge of UAE Labour Law and fluent Arabic and English.
Sr. Oracle EBS Techno-Functional Consultant (Finance & HR)
Dubai, UAE
Application Support Specialist - Open Finance & APIs
Dubai, UAE
Finacle Application Support Lead - Core Banking
Dubai, UAE
Junior Project Manager - IT Delivery (Banking)
Dubai, UAE
Senior Project Analyst - (Banking)
, UAE
Senior IT Project Manager - Banking & Agile Delivery
Dubai, UAE
Application Support Specialist - Open Finance & APIs
Dubai, UAE
HR Manager - IT Staffing
Dubai, UAE