Senior Data Engineer - Python & Microservices

Global Software Solutions Group

, UAE

Senior

PythonFastAPIFlaskDjangoMicroservices ArchitectureREST API Development

Apply

Free

Job Fit Check

Base Career helps you apply smarter for this job.

Ready to Scan

Key skills for this role

PythonFastAPIFlask

Smart Apply

About the Role

Global Software Solutions Group is seeking an experienced Senior Python Data Engineer with strong expertise in Python development, microservices architecture, data engineering, and backend API development.

Key Skills for This Role

PythonFastAPIFlaskDjangoMicroservices ArchitectureREST API Development

Responsibilities

Design, develop, and maintain scalable Python based web frameworks and backend services
Develop robust RESTful APIs using Python frameworks such as FastAPI, Flask, or Django
Build and maintain microservices based applications supporting enterprise data platforms
Design and implement data transformation pipelines for data ingestion, processing, and enrichment
Develop backend systems to efficiently serve datasets through APIs and other interfaces
Collaborate with cross functional teams to deliver scalable and secure data driven applications
Design and maintain relational and NoSQL database schemas
Develop efficient ETL processes for enterprise data requirements
Optimize application and database performance to ensure scalability and reliability
Implement asynchronous programming techniques using asyncio and optimize concurrent connections and I/O operations
Ensure data integrity, consistency, and quality across data transformation pipelines
Participate in code reviews and contribute to software engineering best practices

Requirements

Strong hands on expertise in Core Python
Experience building enterprise grade Python applications
Hands on experience with Python web frameworks such as FastAPI, Flask, or Django
Strong experience with microservices based application design
Experience implementing OAuth, JWT Authentication, API Security Best Practices
Strong hands on experience with data transformation pipelines, ETL processes
Experience working with relational databases (PostgreSQL, MySQL) and NoSQL databases (MongoDB, Redis)
Hands on experience with ORM frameworks like SQLAlchemy or Django ORM
Experience with CI/CD pipeline development and maintenance, Git based workflows
Strong proficiency in SQL, Shell Scripting, and Python scripting

Full Job Posting

Overview

We are looking for an experienced Senior Python Data Engineer with strong expertise in Python development, microservices architecture, data engineering, and backend API development.
The ideal candidate will have hands on experience building scalable Python based applications and data services, designing robust REST APIs, performing complex data transformations, and developing high performance backend frameworks to support enterprise data driven applications.
This role requires strong proficiency in Python web frameworks, asynchronous programming, microservices architecture, ETL processes, database management, and modern software engineering best practices.

Key Responsibilities

Design, develop, and maintain scalable Python based web frameworks and backend services
Develop robust RESTful APIs using Python frameworks such as FastAPI, Flask, or Django
Build and maintain microservices based applications supporting enterprise data platforms
Design and implement data transformation pipelines for data ingestion, processing, and enrichment
Develop backend systems to efficiently serve datasets through APIs and other interfaces
Collaborate with cross functional teams to deliver scalable and secure data driven applications
Design and maintain relational and NoSQL database schemas
Develop efficient ETL (Extract, Transform, Load) processes for enterprise data requirements
Optimize application and database performance to ensure scalability and reliability
Implement asynchronous programming techniques using asyncio and optimize concurrent connections and I/O operations
Ensure data integrity, consistency, and quality across data transformation pipelines
Participate in code reviews and contribute to software engineering best practices

Required Technical Skills

Strong hands on expertise in Core Python
Experience building enterprise grade Python applications
Hands on experience with one or more of: FastAPI, Flask, Django, Pyramid
Strong experience with microservices based application design, service oriented architectures, API integrations, distributed systems, enterprise backend services
Experience implementing OAuth, JWT Authentication, API Security Best Practices, Authorization mechanisms, Encryption standards, Secure API development practices
Strong hands on experience with data transformation pipelines, ETL processes, data cleansing and enrichment, data aggregation techniques, data quality and integrity management
Experience working with relational databases (PostgreSQL, MySQL, SQL Server) and NoSQL databases (MongoDB, Redis)
Hands on experience with ORM frameworks: SQLAlchemy, Django ORM
Experience with CI/CD pipeline development and maintenance, Git based workflows, version control best practices, branching strategies, code reviews, production deployments
Strong proficiency in SQL, Shell Scripting, and Python scripting

Preferred Skills

Exposure to big data technologies: Apache Spark, Hadoop, Apache Kafka
Understanding of data warehousing concepts and large scale data processing architectures
Exposure to cloud platforms: AWS, Microsoft Azure, Google Cloud Platform (GCP)
Knowledge of containerization: Docker, Kubernetes
Knowledge of data governance principles and data security

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Trusted by over 500,000 job seekers on Base Career

Start Free Today