PythonSQLAzure Data FactoryAzure SynapseDatabricksAzure Blob Storage
Full Job Posting
Key Responsibilities
Design, develop, monitor, and maintain end-to-end data pipelines on Azure.
Work with Azure services such as Azure Data Factory (ADF), Azure Synapse, Databricks, and Azure Blob Storage for data ingestion, processing, and analytics.
Develop and optimize data ingestion, transformation, and analytical workflows for structured and unstructured data.
Design efficient data models to ensure optimal performance in data processing and storage.
Implement large-scale data ingestion pipelines capable of handling TBs of data.
Develop scalable and high-throughput distributed batch or real-time data solutions using Apache Kafka, Apache Airflow, and Databricks.
Build and maintain ETL/ELT pipelines for data integration and migration.
Work extensively with relational databases (PostgreSQL, MySQL, SQL Server) and NoSQL databases (MongoDB, CosmosDB, Cassandra, GraphDB).
Optimize SQL queries, performance tuning, indexing, partitioning, and denormalization strategies.
Collaborate with cross-functional teams, including data scientists and software engineers, to integrate data solutions into production environments.
Ensure data quality, integrity, and compliance with security best practices.
Participate in client interactions and stakeholder meetings to gather requirements and provide technical insights.
Required Skills & Qualifications
Bachelor’s/Master’s degree in Computer Science, Data Engineering, or a related field.
5+ years of hands-on experience in data engineering, ETL development, and data pipeline implementation.
Proficiency in Python and SQL for data processing and analysis.
Strong expertise in Azure data services (ADF, Synapse, Databricks, Blob Storage, etc.).
Experience with big data processing frameworks like Spark, Kafka, and Airflow.
Working knowledge of data warehouse solutions such as Synapse, Snowflake, Redshift, or BigQuery.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
Simform is seeking a Tech Lead / Junior Data Architect to design and build modern data platforms on Microsoft Fabric and Azure. The role leads a small delivery pod, owns architecture and technical decisions, and requires