Python Senior Technical Lead - Data Analysis, SQL (159578)

Skill Requirements

• Mandatory Technical Skills
• Ability to be forward-thinking and be able to analyse and anticipate project, technology and team solutions to ensure successful project delivery Ability to take ownership of a technical solution, build new things without needing close supervision, learn and apply new tools and technologies, solve problems without needing constant help, make consistent daily progress on design and build. Directly involved in driving a Data Mesh architecture / design Hand-on Databricks expertise Hands-on experience with ETL tools such as AWS Glue / DBT Strong knowledge of AWS services ( Lambda, Glue, ECS, Step Functions, IAM roles, Lakeformation, EventBridge, SNS, SQS, EC2,Security Groups, Cloudformation, VPC, Cloud Watch, AWS Auto Scaling, Cloud Trail, Service Catalog,Fargate) Promotes an automated deployment approach through dev/ ops pipelines. Ideally using Gitlab Demonstrable working knowledge on different file formats like XML,JSON, Parquet, Iceberg, AVRO. Hands-on experience in developing applications using Python/ PySPARK Understanding of core AWS services, uses, and AWS architecture best practices with in-depth Knowledge of AWS cloud service like Compute, Network, Storage and Identity & access management. Exposure working with Data Warehousing / Big Data applications. Experience with event driven and real time architecture patterns, messaging and streaming technologies such as Kafka, Kinesis and AWS Managed Services for Kafka.
• Ability to be forward-thinking and be able to analyse and anticipate project, technology and team solutions to ensure successful project delivery
• Ability to take ownership of a technical solution, build new things without needing close supervision, learn and apply new tools and technologies, solve problems without needing constant help, make consistent daily progress on design and build.
• Directly involved in driving a Data Mesh architecture / design
• Hand-on Databricks expertise
• Hands-on experience with ETL tools such as AWS Glue / DBT
• Strong knowledge of AWS services ( Lambda, Glue, ECS, Step Functions, IAM roles, Lakeformation, EventBridge, SNS, SQS, EC2,Security Groups, Cloudformation, VPC, Cloud Watch, AWS Auto Scaling, Cloud Trail, Service Catalog,Fargate)
• Promotes an automated deployment approach through dev/ ops pipelines. Ideally using Gitlab
• Demonstrable working knowledge on different file formats like XML,JSON, Parquet, Iceberg, AVRO.
• Hands-on experience in developing applications using Python/ PySPARK
• Understanding of core AWS services, uses, and AWS architecture best practices with in-depth Knowledge of AWS cloud service like Compute, Network, Storage and Identity & access management.
• Exposure working with Data Warehousing / Big Data applications.
• Experience with event driven and real time architecture patterns, messaging and streaming technologies such as Kafka, Kinesis and AWS Managed Services for Kafka.
• For this senior role, we would require experience of full development lifecycle. A strong analytical mind, Strong understanding of industry standards / best practices related to Cloud, serverless technology.
• The role holder must be a strong computer scientist with a good appreciation of data structures and other fundamentals.