Senior Data Engineer - Databricks

We are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks.

We are looking for more than just a "Senior Data Engineer", but a technologist with excellent communication and customer service skills and a passion for data and problem solving.

include:

• Lead and architect migration s of data using Databricks with focus on performance , reliability , and scalability
• Assess and understand ETL jobs, workflows, data marts, BI tools, and reports
• Address technical inquiries concerning customization, integration, enterprise architecture and general feature/functionality of data products
• Experience working with database/data warehouse /data mart solutions in cloud (Preferably AWS. Alternatively Azure, GCP).
• Key must have skill sets – Databricks, SQL, PySpark / Python , AWS
• Support an Agile software development lifecycle
• You will contribute to the growth of our AI & Data Exploitation Practice !
• Ability to hold a position of public trust with the US government.
• 5 - 7 years industry experience coding commercial software and a passion for solving complex problems.
• 5 - 7 years direct experience in Data Engineering with experience in tools such as: Big data tools: Databricks, Apache Spark, Delta Lake , etc. Relational SQL (Preferably T-SQL. Alternatively pgSQL , MySQL) . Data pipeline and workflow management tools: Databricks Workflows , Airflow, Step Functions, etc. AWS cloud services: Databricks on AWS, S3, EC2, RDS (or Azure equivalents) . Object-oriented/object function scripting languages: PySpark / Python, Java, C++, Scala, etc.

working with Data Lake house architecture and Delta Lake /Apache Iceberg.

• Big data tools: Databricks, Apache Spark, Delta Lake , etc.
• Relational SQL (Preferably T-SQL. Alternatively pgSQL , MySQL) .
• Data pipeline and workflow management tools: Databricks Workflows , Airflow, Step Functions, etc.