Senior Data Engineer

Opportunity overview

Data engineering delivery

• Deliver complex data engineering projects and drive execution from design through production deployment.
• Implement scalable data patterns and reusable frameworks.
• Design batch and near-real-time pipelines.
• Build ingestion, transformation, validation, and publishing frameworks.
• Support modernization of legacy workloads.
• Contribute to Apache Iceberg implementation and optimization.
• Apply standards for schema evolution, partitioning, compaction, and metadata management.
• Ensure efficient storage and query performance.
• Implement data quality frameworks and validation layers.
• Support observability, monitoring, operational excellence, and reliability improvements.
• Participate in architecture discussions and code reviews.
• Mentor junior engineers and share best practices.

ISMS responsibilities

• Oversee specified business processes within the information security management system.
• Manage ISMS documentation, conduct risk assessments, and implement risk treatment plans.
• Identify, assess, and manage risks within assigned areas of responsibility.
• Conduct business continuity and information security continuity tests with the CISO.
• Monitor and report on ISMS performance.
• Implement security policies and procedures and report issues to the CISO.

Required qualifications

• At least 5 years of data engineering experience.
• Experience contributing to enterprise-scale data initiatives.
• Experience with AWS S3, Glue, Athena, and Lake Formation.
• Knowledge of IAM and security controls.
• Experience with Delta Lake or Hudi.
• Experience with dbt, Airflow or Step Functions, Python, SQL, and PySpark or Spark.

Preferred technology

• Apache Iceberg experience is preferred.

Location preference

• Reliable commuting to or relocation to Hyderabad is preferred.

About Cohere Health