Data Engineer (Cloud Operations)

Key Responsibilities –

• Design, develop, deploy, and support scalable data pipelines, data models, and platform solutions.
• Monitor, maintain, and troubleshoot data platform operations to ensure reliability, performance, and availability.
• Implement data quality, governance, and security controls including IAM, RBAC, least privilege, encryption, secrets management, logging, auditability, and compliant data handling.
• Ensure secure integration and data exchange by applying API security, SSL/TLS certificates, credential rotation, vulnerability management, and secure-by-design operational practices.
• Build and manage CI/CD pipelines, automation, and release processes for data engineering solutions.
• Collaborate with business and technical stakeholders to deliver data solutions aligned with business requirements.
• Drive incident resolution, root cause analysis, and continuous improvement of data platforms and processes.
• Support cloud-based data platform modernization, migrations, and operational excellence

Education Requirements

• Bachelor’s degree in Computer Science, MIS, Engineering, Business Administration, or a related field required.

Knowledge & Skills REQUIRED

• Minimum 5+ years of relevant work experience – Data Platforms, Cloud & Integration AWS Cloud Platform: EC2, S3, RDS, Lambda, Glue, IAM, Secrets Manager Snowflake, data lake/lakehouse concepts, ETL/ELT, data ingestion, batch processing, and SQL databases REST APIs, GraphQL, API Management, JSON, OpenAPI, API security, and event-based integration Monitoring & Observability Grafana, Prometheus, CloudWatch, OpenTelemetry, ELK Stack, and data quality dashboards Security & Networking IAM, RBAC, OAuth 2.0, OpenID Connect, SAML SSL/TLS certificates, encryption, secrets management, credential rotation Network security, API security, vulnerability management Wiz managed-solution actions, GitHub Advanced Security, and security mitigations
• Data Platforms, Cloud & Integration AWS Cloud Platform: EC2, S3, RDS, Lambda, Glue, IAM, Secrets Manager Snowflake, data lake/lakehouse concepts, ETL/ELT, data ingestion, batch processing, and SQL databases REST APIs, GraphQL, API Management, JSON, OpenAPI, API security, and event-based integration
• AWS Cloud Platform: EC2, S3, RDS, Lambda, Glue, IAM, Secrets Manager
• Snowflake, data lake/lakehouse concepts, ETL/ELT, data ingestion, batch processing, and SQL databases
• REST APIs, GraphQL, API Management, JSON, OpenAPI, API security, and event-based integration
• Monitoring & Observability Grafana, Prometheus, CloudWatch, OpenTelemetry, ELK Stack, and data quality dashboards
• Grafana, Prometheus, CloudWatch, OpenTelemetry, ELK Stack, and data quality dashboards
• Security & Networking IAM, RBAC, OAuth 2.0, OpenID Connect, SAML SSL/TLS certificates, encryption, secrets management, credential rotation
• IAM, RBAC, OAuth 2.0, OpenID Connect, SAML
• SSL/TLS certificates, encryption, secrets management, credential rotation
• Network security, API security, vulnerability management
• Wiz managed-solution actions, GitHub Advanced Security, and security mitigations

Knowledge & Skills Good To Have

• Kubernetes, Docker, container orchestration, scaling, high availability, infrastructure automation, and platform monitoring
• Database performance tuning, data warehousing, and query optimization
• Google Cloud Platform (GCP)
• Programming & Automation: Python, PySpark, Shell/Bash, PowerShell, YAML, JSON, and basic Unix/Linux/Windows administration
• Infrastructure as Code, Visual Studio Code

COMPETENCIES AND BEHAVIORS