Data Engineering

Position Overview

Work Mode and Schedule

• Work from office or hybrid according to business requirements.
• Shift: 5:30pm–2:30am.
• The description lists Chennai and Hyderabad, India as primary locations.

Data Engineering and ETL/ELT

• Develop and support ETL/ELT pipelines for enterprise data processing.
• Develop batch and near-real-time ingestion processes.
• Build transformations and workflows from technical specifications.
• Create reusable data-processing components.
• Implement error handling, logging, and recovery mechanisms.
• Support data models used for analytics and reporting.

Cloud and Database Development

• Develop Snowflake and Databricks tables, views, schemas, models, loading processes, stored procedures, and scheduled tasks.
• Write and optimize complex SQL queries and monitor processing jobs for performance.
• Develop AWS Glue jobs and work with Amazon S3 for ingestion and storage.
• Use IAM roles and permissions according to security guidelines.
• Develop and troubleshoot Oracle Data Integrator mappings, packages, interfaces, and PL/SQL.
• Support Oracle database development and operational activities.

Quality and Production Support

• Execute data quality checks and reconciliation between source and target systems.
• Investigate discrepancies, validate completeness, accuracy, and consistency, and fix processing defects.
• Monitor pipelines and scheduled jobs and resolve production incidents within agreed SLAs.
• Analyze logs and database errors, perform root cause analysis, and implement permanent fixes.
• Escalate complex issues with analysis and supporting evidence.

Testing and Deployment

• Develop unit and integration tests for data pipelines.
• Validate transformations and reconciliation results.
• Prepare deployment scripts and technical implementation documentation.
• Support releases across development, test, and production environments.
• Participate in post-deployment validation.

Required Qualifications

• 5–8+ years of relevant experience.
• Strong hands-on SQL and ETL/ELT development experience.
• Experience with Snowflake and/or Databricks.
• Experience developing enterprise pipelines and ingestion processes.
• Experience with AWS Glue, Amazon S3, IAM, and CloudWatch or equivalent monitoring tools.
• Strong Oracle and PL/SQL experience and hands-on Oracle Data Integrator experience.
• Experience with data validation, reconciliation, troubleshooting, production support, incident management, and performance optimization.
• Experience supporting releases and deployments across multiple environments.
• Strong troubleshooting, analytical, communication, collaboration, documentation, and data-quality skills.
• Ability to work independently, take ownership, and participate in production incident resolution.

About CGI