Data Platform Modernization Engineer - Junior (Databricks)
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
Role Overview
NTT DATA is seeking a Data Platform Modernization Engineer - Junior (Databricks) in Bangalore, Karnataka, India.
The role focuses on migrating Informatica and AWS Glue workloads to the Databricks Lakehouse.
The engineer will work with senior developers and technical leads to resolve technical issues and dependencies.
Key Skills for This Role
Full Job Posting
Role Overview
NTT DATA is seeking a Data Platform Modernization Engineer - Junior (Databricks) in Bangalore, Karnataka, India.
The role focuses on migrating Informatica and AWS Glue workloads to the Databricks Lakehouse.
The engineer will work with senior developers and technical leads to resolve technical issues and dependencies.
Day-to-Day Job Duties
- Analyze Informatica workflows, mappings, and AWS Glue jobs to understand transformation logic and source-to-target mappings.
- Develop Databricks notebooks, transformations, and pipelines using Python, PySpark, Spark SQL, and Databricks SQL.
- Implement Bronze, Silver, and Gold processing with batch and incremental Delta Lake pipelines.
- Maintain Databricks Jobs, Workflows, and Lakeflow Declarative Pipelines as required.
- Reuse frameworks for logging, auditing, data quality, error handling, and notifications.
- Convert Informatica logic and AWS Glue or database processing into Databricks implementations.
- Perform unit testing, source-to-target reconciliation, integration testing, regression testing, UAT, and production validation.
- Investigate pipeline issues, participate in reviews, prepare documentation, and support deployment, monitoring, stabilization, and cutover.
Basic Qualifications
- Have 3–6 years of experience in data engineering, ETL development, or application and data platform development.
- Have hands-on experience with Databricks and Apache Spark.
- Have strong development skills in Python or PySpark and SQL.
- Have experience with Databricks notebooks, Spark SQL or Databricks SQL, Delta Lake, and Databricks Jobs or Workflows.
- Have developed batch or incremental ETL or ELT pipelines.
- Have experience with Informatica PowerCenter, AWS Glue, SSIS, or a similar ETL technology.
- Have experience with relational databases, SQL processing, data validation, unit testing, and troubleshooting.
- Understand layered data architectures such as Bronze, Silver, and Gold.
- Can work within established frameworks and follow coding standards.
- Have strong analytical, problem-solving, and communication skills.
- Hold a bachelor's degree in Computer Science, Information Technology, Engineering, or have equivalent experience.
Nice to Have
- Databricks certification is advantageous.
- Experience with Lakeflow Declarative Pipelines or Delta Live Tables is advantageous.
- Experience with Unity Catalog, Databricks Asset Bundles, or CI/CD is advantageous.
- Experience with AWS S3, Glue, Redshift, Lambda, Auto Loader, streaming ingestion, CDC, or SCD processing is advantageous.
- Experience with performance optimization, data quality frameworks, or cloud data modernization projects is advantageous.
About NTT DATA
NTT DATA is a technology services provider focused on enterprise AI, cloud, security, connectivity, data centers, and application services.
The company states that remote or hybrid arrangements may be available for some positions but can change based on client requirements.
In-office attendance near an NTT DATA office or client site may be required for meetings or events depending on business needs.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at NTT DATA North America
Project Manager - Power Apps
Ottawa, CAN
NTT DATA is seeking an experienced Project Manager to lead Project Power, a global logistics transformation replacing legacy Smartsheet processes with Microsoft Power Platform solutions. The role owns enterprise delivery
Business Analyst
, CAN
NTT DATA is seeking a consulting Business Analyst to turn client problems and opportunities into clear, implementable change. The role covers stakeholder facilitation, requirements, process analysis, delivery support, te
SAP Cutover Lead
, CAN
NTT DATA is seeking an SAP Cutover Lead to own end-to-end cutover strategy, planning, execution, governance, go-live, and hypercare for large-scale SAP transformations. The role requires extensive SAP cutover leadership,
Senior Developer - Data Modernization & Archiving
, CAN
NTT DATA is seeking a Senior Developer to modernize and archive historical financial data from a UNISYS mainframe environment. The role focuses on Oracle PL/SQL, ETL, Power BI, data migration, validation, reporting, gove
Sr Outsystems Solutions Architect
Ottawa, CAN
NTT DATA is seeking a Senior OutSystems Solution Architect to lead enterprise low-code architecture, governance, integrations, delivery, and technical oversight. The role requires deep OutSystems experience, enterprise a
IBMz Network Engineer
Sheffield, GBR
NTT DATA is seeking an IBMz Network Engineer to support large-scale z/OS mainframe network environments. The role focuses on configuring and maintaining host communication, network security, transmission products, and re
DATACOM SME (Data Communication Subject Matter Expert; all genders)
, GBR
NTT DATA is seeking a senior DATACOM SME to provide technical leadership across enterprise networking and data communication environments. The role covers network architecture, implementation, optimization, troubleshooti
Sys. Integration Sr. Specialist Advisor
Mumbai, IND
Project Manager - Power Apps
Ottawa, CAN
Business Analyst
, CAN
SAP Cutover Lead
, CAN
Senior Developer - Data Modernization & Archiving
, CAN
Sr Outsystems Solutions Architect
Ottawa, CAN
IBMz Network Engineer
Sheffield, GBR
DATACOM SME (Data Communication Subject Matter Expert; all genders)
, GBR