taleo
Databricks
Virtusa
IND
Full-time
Senior
Onsite
Discovered 3 weeks ago
DatabricksPySparkSpark SQLSQLDelta LakeFTP
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
DatabricksPySparkSpark SQL
Role Overview
Build and maintain data pipelines in Databricks for ingestion, cleansing, enrichment, and storage.
Key Skills for This Role
DatabricksPySparkSpark SQLSQLDelta LakeFTP
Full Job Posting
Role Overview
Build and maintain data pipelines in Databricks for ingestion, cleansing, enrichment, and storage.
Key Responsibilities
- Develop PySpark pipelines for API ingestion FTP file ingestion Data cleansing Enrichment transformations
- API ingestion
- FTP file ingestion
- Data cleansing
- Enrichment transformations
- Implement incremental & batch loads
- Develop Bronze → Silver → Gold transformations
- Translate legacy SQL stored procedures into Spark jobs
- Optimize Delta Lake tables
- Implement validation checks
- Support testing & reconciliation
Required Skills
- Strong PySpark / Spark SQL
- Strong SQL (read & interpret legacy procedures)
- Experience with API integration
- Experience handling flat files (FTP ingestion)
- Experience with Delta Lake
- Knowledge of partitioning & optimization
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Virtusa
Business Analyst
Toronto, CAN
SeniorFull-time
Virtusa is seeking a senior Business Analyst specializing in Wealth Management to translate client, regulatory, and operational needs into system enhancements and process improvements. The role requires strong requiremen
Discovered 1 weeks agoView →
Java fullstack
Dubai, UAE
SeniorFull-time
Virtusa is seeking a Java full-stack architect to design and govern scalable banking application solutions across cloud and on-premises environments. The role requires strong solution design, architecture documentation,
Discovered 1 weeks agoView →
Architect
Dubai, UAE
SeniorFull-time
The employer is seeking a senior project delivery professional to manage complex cross-functional initiatives from business case through implementation and closure. The role requires 7–10 years of project experience, str
Discovered 1 weeks agoView →
Lead Software Engineer
Dubai, UAE
LeadFull-time
Virtusa is seeking a Lead Software Engineer focused on Finacle testing for core banking technology. The role covers functional and automation testing across banking modules, using Selenium with Java or Playwright with No
Discovered 1 weeks agoView →
Lead Software Engineer
Dubai, UAE
LeadFull-time
Virtusa is seeking a Lead Software Engineer to deliver production-grade BPM solutions using Flowable, Java, and Spring Boot. The role requires deep Flowable or comparable BPM experience, end-to-end process-engine ownersh
Discovered 1 weeks agoView →
Associate Consulting Manager
Mississauga, CAN
ManagerFull-time
Virtusa recherche un profil d’analyste d’affaires ou d’analyste de données pour la région LATAM. Le poste requiert l’analyse de données, la rédaction de requêtes SQL et l’utilisation d’Agile et de Jira. La maîtrise de l’
Discovered 1 weeks agoView →
Senior Solution Architect
Dubai, UAE
SeniorFull-time
Virtusa is seeking a Senior Solution Architect to define, implement, and govern resilient customer-centric solutions across software, integration, cloud, and data architectures. Candidates should have more than 10 years
Discovered 1 weeks agoView →
Lead Software Engineer
Dubai, UAE
LeadFull-time
Seeking a senior retail customer value management leader to own lifecycle strategy across acquisition, cross-sell, retention, and win-back. The role requires 8–10+ years in CVM, growth strategy, retail banking, or lifecy
Discovered 1 weeks agoView →
Business Analyst
Toronto, CAN
Discovered 1 weeks agoFull-time
Java fullstack
Dubai, UAE
Discovered 1 weeks agoFull-time
Architect
Dubai, UAE
Discovered 1 weeks agoFull-time
Lead Software Engineer
Dubai, UAE
Discovered 1 weeks agoFull-time
Lead Software Engineer
Dubai, UAE
Discovered 1 weeks agoFull-time
Associate Consulting Manager
Mississauga, CAN
Discovered 1 weeks agoFull-time
Senior Solution Architect
Dubai, UAE
Discovered 1 weeks agoFull-time
Lead Software Engineer
Dubai, UAE
Discovered 1 weeks agoFull-time