zoho_recruit
Data Engineer - GenAI
AuxoAI
Bengaluru, IND
Full-time
Senior · 6+ years experience
Hybrid
Discovered 3 weeks ago
SQLPythonApache SparkBigQueryDataflowCloud Composer
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
SQLPythonApache Spark
Key Skills for This Role
SQLPythonApache SparkBigQueryDataflowCloud Composer
Full Job Posting
Responsibilities
- Architect and develop end-to-end data pipelines — from ingestion to transformation to consumption
- Lead solutioning and integration for complex data workflows (batch and streaming)
- Use AI-assisted coding tools (e.g., GitHub Copilot, Claude, Gemini) to accelerate code development, refactoring, and debugging
- Implement robust data quality, testing, lineage, and governance frameworks
- Drive best practices across pipeline performance, reusability , and scalability
- Mentor junior engineers and contribute to capability building within the data team
Requirements
- 6+ years of experience in data engineering , with expertise in: End-to-end pipeline development (batch and streaming) Data modeling (dimensional, Data Vault, OBT) ETL/ELT design patterns , performance tuning, and optimization SQL (Advanced) and Python (Advanced) Apache Spark for large-scale data processing
- End-to-end pipeline development (batch and streaming)
- Data modeling (dimensional, Data Vault, OBT)
- ETL/ELT design patterns , performance tuning, and optimization
- SQL (Advanced) and Python (Advanced)
- Apache Spark for large-scale data processing
- Proficiency using AI coding tools (e.g., Copilot, Claude, Gemini) to enhance productivity and code quality
- Strong understanding of data quality frameworks , unit testing, and CI/CD for data workflows
Preferred Qualifications
- Experience with Google Cloud Platform services: BigQuery , Dataflow , Cloud Composer , Pub/Sub , Dataproc , Vertex AI
- BigQuery , Dataflow , Cloud Composer , Pub/Sub , Dataproc , Vertex AI
- Exposure to finance or sales data domains
- Familiarity with Databricks , Delta Lake , or Apache Iceberg
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at AuxoAI
AI Engineer
Bengaluru, IND
Discovered 3 weeks agoFull-time
Senior Applied Scientist - AI Agent Systems
Bengaluru, IND
Discovered 3 weeks agoFull-time
Senior Data Engineer - GCP
, IND
Discovered 3 weeks agoFull-time
Data Engineer - DBT
, IND
Discovered 3 weeks agoFull-time
Senior Applied AI Engineer (Computer Vision)
Bengaluru, IND
Discovered 3 weeks agoFull-time
MicroStrategy Developer
Mumbai, IND
Discovered 3 weeks agoFull-time
Senior Data Scientist - AI & ML
Mumbai, IND
Discovered 3 weeks agoFull-time
Senior Applied Scientist - Semantics
Mumbai, IND
Discovered 3 weeks agoFull-time