company_site
Senior AI Data Engineer
Luxoft
Chennai, IND
Full-time
Senior · 5+ years experience
Discovered 2 weeks ago
• Minimum of 5 years of experience in AI/ML solution implementation (mandatory) • Minimum of 3 years of experience in Pyspark processing high volume data (mandatory) • AI & ML Skills: Multi-Agent System Design & Orchestration Full-stack AI Integration (Frontend to Backend) Advanced Prompt Engineering LLM Observability, Evaluation & Monitoring (LLMOps) • Data Engineering Skills: Proficient in Pyspark coding and concepts. Example: Lazy evaluation, window functions, spark architecture and performance finetuning (ex: data skew reduction (salting etc), joins (broadcast, merge sort joins ect) SQL proficiency and query optimization • Main Technologies: Pyspark Git hub Copilot
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
• Minimum of 5 years of experience in AI/ML solution implementation (mandatory) • Minimum of 3 years of experience in Pyspark processing high volume data (mandatory) • AI & ML Skills: Multi-Agent System Design & Orchestration Full-stack AI Integration (Frontend to Backend) Advanced Prompt Engineering LLM Observability, Evaluation & Monitoring (LLMOps) • Data Engineering Skills: Proficient in Pyspark coding and concepts. Example: Lazy evaluation, window functions, spark architecture and performance finetuning (ex: data skew reduction (salting etc), joins (broadcast, merge sort joins ect) SQL proficiency and query optimization • Main Technologies: Pyspark Git hub Copilot
Key Skills for This Role
• Minimum of 5 years of experience in AI/ML solution implementation (mandatory) • Minimum of 3 years of experience in Pyspark processing high volume data (mandatory) • AI & ML Skills: Multi-Agent System Design & Orchestration Full-stack AI Integration (Frontend to Backend) Advanced Prompt Engineering LLM Observability, Evaluation & Monitoring (LLMOps) • Data Engineering Skills: Proficient in Pyspark coding and concepts. Example: Lazy evaluation, window functions, spark architecture and performance finetuning (ex: data skew reduction (salting etc), joins (broadcast, merge sort joins ect) SQL proficiency and query optimization • Main Technologies: Pyspark Git hub Copilot
Full Job Posting
Responsibilities
- Design, develop, and maintain full-stack Python applications with modern frontend frameworks • Build and optimize RAG (Retrieval-Augmented Generation) systems for AI applications • Create and implement efficient vector databases and knowledge stores • Develop APIs that connect frontend interfaces with backend AI services • Implement and maintain CI/CD pipelines for AI applications • Monitor application performance and troubleshoot issues in production • Design and maintain data pipelines, ETL/ELT workflows, and data infrastructure to support AI and analytics workloads
Skills
- Minimum of 5 years of experience in AI/ML solution implementation (mandatory) • Minimum of 3 years of experience in Pyspark processing high volume data (mandatory) • AI & ML Skills: Multi-Agent System Design & Orchestration Full-stack AI Integration (Frontend to Backend) Advanced Prompt Engineering LLM Observability, Evaluation & Monitoring (LLMOps) • Data Engineering Skills: Proficient in Pyspark coding and concepts. Example: Lazy evaluation, window functions, spark architecture and performance finetuning (ex: data skew reduction (salting etc), joins (broadcast, merge sort joins ect) SQL proficiency and query optimization • Main Technologies: Pyspark Git hub Copilot
About Luxoft
Technology
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Luxoft
Senior Data Engineer (Investment Data)
Abu Dhabi, UAE
Discovered TodayFull-time
GenAI Solutions Architect
Wilmington, USA
Discovered TodayFull-time
GenAI Solutions Architect
Buffalo, USA
Discovered TodayFull-time
Senior Software Developer - Networking platform
Bengaluru, IND
Discovered TodayFull-time
Insurance Business Analyst
London, GBR
Discovered TodayFull-time
Insurance Business Analyst
Norwich, GBR
Discovered TodayFull-time
Insurance Business Analyst
London, GBR
Discovered TodayFull-time
Insurance Business Analyst
Norwich, GBR
Discovered TodayFull-time