lever
ML Engineer
Idt
Remote, IND
Full-time
Senior · 5+ years experience
Remote
Discovered 3 weeks ago
PythonApache SparkHadoopKafkaSnowflakeRedshift
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
PythonApache SparkHadoop
Key Skills for This Role
PythonApache SparkHadoopKafkaSnowflakeRedshift
Full Job Posting
- Design, develop, and maintain scalable data pipelines to support ingestion, transformation, and delivery into centralized feature stores, model-training workflows, and real-time inference services.
- Build and optimize workflows for extracting, storing, and retrieving semantic representations of unstructured data to enable advanced search and retrieval patterns.
- Architect and implement lightweight analytics and dashboarding solutions that deliver natural language query experience and AI-backed insights.
- Define and execute processes for managing prompt engineering techniques, orchestration flows, and model fine-tuning routines to power conversational interfaces.
- Oversee vector data stores and develop efficient indexing methodologies to support retrieval-augmented generation (RAG) workflows.
- Partner with data stakeholders to gather requirements for language-model initiatives and translate into scalable solutions.
- Create and maintain comprehensive documentation for all data processes, workflows and model deployment routines.
- Should be willing to stay informed and learn emerging methodologies in data engineering, MLOps and LLM operations.
- Data & ML Engineer with a proven 5+ year history of building scalable infrastructure.
- Excellent English communication skills.
- Effective oral and written communication skills with BI team and user community.
- Demonstrated experience in utilizing python for data engineering tasks, including transformation, advanced data manipulation, and large-scale data processing.
- Deep understanding of vector databases and RAG architectures, and how they drive semantic retrieval workflows.
- Skilled at integrating open-source LLM frameworks into data engineering workflows for end-to-end model training, customization, and scalable inference.
- Experience with cloud platforms like AWS or Azure Machine Learning for managed LLM deployments.
- Hands-on experience with big data technologies including Apache Spark, Hadoop, and Kafka for distributed processing and real-time data ingestion.
- Experience designing complex data pipelines extracting data from RDBMS, JSON, API and Flat file sources.
- Demonstrated skills in SQL and PLSQL programming, with advanced mastery in Business Intelligence and data warehouse methodologies, along with hands-on experience in one or more relational database systems and cloud-based database services such as Snowflake/Redshift.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Idt
Merchant Services Sales Representative
Los Angeles, USA
Discovered 1 weeks agoFull-time
Merchant Services Sales Representative
, USA
Discovered 1 weeks agoFull-time
Merchant Services Sales Representative
Miami, USA
Discovered 1 weeks agoFull-time
Sales Representative / Retail Account Manager (RAM)
Dallas, USA
Discovered 1 weeks agoFull-time
Sales Representative (Throughout US)
New York City, USA
Discovered 1 weeks agoFull-time
Merchant Services Sales Representative
, USA
Discovered 1 weeks agoFull-time
Merchant Services Sales Representative
, USA
Discovered 1 weeks agoFull-time
Sales Representative / Retail Account Manager (RAM)
Charlotte, USA
Discovered 1 weeks agoFull-time