zoho_recruit
Big Data Engineer
KMCCorp
Hyderabad, IND
Full-time
Mid · 5+ years experience
Onsite
Discovered 3 weeks ago
ScalaSparkKafkaJavaAirflowHadoop
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
ScalaSparkKafka
Key Skills for This Role
ScalaSparkKafkaJavaAirflowHadoop
Full Job Posting
Requirements
- Programming :Scala (Spark batch/streaming), Java (real-time microservices)
- Big Data Systems: Apache Spark, EMR, HDFS, YARN resource management
- Cloud & Storage :Amazon S3, EKS
- Security: HashiCorp Vault, tokenization vs. encryption (FPE)
- Orchestration :Apache Airflow (batch scheduling)
- Operational Excellence Spark log analysis, Dynatrace monitoring, incident handling, data validation
- Mandatory Competencies
- Expertise in distributed data processing (Spark on EMR/Hadoop)
- Proficiency in shell scripting and YARN job management
- Ability to implement format-preserving encryption (tokenization solutions)
- Experience with production troubleshooting (executor logs, metrics, RCA)
Benefits
- Insurance - Family Term Insurance PF
- Paid Time Off - 20 days Holidays - 10 days Flexi timing Competitive Salary Diverse & Inclusive workspace
About KMCCorp
IT Services31 employees
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer