Data Engineer II
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
Role Overview
HackerRank is modernizing its data platform from Redshift to StarRocks and Apache Hudi while building an AI-native data layer.
The Data Engineer II will build and maintain pipelines, support in-product data features, and contribute to datasets powering AI initiatives.
The role involves well-scoped problems under senior guidance with opportunities to grow into broader ownership.
Key Skills for This Role
Full Job Posting
About the Role
HackerRank is modernizing its data platform from Redshift to StarRocks and Apache Hudi while building an AI-native data layer.
The Data Engineer II will build and maintain pipelines, support in-product data features, and contribute to datasets powering AI initiatives.
The role involves well-scoped problems under senior guidance with opportunities to grow into broader ownership.
What You Will Do
- Build and maintain data pipelines on StarRocks, Apache Hudi, Trino, and Spark.
- Support exports, insights dashboards, interview analytics, and the Custom Reports interface.
- Prepare structured datasets for AI-powered natural language querying features.
- Implement access controls and data security policies such as Apache Ranger policies.
- Contribute to self-service pipelines that reduce ad hoc requests from internal teams.
- Write documentation and participate in code and design reviews.
- Troubleshoot data quality and pipeline issues and escalate architectural decisions appropriately.
Who You Are
- Have 2–4 years of data engineering experience.
- Have working knowledge of at least one OLAP database, such as StarRocks, ClickHouse, or Druid.
- Have some experience with Hudi, Iceberg, Delta Lake, or another data lake technology.
- Have familiarity with Trino or Presto and Spark, or strong SQL and Python fundamentals with eagerness to learn.
- Understand basic data security and access control concepts.
- Are comfortable in an AWS and open-source environment or can ramp up quickly.
- Communicate clearly, collaborate with teammates, and ask for help when scope is unclear.
Additional Advantages
- Exposure to AI or LLM-adjacent data work, including RAG, vector stores, or LLM pipelines, is advantageous.
- Experience at a SaaS or B2B product company is advantageous.
About HackerRank
HackerRank helps companies identify and develop technical talent through skills-based hiring and learning products.
The company serves more than 2,500 innovative organizations and emphasizes high standards, urgency, and customer impact.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at HackerRank
Senior Talent Acquisition Partner- GTM ( Contract)
Santa Clara, USA
Software Development Engineer in Test II
, IND
HackerRank is hiring an SDET-II to lead automation practices across web, API, workflow, and AI-driven systems. The role requires 3+ years in QA automation or SDET work, strong Playwright and SerenityJS experience, JavaSc
Manager, Forward Deployed Engineering
Santa Clara, USA
Senior Talent Acquisition Partner- GTM ( Contract)
Santa Clara, USA
Software Development Engineer in Test II
, IND
Software Development Engineer in Test II
Bengaluru, IND