lever
Senior Software Engineer, Distributed Data Systems (IN)
Onehouse
Remote, IND
Full-time
Senior · 5+ years experience
Remote
Discovered 2 weeks ago
Apache HudiJavaCC++UNIXLinux
Free
Job Fit Check
Base Career helps you apply smarter for this job.
?%
Ready to ScanKey skills for this role
Apache HudiJavaC
Key Skills for This Role
Apache HudiJavaCC++UNIXLinux
Full Job Posting
- As a foundational member of the Data Infrastructure team, you will productionize the next generation of our data tech stack by building the software and data features that actually process all of the data we ingest.
- Accelerate our open source enterprise flywheel by working on the guts of Apache Hudi's transactional engine and optimizing it for diverse Onehouse customer workloads.
- Act as a SME to deepen our teams' expertise on database internals, query engines, storage and/or stream processing.
- Design new concurrency control and transactional capabilities that maximize throughput for competing writers.
- Design and implement new indexing schemes, specifically optimized for incremental data processing and analytical query performance.
- Design systems that help scale and streamline metadata and data access from different query/compute engines.
- Solve hard optimization problems to improve the efficiency (increase performance and lower cost) of distributed data processing algorithms over a Kubernetes cluster.
- Leverage data from existing systems to find inefficiencies, and quickly build and validate prototypes.
- Collaborate with other engineers to implement and deploy, safely rollout the optimized solutions in production.
- Strong, object-oriented design and coding skills (Java and/or C/C++ preferably on a UNIX or Linux platform).
- 5+ Years experience with inner workings of distributed (multi-tiered) systems, algorithms, and relational databases.
- You embrace ambiguous/undefined problems with an ability to think abstractly and articulate technical challenges and solutions.
- An ability to prioritize across feature development and tech debt with urgency and speed.
- An ability to solve complex programming/optimization problems.
- An ability to quickly prototype optimization solutions and analyze large/complex data.
- Robust and clear communication skills.
- Nice to haves (but not required):
- Experience working with database systems, Query Engines or Spark codebases.
- Experience in optimization mathematics (linear programming, nonlinear optimization).
- Existing publications of optimizing large-scale data systems in top-tier distributed system conferences.
- PhD degree with 2+ years industry experience in solving and delivering high-impact optimization projects.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Onehouse
Software Engineer, Distributed Data Systems (US)
Sunnyvale, USA
MidFull-time
Discovered 1 weeks agoView →
Staff Solutions Architect - Data Infrastructure
Sunnyvale, USA
SeniorFull-time
Discovered 1 weeks agoView →
Backend Engineer- Kubernetes Infrastructure (India)
Kolkata, IND
SeniorFull-time
Onehouse is seeking a Backend Engineer to build Kubernetes-native infrastructure software for its managed data lake platform. The role focuses on Go or Java, Operators, Controllers, CRDs, distributed systems, cloud integ
Discovered 1 weeks agoView →
Software Engineer, Distributed Data Systems (US)
Sunnyvale, USA
Discovered 1 weeks agoFull-time
Staff Solutions Architect - Data Infrastructure
Sunnyvale, USA
Discovered 1 weeks agoFull-time
Senior Software Engineer, Open Source (US)
Sunnyvale, USA
Discovered 1 weeks agoFull-time
Staff Software Engineer, Open Source (US)
Sunnyvale, USA
Discovered 1 weeks agoFull-time
Backend Engineer- Kubernetes Infrastructure (India)
Kolkata, IND
Discovered 1 weeks agoFull-time
Software Engineer, Distributed Data Systems (IN)
, USA
Discovered 2 weeks agoFull-time
Pre Sales Systems Engineer (US)
Sunnyvale, USA
Discovered 3 weeks agoFull-time
Kubernetes Infrastructure Engineer (India)
Bengaluru, IND
Discovered 3 weeks agoFull-time