Job Summary:
Onehouse is a mission-driven company dedicated to freeing data from data platform lock-in. The Software Engineer, Distributed Data Systems will be responsible for building and optimizing the next generation of the data tech stack, working closely with Apache Hudi's transactional engine and contributing to the development of a scalable data infrastructure.
Responsibilities:
• As a foundational member of the Data Infrastructure team, you will productionize the next generation of our data tech stack by building the software and data features that actually process all of the data we ingest.
• Accelerate our open source enterprise flywheel by working on the guts of Apache Hudi's transactional engine and optimizing it for diverse Onehouse customer workloads.
• Act as a SME to deepen our teams' expertise on database internals, query engines, storage and/or stream processing.
• Design new concurrency control and transactional capabilities that maximize throughput for competing writers.
• Design and implement new indexing schemes, specifically optimized for incremental data processing and analytical query performance.
• Design systems that help scale and streamline metadata and data access from different query/compute engines.
• Solve hard optimization problems to improve the efficiency (increase performance and lower cost) of distributed data processing algorithms over a Kubernetes cluster.
• Leverage data from existing systems to find inefficiencies, and quickly build and validate prototypes.
• Collaborate with other engineers to implement and deploy, safely rollout the optimized solutions in production.
Qualifications:
Required:
• Strong, object-oriented design and coding skills (Java and/or C/C++ preferably on a UNIX or Linux platform).
• Experience with inner workings of distributed (multi-tiered) systems, algorithms, and relational databases.
• You embrace ambiguous/undefined problems with an ability to think abstractly and articulate technical challenges and solutions.
• An ability to prioritize across feature development and tech debt with urgency and speed.
• An ability to solve complex programming/optimization problems.
• An ability to quickly prototype optimization solutions and analyze large/complex data.
• Robust and clear communication skills.
Preferred:
• Experience working with database systems, Query Engines or Spark codebases.
• Experience in optimization mathematics (linear programming, nonlinear optimization).
• Existing publications of optimizing large-scale data systems in top-tier distributed system conferences.
• PhD degree with 2+ years industry experience in solving and delivering high-impact optimization projects.
Company:
Onehouse is a cloud-native managed lakehouse service that aims to improve data lake time-to-value. Founded in 2021, the company is headquartered in Menlo Park, California, USA, with a team of 51-200 employees. The company is currently Growth Stage. Onehouse has a track record of offering H1B sponsorships.
We're Hiring: Professional Pet Sitters (Amherst/Buffalo Area) + (Orchard Park Area)Do you love animals and want to make a difference... ...experiences for both pets and their humans. If youre an animal lover whos reliable, flexible, and looking for meaningful part-...
...Our team is looking for multiple CRNA's to join our Hospital on an ongoing Locum Tenens basis beginning in January 2025. The role involves a 3 shift per week minimum of 8-12 hours per day for a preference of 6+ months. The program is high volume/high acuity and fast paced...
Join the CarDon family! Its an environment thats exciting, respectful and rewarding. We offer positions with amazing benefits , like weekly pay, cell phone discounts and premium access and discounts on hotels, Universal and Disney and more! If you have a heart for ...
Now Hiring School Bus Drivers Paid CDL Training + Flexible Hours!Looking for a rewarding part-time job with a flexible schedule and great benefits? Join Lamers Bus Lines as a School Bus Driver or Charter Driver today!Were hiring school bus drivers and charter bus...
...Job Type: Full-time Company Overview: Nexgen is a premier land surveying firm dedicated to expanding our presence throughout... ...We are seeking a highly motivated and detail oriented Licensed Surveyor to join our team. Job Summary: In your role as a Professional...