V
Senior C++ Software Engineer, Data Engines
Voltron Data
Engineering & Technology
IT & Telecoms
GHS
Confidential
2 months ago
Job Summary
We are looking for a highly motivated Senior C++ Software Engineer for Data Engines, you’ll have the opportunity to work directly on Theseus, the accelerator-native data processing engine built for composability. You will work closely with Voltron Data development teams to build, optimize and maintain our data execution framework, adding new features, making it run faster and more scalable and even contributing to new core architectural components that will enable the engine to run at Petabyte scale.
- Minimum Qualification: Degree
- Experience Level: Senior level
- Experience Length: 5 years
Job Description/Requirements
Responsibilities:
Upon Joining:
- Spending time learning about the Apache Arrow, the compute primitives we use in Theseus, the query parser and optimizer and other foundational components.
- Diving into the data processing engine architecture, how all the different components interact with each other and how data flows through the compute graph.Â
- Understanding memory management mechanics, including spilling memory from GPU, to Host and Disk.
- Learning and embracing the software development culture at Voltron Data.
- Profiling single node and distributed queries executions and analyzing the engine telemetry to better understand how the engine works and how to solve distributed engine issues.
- Diving deep into the various distributed relational algebra algorithms to understand how they work and how they can be improved.
- Working with the team on fixing bugs, implementing simple optimizations or code refactoring projects.
- Building new relational algebra components to expand SQL coverage or DataFrame functionality coverage.
- Making small improvements to more sophisticated engine components such as resource management, task scheduling, and fault tolerance.
- Proposing and implementing core architecture improvements to the engine.
- Working on challenging tasks such as language agnostic user defined functions, multi-query concurrency, and multi-tenancy.
- Integrating the engine with other components and features developed by other teams in the company to provide enterprise grade customer experiences.
Previous experience that could be helpful:
- Experience with data processing engines or frameworks
- Experience in distributed and multi-threaded systems
- Experience in HW resource management including memory and thread poolsÂ
- Working with SQL and non-SQL systems and their computational abstractions
- Developing in C++, especially using modern C++
- Developing for multiple types of hardware (i.e. CPU, GPU)
Important Safety Tips
- Do not make any payment without confirming with the Jobberman Customer Support Team.
- If you think this advert is not genuine, please report it via the Report Job link below.
