V
Senior Query Optimizer Software Engineer
Voltron Data
Engineering & Technology
IT & Telecoms
GHS
Confidential
2 months ago
Job Summary
We are looking for a highly motivated Senior Query Optimizer Software Engineer to join Voltron Data’s team. On the team, you’ll have the opportunity to help support and grow the Voltron Data and Apache Arrow ecosystems. You will work closely with Voltron Data development teams to build and maintain a SQL parser and query optimizer for large scale single node and distributed query execution engines.
- Minimum Qualification: Degree
- Experience Level: Senior level
- Experience Length: 5 years
Job Description/Requirements
ResponsibilitiesUpon joining:
- Spending time learning about the Apache Arrow compute primitives, compute intermediate representation, compute engine, and other foundational components.
- Familiarizing yourself with the different partners for compute kernels and the query execution engine on Apache Arrow.
- Learning and embracing the Apache development process.
Within a month:
- Becoming familiar with our SQL parser and query optimizer.
- Benchmarking queries and exploring the effects of different query optimization techniques using our query optimizer.
- Making changes and improvements to the existing query optimization rules and how it creates physical execution plans for the execution engines under development.
Within 6 months:
- Adding new query optimization rules.
- Making improvements to decision making in the cost based optimization based on metadata availability for the tables being queried.
- Integrating non-SQL operations to the optimization framework.
- Working with client interfacing engineers to understand performance bottlenecks in customer queries.
Within 12 months:
- Proposing and implementing improvements to the query parsing and optimization framework.
- Integrating with a stateful inter-query query engine context to optimize the reusability of compute stages across queries that query the same data in similar ways.
Previous experience that could be helpful:
- Building and/or using open source query optimization frameworks like Apache Calcite, Apache Spark Catalyst, Postgres Query Optimizer, and/or others.
- Developing in C++, especially using modern C++.
- Utilizing serialization libraries like FlatBuffers, Protobuf, Thrift, MessagePack, and/or others.
- Working on non-SQL systems and non-SQL computational abstractions.
Important Safety Tips
- Do not make any payment without confirming with the Jobberman Customer Support Team.
- If you think this advert is not genuine, please report it via the Report Job link below.
