Staff Software Engineer - Query Planner & Reflections
Em resumo IA
Staff Software Engineer na equipa Query Planner & Reflections da Dremio, responsável pelo planeador/otimizador SQL (baseado em Apache Calcite) e pelo motor de substituição de reflections. Requer 8-10+ anos de experiência; localização e condições não indicadas no anúncio.
Descrição
anúncio longo (5 352 caracteres): a IA resumiu-o; o texto integral está no separador ao lado.
- Função
- Definir a arquitetura e a direção técnica da equipa Query Planner & Reflections, abrangendo funcionalidades das edições OSS, Enterprise e Cloud. Desenhar, implementar e entregar iniciativas complexas que atravessam equipas (Query Execution, Catalog, Datalake). Trabalhar com Apache Calcite e Apache Iceberg, incluindo contribuições para o projeto open source. Diagnosticar problemas de correção e desempenho no planeamento de queries e no matching de reflections. Participar em revisões de design e de código, definir padrões técnicos e apoiar outros engenheiros. Colaborar com Product em decisões de roadmap e com Support e equipas de campo em problemas de clientes.
- Requisitos
- Licenciatura ou mestrado em Engenharia Informática ou área técnica afim, ou experiência equivalente
- 8-10+ anos de experiência no desenvolvimento de software em produção
- Conhecimento profundo de planeamento e otimização de queries (otimizadores baseados em custos, reescrita baseada em regras)
- Fundamentos sólidos de bases de dados: SQL, desempenho e modelação de esquemas
- Experiência comprovada em decisões de arquitetura de sistemas e liderança de iniciativas complexas entre equipas
- Capacidade de navegar problemas ambíguos entre organizações de forma independente; boa comunicação
- Conhecimento de sistemas de ficheiros distribuídos (S3, ADLS ou HDFS)
- Valorizado
- fluência em Java ou C++, experiência com Apache Calcite ou framework similar, experiência com motores de query distribuídos, Apache Arrow, materialized views, caching ou disk spilling, contribuições para Apache Calcite, Apache Iceberg ou projetos similares, experiência em AWS, Azure ou GCP
- Condições
- Contrato: não indicado
- Salário: não indicado
- Horário: não indicado
- Local: não indicado
- Benefícios
- não indicados
Be Part of Building the Future
Dremio is the unified lakehouse platform for self-service analytics and AI, serving hundreds of global enterprises, including Maersk, Amazon, Regeneron, NetApp, and S&P Global. Customers rely on Dremio for cloud, hybrid, and on-prem lakehouses to power their data mesh, data warehouse migration, data virtualization, and unified data access use cases. Based on open source technologies, including Apache Iceberg and Apache Arrow, Dremio provides an open lakehouse architecture enabling the fastest time to insight and platform flexibility at a fraction of the cost. Learn more at www.dremio.com.
About the role
Dremio's Query Planner & Reflections (QPR) team owns the SQL planner and optimizer — built on Apache Calcite — and the reflections substitution engine that transparently rewrites queries to hit pre-computed materializations instead of raw source data. As a Staff Software Engineer, you'll set technical direction for this system: driving ambiguous, cross-team initiatives, raising the bar through design and code review, and helping other engineers.
What you'll be doing
- Set architecture and technical direction for the Query Planner and Reflections team spanning next-generation features across OSS, Enterprise, and Cloud editions.
- Own design, implementation, and delivery of complex initiatives that cross team boundaries (Query Execution, Catalog, Datalake).
- Work deeply with Apache Calcite and Apache Iceberg, including driving contributions upstream where it benefits Dremio.
- Diagnose the hardest correctness and performance issues in query planning and reflection matching using query profiles, telemetry, and production data.
- Use AI-assisted development tools for code comprehension, debugging, test generation, documentation, and incident analysis, and apply engineering judgment to validate AI-generated code through review, testing, and benchmarking.
- Design architectures that run correctly across deployment models and public clouds.
- Participate in design and code reviews and set technical standards for the team.
- Partner with Product on multi-quarter roadmap decisions and with Support and field teams on the highest-impact customer issues.
What we're looking for
- B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
- 8-10+ years of experience developing production-level software.
- Fluency in Java/C++ is a plus.
- Deep understanding of query planning and optimization: cost-based optimizers, rule-based rewriting, ideally hands-on with Apache Calcite or a similar framework.
- Strong database fundamentals: SQL, performance, schema design.
- Track record of driving system-level architecture decisions and leading complex, cross-team initiatives.
- Setting technical direction for the team or major component.
- Ability to evaluate tradeoffs and make sound decisions when working with unfamiliar or AI-assisted implementations.
- Ability to navigate ambiguous, cross-org problems independently; strong communication skills.
- Understanding of distributed file systems such as S3, ADLS, or HDFS; AWS, Azure, or GCP experience is a plus.
Bonus points if you have
- Experience with distributed query engines.
- Hands-on experience in query processing or optimization, materialized view matching, distributed systems, concurrency control, code generation, Apache Arrow, caching, or disk spilling.
- Contributions to Apache Calcite, Apache Iceberg, or similar open-source planner projects.
What we value
At Dremio, we hold ourselves to high standards when it comes to People, Thinking, and Action. Our Gnarlies (that's what we call our employees) communicate with clarity, drive accountability, and are respectful towards each other. We confront brutal facts and focus on results while operating with a sense of urgency and building a "flywheel". People who like to jump in and drive momentum will thrive in our #GnarlyLife.
Dremio is an equal opportunity employer supporting workforce diversity. We do not discriminate on the basis of race, religion, color, national origin, gender identity, sexual orientation, age, marital status, protected veteran status, disability status, or any other unlawful factor.
Dremio is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request accommodation due to a disability, please inform your recruiter.
Dremio has policies in place to protect the personal information that employees and applicants disclose to us. Please click here to review the privacy notice.
Important Security Notice for Candidates
At Dremio, we uphold trust and transparency as paramount values in all our interactions with customers, partners, employees, and the general public. We have been targeted by individuals creating fake domains similar to ours to scam prospects and candidates. Please note that all official communications from us will be from an @dremio.com domain. If you suspect you've been targeted by a scam, it's imperative to report the incident to your local law enforcement agencies. For more information about this type of scam, please refer to Dremio's official statement here.
Dremio is not responsible for any fees related to unsolicited resumes and will not pay fees to any third-party agency or company that does not have a signed agreement with the Company.
Como me candidatar
Candidatar no anúncio original ↗
Preparar candidatura
Uma carta de apresentação e uma apresentação curta para esta oferta, escritas a partir do teu perfil, e o que aprender a seguir.
Entra e cria o teu perfil a partir do CV. É privado: não o partilhamos com ninguém.
Algo errado ou ilegal neste anúncio? Reportar
Ofertas semelhantes
- Senior Staff Software Engineer - Query EngineDremio
- Software Engineer - Query ExecutionDremio
- Staff Software Engineer - ConnectivityDremio
- Senior Software Engineer - CatalogDremio
- Staff Software Engineer - AI Copilot (Backend)Zendesk
- Systems Requirement EngineerCapgemini Engineering · Lisboa
Salário comparado ⓘ
28 ofertas · Programadores de software · teletrabalho
ver as que pagam mais →Formação para esta vaga
- DP-3015: Getting Started with Cosmos DB NoSQL DevelopmentGalileu7 h · 590 € + IVAPedido neste anúncio: SQL e bases de dados
- PostgreSQL: An Introduction for Users and Application DevelopersRumosonline · horário laboral · 21 h · 1320 € · início 25/01/2027Pedido neste anúncio: SQL e bases de dados
- INFORMÁTICA - FOLHA DE CÁLCULO E BASE DE DADOSFOR-MAR – Centro de Formação Profissional das Pescas e do Maronline · 25 h · gratuitoPedido neste anúncio: SQL e bases de dados
Requisitos IA
- licenciatura ou mestrado em Informática ou afim
Idiomas IA
Publicado em (1)
- Dremio visto 16 nov
Vista pela primeira vez a 16 nov, 08:02