Data Engineer
Onde
Entra para ver o tempo de viagem
Em resumo IA
Data Engineer para o novo Tech Hub da Capgemini no Porto, a colaborar com um prestador europeu de serviços de mobilidade (sede na Alemanha). Trabalho híbrido. Contrato, salário e prazo não indicados.
Descrição
anúncio longo (4 568 caracteres): a IA resumiu-o; o texto integral está no separador ao lado.
- Função
- Construir e manter pipelines de dados batch, CDC e streaming entre SAP, Kafka, APIs e bases de dados. Desenvolver soluções de dados escaláveis com Azure Data Factory, Databricks, Spark, SQL e Delta Lake. Implementar controlos de qualidade, monitorização, alertas e data contracts, otimizar desempenho, custo e segurança com Unity Catalog, e contribuir para frameworks reutilizáveis, CI/CD e boas práticas. Colaborar com DataOps, ML Engineering, AI, Analytics Engineers e equipas transversais, entregando dados fiáveis para analytics e produtos de IA. Participar em code reviews e em iniciativas de melhoria contínua.
- Requisitos
- Proficiência em Python ou Scala e SQL para pipelines de dados em produção
- Experiência prática com Spark, Delta Lake e Databricks, incluindo otimização básica de desempenho
- Experiência com pipelines batch e com pelo menos um de change data capture ou padrões de streaming
- Experiência prática com serviços de dados Azure, incluindo Azure Data Factory
- Experiência com testes automatizados de qualidade de dados e monitorização de pipelines
- Conhecimentos práticos de Git, CI/CD e code review
- Conhecimentos práticos de Unity Catalog ou ferramentas equivalentes de governação e controlo de acesso a dados
- Valorizado
- Confluent Kafka, Spark Structured Streaming ou frameworks de streaming equivalentes, SAP S/4HANA, BW e Business Data Cloud, processamento documental, embeddings e índices vetoriais para recuperação em IA
- Condições
- Contrato: não indicado
- Salário: não indicado
- Horário: não indicado; regime híbrido
- Local: Porto
- Benefícios
- Seguro de saúde e de vida
- Programa de recomendação com bónus
- Programas locais de desenvolvimento e requalificação (Career Acceleration Programs)
- Outros benefícios segundo parcerias da empresa
Data Engineer
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
You’ll have the opportunity to collaborate with a leading European mobility services provider, headquartered in Germany and backed by nearly 90 years of expertise. As part of this journey, you’ll contribute to the launch of a new Tech Hub in Porto, helping to drive innovative, technology-led solutions that are transforming how businesses move while contributing to a more sustainable future.
YOUR ROLE
- Build and maintain batch, CDC, and streaming data pipelines across SAP, Kafka, APIs, and databases.
- Develop scalable data solutions using Azure Data Factory, Databricks, Spark, SQL, and Delta Lake.
- Implement data quality, monitoring, observability, alerting, and data contract controls.
- Optimize pipeline performance, cost efficiency, and security through Unity Catalog.
- Contribute reusable frameworks, CI/CD processes, and data engineering best practices.
- Collaborate with DataOps, ML Engineering, AI, Analytics Engineers, and cross-functional teams.
- Deliver trusted, curated data to support analytics and AI products.
- Participate in code reviews and support continuous improvement initiatives.
- Good understanding of end-to-end data engineering, data quality, and data lifecycle management.
- Experience working with data contracts, stakeholder collaboration, and analytics-driven use cases.
- Experience with SAP, high-volume transactional data, and data mesh principles (nice to have).
YOUR PROFILE
- Proficiency in Python or Scala and SQL for production data pipelines.
- Practical experience with Spark, Delta Lake and Databricks, including basic performance optimisation.
- Experience with batch pipelines and at least one of change data capture or streaming patterns.
- Practical experience with Azure data services, including Azure Data Factory.
- Experience with automated data-quality testing and pipeline monitoring.
- Working knowledge of Git, CI/CD and code review.
- Working knowledge of Unity Catalog or comparable data-governance and access-control tooling.
- Confluent Kafka, Spark Structured Streaming or comparable streaming frameworks (nice to have).
- SAP S/4HANA, BW and Business Data Cloud extraction and data structures (nice to have).
- Document processing, embeddings and vector indexes for AI retrieval (nice to have).
WHAT WE´LL LOVE ABOUT WORKING HERE?
At Capgemini Portugal we have a flexible and dynamic work environment. Flexibility enables a better work-life balance and gives more flexibility to the employee to manage the working hours, as well if he works at the office or remotely, according with the company’s hybrid work policy; We have local programs that promote people growth, reskill and new skills development (Career Acceleration Programs);We promote an empowering environment with autonomy and peers' relationships among the top scores of our Monthly Employees' feedback;Next to this, we also offer an attractive compensation package and benefits such as Health and Life insurance, as well as Referral program with bonuses for talent recommendations and other fringe benefits according with our partnerships in for; Capgemini Portugal is an equal opportunity employer. We promote equality and dignity in all aspects of recruitment and employment, as well as employment offers and promotions made according with competence and ability or performance, respectively.
ABOUT CAPGEMINI
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fuelled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.
Get the future you want | www.capgemini.com
Apply now!
#LI-Hybrid
Como me candidatar
Candidatura através do anúncio ("Apply now"). Prazo e data de início não indicados. IA
Candidatar no anúncio original ↗
Preparar candidatura
Uma carta de apresentação e uma apresentação curta para esta oferta, escritas a partir do teu perfil, e o que aprender a seguir.
Entra e cria o teu perfil a partir do CV. É privado: não o partilhamos com ninguém.
Algo errado ou ilegal neste anúncio? Reportar
Ofertas semelhantes
- Data EngineerCapgemini · Lisboa
- Senior Data EngineerCapgemini · Porto
- Data Engineer Core OperationsCapgemini · Porto
- Data EngineerCapgemini Engineering · Lisboa
- Data Engineer (Databricks Focus)Capgemini · Lisboa
- Data Engineer (Google)Capgemini · Lisboa
Salário comparado ⓘ
49 ofertas · Analistas de sistemas · distrito de Porto
ver as que pagam mais →Formação para esta vaga
- DP-750: Implement data engineering solutions using Azure DatabricksGalileuonline · horário laboral · 28 h · 1670 € + IVA · início 14/12/2026Pedido neste anúncio: Engenharia de dados (Spark, Databricks)
- AZ-2006: Automate Azure Load Testing by using GitHub ActionsRumosonline · horário laboral · 7 h · 590 € · início 12/02/2027Pedido neste anúncio: Git
- Linguagens de Programação - Programação em PythonServiço de Formação Profissional do Portoonline · horário laboral · 350 h · gratuitoPedido neste anúncio: Python
Requisitos IA
- Experiência com pipelines batch/streaming
Publicado em (1)
- Capgemini Portugal visto 13 out – 15 nov
Onde a empresa está ver no mapa →
- Lisboa (Lisboa) 108 oferta(s) · 2 no site da empresa (escritório)
- Porto (Porto) 39 oferta(s)
- Évora (Évora) 3 oferta(s) · 1 no site da empresa (escritório) · 1 no mapa (edifício) · OSM · Google Maps
- Fundão (Castelo Branco) 4 oferta(s) · 1 no site da empresa (escritório) · OSM · Google Maps
- Vila Nova de Gaia (Porto) ≈ 2 no site da empresa (escritório)
segundo outras ofertas da empresa, as moradas no site da empresa, locais no OpenStreetMap; consultora: o trabalho é muitas vezes nas instalações de um cliente; estas são as moradas dos escritórios da consultora. ≈ ponto aproximado (só a localidade ou o código postal são conhecidos).
Vista pela primeira vez a 13 out, 07:05