Data Engineer DBT / SQL Senior

Capgemini

In a context of rapidly increasing data usage, we are recruiting a Senior Data Engineer , capable of designing robust, scalable and performance-oriented data architectures, while playing a key role in supporting business teams.

Key objective of the position: to enable negotiators to defend competitiveness, through factual analyses based on market reality.

Main responsibilities

• Designing, structuring, and maintaining complex and high-performing data pipelines
• Implementing and industrializing data transformations with DBT
• Leveraging BigQuery and advanced SQL on very large volumes of data
• Manage and optimize real-time feeds (Pub/Sub)
• Parsing and transforming complex payloads ( JSON, Avro, Protobuf ) from APIs and WebApps
• Set up and maintain automated workflows (GitLab CI/CD, Docker Compose)
• Optimize the costs and performance of data processing
• To guarantee a high level of quality, reliability and traceability of data
• Working closely with business, product and tech teams within an Agile (Scrum) framework
• To be proactive in proposing best practices, data standards, and architectural choices

Technical environment

• Google Cloud Platform (GCP) : BigQuery, Cloud Composer, Cloud Run
• DBT (transformation & orchestration)
• Advanced SQL
• Pub/Sub
• Git / GitLab CI-CD
• Docker / Docker Compose
• Linux