Data Engineer

Devoteam International

Within the Data team, you will be involved in the design, development, and industrialization of batch and real-time data pipelines.

You will contribute to the implementation of modern data architectures on GCP as well as the development of robust streaming flows based on Kafka and the Java ecosystem.

Data Warehouse & BigQuery

• Designing and maintaining datasets in BigQuery
• Develop optimized SQL queries (partitioning, clustering)
• Implement cost and performance optimization strategies
• Designing analytical models (web schema, data marts)
• Ensuring the quality and consistency of data

Design and develop ELT/ETL (batch & streaming) pipelines

• Modeling data (analytical models, data warehouse)
• Optimize requests and processing performance
• Setting up real-time streams via Kafka/PubSub
• Participate in defining data architectures (scalability, resilience)

Development & Streaming

• Developing services and APIs in Java (Spring Boot) and/or Scala
• Implementing streaming processes with Kafka / Kafka Streams
• Develop and maintain transformations via DBT (Data Build Tool)
• Contributing to data-oriented microservices architectures

Industrialization & Operation

• Orchestrate workflows with Airflow / Cloud Composer
• Automate deployments via CI/CD (GitLab CI)
• Ensuring version control with Git