Data Engineer

Devoteam Tunisia

Designing and maintaining datasets in BigQuery

• Develop optimized SQL queries (partitioning, clustering)
• Implement cost and performance optimization strategies
• Designing analytical models (web schema, data marts)
• Ensuring the quality and consistency of data

Design and develop ELT/ETL (batch & streaming) pipelines

• Modeling data (analytical models, data warehouse)
• Optimize requests and processing performance
• Setting up real-time streams via Kafka/PubSub
• Participate in defining data architectures (scalability, resilience)

Development & Streaming

• Developing services and APIs in Java (Spring Boot) and/or Scala
• Implementing streaming processes with Kafka / Kafka Streams
• Develop and maintain transformations via DBT (Data Build Tool)
• Contributing to data-oriented microservices architectures

Industrialization & Operation

• Orchestrate workflows with Airflow / Cloud Composer
• Automate deployments via CI/CD (GitLab CI)
• Ensuring version control with Git