Job Responsibilities:

• Conceive and build data architectures
• Participate in the short/mid/long term vision of the overall system
• Execute ETL (extract/transform/load) processes from complex and/or large data
• sets
• Ensure data are easily accessible and that their exploitation is performing as
• requested, even in highly scalable circumstances
• Participate to the architecture and planning of the big data platform to optimize
• the ecosystem’s performances
• Create large data warehouses fit for further reporting or advanced analytics
• Collaborate with machine learning engineers for the implementation and
• deployment of different solutions
• Ensure robust CI/CD processes are in place

Skills Required:

1. A Master in Informatics, Engineering, Mathematics, or related field
2. Demonstrable experience with big data platforms (Hadoop, Cloudera, EMR,
3. Databricks, ...)
4. Technical knowledge in:
5. Data pipeline management
6. Cluster management
7. Workflow management ( Oozie, Airflow)
8. Database management of SQL and noSQL databases
9. Large file storage (HDFS, Data Lake, S3, Blob storage,..)
10. Strong knowledge of Hadoop ecosystem: Hortonworks/Cloudera/EMR
11. Strong knowledge of Java/Scala and Python
12. Strong knowledge of Spark (Scala and Pyspark)
13. Strong knowledge of CI/CD concepts
14. Stream processing such as Kafka, Kinesis, Elisticsearch
15. Good knowledge of a cloud environment
16. High level understanding of data science concepts
17. Knowledge of Daa Visualisation framework like QlikSense is a plus
18. Experience in telecom and/or financial sector is a plus
19. Experience with an agile way of working is a plus
20. Scala & Python skills are the main focus!