As a senior data engineer, you will lead our big data engineers who build data pipelines of structured and unstructured datasets used by our data scientists. You will be a champion of the technical standards for a small team of data engineers and help mentor more junior team members while keeping your day-to-day, hands-on data engineering tasks. You will work closely with our communities of DevOps and data scientists.
Our Big Data Engineers identify and evaluate providers of structured and unstructured datasets and design integration solutions. You will help them architect and implement high-performance batch and streaming data pipelines for our data scientists and internal business users by using our big data stack (AWS services, Kubernetes cluster, S3 data lake, Spark cluster). Furthermore, you will help them assemble large, complex datasets to meet functional business requirements. You will also optimise our current data pipelines and machine-learning workflows.
In addition, our Data Engineers are responsible for maintaining our internal data products as well as rolling out our open data platform. They contribute to an ambitious overall initiative to modernise our architecture and data landscape with new technologies in an agile and dynamic environment.
Responsibilities
Technical Profile
Personal profile
Note
We will not accept any CVs via agencies
LBDE/CM/FG