Data Engineer (Apache Flink - ETL/ELT - Scala - Hadoop)

見る: 110

更新日: 16-11-2025

場所: Brussels Brussels Capital

カテゴリー: 生産/操作

業界:

Loading ...

仕事内容

Role:

Collect, clean, prepare and load the necessary data onto Hadoop, our Data Analytics Platform, so that these can be used for reporting purposes; creating insights and responding to business challenges
Act as a liaison between the team and other stakeholders and contribute to support the Hadoop cluster and the compatibility of all the different software that run on the platform (Scala, Spark, Python).
Implement data quality controls and where data quality issues are detected, liaise with the data supplier for joint root cause analysis
Be able to autonomously design data pipelines, develop them and prepare the launch activities
Properly document your code, share and transfer your knowledge with the rest of the team to ensure a smooth transition into maintenance and support of production applications
Liaise with IT infrastructure teams to address infrastructure issues and to ensure that the components and software used on the platform are all consistent

Required skills:

Knowledge of Apache Flink
Experience with analysis and creation of data pipelines, data architecture, ETL/ELT development and with processing structured and unstructured data
Proven experience with using data stored in RDBMSs and experience or good understanding of NoSQL databases
Ability to write performant Scala code and SQL statements
Ability to design with focus on solutions that are fit for purpose whilst keeping options open for future needs
Ability to analyze data, identify issues (eg gaps, inconsistencies) and troubleshoot these
Have a true agile mindset, capable and willing to take on tasks outside of her/his core competencies to help the team
Experience in working with customers to identify and clarify requirements
Strong verbal and written communication skills, good customer relationship skills
Strong interest in the financial industry and related data.

Remark: This role has been assessed as Inside IR35 which only affect UK resident applicants.

Loading ...

無料の候補者に適用するにはクリックしてください

Loading ...

Loading ...