Cloud platform engineer in a data analytics context

Omschrijving:

What does this function mean?

Our client is currently creating a new big data platform in AWS. On top of the platform, we are building a platform that focuses on supporting data science and other technical computing workflows. You will participate in this effort, as a valuable team player, to analyse, design, and implement the platform in close collaboration with data scientists.

What do they expect from you?

As a platform engineer for data science, you are responsible for engineering a well architected data science platform with particular emphasis in interactive computing and highly automated model lifecycle management based on MLOps. Main considerations for the design include security, maintainability, flexibility, user-friendliness and integration between components on the platform.

You work closely with data scientists to understand their functional needs and translate them in an actual solution. Then, you rapidly iterate over the solution based on frequent feedback from data scientists.

Due to how the platform is used in the group, you are also responsible for documenting guidelines for future platform operators.

An ideal candidate should have:

• Good working knowledge of cloud computing in general, and AWS specifically (AWS IAM, EC2, S3, VPC)
• As our client has chosen for AWS as a cloud service provider we often mention their technology in this job description. Decent Cloud experience (doesn ‘t matter which Cloud, as long as it is one of the big three (GCP, Azure or AWS)) and Infrastructure-as-Code experience is of course equally valuable.
• Good knowledge of user management (authentication and authorization) with AWS products and OSS solutions
• Good grasp of big data ecosystem and tooling especially Apache Spark and related technologies
• Good verbal and written communication skill in English
• Willingness to work in close collaboration with data scientists and other engineers from different teams
• Basic understanding of AWS products related to machine learning (AWS SageMaker)
• Prior experience with Infrastructure-as-Code (IAC) tools such as Terraform, Pulumi, AWS CloudFormation etc
• An ability to work in a highly dynamic environment
• A can-do attitude to cope with non-technical constraints

In time you will develop in-depth and practical experience in:

• Kubernetes / Helm
• Terraform
• AWS SageMaker
• Other AWS services such as Cognito, Lambda, CloudWatch, ECR, Athena etc
• AWS S3
• MLflow
• Apache Spark
• etc

You will have the opportunity to be part of a fast-growing company with a clear vision and you will be supported by a team of experts who are ready to achieve the objectives together with you. You will work in a pleasant, positive atmosphere within a strong and professional company.

We offer you a training programme tailored to your own pace and ambitions.
You will receive a competitive salary package with a lot of extra legal benefits such as a company car, daily allowance, telephone contract, hospitalization insurance, ...

As a creative employee, we can also grant you copyright allowances.

But above all, we ensure that your future is secure and that you can work with the latest technologies.

If you are hesitating between a job as an employee or as a freelancer, we can also guide you so that you can take the step to freelancing in all confidence.

USG Professionals connects the expertise and ambitions of highly educated professionals with the challenges of clients, in six different fields: Engineering, Science, ICT, HR, Legal and Finance. We help our clients with temporary needs (outsourcing) and with the permanent filling of open positions (recruitment).

Are you looking for variation in your job and do you have an affinity with one of our specialist areas? Then this function is also made for you!