Loading ...

Job content

The Data Engineer is responsible for designing, developing, and maintaining data infrastructure and pipelines to collect, store, process, and analyze large volumes of data. They work closely with data science teams, data analysts, and stakeholders to ensure the availability, quality, and reliability of data. The Data Engineer plays a crucial role in implementing effective data analytics solutions to help the business make strategic decisions based on data.

Responsibilities:

1. Data Pipeline Design: Design and develop data pipelines for data ingestion, processing, and transformation.

2. Data Collection and Storage: Implement data collection and storage solutions at scale.

3. Data Processing and Transformation: Develop processes for processing and transforming raw data into actionable formats.

4. Data Quality: Ensure data quality, integrity, and reliability by implementing cleaning and validation processes.

5. Data Security: Implement security measures to protect sensitive and confidential data.

6. Performance Optimization: Optimize the performance of data infrastructure and pipelines to ensure maximum operational efficiency.

7. Technology Watch: Stay updated on trends and technological advancements in the field of Big Data and data infrastructure.

8. Documentation: Document data architectures, processes, and configurations to ensure traceability and understanding.

9. Training and Support: Train and support users on data management best practices and tool usage.

Required Skills:

1. Strong software development and programming skills (Python, Scala, SQL, etc.).

2. Proficiency in data processing technologies (Apache Spark, Hadoop, Kafka, etc.).

3. Knowledge of distributed databases (HBase, Cassandra, MongoDB, etc.).

4. Experience with real-time data streaming tools (Apache Flink, Apache Storm, etc.).

5. Understanding of cloud computing concepts and data storage services (AWS S3, Google Cloud Storage, etc.).

6. Ability to work with event-driven architectures and distributed systems.

7. Strong problem-solving and debugging skills.

8. Excellent communication and teamwork skills.

Education and Experience:

- Bachelor’s degree in computer science, software engineering, data science, or a related field.

- Significant professional experience as a data engineer or in a similar role.

- Relevant certification in Big Data or specific technologies is a plus.

The Data Engineer plays a central role in managing and analyzing the company’s data. By designing and developing effective data pipelines, they contribute to making strategic decisions based on reliable and actionable data.

Type d’emploi : Temps Plein, Freelance

Lieu du poste : En présentiel

Loading ...
Loading ...

Deadline: 02-01-2026

Click to apply for free candidate

Apply

Loading ...

SIMILAR JOBS

Loading ...
Loading ...