Master Graduation Assignment: Data pipeline optimization in cloud environment

Master Graduation Assignment: Data pipeline optimization in cloud environment

Improve PACCAR Parts Europe’s data pipeline structure, leading to a high performing, efficient, and future proof data sourcing

For our Data Analytics Team, we are looking for a graduate student who will conduct research on how to improve PACCAR Parts Europe’s data pipeline.

The current logic of data processing in our cloud environment (AWS/Snowflake) is complex and requires revision and modernization. The data pipeline consists of a large number of transformation layers and processing steps, resulting in long processing times and a high load on available resources.

The current setup of the pipeline is primarily focused on achieving results. With future expansion in mind—including the growing integration of multiple (live) data sources—it is crucial to optimize the effectiveness, maintainability, and future-proof scalability of the pipeline.

During this internship, the focus will be on analyzing the existing architecture, identifying bottlenecks, and defining measures to improve the performance, efficiency, maintainability, and scalability of the data pipeline. The stretch target is to implement the improved method.

Jouw profiel

Your profile:

• Profound experience with SQL
• Good experience with Python
• Preferred experience with Snowflake and AWS
• Understanding of warehouse and/or logistics processes would be a plus
• You can easily deal with large amounts of data, in understanding, structuring and analysis
• You can demonstrate technical creativity and think beyond existing structures
• You can work independently, you are proactive and you are curious
• You feel comfortable communicating in English, native Dutch speaking is preferred

Afdeling

PACCAR Parts Europe (PPE) is responsible for distribution of truck parts to over 1,000 DAF Trucks dealers all over Europe for truck maintenance and repairs. PPE operates 5 state-of-the-art distribution centers (Parts Distribution Centers) in Eindhoven, Leyland, Madrid, Budapest and Massbach.

Within PACCAR Parts Europe Operation, the Data Analytics team is responsible for developing, maintaining and innovating the data warehouse (cloud) in which all operational data is being stored real time. The data in the data warehouse is used for analysis, reporting and intelligent data solutions for daily operation. All in order to contribute to PACCAR Parts key objective to maximize the speed of delivery to our customers, and meanwhile ensure maximum internal efficiency and productivity. Efficient retrieval of data from the data warehouse is essential for a sustainable, effective and future ready data performance.

Wij bieden

• A view behind the scenes at a large international corporation;
• You will get a lot of freedom and responsibility. We are open to your initiatives and depending on the assignment you see your results back in the workplace;
• An experienced coach and supervisor who can teach you a lot and is willing to help you with your assignment;
• After your graduation, you will have the opportunity to start your career at DAF;
• An internship wage of €375,- (Bachelor) or €450,- (Master) per month on full-time base
• A travel allowance, if you don’t have a student travel product (provided by the Dutch government);
• A housing allowance, if you temporarily rent a room near DAF.