Data Engineering Manager

Adaptfy is growing! We are looking for a Data Engineering Manager for a full-time position to join our Data & Analytics team in Amsterdam.

Who we are

Adaptfy is a turnkey data & analytics solution for the SHV family of companies. We support multiple SHV Groups with advanced Data & Analytics in all areas, elevating their operations in diverse industries across international markets and throughout entire valuechains.

Adaptfy is a joint venture formed by SHV and Metyis. Metyis embodies visionary thinking in the digital world, while SHV is a globally established family of companies built on the values of integrity, trust, curiosity, passion, and inclusivity.

At Adaptfy, we play a pivotal role in bringing SHV’s digital vision to life. From optimising supply chains across Europe to enhancing operational efficiency in South America, we connect the dots for SHV, shaping a data-driven future for the entire family of companies.

What we offer

• Interact with senior stakeholders at our clients on regular basis to drive their business towards impactful change
• Become the go-to person for end-to-end data handling, management, and analytics processes.
• Lead your team in creating the pipeline for Data management, data visualization, and analytics products, including automated services, and APIs.
• Working with Data Scientists to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation, and visualization.
• Become part of a fast-growing international and diverse team

What you will do

• Lead, influence & implement the technical roadmap of our clients, in light of overall technology and architecture roadmaps.
• Be responsible for the Architecture, making sure that technical and non-technical components work together in the product to deliver the customer needs.
• Lead and Develop the digital development and operations using Python, Spark, RESTful API, and Microsoft Azure Cloud, ideally with some Data Insights experience.
• Steer the technical excellence of the application and consistency with relevant digital frameworks, best practices, and standards.
• Coach and enable other product team members to deliver best-in-class products.
• Deliver data platforms, data insights and with the collaboration of the data science team – data products, such as recommendation systems, data lakes/hubs, data insights and dashboards.
• Lead project activities and will be responsible for the evaluation of business needs and objectives in collaboration with the project team and other stakeholders.

What you will bring

• 5-7 years of experience in a similar role with experience in developing and deploying ETL solutions on Azure.
• Solid knowledge of data warehousing principles, concepts, and best practices (e.g. ODS, data marts, data lakes, data vault, 3NF).
• Good understanding of common platforms and practices regarding digital development; Cloud-based setups, Advanced Analytics and computing environments, and GitHub (or similar) and CI/CD workflows.
• Experience in setting up automated testing frameworks including unit tests, integration tests.
• Understanding of modern cloud-based architecture (Lambda & Kappa architectures).
• Advanced SQL, data transformation, and data profiling skills.
• Experience in building production ETL/ELT pipelines at scale.
• Data governance experience.
• 3-5 years of hands-on experience with Azure: Data Factory, Databricks, Synapse (DWH), Azure Functions, App logic, and other data analytics services, including streaming.
• Experience with Airflow, Kubernetes, Great expectations is a plus.
• Programming languages: Python (PySpark), scripting languages like Bash.
• Basic knowledge of PowerBI is a plus.
• Customer-centric, passionate about delivering great digital products and services.
• Demonstrating true engineering craftsmanship mindset.
• Passionate about continuous improvement and working collaboratively.
• Strong problem-solving skills coupled with the ability to convey designs and ideas to a wider audience.
• People Management experience (2 or 3-member team).
• Experience in service consulting and stakeholder management.
• Comfortable with ambiguity, highly autonomous.
• A Bachelor's Degree in Computer Science, Mathematics, Economics, Engineering, Operations Research. Statistics, Business or other related technical disciplines (Master's Degree is a plus).