Databricks Data Engineer

At Deloitte, you will design, build, and optimize data pipelines in Databricks. You will apply data engineering best practice and use core Databricks features to deliver scalable and reliable data solutions for our clients.

Databricks Data Engineer

What impact will you make?

As a Databricks Data Engineer, you will be a trusted adviser to our clients, designing and building reliable ETL/ELT pipelines in Databricks. You will apply the medallion architecture and Delta Lake best practice, optimize clusters for performance and cost, and embed data quality to deliver reliable data products. You will work closely with cloud platform engineers to ensure data solutions are secure, scalable, and easy to operate.

How do you do this?

• Develop, optimize, and operate ETL/ELT pipelines in Databricks using PySpark, SparkSQL, and Scala;
• Run migration programmes to Databricks, including legacy ETL processes into scalable data pipelines;
• Build robust data pipelines on Databricks for real time and batch processing;
• Configure and manage Databricks clusters and jobs for cost and performance efficiency;
• Apply CI/CD to automate testing and deployment of notebooks, jobs, and pipelines;
• Drive adoption of Databricks Lakehouse architecture and data engineering practice across our clients.

What’s in it for you?

• Je deelt bij ons mee in de winst. Boven op een vast salaris.
• Altijd blijven groeien. Met ons development program.
• Vergoeding om je thuiswerkplek op een ergonomisch verantwoorde manier in te richten én een internetvergoeding.
• Parttime (32 uur) of fulltime (40 uur) werken.

Be the true you

Naturally you are keen to discover and learn new things each day and you are confident and rely on your self-worth. But most importantly, be the true you. The one and only you. With your personal strengths, view of the world and unique personality. You need the following qualifications for the position of Databricks Data Engineer:

• A technical Master’s degree, preferably in Data Science, Big Data, Econometrics, Physics, Mathematics, Computer Science, Artificial Intelligence, or a related field;
• At least 4 years of work experience in data engineering; consulting experience is a plus;
• Strong hands-on experience with Databricks and Apache Spark (PySpark and Spark SQL);
• Deep understanding of Delta Lake and medallion architecture;
• Proficiency in SQL and one or more data engineering related programming languages (Python, Scala, etc);
• Relevant Databricks certifications (Data Engineer Associate/Professional, Spark Developer Associate, Data Analyst Associate);
• Excellent command of English and Dutch.

(W)here

Bij Deloitte Engineering werken meer dan 100 engineers en consultants zij aan zij met klanten om ideeën om te zetten in producten. Door onze technische expertise en zakelijke inzichten te combineren, helpen we organisaties complexe uitdagingen aan te gaan en duurzame resultaten te behalen. We leveren ons werk en onze expertise aan klanten via twee nauw met elkaar verbonden pijlers:

• Cloudstrategie & Architectuur
• Platform, Ontwikkeling & Integratie

Mensen en samenwerking staan centraal in onze Deloitte Engineering-cultuur. Je komt terecht in een divers en ondersteunend team dat op maat gemaakte trainingen, door de sector erkende certificeringen en begeleiding biedt.

Bij Deloitte hanteren we een flexibel hybride werkmodel. Dit betekent dat we werken op kantoor, bij de klant, thuis en zelfs in je favoriete café.

Kubernetes, DevSecOps tools, machine learning, big data: bij Deloitte werken we met de nieuwste en beste technologieën.

Michael Kandelaars Specialist Lead Cloud Engineering