Senior software engineer - Data Platform Engineer (OLAP)

At Adyen, Data Platform Engineers sit at the intersection of Data Engineering, Backend Engineering, and Systems Engineering, building the foundational layer of tooling and processes for on-premise Big Data Platforms. These tools support tens of products, hundreds of developers, and thousands of daily jobs that contribute to Adyen’s capabilities.

You’ll collaborate with data engineers and ML scientists and engineers to build and roll out these tools. Along with DataOps Engineers, you’ll develop and operate multiple big data platforms, including one with more than 500 nodes, 25k+ CPU cores, 240+ TB of RAM, and 23+ PB of storage capacity, running tens of thousands of Spark jobs a day.

Senior software engineer - Data Platform Engineer (OLAP)

Your Focus Areas

We are currently expanding our platform capabilities. Depending on your expertise, your immediate focus will be driving one of these two key ecosystems:

• The OLAP Ecosystem: Scaling and optimizing our real-time analytical powerhouses (Druid, FastAPI, Java, Kafka).
• The Data Engineering Ecosystem: Designing and building data contracts, validation frameworks, optimization tooling, and robust Kafka ingestion pipelines.

What You’ll Do

You will balance building innovative new tools from scratch with relentlessly improving our existing infrastructure. This role is a perfect fit if you are passionate about:

• Scale: Developing and maintaining high-performance, distributed big data platforms.
• Distributed Systems: Working deeply with various flavors of databases, filesystems, and compute engines.
• Data Quality & Discoverability: Building tools that enhance metadata collection, data lineage, and platform-wide data quality.
• CI/CD & Infrastructure: Optimizing continuous release/deployment environments within a large-scale private cloud system.
• Streaming: Developing stream processing applications and frameworks to reduce time-to-insight for analysts and data scientists.

Who You Are

• Python or Java Expert: 6+ years of experience with object-oriented programming.
• Collaborative Enabler: A strong communicator who thrives on building bridges between the teams you enable (analysts, data scientists) and the teams you depend on (infrastructure, security).
• Distributed Systems Architect: Proven experience developing and maintaining distributed compute/data systems (e.g., Spark, Trino, Druid, ClickHouse).
• Experience with real-time and batch pipelines (Kafka, Spark Streaming) with a focus on user-friendliness and reliability.

This role is based out of our Amsterdam office. We are an office-first company and value in-person collaboration; we do not offer remote-only roles.