Data Engineer

At a glance

ABN AMRO’s Central Data Office is responsible for shaping and executing the bank’s data strategy, bringing together data governance, engineering, and management. Within Data Management Engineering, the team focuses on improving business operations and introducing new capabilities across the organisation. Engineers, data scientists, and analysts work on democratising data through visualisation and governance web portals.

Using Azure platform-as-a-service solutions, the team has delivered a cloud-based platform to visualise and manage ABN AMRO’s metadata and lineage. The applications are powered by Azure Databricks, Azure Data Factory, Unity Catalog, Azure Purview, and PySpark to perform ETL operations. This platform supports metadata scanning and metadata management, enabling technical lineage for BCBS239 regulatory compliance and other lineage use cases.

Your job

We are looking for a Data Engineer with strong experience in data-related topics. You will have room to experiment, implement your ideas, and contribute to business-critical data governance, data lineage, and data visualization capabilities. You will have the opportunity to build innovative features that support business growth using Azure PaaS and SaaS offerings.

You will be part of our developer community, working across multiple teams that include a Product Owner, Data Engineers, Integration Engineers, and Azure DevOps Engineers. We encourage new ideas, and you will have the opportunity to share them in team meetings, internal SharePoint blogs, internal knowledge-sharing channels, or the public-facing ABN AMRO Developer Blog.

Working environment

You work with developers in small Agile teams (5-9 persons) within a DevOps culture. The atmosphere is informal, and learning from mistakes is encouraged, provided everyone is open about them. The teams collaborate closely with departments, international branches, and subsidiaries across the bank.

Your profile

You know how to explain problems and solutions, both in detail to a technical audience and in a simplified way to non-technical people. You organize your time efficiently, stay calm when problems arise in production, and prioritize your work effectively.

Proven track record in:

Data Pipelines & ETL Development

• Design, build, and maintain scalable data pipelines using Azure Databricks (PySpark) and Spark-based ETL frameworks.
• Optimize end-to-end data processing workflows using Delta Lake architecture for reliability, performance, and ACID-compliant operations.

Data Governance & Storage

• Implement secure and governed data access using Unity Catalog for metadata management and permissions.
• Manage data ingestion and storage across ADLS Gen2 and Azure Blob Storage, ensuring efficient file organization, partitioning, and lifecycle management.

Data Integration & Analytics

• Develop integration workflows using Azure Data Factory or Azure Synapse Analytics.
• Build robust SQL-based transformations with Azure SQL, MS-SQL, and MySQL, including relational modelling, stored procedures, and performance tuning.

Cloud & DevOps (Azure)

• Build and deploy data solutions on Azure Databricks, Azure SQL, and storage services.
• Develop CI/CD pipelines using Azure DevOps, GitHub Actions, or Jenkins to automate deployments, testing, and workspace integration.
• Manage secrets and credentials using Azure Key Vault.

Testing & Quality

• Implement unit and integration tests for Spark ETL pipelines and SQL logic.
• Ensure data quality, validation, and schema enforcement across all pipelines using tools, checkpoints, and best practices.

Collaboration & Engineering Practices

• Work closely with data architects, analysts, and cross-functional engineering teams.
• Use Git for version control, participate in code reviews, and follow best practices in structured, maintainable code.

Required skills

• Strong hands-on experience with Azure Databricks, PySpark, and Spark processing.
• Expertise in Delta Lake and distributed data processing.
• Proficiency in Python (PySpark) and SQL for ETL development.
• Strong understanding of Azure Data Factory, Azure Synapse, Azure SQL, and cloud-based data integration tools.
• Experience with ADLS Gen2, Azure Blob Storage, and data lake design.
• Knowledge of Unity Catalog for governance and metadata management.
• Familiarity with Azure Key Vault for secure secrets handling.
• Experience with version control using Git.
• Hands-on experience with Azure DevOps pipelines and CI/CD tools.

Soft skills

• Excellent analytical and problem-solving abilities.
• Strong communication and collaboration across engineering and data teams.
• Ability to work independently and in agile, fast-moving environments.
• Attention to detail, data quality, and structured thinking.

Preferred

• Minimum 2-3 years of experience working in data engineering or Spark-based ETL environments.
• Azure / DevOps / Databricks certifications.
• Experience working with large-scale distributed data systems and enterprise-grade data lakes.

We are offering

• An extensive employment benefits package.
• Five weeks of vacation per year, with the option to purchase an additional four weeks per year.
• A personal development budget of € 1,000 per year, which can be accumulated up to € 3,000.
• The possibility to work from home, in consultation with your team and depending on your position.
• An annual public transport pass with free public transportation throughout the Netherlands.
• An excellent pension scheme.