Data Engineer

Bij ABN AMRO’s Central Data Office (CDO) werk je aan data-innovatie en de uitvoering van de datastrategie van de bank. Het CDO brengt data governance, engineering en management samen en werkt volgens het Federated Data Governance Model, met focus op datakwaliteit, compliance en efficiëntie.

Binnen Data Management Engineering verbeteren we bedrijfsprocessen en introduceren we nieuwe capabilities door data te democratiseren via visualisatie- en governanceportalen. Met Azure platform-as-a-service is een cloudoplossing gebouwd voor het visualiseren en beheren van metadata en lineage (Metadata Connectors), powered by Azure Databricks, Azure Data Factory, Unity Catalog, Azure Purview en PySpark voor ETL. Het platform ondersteunt metadata scanning en management, inclusief het bouwen van technical lineage voor BCBS239 regulatory compliance en andere lineage use cases.

Data Engineer

We zoeken een Data Engineer met sterke ervaring in data-gerelateerde onderwerpen. Je krijgt ruimte om te experimenteren, je ideeën te implementeren en bij te dragen aan business‑kritische data governance, data lineage en data-visualisatie. Je bouwt innovatieve features die business growth ondersteunen met Azure PaaS- en SaaS-oplossingen.

Je wordt onderdeel van onze developer community en werkt over meerdere teams heen met onder andere een Product Owner, Data Engineers, Integration Engineers en Azure DevOps Engineers. We moedigen nieuwe ideeën aan en je krijgt de kans deze te delen in teammeetings en via interne SharePoint blogs of de public‑facing ABN AMRO Developer Blog.

Working environment

Je werkt met developers in kleine Agile teams (5-9 personen) binnen een DevOps-cultuur. De sfeer is informeel en fouten maken is oké, zolang iedereen er open over is en ervan leert. Teams werken continu samen met alle afdelingen van de bank, internationale vestigingen en dochterondernemingen.

Your profile

Je kunt problemen en oplossingen uitleggen, zowel gedetailleerd aan een technisch publiek als vereenvoudigd aan niet-technische stakeholders. Je organiseert je tijd efficiënt, blijft rustig bij productie-issues en bent sterk in het prioriteren van werk. Daarnaast heb je een bewezen track record in het volgende:

Data Pipelines & ETL Development

• Design, build, and maintain scalable data pipelines using Azure Databricks (PySpark) and Spark‑based ETL frameworks.
• Optimize end‑to‑end data processing workflows using Delta Lake architecture for reliability, performance, and ACID‑compliant operations.

Data Governance & Storage

• Implement secure and governed data access using Unity Catalog for metadata management and permissions.
• Manage data ingestion and storage across ADLS Gen2 and Azure Blob Storage, ensuring efficient file organization, partitioning, and lifecycle management.

Data Integration & Analytics

• Develop integration workflows using Azure Data Factory or Azure Synapse Analytics.
• Build robust SQL‑based transformations with Azure SQL, MS‑SQL, MySQL, including relational modelling, stored procedures, and performance tuning.

Cloud & DevOps (Azure)

• Build and deploy data solutions on Azure Databricks, Azure SQL, and storage services.
• Develop CI/CD pipelines using Azure DevOps, GitHub Actions, or Jenkins to automate deployments, testing, and workspace integration.
• Manage secrets and credentials using Azure Key Vault.

Testing & Quality

• Implement unit and integration tests for Spark ETL pipelines and SQL logic.
• Ensure data quality, validation, and schema enforcement across all pipelines using tools, checkpoints, and best practices.

Collaboration & Engineering Practices

• Work closely with data architects, analysts, and cross‑functional engineering teams.
• Use Git for version control, participate in code reviews, and follow best practices in structured, maintainable code.

Required Skills

• Strong hands‑on experience with Azure Databricks, PySpark, and Spark processing.
• Expertise in Delta Lake and distributed data processing.
• Proficiency in Python (PySpark) and SQL for ETL development.
• Strong understanding of Azure Data Factory, Azure Synapse, Azure SQL, and cloud‑based data integration tools.
• Experience with ADLS Gen2, Azure Blob Storage, and data lake design.
• Knowledge of Unity Catalog for governance and metadata management.
• Familiarity with Azure Key Vault for secure secrets handling.
• Experience with version control using Git.
• Hands‑on experience with Azure DevOps pipelines and CI/CD tools.

Soft Skills

• Excellent analytical and problem‑solving abilities.
• Strong communication and collaboration across engineering and data teams.
• Ability to work independently and in agile, fast‑moving environments.
• Attention to detail, data quality, and structured thinking.

Preferred

• Minimum 2-3 years of experience working in data engineering or Spark‑based ETL environments.
• Azure / DevOps / Databricks certifications.
• Experience working with large‑scale distributed data systems and enterprise‑grade data lakes.

We are offering

• Five weeks of vacation per year. You have the option to purchase an additional four weeks per year.
• Personal development Budget of € 1,000 per year, which you can accumulate up to € 3,000.
• Possibility to work from home (in consultation with your team and depending on your position).
• An annual public transport pass with free public transportation throughout the Netherlands.
• An excellent pension scheme.

gaurav.sikka@nl.abnamro.com