Data Engineer – Extraction & Ingestion

Join A‑INSIGHTS as a Data Engineer – Extraction & Ingestion (Python)

A‑INSIGHTS turns raw market signals into clear, actionable insights for decision makers at names like McCain, FrieslandCampina and Ahold Delhaize. Our data pipelines are the first mile of that journey. As our next Data Engineer you’ll play a vital role in the ingestion layer, designing resilient scrapers and API connectors that keep fresh, high‑quality data flowing 24/7.

What you will be doing

You are co-responsible for the front door of our central data platform

• Ingest structured & unstructured data through robust Python scrapers and API connectors.
• Orchestrate the early ELT steps: validation, normalization, schema mapping, so downstream teams start with trustworthy tables.
• Observe & debug: surface anomalies fast with rich logging, metrics and alerting; dive into IDE‑level debugging when things break.
• Raise the bar: code reviews, test coverage and clean architecture; leave every module better than you found it.
• Embed AI (Azure OpenAI & Cognitive Services) to auto‑classify, summarize and deduplicate news, documents and web content.

Projects you’ll tackle in the first year

• Migrate legacy scrapers to Azure Functions with retry logic, exponential back‑off and structured logs.
• AI‑powered news crawler that tags relevance and generates summaries, enriching the curated dataset.
• Document‑to‑insight pipeline to extract, vectorize and summarize PDF/Office files at scale.

Ongoing work you will contribute to

• Build & maintain Python ingestion jobs and first-step ELT pipelines.
• Deploy and observe services through Azure DevOps and Docker.
• Keep our data platform reliable, scalable and secure
• Follow data engineering best practices for design, testing and documentation.
• Build and maintain cloud infrastructure in Azure to support scalable and secure data ingestion processes.

Tech stack

Daily tools

• Python (including Pandas, Selenium, and internal SDKs)
• API integration (REST, GraphQL)
• Azure DevOps (Git version control, CI/CD pipelines)
• Docker & Azure Container Registry
• Azure Function Apps & Logic Apps

You’ll also touch

• Azure AI Services & AI Foundry
• SQL (SQL Server Management Studio / Azure Data Studio)
• Azure Key Vault
• Azure Storage Services (Blob, Table, Queue)
• Azure Monitor / Application Insights

Haven’t used every tool yet? If you’ve mastered similar tech and love learning, we’ll back you.

Your Talent

• 2–4 years of professional software development (preferably Python).
• Proven track record building and maintaining production‑grade codebases.
• Git power user branching, rebasing, PR reviews and CI checks are second nature.
• Solid grasp of clean code, architectural patterns and debugging.
• Comfortable working with datasets, data‑quality rules, formats and transformations.
• Bonus points Web scraping, Selenium, SQL optimization, Azure, Pandas or NumPy.

Passion beats checklist perfection: if you tick most boxes, let’s talk.

Who you'll be working with:

Martijn – Head of Product & Tech

Wilco – Technical Lead Platform

Jan – Senior Data Engineer

What we offer:

• Competitive salary € 47 500 – € 57 500 annually, including 8 % holiday allowance.
• Performance bonus up to 10 % of gross salary.
• Hybrid work: 2–5 days/week in our Amsterdam HQ
• Personal growth plan and budget for both hard & soft skills.
• A supportive team of experienced engineers (pair‑programming, architecture sparring).
• Regular company events, dinners, BBQs, boat trips, padel tournaments, because fun fuels focus.

About A-INSIGHTS

We enable the world’s biggest food companies like McCain, Royal FrieslandCampina, Ahold Delhaize, Puratos, Savencia and more to save time, deepen insights and seamlessly share knowledge. With a strong product, a clear mission and rapid growth ahead, there’s never been a better time to join us.

Our Amsterdam team is a vibrant mix of 15 + nationalities who blend curiosity with craft (and occasionally turn each other into works of art).

We’re serious about inclusion

Research shows some groups only apply when they meet every requirement. If you’re excited by this role but your experience doesn’t line up perfectly, please apply anyway—we’d love to hear your story.

Ready to be our next secret ingredient?

Have Questions? For any inquiries or additional information, please contact Nofar Biran.

• Email: nofar.biran@a-insighst.eu
• WhatsApp: +31 (0)611532011