Researcher Robot Learning: 3D Foundation Models in Diffusion Policie

Researcher Robot Learning: 3D Foundation Models in Diffusion Policie

Shape the next step in robot learning: combining diffusion policies with advanced 3D foundation models so robots learn faster and more robustly in the real world.

Job description

Vision-Language-Action (VLA) models and diffusion policies are currently defining the state-of-the-art in robot learning, yet they typically rely on 2D inputs that limit spatial reasoning. This research explores the potential of integrating advanced 3D foundation models, such as VGGT, directly into VLA-based diffusion architectures. By leveraging pre-trained 3D knowledge—capable of understanding non-overlapping views and complex geometry—the project aims to surpass the limitations of standard RGB approaches. The core challenge involves effectively fusing these rich spatial modalities to achieve faster learning and superior generalization on a physical robot arm.

Job requirements

Applicants should:

• Have an MSc degree in Artificial Intelligece, Computer Science, or Robotics
• Have strong programming skills
• Have experience with deep learning
• Have affinity with natural language processing or 3D computer vision
• Have profound interest in human-technology interaction
• Embrace open science principles and modern communication tools

TU Delft (Delft University of Technology)

Delft University of Technology is built on strong foundations. As creators of the world-famous Dutch waterworks and pioneers in biotech, TU Delft is a top international university combining science, engineering and design. It delivers world class results in education, research and innovation to address challenges in the areas of energy, climate, mobility, health and digital society. For generations, our engineers have proven to be entrepreneurial problem-solvers, both in business and in a social context.

Faculty Mechanical Engineering

ME is a dynamic and innovative faculty with high-tech lab facilities and international reach. It’s a large faculty but also versatile, so we can often make unique connections by combining different disciplines. This is reflected in ME’s outstanding, state-of-the-art education, which trains students to become responsible and socially engaged engineers and scientists. We translate our knowledge and insights into solutions to societal issues, contributing to a sustainable society and to the development of prosperity and well-being. That is what unites us in pioneering research, inspiring education and (inter)national cooperation.

Conditions of employment

• Duration of contract is 12 months (temporary)
• An excellent pension scheme via the ABP.
• The possibility to compile an individual employment package every year.
• Discount with health insurers on supplemental packages.
• Flexible working week.
• Plenty of opportunities for education, training and courses.
• Partially paid parental leave
• Attention for working healthy and energetically with the vitality program.