PhD Candidate at UCL

I’m a human-computer interaction researcher studying interpersonal and human-AI collaboration in mixed reality. Through the design of novel interactive systems and evaluation of their use in context, I investigate how spatial environments can be computationally parsed, represented, and transformed to support new forms of situated action and shared understanding. My PhD research in the VECG Group at University College London examines asymmetric collaboration in mixed reality, analyzing how spatial configurations and context shape interaction when collaborators have differing roles, capabilities, or interfaces. By combining methods and concepts from human-computer interaction, generative AI, computer vision, and computer-supported cooperative work, my work connects sensing and inference with interaction design and evaluation.

I hold a BSc and MSc in Computer Science and have completed research internships at Google (BIRD Lab), Niantic Labs, Microsoft Research (EPIC Group), and TNO Research (Intelligent Imaging), and worked as a data scientist at IBM before starting my PhD.

Education
Jul. 2021 — Dec. 2025London, UK

Ph.D. Computer ScienceUniversity College London

Research group: Virtual Environments and Computer Graphics (VECG). Topic: “Constructing Shared Space: Designing for Asymmetry in Collaborative Mixed Reality”. Supervisors: Prof. Anthony Steed (primary) and Prof. Simon Julier (secondary).
Feb. 2018 — Oct. 2020Delft, Netherlands

M.Sc. Computer ScienceDelft University of Technology

Track: Data Science & Technology; Thesis: “Generative RGB-D Face Completion for Head-Mounted Display Removal”; Supervisors: Prof. Pablo Cesar (TU Delft, CWI) and Dr. Frank ter Haar (TNO).
Sept. 2013 — Feb. 2018Leiden, Netherlands

B.Sc. Computer ScienceLeiden University

Thesis: “A Comparative Performance Analysis of Feature Description Algorithms”. Supervisor: Prof. Michael Lew.
Work Experience
May. 2025 — Sept. 2025Mountain View, CA, USA

Research / Software Engineering InternGoogle

  • Continued my research projects at the BIRD Lab while collaborating with researchers and engineers across the Google XR organization.
  • Led the research and writing of a first-author paper (in preparation) introducing a novel system driven by 3D Gaussian Splatting (3DGS). Additionally, served as a core contributor to three other publications including Sensible Agent (ACM UIST ‘25) and XR Blocks.
Dec. 2024 — May. 2025Seattle, WA, USA

Student ResearcherGoogle

Oct. 2023 — Jun. 2024London, UK

Research InternNiantic Labs

  • Conducted research on the future of location-based AR authoring under the mentorship of Jessica van Brummelen and Gabriel Brostow as a part-time internship during my Ph.D. studies.
  • Authored a first-author paper on CoCreatAR at ACM CHI ‘25, which received a Best Paper Honorable Mention award and had a related non-provisional patent application filed. I presented a follow-up work titled AdjustAR as a poster at ACM UIST ‘25.
May 2023 — Sept. 2023Redmond, WA, USA

Research InternMicrosoft Research

Oct. 2020 — Jul. 2021Amsterdam, Netherlands

Data ScientistIBM

  • Built and deployed custom ML models to solve client-specific problems and improve enterprise processes.
  • Presented insights to technical and non-technical stakeholders to support strategic decisions.
Feb. 2020 — Oct. 2020Amsterdam, Netherlands

Cloud Solution Architect Intern (Data & AI)Microsoft

  • Developed data models and analytics solutions for global clients and internal teams.
  • Designed a proof-of-concept system using a data-driven approach to improve data center construction management.
Jul. 2019 — Aug. 2020The Hague, Netherlands

Research InternNetherlands Organisation for Applied Scientific Research (TNO Research)

  • Conducted research towards a novel approach to head-mounted display (HMD) removal within RGB-D images at the Intelligent Imaging group under the mentorship of Frank ter Haar.
  • Designed and evaluated a generative adversarial network (GAN) for the joint inpainting of RGB-D images. Described the results in my MSc thesis as well as a paper at the VHCIE workshop at IEEE VR 2021.
Publications
Conference & Journal Papers
Oct. 2025

Sensible Agent: A Framework for Unobtrusive Interaction with Proactive AR Agents

Geonsun Lee, Min Xia, Nels Numan, Xun Qian, David Li, Yanhe Chen, Achin Kulshrestha, Ishan Chatterjee, Yinda Zhang, Dinesh Manocha, David Kim, Ruofei Du
38th ACM Symposium on User Interface Software and Technology (ACM UIST 2025)
Oct. 2025

XR Blocks: Accelerating Human-Centered AI + XR Innovation

David Li, Nels Numan, Xun Qian, Yanhe Chen, Zhongyi Zhou, Evgenii Alekseev, Geonsun Lee, Alex Cooper, Min Xia, Scott Chung, Jeremy Nelson, Xiuxiu Yuan, Jolica Dias, Tim Bettridge, Benjamin Hersh, Michelle Huynh, Konrad Piascik, Ricardo Cabello, David Kim, Ruofei Du
arXiv preprint arXiv:2509.25504
Apr. 2025

CoCreatAR: Enhancing Authoring of Outdoor Augmented Reality Experiences Through Asymmetric Collaboration

Nels Numan, Gabriel Brostow, Suhyun Park, Simon Julier, Anthony Steed, Jessica Van Brummelen
43rd ACM CHI Conference on Human Factors in Computing Systems (ACM CHI 2025)
  • ★ Best Paper Honorable Mention (top 5% of submissions)
  • Patent Pending
  • Oct. 2024

    SpaceBlender: Creating Context-Rich Collaborative Spaces Through Generative 3D Scene Blending

    Nels Numan*, Shwetha Rajaram*, Balasaravanan Thoravi Kumaravel, Nicolai Marquardt, Andrew D. Wilson
    37th ACM Symposium on User Interface Software and Technology (ACM UIST 2024)
  • Patent Pending
  • Oct. 2024

    BlendScape: Enabling End-User Customization of Video-Conferencing Environments Through Generative AI

    Shwetha Rajaram*, Nels Numan*, Balasaravanan Thoravi Kumaravel, Nicolai Marquardt, Andrew D. Wilson
    37th ACM Symposium on User Interface Software and Technology (ACM UIST 2024)
  • ★ Best Paper Honorable Mention (top 1.5% of submissions)
  • Patent Pending (US Patent App. 18/542,501)
  • Mar. 2024

    DreamCodeVR: Towards Democratizing Behavior Design in Virtual Reality with Speech-Driven Programming

    Daniele Giunchi, Nels Numan, Elia Gatti, Anthony Steed
    31st IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR 2024)
    Oct. 2023

    Extending the Open-Source Social Virtual Reality Ecosystem to the Browser in Ubiq

    Sebastian Friston, Ben Congdon, Nels Numan, Klara Brandstätter, Lisa Izzouzi, Felix Thiel, Jingyi Zhang, Daniele Giunchi, David Swapp, Anthony Steed
    28th International ACM Conference on 3D Web Technology (ACM Web3D 2023)
    Mar. 2023

    Immersive Competence and Immersive Literacy: Exploring How Users Learn about Immersive Experiences

    Anthony Steed, Daniel Archer, Lisa Izzouzi, Nels Numan, Kalila Shapiro, David Swapp, Dinah Lammiman, Rob Lindeman
    Frontiers in Virtual Reality
    Nov. 2022

    Exploring User Behaviour in Asymmetric Collaborative Mixed Reality

    Nels Numan, Anthony Steed
    28th ACM Symposium on Virtual Reality Software and Technology (ACM VRST 2022)
    Oct. 2022

    Ubiq-Exp: a Toolkit to Build and Run Remote and Distributed Mixed Reality Experiments

    Anthony Steed, Lisa Izzouzi, Klara Brandstätter, Sebastian Friston, Benjamin Congdon, Otto Olkkonen, Daniele Giunchi, Nels Numan, David Swapp
    Frontiers in Virtual Reality
    Posters & Workshop Papers
    Oct. 2025

    AdjustAR: AI-Driven In-Situ Adjustment of Site-Specific Augmented Reality Content

    Nels Numan, Jessica Van Brummelen, Ziwen Lu, Anthony Steed
    38th ACM Symposium on User Interface Software and Technology (ACM UIST 2025 Adjunct)
    Mar. 2024

    StreamSpace: A Framework for Window Streaming in Collaborative Mixed Reality Environments

    Daniele Giunchi, Riccardo Bovo, Nels Numan, Anthony Steed
    31st IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (IEEE VR 2024)
    Mar. 2024

    AIsop: Exploring Immersive VR Storytelling Leveraging Generative AI

    Elia Gatti, Daniele Giunchi, Nels Numan, Anthony Steed
    31st IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (IEEE VR 2024)
    Mar. 2023

    Ubiq-Genie: Leveraging External Frameworks for Enhanced Social VR Experiences

    Nels Numan, Daniele Giunchi, Benjamin Congdon, Anthony Steed
    OAT: 2nd Workshop on Open Access Tools and Libraries for Virtual Reality (IEEE VR 2023)
    Mar. 2023

    Towards Outdoor Collaborative Mixed Reality: Lessons Learnt from a Prototype System

    Nels Numan, Ziwen Lu, Benjamin Congdon, Daniele Giunchi, Alexandros Rotsidis, Andreas Lernis, Kyriakos Larmos, Tereza Kourra, Panayiotis Charalambous, Yiorgos Chrysanthou, Simon Julier, Anthony Steed
    ReDigiTS: 2nd Workshop on 3D Reconstruction, Digital Twinning, and Simulation for Virtual Experiences (IEEE VR 2023)
    Mar. 2021

    Generative RGB-D Face Completion for Head-Mounted Display Removal

    Nels Numan, Frank ter Haar, Pablo Cesar
    VHCIE: 6th Workshop on Virtual Humans and Crowds for Immersive Environments (IEEE VR 2021)
    Mar. 2019

    Star Tag: a Superhuman Sport to Promote Physical Activity

    Nels Numan, Ayla Kolster, Niels Hoogerwerf, Bernd Kreynen, Jeanique Romeijnders, Tomas Heinsohn Huala, Nestor Z. Salamon, J. Timothy Balint, Stephan Lukosch, Rafael Bidarra
    SHS: 1st Workshop on Superhuman Sports (IEEE VR 2019)
    Service & Teaching
    Reviewer
  • ★ Special Recognition for Outstanding Review (2025)
  • 2× ★ Special Recognition for Outstanding Review (2025)
  • ★ Special Recognition for Outstanding Review (2024)
  • 2025—2026

    Web Co-Chair

    2021—2024

    Postgraduate Teaching AssistantUniversity College London

    • Virtual Environments (COMP0113) with Prof. Anthony Steed
    • Systems Engineering (COMP0016) with Prof. Dean Mohamedally
    2022—2025

    Mentor

    • Molly Zhu (thesis project, UCL ME Computer Science): Real-Time Speech Captioning and Visualization with Ubiq-Genie
    • Rowan Meng (summer intern, UCL): Embodied LLM-based Programming with Ubiq-Genie
    • Aiman Sohail (summer intern, Queen Mary University): Generative Storytelling in Social VR with Ubiq-Genie
    • Pruetikorn Chirattitikarn (thesis project, UCL MSc Computer Science): Exploring Environmental Representations in Collaborative MR
    • Angela Yu (thesis project, UCL MEng Computer Science): Interactive Avatar Appearance Modelling with Generative AI
    • Praveen Selvaraj (thesis project, UCL MSc Computer Science): Escape Room in Asymmetric Collaborative MR
    Grants & Awards
    Apr. 2025

    Best Paper Honorable Mention at ACM CHI '25

    CoCreatAR: Enhancing Authoring of Outdoor Augmented Reality Experiences Through Asymmetric Collaboration
    Jan. 2025

    Departmental Travel Grant

    UCL Computer Science
    Oct. 2024

    Best Paper Honorable Mention at ACM UIST '24

    BlendScape: Enabling End-User Customization of Video-Conferencing Environments Through Generative AI
    Oct. 2024

    Departmental Travel Grant

    UCL Computer Science
    Jul. 2021 — Jul. 2024

    Ph.D. Studentship

    European Union’s Horizon 2020 Research and Innovation Program (Project RISE), grant no. 739578.
    Oct. 2023

    Honorable Mention for Best Design Award at ISMAR 2023 Student Competition

    Reviving the Euston Arch: A Mixed Reality Approach to Cultural Heritage Tours
    Jun. 2022

    UCL Nominee for Microsoft Research PhD Fellowship

    Mar. 2019

    Conference Travel Grant

    Delft Sports Engineering Institute
    Skills
    Programming Languages and Frameworks
  • Python
  • C++
  • C#
  • Java
  • JavaScript
  • Node.js
  • TypeScript
  • PHP
  • R
  • SQL
  • TensorFlow
  • PyTorch
  • MRTK
  • Niantic ARDK
  • Software and Services
  • Unity
  • Adobe Illustrator
  • Adobe Photoshop
  • Adobe InDesign
  • TouchDesigner
  • AWS
  • Azure
  • GCP
  • Current Work Eligibility
  • European Union
  • United Kingdom (part-time)
  • United States