Luke Hollis
Researcher in Simulation and Perception. Focus on Generative World Models and Causal Discovery. 10+ years of technical leadership in 3D graphics and physics-based simulation.
EXPERIENCE
2025-
Researcher, Massachusetts Institute of Technology
Media Lab, City Science SF, World Models, Simulation, Causal Inference
2025-
Research Assistant, Harvard University
Remote Sensing, LiDAR, Computer Vision
2023–2025
Applied AI Engineer and Advisor, Startups
Machine Learning, Product Development, Technical Strategy
2020–2022
Lead 3d Research Engineer, Harvard University
3D Reconstruction, XR, Agent-based Modeling, Computer Vision
2019–2020
Visiting Researcher, Massachusetts Institute of Technology
Geospatial analyses, Computational Design, Human-Computer Interaction
2014–2019
Founder, Researcher, Archimedes Digital
Spatial Computing, 3D Reconstruction, Machine Learning
EDUCATION
2025-2027
Harvard University, Masters of Data Science
Harvard Kennedy School, Intelligence Project
2025
Stanford University, Graduate Coursework
Data Science and Artificial Intelligence, Applied Math
Research
MIT Media Lab, Harvard Computational Robotics, Harvard Visual Computing
ADVISORY POSITIONS
2024
Apple, iPhone Camera Team, 3d Capture
2024
IBM Almaden Research Center, Spatial Intelligence
2018-2019
Google, Artificial Intelligence (NLP) Admin, Summer of Code
OPEN SOURCE
Convert any 3d capture into a segmented scene graph with physics properties
Part of real2sim pipeline using 3dgs, LangSplat, and GaussGym. Python, Nvidia IsaacSim
3
Three.js + Torch implementation of Unity's ML-Agents framework for agent training and visualization in browser
Agent training and visualization in browser. Python, Three.js
26
1
Create multi-agent simulations in game engines for realistic human behaviors and synthetic training data
Realistic human behaviors and synthetic training data. C#
29
3
Open, hackable 3d digital twin / virtual tour builder that supports 360 images, 3d gaussian splatting, and vfx
Supports 360 images, 3d gaussian splatting, and vfx. JavaScript
29
7
Full workflow from input images to 3dgs with language features segmented into scene graph with predictive physics
Combines 3dgs, LangSplat, SplatGraph, and GaussGym. Python, Nvidia IsaacSim
3
Pytorch implementation of "Genie: Generative Interactive Environments", Bruce et al. (2024).
Bruce et al. (2024). Python, PyTorch
4
2
SELECTED PRESS
Selected Publications
![[Working Title] Predictive Real2Sim Digital Twins: A World Model Approach to Deformable Mesh and Soft-Body Simulation Physics](/static/splatgraph.jpg)
[Working Title] Predictive Real2Sim Digital Twins: A World Model Approach to Deformable Mesh and Soft-Body Simulation Physics
2026Applying world model architectures to predictive physics simulation for deformable objects.
Heng Yang, Luke Hollis
Harvard Computational Robotics Group
In Progress
World Models Physics Simulation Digital Twins
![[Working Title] Scaling Language-Grounded Splatting to Large Urban Spaces](/static/urban_mobility_splatgraph.jpg)
[Working Title] Scaling Language-Grounded Splatting to Large Urban Spaces
2026Novel approach to scale language-grounded 3D gaussian splatting techniques for large-scale urban environments.
Yasushi Sakai, Luke Hollis
MIT Media Lab & Harvard University
In Progress
3D Gaussian Splatting Computer Vision Urban Computing
Urban Planning and Design with 3D Street Captures and 360 Video
2025Methodology for integrating immersive 3D captures into urban planning workflows.
Peter Hirshberg, Kate Connally, Lee Crawford, Luke Hollis
MIT Media Lab
Forthcoming
Urban Planning 360 Video 3D Capture
COMPUTER LANGUAGES
Languages
Python, Javascript, C#, C++, R
Technologies
Torch/Tensorflow, Three.js, Unreal, Unity, Next.js, React, foundation world models and robotics / simulation environments, Isaac Gym, Genesis/Cosmos/V-JEPA 2, MuJoCo, ArduPilot, XPlane, SITL, iNAV, etc.
Methodologies
Reinforcement Learning, Self-Supervised Learning, Causal Inference
AWARDS AND HONORS
2026
E14 and MIT Media Lab, Beyond the Lab, IAP Cohort
2025
Sequoia Capital, Start-up Trek, selected founders from Harvard and MIT
AGI House, World Models Hackathon, 1st Place Winner
Replicate, Digital Twins Hackathon, 1st Place Winner
E14, Artificial Intelligence at MIT Summit, Mountain View
2024
Matterport Digital Twin Award, Top 10 Most Viewed Space of Year
National USS Hornet Hackathon, 1st Place Winner
AGI House, Simulations Hackathon, 1st Place Winner
2023
Matterport Digital Twin Award, Honorable Mention
2020
Graduate Research Fellowship, Massachusetts Institute of Technology
OTHER HIGHLIGHTS
- Built an open source version of Google DeepMind Genie generative world models that I presented at Google and implemented for RL training and simulation
- Built XR software used by every top 100 university in the world at my first startup
- Created an open-source ML Library for Three.js based on one from Unity
- Created a text-to-3d simulation platform used by major construction companies and intelligence analysts for running experiments and risk estimation
- Started and co-organize the Harvard/MIT Reinforcement Learning student group, led technical workshops on Model-based RL
PRESENTATIONS AND INVITED TALKS
2025
Autonomy and Robotics, Ethics and Engineering Guest Lecture, Massachusetts Institute of Technology.
Techniques and Development in Remote Sensing, Lecture, Harvard University.
3d Capture at Stanford Campus, Part 2 of 2. Apple. Stanford University.
3d Capture at Stanford Campus, Part 1 or 2. Apple. Stanford University.
Language-Conditioned Simulation with Reinforcement Learning: Synthesizing Decision-Grade Digital Twins for Complex Physical Systems. Università Cattolica del Sacro Cuore
2024
Generative Interactive Environments: World Models and Learning from GDM Genie. Google
3d Capture and Digital Generative Environments for High Fidelity Urban Simulations of Historical Spaces. Harvard University
Techniques and Methodologies in 3d capture and 3d Gaussian Splatting. Old Dominion University.
2023
Synthesizing Multiple Data Imports for 3d Captures of Large Architectural Features. Università degli Studi di Pavia
2022
Digitization and 3d Simulations for Large Exterior Architectural Spaces. Columbia University
2019
Neural Rendering: 3d Capture and Narrative Building in Extended Realities. American Research Center in Egypt
Extending Reality with Reality Capture Workshop. American University of Cairo
3d Graphics in Extended Reality. Massachusetts Institute for Technology
Building our Digital Imagination: XR in 3d Capture. Women in Games Boston
Designing across Virtual, Augmented, and Mixed Realities for 3d Capture. Harvard University
Creating Immersive Multiplayer Environments for Data Visualization. Computer Applications and Quantitative Methods
Immersive Data Visualization and Interpretation. Computer Applications and Quantitative Methods
2018
Challenges in the Creation of Digital Textual Annotation. Leonard Muellner and Luke Hollis, Harvard University
XR 3d Capture Architectural Data. Harvard University
Digital Futures Consortium: Visualizing 3d Captures in XR. Harvard University
Boston University Mellon Seminar.
Digital Preservation spanning 2D and 3D Interfaces: Cross-platform visualization of data from recording and reconstruction. American Institute Annual Conference
2017
The Harvard Yard 3d Capture Architectural Features Project. Brandon Bentley, Aden Brown, Jeffrey P. Emanuel, and Luke Hollis. Harvard University
Harvard Yard 3d Graphics Lecture, Harvard University
Cityscale handheld AR and cross-platform VR for visualizing georeferenced datasets as a part of a microservices software architecture. Computer Applications and Quantitative Methods