TopoEgo ongoing Jan 2026 – present
TopoEgo: Topology-Aware 4D Gaussian Splatting for Egocentric Vision
Objects get cut. Most 4D methods pretend they don't.
Current 4D Gaussian Splatting methods assume scene topology never changes: a connected object must remain connected. Egocentric video violates this constantly — cutting, opening, breaking, disassembly — and continuous deformation fields respond with severe stretching and ghosting artifacts. TopoEgo extends rigid tracking into a piece-wise rigid kinematic tracker, using spacetime clustering to route canonical Gaussians into independent post-event SE(3) branches at topological boundaries. The project also introduces the TopoEgo benchmark: curated EPIC-KITCHENS and Ego4D sequences with camera poses, dense 2D segmentation masks, and temporal state-change annotations for discontinuous egocentric interactions.
First author — with Chiara Plizzari (Bocconi University), Stefano Gasperini (TUM)
Paper, code, and the TopoEgo benchmark will be released publicly upon acceptance.