I love SfM, but it's way less useful than it should be because of a handful of characteristic failures.
@zhengqi_li's new paper basically solves them all:
-No parallax? ✅
-No calibration? ✅
-Dynamic scenes? ✅
-Dense geometry? ✅
Best of all, it's super fast.
Aleksander Hołyński
Introducing MegaSaM!
Accurate, fast, & robust structure + camera estimation from casual monocular videos of dynamic scenes!
MegaSaM outputs camera parameters and consistent video depth, scaling to long videos with unconstrained camera paths and complex scene dynamics!