Part-based modelling of compound scenes from images

Abstract

We propose a method to recover the structure of a com- pound scene from multiple silhouettes. Structure is ex- pressed as a collection of 3D primitives chosen from a pre- defined library, each with an associated pose. This has several advantages over a volume or mesh representation both for estimation and the utility of the recovered model. The main challenge in recovering such a model is the com- binatorial number of possible arrangements of parts. We address this issue by exploiting the intrinsic structure and sparsity of the problem, and show that our method scales to scenes constructed from large libraries of parts.