2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)
Download PDF

Abstract

We address the problem of detecting and erasing furniture from a wide angle photograph of a room. Inpainting large regions of an in-door scene often results in geometric inconsistencies of background elements within the inpaint mask. To address this problem, we uti-lize perceptual information (e.g. instance segmentation, and room layout) to produce a geometrically consistent empty version of a room. We share important details to make this system viable, such as per-plane inpainting, automatic rectification, and texture refinement. We provide detailed ablation along with qualitative examples, justifying our design choices. We show an application of our system by removing real furniture from a room and redecorating it with virtual furniture.
Like what you’re reading?
Already a member?
Get this article FREE with a new membership!

Related Articles