Object oriented structure from motion: Can a scribble help?

Rahaf Rahal, Daniel Asmar, Elie Shammas, Bernard Ghanem

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

The concept of anywhere anytime scanning of 3D objects is very appealing. One promising solution to extract structure is to rely on a monocular camera to perform, what is well-known as Structure from Motion (SfM). Despite the significant progress achieved in SfM, the structures that are obtained are still below par the quality of reconstruction obtained through laser scanning, especially when objects are kept as part of their background. This paper looks into the idea of treating points in the scene non-uniformly, in an attempt to give more weight to the objects of interest. The system presented utilizes a minimal user interaction, in the form of a scribble, to segment the pertinent objects from different views and focus the reconstruction on them, leading to what we call Object Oriented SfM (OOSfM). We test the effect of OOSfM on the reconstruction of specific objects by formulating the bundle adjustment (BA) step in three novel manners. Our proposed system is tested on several real and synthetic datasets, and results of the different formulations of BA presented are reported and compared to the conventional (vanilla) SfM pipeline results. Experiments show that keeping the background points actually improves the reconstructed objects of interest.

Original languageEnglish (US)
Title of host publicationVISAPP
EditorsJose Braz, Francisco Imai, Alain Tremeau
PublisherSciTePress
Pages541-548
Number of pages8
Volume5
ISBN (Electronic)9789897582905
StatePublished - Jan 1 2018
Event13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2018 - Funchal, Madeira, Portugal
Duration: Jan 27 2018Jan 29 2018

Publication series

NameVISIGRAPP 2018 - Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications
Volume5

Conference

Conference13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2018
CountryPortugal
CityFunchal, Madeira
Period01/27/1801/29/18

Keywords

  • Interactive image segmentation
  • Object reconstruction
  • Structure from motion

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Object oriented structure from motion: Can a scribble help?'. Together they form a unique fingerprint.

Cite this