Bentley Systems, Incorporated
3D object detection from calibrated 2D images

Abstract:

In an example embodiment, techniques are provided for 3D object detection by detecting objects in 2D (as 2D bounding boxes) in a set of calibrated 2D images of a scene, matching the 2D bounding boxes that correspond to the same object and reconstructing objects in 3D (represented as 3D bounding boxes) from the corresponding, matched 2D bounding boxes. The techniques may leverage the advances in 2D object detection to address the unresolved issue of 3D object detection. If sparse 3D points for the scene are available (e.g., as a byproduct of SfM photogrammetry reconstruction) they may be used to refine the 3D bounding boxes (e.g., to reduce their size).