Meta Platforms, Inc.
Calibration for multi-camera systems

Abstract:

An image processing system calibrates multiple cameras of a camera rig system. The image processing system may correct barrel distortion of raw images to generate rectilinear images. The image processing system identifies key points in neighboring rectilinear image pairs captured by adjacent cameras. The image processing system may generate a parameter vector by solving an optimization problem using a gradient descent loop and the key points. The optimization problem reduces a displacement error to align the key points of the rectilinear images by adjusting calibration of the cameras or a transform of the images (which corresponds to camera calibration). The image processing system may jointly rectify, i.e., calibrate, multiple cameras simultaneously.