General Electric Company
SYSTEM AND METHOD FOR UNSUPERVISED DEEP LEARNING FOR DEFORMABLE IMAGE REGISTRATION

Abstract:

A method is provided. The method includes acquiring simultaneously multiple magnetic resonance (MR) images and multiple ultrasound images of an anatomical region of a subject over a scanned duration. The method also includes training an unsupervised deep learning-based deformable registration network. This training includes training a MR registration subnetwork based on the multiple MR images to generate MR deformation and transformation vectors, training an ultrasound registration subnetwork based on the multiple ultrasound images to generate ultrasound deformation and transformation vectors, and training a MR-to-ultrasound subnetwork based the multiple MR images and the multiple ultrasound images to generate MR-to-ultrasound deformation and transformation vectors between corresponding pairs of MR images and ultrasound images at each time point.