International Business Machines Corporation
VIDEO FRAME SYNTHESIS USING TENSOR NEURAL NETWORKS

Abstract:

A method for implementing video frame synthesis using a tensor neural network includes receiving input video data including one or more missing frames, converting the input video data into an input tensor, generating, through tensor completion based on the input tensor, output video data including one or more synthesized frames corresponding to the one or more missing frames by using a transform-based tensor neural network (TTNet) including a plurality of phases implementing a tensor iterative shrinkage thresholding algorithm (ISTA), and obtaining a loss function based on the output video data.