Apple Inc.
Encoding Three-Dimensional Data For Processing By Capsule Neural Networks

Abstract:

A method includes defining a geometric capsule that is interpretable by a capsule neural network, wherein the geometric capsule includes a feature representation and a pose. The method also includes determining multiple viewpoints relative to the geometric capsule and determining a first appearance representation of the geometric capsule for each of the multiple viewpoints. The method also includes determining a transform for each of the multiple viewpoints that moves each of the multiple viewpoints to a respective transformed viewpoint and determining second appearance representations that each correspond to one of the transformed viewpoints. The method also includes combining the second appearance representations to define an agreed appearance representation. The method also includes updating the feature representation for the geometric capsule based on the agreed appearance representation.