The Home Depot, Inc.
COMPLEMENTARY ITEM RECOMMENDATIONS BASED ON MULTI-MODAL EMBEDDINGS

Abstract:

Systems and methods for providing suggestions of complementary products responsive to an anchor product are disclosed. The method includes receiving a selection of an anchor product. A similarity score between text embeddings of the anchor product and text embeddings of a plurality of products in a product database is calculated. A similarity score between an image feature of the anchor product and an image feature of the plurality of products in the product database is calculated. A weighted score between the two similarity scores as calculated for the anchor product and the plurality of products in the product database is calculated. At least one of the products from the product database having a highest weighted score is selected and returned responsive to the selection of the anchor product.