International Business Machines Corporation
DECENTRALIZED ONLINE MULTI-AGENT VISUAL QUESTION ANSWERING

Abstract:

An approach to real-time multi-agent visual question answering in a decentralized environment. The approach can include initializing a plurality of agents based on data associated with an image and a question about the image. The approach can include identifying a first portion of the plurality of agents to construct a grid of agents based on similarity between the first portion of agents. The approach can include determining a second portion of agents of the first portion of agents with edges between agents allowing sharing of agent concepts and agent parameters. The approach can include generate training trajectories of the grid of agents based on executing a collaborative rollout. Additionally, the approach can include optimizing agent policies of the grid of agents.