Visa Inc.
METHOD AND SYSTEM USING AI CALL PREDICTION AND CACHE

Abstract:

Methods and systems of predicting and processing cacheable AI calls are disclosed. One method includes determining, by a call prediction processing computer, that an AI computer is operating below a threshold processor usage. The method then includes requesting, by the call prediction processing computer, a set of cacheable requests from an orchestration service computer and receiving, from the orchestration service computer, the set of cacheable requests. Then the method includes sending, by the call prediction processing computer, a cacheable request from the set of cacheable requests to the AI computer. The method then includes receiving, by the call prediction processing computer, an output. The output is generated by the AI computer based on the cacheable request. Then the call prediction processing computer stores the output in a data repository.