SAP SE
Adaptive cloud request handling

Abstract:

A cloud computing system receives a plurality of requests originating from a plurality of tenants. Thereafter, a load balancer forming part of the cloud computing system dispatches each request to one of a plurality of groups of servers based on a group mapping table configured to optimize a cache hit ratio. Each group of servers includes a plurality of servers dispatching each request to one of the plurality of servers within each group of servers. The cloud computing system provides responses to the requests to the respective tenants as generated by the respective servers within the respective groups of servers. The group mapping table can be generated by monitoring historical request statistics for each of the tenants, monitoring current resource consumption by the plurality of groups of servers when handling requests from the tenants, and associating each tenant with one of the groups of servers based on such monitoring.