Micron Technology, Inc.
WORKLOAD ALLOCATION AMONG HARDWARE DEVICES

Abstract:

An example method corresponding to workload allocation among hardware devices can include monitoring, by a processing unit, workload characteristics associated with execution of workloads by a plurality of hardware devices, such as hardware accelerators. The method can include determining, by the processing unit, particular characteristics corresponding to a workload processed by at least one of the hardware devices and performing, by the processing unit, an action to determine that a particular hardware device exhibits higher performance in executing the workload than a different hardware device. The method can further include allocating a subsequent workload that has characteristics corresponding to the workload exhibiting the particular characteristics to the hardware device that exhibits higher performance in executing the workload than a different hardware device.