Pure Storage, Inc.
Efficient Data Encoding And Processing In A Storage Network

Abstract:

A method for execution by a processing module of a storage network includes determining processing parameters for data based on a number of storage and execution units of the storage network to be utilized in processing the data, where the data is associated with a task. The method further includes task partitioning of the task based on the number of storage and execution units and the processing parameters. The method further includes processing the data in accordance with the processing parameters to produce slice groupings. The method further includes partitioning the task based on the task partitioning to produce partial tasks. The method further includes sending the slice groupings and corresponding partial tasks to the storage and execution units.