International Business Machines Corporation
Optimizing updates to distributed data processing applications

Abstract:

Techniques for optimizing updates to a distributed data processing application are provided. A runtime engine compares a first version of a distributed application to a second, new version of the distributed application. The runtime engine identifies change(s) to the first version. The runtime engine generates compiler hint(s) for the change(s). The second version of the distributed application and compiler hint(s) are sent to a compiler. The runtime engine receives, from the compiler, a compiled second version of the distributed application and compiler-scheduler hint(s) describing respective optimizations the compiler made to the compiled second version of the distributed application based on the change(s) made to the first version of the distributed application and the compiler hint(s). The runtime engine optimizes an update by overlaying the change(s) made to the first version of the distributed application based on the compiler-scheduler hint(s) and the compiled second version of the distributed application.