Oracle Corporation
Re-using data structures beyond the life of an in-memory processing session

Abstract:

Techniques for retaining in-memory dataframes beyond an in-memory processing session. One technique includes receiving a request to execute a first run having a first set of tasks, creating a first session to execute the first run, and executing the first run in the first session using a dataframe constructed for a dataset defined as a component of the first run. The executing the first run generates an updated dataframe. The technique further includes receiving a request to execute a second run having a second set of tasks. A dependency exists between the first run and the second run based on a condition that the dataset is defined as a component of the first run and the second run. The technique further includes creating a second session to execute the second run, and executing the second run in the second session using the updated dataframe for the dataset.