Palantir Technologies Inc.
DATA INSIGHTS

Abstract:

A data insight system generates an index of precalculated statistical attributes associated with massive data files, such as network log data, that allows improved access to statistical attributes associated with the data items. The system may partition time-based data items into segments based on one or more metadata criteria (e.g., product, status, deployment, environment, version, host, etc.), such as may be selected by a user. The system may then group the data items by time intervals (e.g., 1 minute, 60 minutes, 24 hours, etc.), and calculate one or more statistical attributes (e.g., sum, average, standard deviation, etc.) for each of the segments within each of the time windows. This statistical data may then be stored in association with the corresponding segment and time interval for access by one or more front end software applications.