VMware, Inc.
EFFICIENT EVENT-TYPE-BASED DISTRIBUTED LOG-ANALYTICS SYSTEM

Abstract:

The current document is directed to methods and systems that efficiently transmit and process log/event messages within and among distributed computer facilities. By digesting and condensing log/event messages at the message-collector level, the volume of data transmitted from message collectors to message-ingestion-and-processing systems is greatly reduced, which increases system efficiencies by decreasing network overheads and which provides sufficient additional computational bandwidth at the message-collector level to allow message collectors to offload many message-processing tasks from message-ingestion-and-processing system and other downstream processing systems. When the currently disclosed, improved message-collectors carry out message-processing tasks formerly carried out by message-ingestion-and-processing systems and other downstream processing systems, an even greater deduction in the volume of data transmitted from message collectors to message-ingestion-and-processing systems is obtained, further increasing system efficiencies. The decrease in data volume also contributes to increased message-query-processing efficiencies.