Snowflake Inc.
Storing multi-level metadata in database systems

Abstract:

The subject technology receives first metadata corresponding to a set of micro-partitions. The subject technology generates second metadata for a grouping of the first metadata. The subject technology generates a first data structure including the first metadata and a second data structure including the second metadata, the second data structure including information associating the second metadata to the first metadata. Further, the subject technology stores the first data structure and the second data structure in persistent storage as a first file and a second file.