Twitter, Inc. (delisted)
Indexing data in information retrieval systems

Abstract:

Methods, systems, and apparatus, including computer programs encoded on computer storage medium, for indexing data in information retrieval systems. In one aspect, a system includes computer readable storage media, where the non-transitory computer readable storage media include postings lists for a term, where each posting list includes postings blocks, position blocks, and metadata blocks. Each postings block includes document identifiers and respective indications of frequency of the term in each document. Each position block includes position indications for the term in the documents of a corresponding postings block. Each metadata block includes an indication of the size of the document identifiers in the associated postings block, an indication of the size of the indications of frequency of terms in the associated postings block, an indication of a number of postings in the associated postings block, and an indication of position information for postings in the associated postings block.