International Business Machines Corporation
Automatic keyphrase extraction from text using the cross-entropy method

Abstract:

Automated keyphrase extraction from a digital text document. A pool of candidate keyphrases of the digital text document is created. A cross-entropy method is then employed to compute a set of output keyphrases out of the pool of candidate keyphrases, by iteratively optimizing an objective function that is configured to cause the set of output keyphrases to be descriptive of one or more main topics discussed in the digital text document. The set of output keyphrases may be used for at least one of: text summarization, text categorization, opinion mining, and document indexing.