International Business Machines Corporation
Methods and systems for processing language with standardization of source data

Abstract:

Embodiments for processing language by one or more processors are described. A plurality of document portions are detected. Each of the plurality of document portions includes text in a respective language type. The text of each of the plurality of document portions is converted to a standardized language type. A language processing method is caused to be performed on the plurality of document portions after the converting of the text of each of the plurality of document portions to the standardized language type.