Documents

Identifying the language of a text is often done before you select the right language model.

Extracting text from a file should be accompanied with the extraction of meta-information.

Pre-processing text with the goal to increase the quality of subsequent NLP tasks.

Finding texts that are exactly the same or show a high similarity. Similarity can be measured on lexicality or semantic meaning from embeddings.