Summary
English to French:   more detail...
  1. tokenization:


English

Detailed Translations for tokenization from English to French

tokenization:

tokenization [the ~] noun

  1. the tokenization
    – In text mining or Full-Text Search, the process of identifying meaningful units within strings, either at word boundaries, morphemes, or stems, so that related tokens can be grouped. For example, although "San Francisco" is two words, it could be treated as a single token. 1

Translation Matrix for tokenization:

Not SpecifiedRelated TranslationsOther Translations
segmentation du texte en unités lexicales tokenization

Related Definitions for "tokenization":

  1. In text mining or Full-Text Search, the process of identifying meaningful units within strings, either at word boundaries, morphemes, or stems, so that related tokens can be grouped. For example, although "San Francisco" is two words, it could be treated as a single token.1