SimpleEnTokenizer
- class lightautoml.text.tokenizer.SimpleEnTokenizer(n_jobs=4, to_string=True, stopwords=False, is_stemmer=True, **kwargs)[source]
Bases:
lightautoml.text.tokenizer.BaseTokenizer
English tokenizer.
- __init__(n_jobs=4, to_string=True, stopwords=False, is_stemmer=True, **kwargs)[source]
Tokenizer for English language.