ConcatTextTransformer

class lightautoml.transformers.text.ConcatTextTransformer(special_token=' [SEP] ')

Bases: lightautoml.transformers.base.LAMLTransformer

Concat text features transformer.

__init__(special_token=' [SEP] ')

Parameters

special_token (str) – Add special token between columns.

transform(dataset)

Transform text dataset to one text column.

Parameters

dataset (Union[NumpyDataset, PandasDataset]) – Pandas or Numpy dataset of text features.

Return type

PandasDataset

Returns

Pandas dataset with one text column.