ConcatTextTransformer

class lightautoml.transformers.text.ConcatTextTransformer(special_token=' [SEP] ')

Bases: LAMLTransformer

Concat text features transformer.

Parameters:

special_token (str) – Add special token between columns.

transform(dataset)

Transform text dataset to one text column.

Parameters:

dataset (Union[NumpyDataset, PandasDataset]) – Pandas or Numpy dataset of text features.

Return type:

PandasDataset

Returns:

Pandas dataset with one text column.