FileBatchGenerator

class lightautoml.reader.tabular_batch_generator.FileBatchGenerator(file, n_jobs=1, batch_size=None, read_csv_params=None)[source]

Bases: BatchGenerator

Generator of batches from file.

Parameters:
  • file – File path.

  • n_jobs (int) – Number of processes to handle.

  • batch_size (Optional[int]) – Batch size. Default is None, split by n_jobs.

  • read_csv_params (Optional[dict]) – Params of reading csv file. Look for pandas.read_csv params.