Reference for BasePipeline
As its name suggests, the BasePipeline will simply feed the output of the provided parser as input to the provided chunker.
Bases: AbstractPipeline
chunk_file(filepath)
Parses and chunks a string based on the provided parser and chunker.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
filepath
|
Filepath
|
the path to a file. |
required |
Returns:
| Type | Description |
|---|---|
list[Chunk]
|
list[Chunk]: A list of chunks. |
chunk_string(string)
Parses and chunks a string based on the provided parser and chunker.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
string
|
str
|
a string. |
required |
Returns:
| Type | Description |
|---|---|
list[Chunk]
|
list[Chunk]: A list of chunks. |