![]() |
ImFusion SDK 4.3
|
Classes used to define a data pipeline, mostly used for model training purposes. More...
Collaboration diagram for Data Pipelines:Classes used to define a data pipeline, mostly used for model training purposes.
This includes data loading and processing (or caching, filtering, etc.) Data Structures via DataLoader instances. These building blocks can be assembled manually or within the higher-level Dataset class.
Classes | |
| class | DataLoader |
| Interface for all data loaders, establishing the mechanism for loading and processing data. More... | |
| class | DataReader |
| Base class for data readers. More... | |
| class | Dataset |
| Class for creating an iterable dataset by chaining data loading and transforming operations executed in a lazy fashion. More... | |
| class | BatchDataLoader |
| Batches the items in the nested loader into batches of the specified size. More... | |
| class | CacheDataLoader |
| Caches the dataset loaded until now. More... | |
| class | FilterDataLoader |
| Filters the items according to user defined criterion. More... | |
| class | FilterEmptyElementContentDataLoader |
| Filters the items out if any of the selected fields is holding a DataElement with empty content. More... | |
| class | MapDataLoader |
| Applies a mapping to each item in the nested loader. More... | |
| class | PersistentCacheDataLoader |
| Caches the dataset loaded until now in a persistent manner (on a disk location) More... | |
| class | PrefetchDataLoader |
| Prefetch the next items in a background thread. More... | |
| class | PreprocessDataLoader |
| Applies a preprocessing pipeline to each item in the nested loader. More... | |
| class | RepeatDataLoader |
| Repeats items coming from a nested loader. More... | |
| class | SampleDataLoader |
| Extract samples from each item in the nested loader. More... | |
| class | ShuffleDataLoader |
| Shuffles the next specified items in the nested loader. More... | |
| class | SplitDataLoader |
| Splits the items in the nested loader into DataItems containing a single image (batch size of 1) More... | |
| class | FileReader |
| Loads data by reading the files from a list of data "columns" (see above). More... | |