| Interface | Description |
|---|---|
| ControlledReader<T> |
A interface for reading a a continous data set stored in eighther memory or file system
|
| ResettableIterator<T> | |
| Restorable | |
| RestorableIterator<E> | |
| Shuffle |
Different interfaces to go to disk
|
| Class | Description |
|---|---|
| ControlledFileReader | |
| ControlledFileReaderFlags |
Memory mappable limit can be increased in linux with following command.
|
| ControlledMemoryReader |
Wrapper for tuples in memory.
|
| FileLoader | |
| FSKeyedMerger |
Un sorted merger
|
| FSKeyedMergerTest | |
| FSKeyedSortedMerger |
Sorted merger implementation
todo add support to handling large values.
|
| FSKeyedSortedMerger2 |
Sorted merger implementation
todo add support to handling large values.
|
| FSKeyedSortedMergerTest | |
| FSMerger |
Save the records to file system and retrieve them, this is just values, so no
sorting as in the keyed case
|
| FSMergerTest | |
| FSSorter |
File based sorter of records, we assume we can read maxbytes from all the files in the disk
into memory, this may not be the case for larger records and we have to take special
consideration into that.
|
| MemoryMapUtils | |
| OpenFile |
Represent an open file containing the channel and the buffer
|
| OpenFilePart |
Represent an open file part.
|
| RestorableIteratorTest | |
| RestorePoint |