edu.iu.dsc.tws.dataset.partition

Class DiskBackedCollectionPartition<T>

java.lang.Object

edu.iu.dsc.tws.dataset.partition.CollectionPartition<T>

edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition<T>

edu.iu.dsc.tws.dataset.partition.DiskBackedCollectionPartition<T>

All Implemented Interfaces:

DataPartition<T>, java.io.Closeable, java.io.Serializable, java.lang.AutoCloseable

public class DiskBackedCollectionPartition<T>
extends BufferedCollectionPartition<T>

See Also:

Serialized Form

Field Summary

Fields inherited from class edu.iu.dsc.tws.dataset.partition.CollectionPartition

dataList

Fields inherited from interface edu.iu.dsc.tws.api.dataset.DataPartition

DEFAULT_REF

Constructor Summary

Constructors

Constructor and Description
DiskBackedCollectionPartition(long maxFramesInMemory, Config config)
DiskBackedCollectionPartition(long maxFramesInMemory, Config config, java.lang.String reference)
DiskBackedCollectionPartition(long maxFramesInMemory, MessageType dataType, Config config)
DiskBackedCollectionPartition(long maxFramesInMemory, MessageType dataType, long bufferedBytes, Config config, java.lang.String reference)
DiskBackedCollectionPartition(MessageType dataType, long bufferedBytes, Config config)
DiskBackedCollectionPartition(MessageType dataType, long bufferedBytes, Config config, java.lang.String reference)

Method Summary

Modifier and Type	Method and Description
protected FileSystem	getFileSystem(Config config)
protected Path	getRootPath(Config config)
protected java.lang.String	getRootPathStr(Config config)

Methods inherited from class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition

add, addAll, clear, close, dispose, flush, get, getConsumer, getReference, hasIndexInMemory

Methods inherited from class edu.iu.dsc.tws.dataset.partition.CollectionPartition

getPartitionId, setId

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.dataset.DataPartition

first, firstOrDefault

Constructor Detail

DiskBackedCollectionPartition

public DiskBackedCollectionPartition(long maxFramesInMemory,
                                     MessageType dataType,
                                     long bufferedBytes,
                                     Config config,
                                     java.lang.String reference)

DiskBackedCollectionPartition

public DiskBackedCollectionPartition(long maxFramesInMemory,
                                     Config config)

DiskBackedCollectionPartition

public DiskBackedCollectionPartition(long maxFramesInMemory,
                                     Config config,
                                     java.lang.String reference)

DiskBackedCollectionPartition

public DiskBackedCollectionPartition(long maxFramesInMemory,
                                     MessageType dataType,
                                     Config config)

DiskBackedCollectionPartition

public DiskBackedCollectionPartition(MessageType dataType,
                                     long bufferedBytes,
                                     Config config)

DiskBackedCollectionPartition

public DiskBackedCollectionPartition(MessageType dataType,
                                     long bufferedBytes,
                                     Config config,
                                     java.lang.String reference)

Method Detail

getRootPathStr

protected java.lang.String getRootPathStr(Config config)

getFileSystem

protected FileSystem getFileSystem(Config config)

Specified by:

getFileSystem in class BufferedCollectionPartition<T>

getRootPath

protected Path getRootPath(Config config)

Specified by:

getRootPath in class BufferedCollectionPartition<T>