edu.iu.dsc.tws.api.dataset

Interface DataPartition<T>

Type Parameters:

T - partition

All Superinterfaces:

java.io.Serializable

All Known Implementing Classes:

BufferedCollectionPartition, CollectionPartition, DiskBackedCollectionPartition, EmptyDataPartition, EntityPartition, HDFSBackedCollectionPartition

public interface DataPartition<T>
extends java.io.Serializable

Partition of a distributed set

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	DEFAULT_REF

Method Summary

Modifier and Type	Method and Description
default void	clear()
default T	first() Returns the first data frame of this partition
default T	firstOrDefault(T defaultValue) Returns the first data frame of this partition or defaultValue if it doesn't exist
DataPartitionConsumer<T>	getConsumer() Get the data consumer
int	getPartitionId() Get the id of the partition
default java.lang.String	getReference() Reference can be used to load a persisted partition from disk of hdfs
void	setId(int id)

Field Detail

DEFAULT_REF

static final java.lang.String DEFAULT_REF

See Also:

Constant Field Values

Method Detail

getConsumer

DataPartitionConsumer<T> getConsumer()

Get the data consumer

Returns:

the consumer

firstOrDefault

default T firstOrDefault(T defaultValue)

Returns the first data frame of this partition or defaultValue if it doesn't exist

first

default T first()

Returns the first data frame of this partition

setId

void setId(int id)

getPartitionId

int getPartitionId()

Get the id of the partition

Returns:

the id of the partition

clear

default void clear()

getReference

default java.lang.String getReference()

Reference can be used to load a persisted partition from disk of hdfs