edu.iu.dsc.tws.api.compute

Interface TaskPartitioner<T>

All Superinterfaces:

java.io.Serializable

All Known Subinterfaces:

PartitionFunc<T>

All Known Implementing Classes:

DeterministicTaskPartitioner, HashingPartitioner, LoadBalancePartitioner, OneToOnePartitioner, TaskPartitionerForRandom, TaskPartitionerForSampledData

public interface TaskPartitioner<T>
extends java.io.Serializable

Partition the value into a destination.

Method Summary

Modifier and Type	Method and Description
void	commit(int source, int partition) Indicate that we are using this partition
int	partition(int source, T data) Get a partition id, it should be from the set of destinations
void	prepare(java.util.Set<java.lang.Integer> sources, java.util.Set<java.lang.Integer> destinations) Prepare the partition with sources and destinations.

Method Detail

prepare

void prepare(java.util.Set<java.lang.Integer> sources,
             java.util.Set<java.lang.Integer> destinations)

Prepare the partition with sources and destinations. The sources have values to partition and the partitions should be among destinations

partition

int partition(int source,
              T data)

Get a partition id, it should be from the set of destinations

Parameters:

source - source of the data

data - data to be partitioned

Returns:

partition id

commit

void commit(int source,
            int partition)

Indicate that we are using this partition

Parameters:

source - source of the partition

partition - partition to commit