edu.iu.dsc.tws.examples.batch.terasort

Class TaskPartitionerForSampledData

java.lang.Object

edu.iu.dsc.tws.examples.batch.terasort.TaskPartitionerForRandom

edu.iu.dsc.tws.examples.batch.terasort.TaskPartitionerForSampledData

All Implemented Interfaces:

TaskPartitioner<byte[]>, java.io.Serializable

public class TaskPartitionerForSampledData
extends TaskPartitionerForRandom

See Also:

Serialized Form

Field Summary

Fields inherited from class edu.iu.dsc.tws.examples.batch.terasort.TaskPartitionerForRandom

destinationsList, keysToOneTask

Constructor Summary

Constructors

Constructor and Description
TaskPartitionerForSampledData(byte[] minMax, int keySize)

Method Summary

Modifier and Type	Method and Description
protected int	getIndex(byte[] array)
int	partition(int source, byte[] data) Get a partition id, it should be from the set of destinations
void	prepare(java.util.Set<java.lang.Integer> sources, java.util.Set<java.lang.Integer> destinations) Prepare the partition with sources and destinations.

Methods inherited from class edu.iu.dsc.tws.examples.batch.terasort.TaskPartitionerForRandom

commit

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TaskPartitionerForSampledData

public TaskPartitionerForSampledData(byte[] minMax,
                                     int keySize)

Method Detail

prepare

public void prepare(java.util.Set<java.lang.Integer> sources,
                    java.util.Set<java.lang.Integer> destinations)

Description copied from interface: TaskPartitioner

Prepare the partition with sources and destinations. The sources have values to partition and the partitions should be among destinations

Specified by:

prepare in interface TaskPartitioner<byte[]>

Overrides:

prepare in class TaskPartitionerForRandom

getIndex

protected int getIndex(byte[] array)

Overrides:

getIndex in class TaskPartitionerForRandom

partition

public int partition(int source,
                     byte[] data)

Description copied from interface: TaskPartitioner

Get a partition id, it should be from the set of destinations

Specified by:

partition in interface TaskPartitioner<byte[]>

Overrides:

partition in class TaskPartitionerForRandom

Parameters:

source - source of the data

data - data to be partitioned

Returns:

partition id