edu.iu.dsc.tws.comms.shuffle

Class FSKeyedMerger

java.lang.Object

edu.iu.dsc.tws.comms.shuffle.FSKeyedMerger

All Implemented Interfaces:

Shuffle

public class FSKeyedMerger
extends java.lang.Object
implements Shuffle

Un sorted merger

This merger can't output data in the expected format Iterator>

Constructor Summary

Constructors

Constructor and Description
FSKeyedMerger(long maxBytesInMemory, long maxRecsInMemory, java.lang.String dir, java.lang.String opName, MessageType kType, MessageType dType)

Method Summary

Modifier and Type	Method and Description
void	add(java.lang.Object key, byte[] data, int length) Add the data to the file
void	add(Tuple tuple) Add tuple with byte value and key
void	clean() Cleanup the directories
ResettableIterator<java.lang.Object>	readIterator() This method gives the values
void	run() This method saves the data to file system
void	switchToReading() Switch to reading, we cannot add after this

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.comms.shuffle.Shuffle

add

Constructor Detail

FSKeyedMerger

public FSKeyedMerger(long maxBytesInMemory,
                     long maxRecsInMemory,
                     java.lang.String dir,
                     java.lang.String opName,
                     MessageType kType,
                     MessageType dType)

Method Detail

add

public void add(Tuple tuple)

Description copied from interface: Shuffle

Add tuple with byte value and key

Specified by:

add in interface Shuffle

Parameters:

tuple - tuple

add

public void add(java.lang.Object key,
                byte[] data,
                int length)

Add the data to the file

Specified by:

add in interface Shuffle

Parameters:

key - the object key

data - the data

length - length of the data

switchToReading

public void switchToReading()

Description copied from interface: Shuffle

Switch to reading, we cannot add after this

Specified by:

switchToReading in interface Shuffle

run

public void run()

This method saves the data to file system

Specified by:

run in interface Shuffle

readIterator

public ResettableIterator<java.lang.Object> readIterator()

This method gives the values

Specified by:

readIterator in interface Shuffle

Returns:

an iterator

clean

public void clean()

Cleanup the directories

Specified by:

clean in interface Shuffle