edu.iu.dsc.tws.comms.dfw.io.reduce

Class ReduceStreamingReceiver

java.lang.Object

edu.iu.dsc.tws.comms.dfw.io.SourceReceiver

edu.iu.dsc.tws.comms.dfw.io.reduce.ReduceStreamingReceiver

All Implemented Interfaces:

MessageReceiver

Direct Known Subclasses:

AllReduceStreamingFinalReceiver, ReduceStreamingFinalReceiver, ReduceStreamingPartialReceiver

public abstract class ReduceStreamingReceiver
extends SourceReceiver

Field Summary

Fields

Modifier and Type	Field and Description
protected ReduceFunction	reduceFunction

Fields inherited from class edu.iu.dsc.tws.comms.dfw.io.SourceReceiver

barriers, destination, isSyncSent, messages, operation, sendPendingMax, sourcesOfTarget, syncReceived, syncState, targetStates, workerId

Constructor Summary

Constructors

Constructor and Description
ReduceStreamingReceiver(int dst, ReduceFunction function)
ReduceStreamingReceiver(ReduceFunction function)

Method Summary

Modifier and Type	Method and Description
protected boolean	aggregate(int target, boolean sync, boolean allValuesFound) Aggregate values from sources for a target, assumes every source has a value
abstract boolean	handleMessage(int source, java.lang.Object message, int flags, int dest)
void	init(Config cfg, DataFlowOperation op, java.util.Map<java.lang.Integer,java.util.List<java.lang.Integer>> expectedIds) Initialize the message receiver with tasks from which messages are expected For each sub edge in graph, for each path, gives the expected task ids
protected boolean	isAllEmpty(int target) Check weather all the other information is flushed
protected boolean	isFilledToSend(int target, boolean sync) Return true if we are filled to send
protected void	onSyncEvent(int target, byte[] value) This method is called when there is a sync event on the operation
protected boolean	sendSyncForward(int target) Handle the sync
protected boolean	sendToTarget(int target, boolean sync) Send the values to a target

Methods inherited from class edu.iu.dsc.tws.comms.dfw.io.SourceReceiver

allQueuesEmpty, allSyncsPresent, clean, isComplete, onFinish, onMessage, progress

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.comms.messaging.MessageReceiver

close, onMessage

Field Detail

reduceFunction

protected ReduceFunction reduceFunction

Constructor Detail

ReduceStreamingReceiver

public ReduceStreamingReceiver(ReduceFunction function)

ReduceStreamingReceiver

public ReduceStreamingReceiver(int dst,
                               ReduceFunction function)

Method Detail

init

public void init(Config cfg,
                 DataFlowOperation op,
                 java.util.Map<java.lang.Integer,java.util.List<java.lang.Integer>> expectedIds)

Description copied from interface: MessageReceiver

Initialize the message receiver with tasks from which messages are expected For each sub edge in graph, for each path, gives the expected task ids

target -> source tasks

Specified by:

init in interface MessageReceiver

Overrides:

init in class SourceReceiver

expectedIds - expected task ids

sendToTarget

protected boolean sendToTarget(int target,
                               boolean sync)

Description copied from class: SourceReceiver

Send the values to a target

Specified by:

sendToTarget in class SourceReceiver

Parameters:

target - the target

Returns:

true if all the values are sent successfully

aggregate

protected boolean aggregate(int target,
                            boolean sync,
                            boolean allValuesFound)

Description copied from class: SourceReceiver

Aggregate values from sources for a target, assumes every source has a value

Specified by:

aggregate in class SourceReceiver

Parameters:

target - target

sync - true if all the syncs are present

Returns:

true if there are no more elements to aggregate

onSyncEvent

protected void onSyncEvent(int target,
                           byte[] value)

Description copied from class: SourceReceiver

This method is called when there is a sync event on the operation

Specified by:

onSyncEvent in class SourceReceiver

Parameters:

target - the target to which the sync event belong

value - the byte value, can be null

isAllEmpty

protected boolean isAllEmpty(int target)

Description copied from class: SourceReceiver

Check weather all the other information is flushed

Specified by:

isAllEmpty in class SourceReceiver

Parameters:

target - target

Returns:

true if there is nothing to process

sendSyncForward

protected boolean sendSyncForward(int target)

Description copied from class: SourceReceiver

Handle the sync

Specified by:

sendSyncForward in class SourceReceiver

Parameters:

target - target

Returns:

the needFurtherProgress

isFilledToSend

protected boolean isFilledToSend(int target,
                                 boolean sync)

Description copied from class: SourceReceiver

Return true if we are filled to send

Specified by:

isFilledToSend in class SourceReceiver

Returns:

true if we are filled enough to send

handleMessage

public abstract boolean handleMessage(int source,
                                      java.lang.Object message,
                                      int flags,
                                      int dest)