edu.iu.dsc.tws.comms.dfw.io.gather.keyed

Class KGatherStreamingFinalReceiver

java.lang.Object

edu.iu.dsc.tws.comms.dfw.io.KeyedReceiver

edu.iu.dsc.tws.comms.dfw.io.gather.keyed.KGatherStreamingReceiver

edu.iu.dsc.tws.comms.dfw.io.gather.keyed.KGatherStreamingFinalReceiver

All Implemented Interfaces:

MessageReceiver

public class KGatherStreamingFinalReceiver
extends KGatherStreamingReceiver

Keyed reduce final receiver for streaming mode

Field Summary

Fields

Modifier and Type	Field and Description
protected int	localWindowCount variable used to keep track of the current local window count.
protected int	windowSize Streaming messages are only kept until the window size is met.

Fields inherited from class edu.iu.dsc.tws.comms.dfw.io.KeyedReceiver

batchDone, dataFlowOperation, destination, executor, finishedSources, isEmptySent, isFinalBatchReceiver, keyLimit, limitPerKey, messages, representSource, representSourceSet, sendQueue, thisSources

Constructor Summary

Constructors

Constructor and Description
KGatherStreamingFinalReceiver(BulkReceiver receiver, int window)

Method Summary

Modifier and Type	Method and Description
void	init(Config cfg, DataFlowOperation op, java.util.Map<java.lang.Integer,java.util.List<java.lang.Integer>> expectedIds) Initialize the message receiver with tasks from which messages are expected For each sub edge in graph, for each path, gives the expected task ids
boolean	progress() Default progress method for keyed receivers.

Methods inherited from class edu.iu.dsc.tws.comms.dfw.io.gather.keyed.KGatherStreamingReceiver

isAllQueuesEmpty, offerMessage, sendToTarget

Methods inherited from class edu.iu.dsc.tws.comms.dfw.io.KeyedReceiver

checkIfEmptyIsSent, finishProgress, isComplete, isSourcesFinished, moveMessagesToSendQueue, moveMessageToSendQueue, onFinish, onMessage

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.comms.messaging.MessageReceiver

clean, close, onMessage

Field Detail

windowSize

protected int windowSize

Streaming messages are only kept until the window size is met. by default the window size is 1, so all messages are forwarded as they arrive.

localWindowCount

protected int localWindowCount

variable used to keep track of the current local window count. This value is always reset to 0 after it reaches the windowSize

Constructor Detail

KGatherStreamingFinalReceiver

public KGatherStreamingFinalReceiver(BulkReceiver receiver,
                                     int window)

Method Detail

init

public void init(Config cfg,
                 DataFlowOperation op,
                 java.util.Map<java.lang.Integer,java.util.List<java.lang.Integer>> expectedIds)

Description copied from interface: MessageReceiver

Initialize the message receiver with tasks from which messages are expected For each sub edge in graph, for each path, gives the expected task ids

target -> source tasks

Specified by:

init in interface MessageReceiver

Overrides:

init in class KeyedReceiver

expectedIds - expected task ids

progress

public boolean progress()

Description copied from class: KeyedReceiver

Default progress method for keyed receivers. This method is targeted at partial receivers which typically execute the same logic. For custom progress logic this method needs to be overwritten

Specified by:

progress in interface MessageReceiver

Overrides:

progress in class KeyedReceiver

Returns:

true if needs further communicationProgress