edu.iu.dsc.tws.comms.dfw.io.partition

Class DPartitionBatchFinalReceiver

java.lang.Object

edu.iu.dsc.tws.comms.dfw.io.partition.DPartitionBatchFinalReceiver

All Implemented Interfaces:

MessageReceiver

public class DPartitionBatchFinalReceiver
extends java.lang.Object
implements MessageReceiver

A receiver that goes to disk

Field Summary

Fields

Modifier and Type	Field and Description
protected <any>	targetStates Keep state about the targets

Constructor Summary

Constructors

Constructor and Description
DPartitionBatchFinalReceiver(BulkReceiver receiver, java.util.List<java.lang.String> shuffleDirs, java.util.Comparator<java.lang.Object> com, boolean groupByKey)

Method Summary

Modifier and Type	Method and Description
void	clean() Clean any state associated with the receiver and go to initial state
void	close() Close the receiver
void	init(Config cfg, DataFlowOperation op, java.util.Map<java.lang.Integer,java.util.List<java.lang.Integer>> expectedIds) Initialize the message receiver with tasks from which messages are expected For each sub edge in graph, for each path, gives the expected task ids
boolean	isComplete() Weather we are complete a set of messages
boolean	onMessage(int source, int path, int target, int flags, java.lang.Object object) The actual message callback
boolean	progress() This method will be called by the communicationProgress

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.comms.messaging.MessageReceiver

onMessage

Field Detail

targetStates

protected <any> targetStates

Keep state about the targets

Constructor Detail

DPartitionBatchFinalReceiver

public DPartitionBatchFinalReceiver(BulkReceiver receiver,
                                    java.util.List<java.lang.String> shuffleDirs,
                                    java.util.Comparator<java.lang.Object> com,
                                    boolean groupByKey)

Method Detail

init

public void init(Config cfg,
                 DataFlowOperation op,
                 java.util.Map<java.lang.Integer,java.util.List<java.lang.Integer>> expectedIds)

Description copied from interface: MessageReceiver

Initialize the message receiver with tasks from which messages are expected For each sub edge in graph, for each path, gives the expected task ids

target -> source tasks

Specified by:

init in interface MessageReceiver

expectedIds - expected task ids

onMessage

public boolean onMessage(int source,
                         int path,
                         int target,
                         int flags,
                         java.lang.Object object)

Description copied from interface: MessageReceiver

The actual message callback

Specified by:

onMessage in interface MessageReceiver

Parameters:

source - the source task

path - the path that is taken by the message, that is intermediate targets

target - the target of this receiver

flags - the communication flags

object - the actual message

Returns:

true if the message is accepted

progress

public boolean progress()

Description copied from interface: MessageReceiver

This method will be called by the communicationProgress

Specified by:

progress in interface MessageReceiver

Returns:

true if needs further communicationProgress

isComplete

public boolean isComplete()

Description copied from interface: MessageReceiver

Weather we are complete a set of messages

Specified by:

isComplete in interface MessageReceiver

Returns:

true if a round is complete with syncs

close

public void close()

Description copied from interface: MessageReceiver

Close the receiver

Specified by:

close in interface MessageReceiver

clean

public void clean()

Description copied from interface: MessageReceiver

Clean any state associated with the receiver and go to initial state

Specified by:

clean in interface MessageReceiver