edu.iu.dsc.tws.comms.dfw

Class MToNSimple

java.lang.Object

edu.iu.dsc.tws.comms.dfw.MToNSimple

All Implemented Interfaces:

ChannelReceiver, DataFlowOperation

public class MToNSimple
extends java.lang.Object
implements DataFlowOperation, ChannelReceiver

Constructor Summary

Constructors

Constructor and Description
MToNSimple(Config cfg, TWSChannel channel, LogicalPlan tPlan, java.util.Set<java.lang.Integer> srcs, java.util.Set<java.lang.Integer> dests, MessageReceiver finalRcvr, MessageReceiver partialRcvr, MessageType dType, MessageType rcvType, int e, MessageSchema messageSchema)
MToNSimple(Config cfg, TWSChannel channel, LogicalPlan tPlan, java.util.Set<java.lang.Integer> srcs, java.util.Set<java.lang.Integer> dests, MessageReceiver finalRcvr, MessageReceiver partialRcvr, MessageType dType, MessageType rcvType, MessageType kType, MessageType rcvKType, int e, MessageSchema messageSchema)
MToNSimple(TWSChannel channel, java.util.Set<java.lang.Integer> srcs, java.util.Set<java.lang.Integer> dests, MessageReceiver finalRcvr, MessageReceiver partialRcvr, MessageSchema messageSchema)
MToNSimple(TWSChannel channel, java.util.Set<java.lang.Integer> sourceTasks, java.util.Set<java.lang.Integer> destTasks, MessageReceiver finalRcvr, MessageReceiver partialRcvr, MessageType dataType, MessageSchema messageSchema)
MToNSimple(TWSChannel channel, java.util.Set<java.lang.Integer> sourceTasks, java.util.Set<java.lang.Integer> destTasks, MessageReceiver finalRcvr, MessageReceiver partialRcvr, MessageType dataType, MessageType keyType, MessageSchema messageSchema)

Method Summary

Modifier and Type	Method and Description
void	close() Close the operation
void	finish(int source) If this is a larger transfer of dataflow style, we need to finish
MessageType	getDataType() returns the data type that is associated with the data flow operation
MessageType	getKeyType() returns the key type that is associated with the data flow operation
LogicalPlan	getLogicalPlan() Task plan associated with this operation
MessageType	getReceiveDataType() returns the data type that is associated with the data flow operation
MessageType	getReceiveKeyType() returns the key type that is associated with the data flow operation
java.util.Set<java.lang.Integer>	getSources() Get the sources of the operation
java.util.Set<java.lang.Integer>	getTargets() Get targets of operation
java.lang.String	getUniqueId() Returns a unique id for this operation.
void	init(Config cfg, MessageType t, LogicalPlan logicalPlan, int ed) Initialize
boolean	isComplete() Weather the operation doesn't have any pending sends or receives
boolean	isDelegateComplete()
boolean	progress() Progress the pending dataflow operations
protected java.util.Map<java.lang.Integer,java.util.List<java.lang.Integer>>	receiveExpectedTaskIds()
boolean	receiveMessage(MessageHeader header, java.lang.Object object) Receive a fully built message
boolean	receiveSendInternally(int source, int path, int destination, int flags, java.lang.Object message) For partial receives the path and
protected java.util.Set<java.lang.Integer>	receivingExecutors()
void	reset() Reset and get the operation to initial state
boolean	send(int source, java.lang.Object message, int flags) Send a send message, this call will work asynchronously
boolean	send(int source, java.lang.Object message, int flags, int target) Send the message on a specific path
boolean	sendPartial(int source, java.lang.Object message, int flags) Use this to inject partial results in a distributed dataflow operation
boolean	sendPartial(int source, java.lang.Object message, int flags, int target) Send partial message on a specific path

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.comms.channel.ChannelReceiver

handleReceivedChannelMessage, sendCompleted

Constructor Detail

MToNSimple

public MToNSimple(TWSChannel channel,
                  java.util.Set<java.lang.Integer> sourceTasks,
                  java.util.Set<java.lang.Integer> destTasks,
                  MessageReceiver finalRcvr,
                  MessageReceiver partialRcvr,
                  MessageType dataType,
                  MessageType keyType,
                  MessageSchema messageSchema)

MToNSimple

public MToNSimple(TWSChannel channel,
                  java.util.Set<java.lang.Integer> sourceTasks,
                  java.util.Set<java.lang.Integer> destTasks,
                  MessageReceiver finalRcvr,
                  MessageReceiver partialRcvr,
                  MessageType dataType,
                  MessageSchema messageSchema)

MToNSimple

public MToNSimple(TWSChannel channel,
                  java.util.Set<java.lang.Integer> srcs,
                  java.util.Set<java.lang.Integer> dests,
                  MessageReceiver finalRcvr,
                  MessageReceiver partialRcvr,
                  MessageSchema messageSchema)

MToNSimple

public MToNSimple(Config cfg,
                  TWSChannel channel,
                  LogicalPlan tPlan,
                  java.util.Set<java.lang.Integer> srcs,
                  java.util.Set<java.lang.Integer> dests,
                  MessageReceiver finalRcvr,
                  MessageReceiver partialRcvr,
                  MessageType dType,
                  MessageType rcvType,
                  int e,
                  MessageSchema messageSchema)

MToNSimple

public MToNSimple(Config cfg,
                  TWSChannel channel,
                  LogicalPlan tPlan,
                  java.util.Set<java.lang.Integer> srcs,
                  java.util.Set<java.lang.Integer> dests,
                  MessageReceiver finalRcvr,
                  MessageReceiver partialRcvr,
                  MessageType dType,
                  MessageType rcvType,
                  MessageType kType,
                  MessageType rcvKType,
                  int e,
                  MessageSchema messageSchema)

Method Detail

init

public void init(Config cfg,
                 MessageType t,
                 LogicalPlan logicalPlan,
                 int ed)

Initialize

sendPartial

public boolean sendPartial(int source,
                           java.lang.Object message,
                           int flags)

Description copied from interface: DataFlowOperation

Use this to inject partial results in a distributed dataflow operation

Specified by:

sendPartial in interface DataFlowOperation

message - message

Returns:

true if message is accepted

sendPartial

public boolean sendPartial(int source,
                           java.lang.Object message,
                           int flags,
                           int target)

Description copied from interface: DataFlowOperation

Send partial message on a specific path

Specified by:

sendPartial in interface DataFlowOperation

Parameters:

source - the source

message - message as a generic object

target - the final target

Returns:

true if message is accepted

send

public boolean send(int source,
                    java.lang.Object message,
                    int flags)

Description copied from interface: DataFlowOperation

Send a send message, this call will work asynchronously

Specified by:

send in interface DataFlowOperation

Parameters:

source - source task

message - message as a generic object

Returns:

true if message is accepted

send

public boolean send(int source,
                    java.lang.Object message,
                    int flags,
                    int target)

Description copied from interface: DataFlowOperation

Send the message on a specific path

Specified by:

send in interface DataFlowOperation

Parameters:

source - source task

message - a generic java object

target - target task

Returns:

true if message is accepted

isComplete

public boolean isComplete()

Description copied from interface: DataFlowOperation

Weather the operation doesn't have any pending sends or receives

Specified by:

isComplete in interface DataFlowOperation

Returns:

is complete

isDelegateComplete

public boolean isDelegateComplete()

Specified by:

isDelegateComplete in interface DataFlowOperation

progress

public boolean progress()

Description copied from interface: DataFlowOperation

Progress the pending dataflow operations

Specified by:

progress in interface DataFlowOperation

Returns:

true if there is more messages to communicationProgress, unless return false

close

public void close()

Description copied from interface: DataFlowOperation

Close the operation

Specified by:

close in interface DataFlowOperation

reset

public void reset()

Description copied from interface: DataFlowOperation

Reset and get the operation to initial state

Specified by:

reset in interface DataFlowOperation

finish

public void finish(int source)

Description copied from interface: DataFlowOperation

If this is a larger transfer of dataflow style, we need to finish

Specified by:

finish in interface DataFlowOperation

getLogicalPlan

public LogicalPlan getLogicalPlan()

Description copied from interface: DataFlowOperation

Task plan associated with this operation

Specified by:

getLogicalPlan in interface DataFlowOperation

Returns:

task plan

getUniqueId

public java.lang.String getUniqueId()

Description copied from interface: DataFlowOperation

Returns a unique id for this operation. This would in most case be the edge number for the given operation.

Specified by:

getUniqueId in interface DataFlowOperation

Returns:

an unique id as a String

receiveSendInternally

public boolean receiveSendInternally(int source,
                                     int path,
                                     int destination,
                                     int flags,
                                     java.lang.Object message)

Description copied from interface: ChannelReceiver

For partial receives the path and

Specified by:

receiveSendInternally in interface ChannelReceiver

Parameters:

source - the source

path - target to be sent

destination - the path to be used

flags - flags

message - message

Returns:

true if success

receivingExecutors

protected java.util.Set<java.lang.Integer> receivingExecutors()

receiveExpectedTaskIds

protected java.util.Map<java.lang.Integer,java.util.List<java.lang.Integer>> receiveExpectedTaskIds()

receiveMessage

public boolean receiveMessage(MessageHeader header,
                              java.lang.Object object)

Description copied from interface: ChannelReceiver

Receive a fully built message

Specified by:

receiveMessage in interface ChannelReceiver

Parameters:

header - the header

object - the built message

Returns:

true if accepted

getSources

public java.util.Set<java.lang.Integer> getSources()

Description copied from interface: DataFlowOperation

Get the sources of the operation

Specified by:

getSources in interface DataFlowOperation

Returns:

source set

getKeyType

public MessageType getKeyType()

Description copied from interface: DataFlowOperation

returns the key type that is associated with the data flow operation

Specified by:

getKeyType in interface DataFlowOperation

Returns:

the MessageType or an UnsupportedOperationException

getDataType

public MessageType getDataType()

Description copied from interface: DataFlowOperation

returns the data type that is associated with the data flow operation

Specified by:

getDataType in interface DataFlowOperation

Returns:

the MessageType or an UnsupportedOperationException

getReceiveDataType

public MessageType getReceiveDataType()

Description copied from interface: DataFlowOperation

returns the data type that is associated with the data flow operation

Specified by:

getReceiveDataType in interface DataFlowOperation

Returns:

the MessageType or an UnsupportedOperationException

getReceiveKeyType

public MessageType getReceiveKeyType()

Description copied from interface: DataFlowOperation

returns the key type that is associated with the data flow operation

Specified by:

getReceiveKeyType in interface DataFlowOperation

Returns:

the MessageType or an UnsupportedOperationException

getTargets

public java.util.Set<java.lang.Integer> getTargets()

Description copied from interface: DataFlowOperation

Get targets of operation

Specified by:

getTargets in interface DataFlowOperation

Returns:

target set