edu.iu.dsc.tws.comms.batch

Class BJoin

java.lang.Object

edu.iu.dsc.tws.api.comms.BaseOperation

edu.iu.dsc.tws.comms.batch.BJoin

public class BJoin
extends BaseOperation

Batch Join operation

Field Summary

Fields inherited from class edu.iu.dsc.tws.api.comms.BaseOperation

op

Constructor Summary

Constructors

Constructor and Description
BJoin(Communicator comm, LogicalPlanBuilder logicalPlanBuilder, MessageType keyType, MessageType leftDataType, MessageType rightDataType, BulkReceiver rcvr, DestinationSelector destSelector, boolean shuffle, java.util.Comparator<java.lang.Object> comparator, CommunicationContext.JoinType joinType, CommunicationContext.JoinAlgorithm joinAlgorithm)
BJoin(Communicator comm, LogicalPlanBuilder logicalPlanBuilder, java.util.Set<java.lang.Integer> leftSources, java.util.Set<java.lang.Integer> rightSource, MessageType keyType, MessageType leftDataType, MessageType rightDataType, BulkReceiver rcvr, DestinationSelector destSelector, boolean shuffle, java.util.Comparator<java.lang.Object> comparator, CommunicationContext.JoinType joinType, CommunicationContext.JoinAlgorithm joinAlgorithm)
BJoin(Communicator comm, LogicalPlan plan, java.util.Set<java.lang.Integer> leftSources, java.util.Set<java.lang.Integer> rightSources, java.util.Set<java.lang.Integer> targets, MessageType keyType, MessageType leftDataType, MessageType rightDataType, BulkReceiver rcvr, DestinationSelector destSelector, boolean shuffle, java.util.Comparator<java.lang.Object> comparator, CommunicationContext.JoinType joinType, CommunicationContext.JoinAlgorithm joinAlgorithm)
BJoin(Communicator comm, LogicalPlan plan, java.util.Set<java.lang.Integer> leftSources, java.util.Set<java.lang.Integer> rightSources, java.util.Set<java.lang.Integer> targets, MessageType keyType, MessageType leftDataType, MessageType rightDataType, BulkReceiver rcvr, DestinationSelector destSelector, boolean shuffle, java.util.Comparator<java.lang.Object> comparator, CommunicationContext.JoinType joinType, CommunicationContext.JoinAlgorithm joinAlgorithm, MessageSchema leftSchema, MessageSchema rightSchema)
BJoin(Communicator comm, LogicalPlan plan, java.util.Set<java.lang.Integer> leftSources, java.util.Set<java.lang.Integer> rightSources, java.util.Set<java.lang.Integer> targets, MessageType keyType, MessageType leftDataType, MessageType rightDataType, BulkReceiver rcvr, DestinationSelector destSelector, boolean useDisk, java.util.Comparator<java.lang.Object> comparator, int leftEdgeId, int rightEdgeId, CommunicationContext.JoinType joinType, CommunicationContext.JoinAlgorithm joinAlgorithm, MessageSchema leftSchema, MessageSchema rightSchema) Construct a Batch partition operation

Method Summary

Modifier and Type	Method and Description
void	close()
void	finish(int source) Indicate the end of the communication for a given tag value
boolean	isComplete() Weather we have messages pending
boolean	join(int source, java.lang.Object key, java.lang.Object data, int flags, int tag) Send a data to be partitioned
boolean	progress() Progress the operation, if not called, messages will not be processed
boolean	progressChannel() Progress the channel and the operation
void	reset() Clean the operation, this doesn't close it
boolean	sendBarrier(int src, byte[] barrierId)

Methods inherited from class edu.iu.dsc.tws.api.comms.BaseOperation

waitForCompletion

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BJoin

public BJoin(Communicator comm,
             LogicalPlan plan,
             java.util.Set<java.lang.Integer> leftSources,
             java.util.Set<java.lang.Integer> rightSources,
             java.util.Set<java.lang.Integer> targets,
             MessageType keyType,
             MessageType leftDataType,
             MessageType rightDataType,
             BulkReceiver rcvr,
             DestinationSelector destSelector,
             boolean useDisk,
             java.util.Comparator<java.lang.Object> comparator,
             int leftEdgeId,
             int rightEdgeId,
             CommunicationContext.JoinType joinType,
             CommunicationContext.JoinAlgorithm joinAlgorithm,
             MessageSchema leftSchema,
             MessageSchema rightSchema)

Construct a Batch partition operation

Parameters:

comm - the communicator

plan - task plan

targets - target tasks

rcvr - receiver

leftDataType - data type

destSelector - destination selector

BJoin

public BJoin(Communicator comm,
             LogicalPlan plan,
             java.util.Set<java.lang.Integer> leftSources,
             java.util.Set<java.lang.Integer> rightSources,
             java.util.Set<java.lang.Integer> targets,
             MessageType keyType,
             MessageType leftDataType,
             MessageType rightDataType,
             BulkReceiver rcvr,
             DestinationSelector destSelector,
             boolean shuffle,
             java.util.Comparator<java.lang.Object> comparator,
             CommunicationContext.JoinType joinType,
             CommunicationContext.JoinAlgorithm joinAlgorithm,
             MessageSchema leftSchema,
             MessageSchema rightSchema)

BJoin

public BJoin(Communicator comm,
             LogicalPlan plan,
             java.util.Set<java.lang.Integer> leftSources,
             java.util.Set<java.lang.Integer> rightSources,
             java.util.Set<java.lang.Integer> targets,
             MessageType keyType,
             MessageType leftDataType,
             MessageType rightDataType,
             BulkReceiver rcvr,
             DestinationSelector destSelector,
             boolean shuffle,
             java.util.Comparator<java.lang.Object> comparator,
             CommunicationContext.JoinType joinType,
             CommunicationContext.JoinAlgorithm joinAlgorithm)

BJoin

public BJoin(Communicator comm,
             LogicalPlanBuilder logicalPlanBuilder,
             MessageType keyType,
             MessageType leftDataType,
             MessageType rightDataType,
             BulkReceiver rcvr,
             DestinationSelector destSelector,
             boolean shuffle,
             java.util.Comparator<java.lang.Object> comparator,
             CommunicationContext.JoinType joinType,
             CommunicationContext.JoinAlgorithm joinAlgorithm)

BJoin

public BJoin(Communicator comm,
             LogicalPlanBuilder logicalPlanBuilder,
             java.util.Set<java.lang.Integer> leftSources,
             java.util.Set<java.lang.Integer> rightSource,
             MessageType keyType,
             MessageType leftDataType,
             MessageType rightDataType,
             BulkReceiver rcvr,
             DestinationSelector destSelector,
             boolean shuffle,
             java.util.Comparator<java.lang.Object> comparator,
             CommunicationContext.JoinType joinType,
             CommunicationContext.JoinAlgorithm joinAlgorithm)

Method Detail

join

public boolean join(int source,
                    java.lang.Object key,
                    java.lang.Object data,
                    int flags,
                    int tag)

Send a data to be partitioned

Parameters:

source - source

key - key for the data

data - data

flags - data flag

Returns:

true if the data is accepted

isComplete

public boolean isComplete()

Weather we have messages pending

Overrides:

isComplete in class BaseOperation

Returns:

true if there are messages pending

finish

public void finish(int source)

Indicate the end of the communication for a given tag value

Overrides:

finish in class BaseOperation

Parameters:

source - the source that is ending

progress

public boolean progress()

Progress the operation, if not called, messages will not be processed

Overrides:

progress in class BaseOperation

Returns:

true if further progress is needed

close

public void close()

Overrides:

close in class BaseOperation

reset

public void reset()

Clean the operation, this doesn't close it

Overrides:

reset in class BaseOperation

sendBarrier

public boolean sendBarrier(int src,
                           byte[] barrierId)

Overrides:

sendBarrier in class BaseOperation

progressChannel

public boolean progressChannel()

Progress the channel and the operation

Overrides:

progressChannel in class BaseOperation

Returns:

true if further progress is required