edu.iu.dsc.tws.api.tset.sets.batch

Interface BatchRowTSet

All Superinterfaces:

AcceptingData<Row>, java.io.Serializable, StoringData<Row>, TBase

All Known Implementing Classes:

BatchRowTSetImpl, RowCachedTSet, RowCheckpointedTSet, RowComputeTSet, RowPersistedTSet, RowSourceTSet, RowStoredTSet

public interface BatchRowTSet
extends TBase, AcceptingData<Row>, StoringData<Row>

Method Summary

Modifier and Type	Method and Description
BatchRowTLink	direct() Direct/pipe communication
BatchRowTLink	join(BatchRowTSet rightTSet, CommunicationContext.JoinType type, java.util.Comparator<Row> keyComparator) Joins with another BatchTupleTSet.
BatchRowTLink	partition(PartitionFunc<Row> partitionFn, int columnIndex, int targetParallelism) Returns a Partition TLink that would partition data according based on a function provided.
BatchRowTSet	withSchema(RowSchema dataType) Sets the data type of the TSet output.

Methods inherited from interface edu.iu.dsc.tws.api.tset.TBase

getId, getName, setName

Methods inherited from interface edu.iu.dsc.tws.api.tset.sets.AcceptingData

addInput

Methods inherited from interface edu.iu.dsc.tws.api.tset.StoringData

cache, lazyCache, lazyPersist, persist

Method Detail

direct

BatchRowTLink direct()

Direct/pipe communication

Returns:

Keyed Direct TLink

partition

BatchRowTLink partition(PartitionFunc<Row> partitionFn,
                        int columnIndex,
                        int targetParallelism)

Returns a Partition TLink that would partition data according based on a function provided. The parallelism of the target TSet can also be specified.

Parameters:

partitionFn - Partition function

columnIndex - column index to use

targetParallelism - Target parallelism

Returns:

Partition TLink

join

BatchRowTLink join(BatchRowTSet rightTSet,
                   CommunicationContext.JoinType type,
                   java.util.Comparator<Row> keyComparator)

Joins with another BatchTupleTSet. Note that this TSet will be considered the left TSet

Parameters:

rightTSet - right tset

type - CommunicationContext.JoinType

keyComparator - key comparator

Returns:

Joined TLink

withSchema

BatchRowTSet withSchema(RowSchema dataType)

Sets the data type of the TSet output. This will be used in the packers for efficient SER-DE operations in the following TLinks

Parameters:

dataType - data type as a MessageType

Returns:

this TSet