edu.iu.dsc.tws.api.tset.sets

Interface TupleTSet<K,V>

Type Parameters:

K - key type

V - value type

All Superinterfaces:

java.io.Serializable, TBase

All Known Subinterfaces:

BatchTupleTSet<K,V>, StreamingTupleTSet<K,V>

All Known Implementing Classes:

BatchTupleTSetImpl, KeyedCachedTSet, KeyedCheckpointedTSet, KeyedPersistedTSet, KeyedSourceTSet, KeyedStoredTSet, KeyedTSet, SKeyedSourceTSet, SKeyedTSet, StreamingTupleTSetImpl

public interface TupleTSet<K,V>
extends TBase

Twister data set for keyed data. This would abstract the Task level keyed computations in a more user friendly API. A TupleTSet will be followed by a Keyed TLink that would expose keyed communication operations. Note the extensions of this interface BatchTupleTSet and StreamingTupleTSet. These would intimately separate out the operations based on the OperationMode of the data flow graph. This interface only specifies the common operations for Batch and Streaming operations.

Method Summary

Modifier and Type	Method and Description
TLink<?,?>	keyedDirect() Direct/pipe communication
TLink<?,?>	keyedPartition(PartitionFunc<K> partitionFn) Partitions data using a PartitionFunc based on keys
TupleTSet<K,V>	setName(java.lang.String name) Set the name of the set
TupleTSet<K,V>	withSchema(TupleSchema schema) Sets the data type of the TupleTSet output.

Methods inherited from interface edu.iu.dsc.tws.api.tset.TBase

getId, getName

Method Detail

setName

TupleTSet<K,V> setName(java.lang.String name)

Set the name of the set

Specified by:

setName in interface TBase

Parameters:

name - name

Returns:

this set

keyedPartition

TLink<?,?> keyedPartition(PartitionFunc<K> partitionFn)

Partitions data using a PartitionFunc based on keys

Parameters:

partitionFn - partition function

Returns:

Keyed Partition TLink

keyedDirect

TLink<?,?> keyedDirect()

Direct/pipe communication

Returns:

Keyed Direct TLink

withSchema

TupleTSet<K,V> withSchema(TupleSchema schema)

Sets the data type of the TupleTSet output. This will be used in the packers for efficient SER-DE operations in the following TLinks

Parameters:

schema - data type as a MessageType

Returns:

this TupleTSet