edu.iu.dsc.tws.tset.sets.streaming

Class StreamingTupleTSetImpl<K,V>

java.lang.Object

edu.iu.dsc.tws.tset.sets.BaseTSet<T>

edu.iu.dsc.tws.tset.sets.BaseTSetWithSchema<V>

edu.iu.dsc.tws.tset.sets.streaming.StreamingTupleTSetImpl<K,V>

Type Parameters:

K - key type

V - data (value) type

All Implemented Interfaces:

StreamingTupleTSet<K,V>, TupleTSet<K,V>, TBase, Buildable, BuildableTSet, java.io.Serializable

Direct Known Subclasses:

SKeyedSourceTSet, SKeyedTSet

public abstract class StreamingTupleTSetImpl<K,V>
extends BaseTSetWithSchema<V>
implements StreamingTupleTSet<K,V>

Attaches a key to the oncoming data.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class edu.iu.dsc.tws.tset.sets.BaseTSet

BaseTSet.StateType

Method Summary

Modifier and Type	Method and Description
KeyedSchema	getOutputSchema()
StreamingEnvironment	getTSetEnv() tset env
SKeyedDirectTLink<K,V>	keyedDirect() Direct/pipe communication
SKeyedPartitionTLink<K,V>	keyedPartition(PartitionFunc<K> partitionFn) Partitions data using a PartitionFunc based on keys
StreamingTupleTSetImpl<K,V>	withSchema(TupleSchema schema) Sets the data type of the TupleTSet output.

Methods inherited from class edu.iu.dsc.tws.tset.sets.BaseTSetWithSchema

getInputSchema, setOutputSchema

Methods inherited from class edu.iu.dsc.tws.tset.sets.BaseTSet

addChildToGraph, addChildToGraph, equals, getId, getInputs, getName, getParallelism, getStateType, hashCode, isMutable, rename, setMutable, setStateType, setTSetEnv, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.tset.sets.streaming.StreamingTupleTSet

setName

Methods inherited from interface edu.iu.dsc.tws.api.tset.TBase

getId, getName

Methods inherited from interface edu.iu.dsc.tws.tset.sets.BuildableTSet

build, getINode

Methods inherited from interface edu.iu.dsc.tws.tset.Buildable

generateID, getTBaseGraph

Method Detail

getTSetEnv

public StreamingEnvironment getTSetEnv()

Description copied from interface: Buildable

tset env

Specified by:

getTSetEnv in interface Buildable

Overrides:

getTSetEnv in class BaseTSet<V>

Returns:

tset env

keyedPartition

public SKeyedPartitionTLink<K,V> keyedPartition(PartitionFunc<K> partitionFn)

Description copied from interface: StreamingTupleTSet

Partitions data using a PartitionFunc based on keys

Specified by:

keyedPartition in interface StreamingTupleTSet<K,V>

Specified by:

keyedPartition in interface TupleTSet<K,V>

Parameters:

partitionFn - partition function

Returns:

Streaming Keyed Partition TLink

keyedDirect

public SKeyedDirectTLink<K,V> keyedDirect()

Description copied from interface: TupleTSet

Direct/pipe communication

Specified by:

keyedDirect in interface TupleTSet<K,V>

Returns:

Keyed Direct TLink

withSchema

public StreamingTupleTSetImpl<K,V> withSchema(TupleSchema schema)

Description copied from interface: TupleTSet

Sets the data type of the TupleTSet output. This will be used in the packers for efficient SER-DE operations in the following TLinks

Specified by:

withSchema in interface TupleTSet<K,V>

Parameters:

schema - data type as a MessageType

Returns:

this TupleTSet

getOutputSchema

public KeyedSchema getOutputSchema()

Overrides:

getOutputSchema in class BaseTSetWithSchema<V>