edu.iu.dsc.tws.tset.links.streaming

Class StreamingGatherLink<T>

java.lang.Object

edu.iu.dsc.tws.tset.links.BaseTLink<T1,T0>

edu.iu.dsc.tws.tset.links.BaseTLinkWithSchema<T1,T0>

edu.iu.dsc.tws.tset.links.streaming.StreamingTLinkImpl<java.util.Iterator<Tuple<java.lang.Integer,T>>,T>

edu.iu.dsc.tws.tset.links.streaming.StreamingGatherLink<T>

Type Parameters:

T - value type

All Implemented Interfaces:

StreamingTLink<java.util.Iterator<Tuple<java.lang.Integer,T>>,T>, TLink<java.util.Iterator<Tuple<java.lang.Integer,T>>,T>, TBase, Buildable, BuildableTLink, java.io.Serializable

Direct Known Subclasses:

SAllGatherTLink, SGatherTLink

public abstract class StreamingGatherLink<T>
extends StreamingTLinkImpl<java.util.Iterator<Tuple<java.lang.Integer,T>>,T>

This is the Tlinks used by gather operations. Specific operations such as map, flatmap, cache, etc will be done on the tuple value only (key will be dropped, as key is an information forcibly attached at the communication level). If the key information is required, users can use the compute methods which enables the use of Iterator<Tuple<K, T>>

See Also:

Serialized Form

Method Summary

Modifier and Type	Method and Description
<O> SComputeTSet<O,java.util.Iterator<Tuple<java.lang.Integer,T>>>	flatmap(FlatMapFunc<O,T> mapFn) Performs flat map operation based on the FlatMapFunc provided
void	forEach(ApplyFunc<T> applyFunction) Applies a function elementwise.
<O> SComputeTSet<O,java.util.Iterator<Tuple<java.lang.Integer,T>>>	map(MapFunc<O,T> mapFn) Performs elementwise map operation based on the MapFunc provided
<K,V> SKeyedTSet<K,V>	mapToTuple(MapFunc<Tuple<K,V>,T> genTupleFn) Maps the data passed through the TLink to Tuple based on a MapFunc and thereby creating a TupleTSet

Methods inherited from class edu.iu.dsc.tws.tset.links.streaming.StreamingTLinkImpl

compute, compute, compute, compute, countWindow, countWindow, getTSetEnv, sink, timeWindow, timeWindow

Methods inherited from class edu.iu.dsc.tws.tset.links.BaseTLinkWithSchema

getSchema

Methods inherited from class edu.iu.dsc.tws.tset.links.BaseTLink

addChildToGraph, equals, getId, getName, getSourceParallelism, getTargetParallelism, hashCode, rename, setTSetEnv, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.tset.link.streaming.StreamingTLink

setName

Methods inherited from interface edu.iu.dsc.tws.api.tset.TBase

getId, getName

Methods inherited from interface edu.iu.dsc.tws.tset.links.BuildableTLink

build, getEdge

Methods inherited from interface edu.iu.dsc.tws.tset.Buildable

generateID, getTBaseGraph

Method Detail

map

public <O> SComputeTSet<O,java.util.Iterator<Tuple<java.lang.Integer,T>>> map(MapFunc<O,T> mapFn)

Description copied from interface: TLink

Performs elementwise map operation based on the MapFunc provided

Type Parameters:

O - output type

Parameters:

mapFn - map function T0 to O

Returns:

Compute tset

flatmap

public <O> SComputeTSet<O,java.util.Iterator<Tuple<java.lang.Integer,T>>> flatmap(FlatMapFunc<O,T> mapFn)

Description copied from interface: TLink

Performs flat map operation based on the FlatMapFunc provided

Type Parameters:

O - map function to T0 to multiple elements of <O>

Parameters:

mapFn - map function which can produce multiple elements for a single <T0> element

Returns:

Compute TSet

mapToTuple

public <K,V> SKeyedTSet<K,V> mapToTuple(MapFunc<Tuple<K,V>,T> genTupleFn)

Description copied from interface: TLink

Maps the data passed through the TLink to Tuple based on a MapFunc and thereby creating a TupleTSet

Type Parameters:

K - key type

V - value type

Parameters:

genTupleFn - MapFunc to generate a Tuple

Returns:

Keyed TSet

forEach

public void forEach(ApplyFunc<T> applyFunction)

Description copied from interface: TLink

Applies a function elementwise. Similar to compute, but the ApplyFunc does not return anything.

Parameters:

applyFunction - apply function