edu.iu.dsc.tws.api.tset.link.streaming

Interface StreamingTLink<T1,T0>

Type Parameters:

T1 - comms data type

T0 - base data type

All Superinterfaces:

java.io.Serializable, TBase, TLink<T1,T0>

All Known Implementing Classes:

SAllGatherTLink, SAllReduceTLink, SDirectTLink, SGatherTLink, SKeyedDirectTLink, SKeyedPartitionTLink, SPartitionTLink, SReduceTLink, SReplicateTLink, StreamingGatherLink, StreamingIteratorLink, StreamingSingleLink, StreamingTLinkImpl

public interface StreamingTLink<T1,T0>
extends TLink<T1,T0>

Streaming extension of TLink. Also overrides the return types to match streaming operations.

Method Summary

Modifier and Type	Method and Description
<O> StreamingTSet<O>	compute(ComputeCollectorFunc<O,T1> computeFunction) Creates a Compute TSet based on the ComputeCollectorFunc provided.
<O> StreamingTSet<O>	compute(ComputeFunc<O,T1> computeFunction) Creates a Compute TSet based on the ComputeFunc provided.
<O> StreamingTSet<O>	flatmap(FlatMapFunc<O,T0> mapFn) Performs flat map operation based on the FlatMapFunc provided
void	forEach(ApplyFunc<T0> applyFunction) Applies a function elementwise.
<O> StreamingTSet<O>	map(MapFunc<O,T0> mapFn) Performs elementwise map operation based on the MapFunc provided
<K,V> StreamingTupleTSet<K,V>	mapToTuple(MapFunc<Tuple<K,V>,T0> genTupleFn) Maps the data passed through the TLink to Tuple based on a MapFunc and thereby creating a TupleTSet
StreamingTLink<T1,T0>	setName(java.lang.String name) Name of the TSet and return the same tlink
TBase	sink(SinkFunc<T1> sinkFunction) Creates a Sink TSet based on the SinkFunc.

Methods inherited from interface edu.iu.dsc.tws.api.tset.TBase

getId, getName

Method Detail

setName

StreamingTLink<T1,T0> setName(java.lang.String name)

Description copied from interface: TLink

Name of the TSet and return the same tlink

Specified by:

setName in interface TBase

Specified by:

setName in interface TLink<T1,T0>

Parameters:

name - name

Returns:

this tlink

compute

<O> StreamingTSet<O> compute(ComputeFunc<O,T1> computeFunction)

Description copied from interface: TLink

Creates a Compute TSet based on the ComputeFunc provided.

Specified by:

compute in interface TLink<T1,T0>

Type Parameters:

O - output tset base type

Parameters:

computeFunction - comp function. Takes in T0 type object and map to the output type O

Returns:

Compute TSet

compute

<O> StreamingTSet<O> compute(ComputeCollectorFunc<O,T1> computeFunction)

Description copied from interface: TLink

Creates a Compute TSet based on the ComputeCollectorFunc provided.

Specified by:

compute in interface TLink<T1,T0>

Type Parameters:

O - output type (for the RecordCollector)

Parameters:

computeFunction - compute function with collector

Returns:

Compute TSet

map

<O> StreamingTSet<O> map(MapFunc<O,T0> mapFn)

Description copied from interface: TLink

Performs elementwise map operation based on the MapFunc provided

Specified by:

map in interface TLink<T1,T0>

Type Parameters:

O - output type

Parameters:

mapFn - map function T0 to O

Returns:

Compute tset

flatmap

<O> StreamingTSet<O> flatmap(FlatMapFunc<O,T0> mapFn)

Description copied from interface: TLink

Performs flat map operation based on the FlatMapFunc provided

Specified by:

flatmap in interface TLink<T1,T0>

Type Parameters:

O - map function to T0 to multiple elements of <O>

Parameters:

mapFn - map function which can produce multiple elements for a single <T0> element

Returns:

Compute TSet

mapToTuple

<K,V> StreamingTupleTSet<K,V> mapToTuple(MapFunc<Tuple<K,V>,T0> genTupleFn)

Description copied from interface: TLink

Maps the data passed through the TLink to Tuple based on a MapFunc and thereby creating a TupleTSet

Specified by:

mapToTuple in interface TLink<T1,T0>

Type Parameters:

K - key type

V - value type

Parameters:

genTupleFn - MapFunc to generate a Tuple

Returns:

Keyed TSet

forEach

void forEach(ApplyFunc<T0> applyFunction)

Description copied from interface: TLink

Applies a function elementwise. Similar to compute, but the ApplyFunc does not return anything.

Specified by:

forEach in interface TLink<T1,T0>

Parameters:

applyFunction - apply function

sink

TBase sink(SinkFunc<T1> sinkFunction)

Description copied from interface: TLink

Creates a Sink TSet based on the SinkFunc.

Specified by:

sink in interface TLink<T1,T0>

Parameters:

sinkFunction - sink function which takes in <T1>. Similar to a compute, but would not return any TSet

Returns:

Sink tset. This would would be a terminal TSet with no transformation capabilities.