edu.iu.dsc.tws.tset.links.batch

Class KeyedPipeTLink<K,V>

java.lang.Object

edu.iu.dsc.tws.tset.links.BaseTLink<T1,T0>

edu.iu.dsc.tws.tset.links.BaseTLinkWithSchema<T1,T0>

edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl<T,T>

edu.iu.dsc.tws.tset.links.batch.BatchSingleLink<Tuple<K,V>>

edu.iu.dsc.tws.tset.links.batch.KeyedPipeTLink<K,V>

All Implemented Interfaces:

BatchTLink<Tuple<K,V>,Tuple<K,V>>, TLink<Tuple<K,V>,Tuple<K,V>>, StoringData<Tuple<K,V>>, TBase, Buildable, BuildableTLink, java.io.Serializable

public class KeyedPipeTLink<K,V>
extends BatchSingleLink<Tuple<K,V>>

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
KeyedPipeTLink(BatchEnvironment tSetEnv, int sourceParallelism, TupleSchema schema)

Method Summary

Modifier and Type	Method and Description
KeyedCachedTSet<K,V>	cache() Runs this TSet and caches the data to an in-memory DataPartition and exposes the data as another TSet.
Edge	getEdge()
protected KeyedSchema	getSchema()
KeyedCachedTSet<K,V>	lazyCache() Performs caching lazily.
KeyedPersistedTSet<K,V>	lazyPersist() Performs persisting lazily.
KeyedTSet<K,V>	mapToTuple()
KeyedPersistedTSet<K,V>	persist() Similar to cache, but the data is stored in a disk based DataPartition.
KeyedPipeTLink<K,V>	setName(java.lang.String name) Name of the TSet and return the same tlink

Methods inherited from class edu.iu.dsc.tws.tset.links.batch.BatchSingleLink

flatmap, forEach, lazyForEach, map, mapToTuple

Methods inherited from class edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl

compute, compute, compute, compute, getTSetEnv, sink

Methods inherited from class edu.iu.dsc.tws.tset.links.BaseTLink

addChildToGraph, equals, getId, getName, getSourceParallelism, getTargetParallelism, hashCode, rename, setTSetEnv, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.tset.TBase

getId, getName

Methods inherited from interface edu.iu.dsc.tws.tset.links.BuildableTLink

build

Methods inherited from interface edu.iu.dsc.tws.tset.Buildable

generateID, getTBaseGraph

Constructor Detail

KeyedPipeTLink

public KeyedPipeTLink(BatchEnvironment tSetEnv,
                      int sourceParallelism,
                      TupleSchema schema)

Method Detail

mapToTuple

public KeyedTSet<K,V> mapToTuple()

setName

public KeyedPipeTLink<K,V> setName(java.lang.String name)

Description copied from interface: TLink

Name of the TSet and return the same tlink

Parameters:

name - name

Returns:

this tlink

getSchema

protected KeyedSchema getSchema()

Overrides:

getSchema in class BaseTLinkWithSchema<Tuple<K,V>,Tuple<K,V>>

getEdge

public Edge getEdge()

lazyCache

public KeyedCachedTSet<K,V> lazyCache()

Description copied from interface: StoringData

Performs caching lazily. i.e. cache operation would only be performed when the TSet is evaluated explicitly.

Specified by:

lazyCache in interface StoringData<Tuple<K,V>>

Overrides:

lazyCache in class BatchSingleLink<Tuple<K,V>>

Returns:

Cached TSet

cache

public KeyedCachedTSet<K,V> cache()

Description copied from interface: StoringData

Runs this TSet and caches the data to an in-memory DataPartition and exposes the data as another TSet.

Specified by:

cache in interface StoringData<Tuple<K,V>>

Overrides:

cache in class BatchSingleLink<Tuple<K,V>>

Returns:

Cached TSet

lazyPersist

public KeyedPersistedTSet<K,V> lazyPersist()

Description copied from interface: StoringData

Performs persisting lazily.

Specified by:

lazyPersist in interface StoringData<Tuple<K,V>>

Overrides:

lazyPersist in class BatchSingleLink<Tuple<K,V>>

Returns:

Persisted / Checkpointed TSets

persist

public KeyedPersistedTSet<K,V> persist()

Description copied from interface: StoringData

Similar to cache, but the data is stored in a disk based DataPartition. This method would also expose the checkpointing ability to TSets.

Specified by:

persist in interface StoringData<Tuple<K,V>>

Overrides:

persist in class BatchSingleLink<Tuple<K,V>>

Returns:

Persisted / Checkpointed TSets