edu.iu.dsc.tws.tset.links.batch

Class BatchIteratorLinkWrapper<T>

java.lang.Object

edu.iu.dsc.tws.tset.links.BaseTLink<T1,T0>

edu.iu.dsc.tws.tset.links.BaseTLinkWithSchema<T1,T0>

edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl<java.util.Iterator<T>,T>

edu.iu.dsc.tws.tset.links.batch.BatchIteratorLink<T>

edu.iu.dsc.tws.tset.links.batch.BatchIteratorLinkWrapper<T>

Type Parameters:

T - type

All Implemented Interfaces:

BatchTLink<java.util.Iterator<T>,T>, TLink<java.util.Iterator<T>,T>, StoringData<T>, TBase, Buildable, BuildableTLink, java.io.Serializable

Direct Known Subclasses:

DirectTLink, JoinTLink, PartitionTLink, ReplicateTLink

public abstract class BatchIteratorLinkWrapper<T>
extends BatchIteratorLink<T>

Wrapper class for BatchIteratorLink that implements StorableTBase related methods. Intended to be used with non-keyed TLinks that would produce an Iterator

See Also:

Serialized Form

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	BatchIteratorLinkWrapper()

Method Summary

Modifier and Type	Method and Description
CachedTSet<T>	cache() Runs this TSet and caches the data to an in-memory DataPartition and exposes the data as another TSet.
CachedTSet<T>	lazyCache() Performs caching lazily.
PersistedTSet<T>	lazyPersist() Performs persisting lazily.
PersistedTSet<T>	persist() Similar to cache, but the data is stored in a disk based DataPartition.

Methods inherited from class edu.iu.dsc.tws.tset.links.batch.BatchIteratorLink

flatmap, forEach, lazyForEach, map, mapToTuple

Methods inherited from class edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl

compute, compute, compute, compute, getTSetEnv, sink

Methods inherited from class edu.iu.dsc.tws.tset.links.BaseTLinkWithSchema

getSchema

Methods inherited from class edu.iu.dsc.tws.tset.links.BaseTLink

addChildToGraph, equals, getId, getName, getSourceParallelism, getTargetParallelism, hashCode, rename, setTSetEnv, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.tset.link.batch.BatchTLink

setName

Methods inherited from interface edu.iu.dsc.tws.api.tset.TBase

getId, getName

Methods inherited from interface edu.iu.dsc.tws.tset.links.BuildableTLink

build, getEdge

Methods inherited from interface edu.iu.dsc.tws.tset.Buildable

generateID, getTBaseGraph

Constructor Detail

BatchIteratorLinkWrapper

protected BatchIteratorLinkWrapper()

Method Detail

lazyCache

public CachedTSet<T> lazyCache()

Description copied from interface: StoringData

Performs caching lazily. i.e. cache operation would only be performed when the TSet is evaluated explicitly.

Returns:

Cached TSet

cache

public CachedTSet<T> cache()

Description copied from interface: StoringData

Runs this TSet and caches the data to an in-memory DataPartition and exposes the data as another TSet.

Specified by:

cache in interface StoringData<T>

Overrides:

cache in class BatchTLinkImpl<java.util.Iterator<T>,T>

Returns:

Cached TSet

lazyPersist

public PersistedTSet<T> lazyPersist()

Description copied from interface: StoringData

Performs persisting lazily.

Returns:

Persisted / Checkpointed TSets

persist

public PersistedTSet<T> persist()

Description copied from interface: StoringData

Similar to cache, but the data is stored in a disk based DataPartition. This method would also expose the checkpointing ability to TSets.

Specified by:

persist in interface StoringData<T>

Overrides:

persist in class BatchTLinkImpl<java.util.Iterator<T>,T>

Returns:

Persisted / Checkpointed TSets