edu.iu.dsc.tws.tset.sets.batch.row

Class RowCachedTSet

java.lang.Object

edu.iu.dsc.tws.tset.sets.BaseTSet<T>

edu.iu.dsc.tws.tset.sets.BaseTSetWithSchema<Row>

edu.iu.dsc.tws.tset.sets.batch.row.BatchRowTSetImpl

edu.iu.dsc.tws.tset.sets.batch.row.RowStoredTSet

edu.iu.dsc.tws.tset.sets.batch.row.RowCachedTSet

All Implemented Interfaces:

AcceptingData<Row>, BatchRowTSet, StorableTBase<Row>, StoringData<Row>, TBase, Buildable, BuildableTSet, java.io.Serializable

public class RowCachedTSet
extends RowStoredTSet

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class edu.iu.dsc.tws.tset.sets.BaseTSet

BaseTSet.StateType

Field Summary

Fields inherited from class edu.iu.dsc.tws.tset.sets.batch.row.RowStoredTSet

storedSource

Constructor Summary

Constructors

Constructor and Description
RowCachedTSet(BatchEnvironment tSetEnv, SinkFunc<Row> sinkFunc, int parallelism, RowSchema inputSchema)

Method Summary

Modifier and Type	Method and Description
RowCachedTSet	cache() Runs this TSet and caches the data to an in-memory DataPartition and exposes the data as another TSet.
INode	getINode()
RowCachedTSet	lazyCache() Performs caching lazily.
RowCachedTSet	lazyPersist() Performs persisting lazily.
RowCachedTSet	persist() Similar to cache, but the data is stored in a disk based DataPartition.
RowCachedTSet	setName(java.lang.String n) Sets the name for the TBase
RowCachedTSet	withSchema(TupleSchema schema)

Methods inherited from class edu.iu.dsc.tws.tset.sets.batch.row.RowStoredTSet

direct, getData, getInputSchema, getStoredSourceTSet, join, partition

Methods inherited from class edu.iu.dsc.tws.tset.sets.batch.row.BatchRowTSetImpl

addInput, getTSetEnv, pipe, withSchema

Methods inherited from class edu.iu.dsc.tws.tset.sets.BaseTSetWithSchema

getOutputSchema, setOutputSchema

Methods inherited from class edu.iu.dsc.tws.tset.sets.BaseTSet

addChildToGraph, addChildToGraph, equals, getId, getInputs, getName, getParallelism, getStateType, hashCode, isMutable, rename, setMutable, setStateType, setTSetEnv, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.tset.sets.StorableTBase

getDataObject

Methods inherited from interface edu.iu.dsc.tws.api.tset.TBase

getId, getName

Methods inherited from interface edu.iu.dsc.tws.tset.sets.BuildableTSet

build

Methods inherited from interface edu.iu.dsc.tws.tset.Buildable

generateID, getTBaseGraph

Constructor Detail

RowCachedTSet

public RowCachedTSet(BatchEnvironment tSetEnv,
                     SinkFunc<Row> sinkFunc,
                     int parallelism,
                     RowSchema inputSchema)

Method Detail

setName

public RowCachedTSet setName(java.lang.String n)

Description copied from interface: TBase

Sets the name for the TBase

Specified by:

setName in interface TBase

Overrides:

setName in class BatchRowTSetImpl

withSchema

public RowCachedTSet withSchema(TupleSchema schema)

cache

public RowCachedTSet cache()

Description copied from interface: StoringData

Runs this TSet and caches the data to an in-memory DataPartition and exposes the data as another TSet.

Specified by:

cache in interface StoringData<Row>

Overrides:

cache in class BatchRowTSetImpl

Returns:

Cached TSet

lazyCache

public RowCachedTSet lazyCache()

Description copied from interface: StoringData

Performs caching lazily. i.e. cache operation would only be performed when the TSet is evaluated explicitly.

Specified by:

lazyCache in interface StoringData<Row>

Overrides:

lazyCache in class BatchRowTSetImpl

Returns:

Cached TSet

persist

public RowCachedTSet persist()

Description copied from interface: StoringData

Similar to cache, but the data is stored in a disk based DataPartition. This method would also expose the checkpointing ability to TSets.

Specified by:

persist in interface StoringData<Row>

Overrides:

persist in class BatchRowTSetImpl

Returns:

Persisted / Checkpointed TSets

lazyPersist

public RowCachedTSet lazyPersist()

Description copied from interface: StoringData

Performs persisting lazily.

Specified by:

lazyPersist in interface StoringData<Row>

Overrides:

lazyPersist in class BatchRowTSetImpl

Returns:

Persisted / Checkpointed TSets

getINode

public INode getINode()

Specified by:

getINode in interface BuildableTSet

Overrides:

getINode in class RowStoredTSet