edu.iu.dsc.tws.tset.sets.batch.row

Class RowPersistedTSet

java.lang.Object

edu.iu.dsc.tws.tset.sets.BaseTSet<T>

edu.iu.dsc.tws.tset.sets.BaseTSetWithSchema<Row>

edu.iu.dsc.tws.tset.sets.batch.row.BatchRowTSetImpl

edu.iu.dsc.tws.tset.sets.batch.row.RowStoredTSet

edu.iu.dsc.tws.tset.sets.batch.row.RowPersistedTSet

All Implemented Interfaces:

AcceptingData<Row>, BatchRowTSet, StorableTBase<Row>, StoringData<Row>, TBase, Buildable, BuildableTSet, java.io.Serializable

Direct Known Subclasses:

RowCheckpointedTSet

public class RowPersistedTSet
extends RowStoredTSet

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class edu.iu.dsc.tws.tset.sets.BaseTSet

BaseTSet.StateType

Field Summary

Fields inherited from class edu.iu.dsc.tws.tset.sets.batch.row.RowStoredTSet

storedSource

Constructor Summary

Constructors

Constructor and Description
RowPersistedTSet(BatchEnvironment tSetEnv, SinkFunc<Row> storingSinkFn, int parallelism, RowSchema inputSchema)

Method Summary

Modifier and Type	Method and Description
RowPersistedTSet	addInput(java.lang.String key, StorableTBase<?> input) Allows users to pass in other TSets as inputs for a TSet
RowCachedTSet	cache() Runs this TSet and caches the data to an in-memory DataPartition and exposes the data as another TSet.
INode	getINode()
RowCachedTSet	lazyCache() Performs caching lazily.
RowPersistedTSet	lazyPersist() Performs persisting lazily.
RowPersistedTSet	persist() Similar to cache, but the data is stored in a disk based DataPartition.
RowPersistedTSet	setName(java.lang.String n) Sets the name for the TBase
RowPersistedTSet	withSchema(TupleSchema schema)

Methods inherited from class edu.iu.dsc.tws.tset.sets.batch.row.RowStoredTSet

direct, getData, getInputSchema, getStoredSourceTSet, join, partition

Methods inherited from class edu.iu.dsc.tws.tset.sets.batch.row.BatchRowTSetImpl

getTSetEnv, pipe, withSchema

Methods inherited from class edu.iu.dsc.tws.tset.sets.BaseTSetWithSchema

getOutputSchema, setOutputSchema

Methods inherited from class edu.iu.dsc.tws.tset.sets.BaseTSet

addChildToGraph, addChildToGraph, equals, getId, getInputs, getName, getParallelism, getStateType, hashCode, isMutable, rename, setMutable, setStateType, setTSetEnv, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.tset.sets.StorableTBase

getDataObject

Methods inherited from interface edu.iu.dsc.tws.api.tset.TBase

getId, getName

Methods inherited from interface edu.iu.dsc.tws.tset.sets.BuildableTSet

build

Methods inherited from interface edu.iu.dsc.tws.tset.Buildable

generateID, getTBaseGraph

Constructor Detail

RowPersistedTSet

public RowPersistedTSet(BatchEnvironment tSetEnv,
                        SinkFunc<Row> storingSinkFn,
                        int parallelism,
                        RowSchema inputSchema)

Method Detail

setName

public RowPersistedTSet setName(java.lang.String n)

Description copied from interface: TBase

Sets the name for the TBase

Specified by:

setName in interface TBase

Overrides:

setName in class BatchRowTSetImpl

addInput

public RowPersistedTSet addInput(java.lang.String key,
                                 StorableTBase<?> input)

Description copied from interface: AcceptingData

Allows users to pass in other TSets as inputs for a TSet

Specified by:

addInput in interface AcceptingData<Row>

Overrides:

addInput in class BatchRowTSetImpl

Parameters:

key - the key used to store the given TSet

input - a StorableTBase TSet to be added as an input

Returns:

this TSet

withSchema

public RowPersistedTSet withSchema(TupleSchema schema)

cache

public RowCachedTSet cache()

Description copied from interface: StoringData

Runs this TSet and caches the data to an in-memory DataPartition and exposes the data as another TSet.

Specified by:

cache in interface StoringData<Row>

Overrides:

cache in class BatchRowTSetImpl

Returns:

Cached TSet

lazyCache

public RowCachedTSet lazyCache()

Description copied from interface: StoringData

Performs caching lazily. i.e. cache operation would only be performed when the TSet is evaluated explicitly.

Specified by:

lazyCache in interface StoringData<Row>

Overrides:

lazyCache in class BatchRowTSetImpl

Returns:

Cached TSet

persist

public RowPersistedTSet persist()

Description copied from interface: StoringData

Similar to cache, but the data is stored in a disk based DataPartition. This method would also expose the checkpointing ability to TSets.

Specified by:

persist in interface StoringData<Row>

Overrides:

persist in class BatchRowTSetImpl

Returns:

Persisted / Checkpointed TSets

lazyPersist

public RowPersistedTSet lazyPersist()

Description copied from interface: StoringData

Performs persisting lazily.

Specified by:

lazyPersist in interface StoringData<Row>

Overrides:

lazyPersist in class BatchRowTSetImpl

Returns:

Persisted / Checkpointed TSets

getINode

public INode getINode()

Specified by:

getINode in interface BuildableTSet

Overrides:

getINode in class RowStoredTSet