edu.iu.dsc.tws.tset.sets.batch.row

Class RowStoredTSet

java.lang.Object

edu.iu.dsc.tws.tset.sets.BaseTSet<T>

edu.iu.dsc.tws.tset.sets.BaseTSetWithSchema<Row>

edu.iu.dsc.tws.tset.sets.batch.row.BatchRowTSetImpl

edu.iu.dsc.tws.tset.sets.batch.row.RowStoredTSet

All Implemented Interfaces:

AcceptingData<Row>, BatchRowTSet, StorableTBase<Row>, StoringData<Row>, TBase, Buildable, BuildableTSet, java.io.Serializable

Direct Known Subclasses:

RowCachedTSet, RowPersistedTSet

public abstract class RowStoredTSet
extends BatchRowTSetImpl
implements StorableTBase<Row>

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class edu.iu.dsc.tws.tset.sets.BaseTSet

BaseTSet.StateType

Field Summary

Fields

Modifier and Type	Field and Description
protected RowSourceTSet	storedSource

Method Summary

Modifier and Type	Method and Description
BatchRowTLink	direct() Direct/pipe communication
java.util.List<Row>	getData() retrieve data saved in the TSet as a List
INode	getINode()
RowSchema	getInputSchema()
RowSourceTSet	getStoredSourceTSet() retrieve data saved in the TSet
BatchRowTLink	join(BatchRowTSet rightTSet, CommunicationContext.JoinType type, java.util.Comparator<Row> keyComparator) Joins with another BatchTupleTSet.
BatchRowTLink	partition(PartitionFunc<Row> partitionFn, int targetParallelism, int columnIndex) Returns a Partition TLink that would partition data according based on a function provided.

Methods inherited from class edu.iu.dsc.tws.tset.sets.batch.row.BatchRowTSetImpl

addInput, cache, getTSetEnv, lazyCache, lazyPersist, persist, pipe, setName, withSchema

Methods inherited from class edu.iu.dsc.tws.tset.sets.BaseTSetWithSchema

getOutputSchema, setOutputSchema

Methods inherited from class edu.iu.dsc.tws.tset.sets.BaseTSet

addChildToGraph, addChildToGraph, equals, getId, getInputs, getName, getParallelism, getStateType, hashCode, isMutable, rename, setMutable, setStateType, setTSetEnv, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.tset.sets.StorableTBase

getDataObject

Methods inherited from interface edu.iu.dsc.tws.api.tset.TBase

getId, getName, setName

Methods inherited from interface edu.iu.dsc.tws.tset.sets.BuildableTSet

build

Methods inherited from interface edu.iu.dsc.tws.tset.Buildable

generateID, getTBaseGraph

Field Detail

storedSource

protected RowSourceTSet storedSource

Method Detail

partition

public BatchRowTLink partition(PartitionFunc<Row> partitionFn,
                               int targetParallelism,
                               int columnIndex)

Description copied from interface: BatchRowTSet

Returns a Partition TLink that would partition data according based on a function provided. The parallelism of the target TSet can also be specified.

Specified by:

partition in interface BatchRowTSet

Overrides:

partition in class BatchRowTSetImpl

Parameters:

partitionFn - Partition function

targetParallelism - column index to use

columnIndex - Target parallelism

Returns:

Partition TLink

join

public BatchRowTLink join(BatchRowTSet rightTSet,
                          CommunicationContext.JoinType type,
                          java.util.Comparator<Row> keyComparator)

Description copied from interface: BatchRowTSet

Joins with another BatchTupleTSet. Note that this TSet will be considered the left TSet

Specified by:

join in interface BatchRowTSet

Overrides:

join in class BatchRowTSetImpl

Parameters:

rightTSet - right tset

type - CommunicationContext.JoinType

keyComparator - key comparator

Returns:

Joined TLink

direct

public BatchRowTLink direct()

Description copied from interface: BatchRowTSet

Direct/pipe communication

Specified by:

direct in interface BatchRowTSet

Overrides:

direct in class BatchRowTSetImpl

Returns:

Keyed Direct TLink

getData

public java.util.List<Row> getData()

Description copied from interface: StorableTBase

retrieve data saved in the TSet as a List

NOTE: use this method only when you need to pull the data from the tset. Otherwise this would unnecessarily loads data to the memory.

Specified by:

getData in interface StorableTBase<Row>

Returns:

dataObject

getStoredSourceTSet

public RowSourceTSet getStoredSourceTSet()

Description copied from interface: StorableTBase

retrieve data saved in the TSet

Specified by:

getStoredSourceTSet in interface StorableTBase<Row>

Returns:

dataObject

getInputSchema

public RowSchema getInputSchema()

Overrides:

getInputSchema in class BaseTSetWithSchema<Row>

getINode

public INode getINode()

Specified by:

getINode in interface BuildableTSet