edu.iu.dsc.tws.tset.ops

Class CheckpointedSourceOp<T>

java.lang.Object

edu.iu.dsc.tws.tset.ops.BaseOp

edu.iu.dsc.tws.tset.ops.SourceOp<T>

edu.iu.dsc.tws.tset.ops.CheckpointedSourceOp<T>

All Implemented Interfaces:

Closable, Collector, Receptor, INode, ISource, java.io.Serializable

public class CheckpointedSourceOp<T>
extends SourceOp<T>
implements Collector

See Also:

Serialized Form

Field Summary

Fields inherited from class edu.iu.dsc.tws.tset.ops.SourceOp

multiEdgeOpAdapter, source

Constructor Summary

Constructors

Constructor and Description
CheckpointedSourceOp(DiskPartitionBackedSourceWrapper<T> sourceWrapper, BaseTSet originTSet, java.util.Map<java.lang.String,java.lang.String> receivables)

Method Summary

Modifier and Type	Method and Description
DataPartition<?>	get(java.lang.String name) get the collected valued
IONames	getCollectibleNames() This method should return a set of collectible names, that can be collected from this collector.

Methods inherited from class edu.iu.dsc.tws.tset.ops.SourceOp

close, execute, prepare

Methods inherited from class edu.iu.dsc.tws.tset.ops.BaseOp

add, getReceivableNames, gettSetContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.compute.modifiers.Collector

get

Methods inherited from interface edu.iu.dsc.tws.api.compute.modifiers.Closable

reset

Methods inherited from interface edu.iu.dsc.tws.api.compute.modifiers.Receptor

add

Constructor Detail

CheckpointedSourceOp

public CheckpointedSourceOp(DiskPartitionBackedSourceWrapper<T> sourceWrapper,
                            BaseTSet originTSet,
                            java.util.Map<java.lang.String,java.lang.String> receivables)

Method Detail

get

public DataPartition<?> get(java.lang.String name)

Description copied from interface: Collector

get the collected valued

Specified by:

get in interface Collector

Parameters:

name - name of the value to collect

Returns:

the partition of the data

getCollectibleNames

public IONames getCollectibleNames()

Description copied from interface: Collector

This method should return a set of collectible names, that can be collected from this collector. These names will be used by task plan builder to cross validate parallelism between two task graphs.

If Collector C of task graph TG1 collects variable "var1" and C's parallelism is n, If Receptor R of task graph TG2 is interested in receiving "var1", R's parallelism should be equal to n and, R should have the same distribution as C among the workers.

Specified by:

getCollectibleNames in interface Collector

Returns:

set of names of collectbles