edu.iu.dsc.tws.tset.sinks

Class StreamingDiskPersistSink<T>

java.lang.Object

edu.iu.dsc.tws.api.tset.fn.BaseTFunction<T,T>

edu.iu.dsc.tws.api.tset.fn.BaseSinkFunc<T>

edu.iu.dsc.tws.tset.sinks.StreamingDiskPersistSink<T>

All Implemented Interfaces:

SinkFunc<T>, TFunction<T,T>, java.io.Serializable

public class StreamingDiskPersistSink<T>
extends BaseSinkFunc<T>

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
StreamingDiskPersistSink(java.lang.String referencePrefix) Creates an instance of StreamingDiskPersistSink with a referencePrefix

Method Summary

Modifier and Type	Method and Description
boolean	add(T value) Every time an edge produces a value, this method is called.
void	close()
DiskBackedCollectionPartition<T>	get() Return the data partition associated with this task instance.
void	prepare(TSetContext ctx) Prepare the function.

Methods inherited from class edu.iu.dsc.tws.api.tset.fn.BaseTFunction

getInput, getTSetContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.tset.fn.TFunction

end

Constructor Detail

StreamingDiskPersistSink

public StreamingDiskPersistSink(java.lang.String referencePrefix)

Creates an instance of StreamingDiskPersistSink with a referencePrefix

Parameters:

referencePrefix - referencePrefix will be used to uniquely identify the set of disk partitions created with this function

Method Detail

prepare

public void prepare(TSetContext ctx)

Description copied from interface: TFunction

Prepare the function. Use this context in case you need to add/get inputs

Specified by:

prepare in interface TFunction<T,T>

Overrides:

prepare in class BaseTFunction<T,T>

Parameters:

ctx - CONTEXT

add

public boolean add(T value)

Description copied from interface: SinkFunc

Every time an edge produces a value, this method is called.

Parameters:

value - the value to add

Returns:

true if success

close

public void close()

get

public DiskBackedCollectionPartition<T> get()

Description copied from interface: SinkFunc

Return the data partition associated with this task instance. Specifically to be used for caching functionality.

Returns:

data partition - type remains unknown as the output of sunk data can be a different type than T. Example, caching gatherTlink,T -> Tuple<int, T> but the output would be T