edu.iu.dsc.tws.tset.sinks

Class BaseDiskPersistIterSink<T,T1>

java.lang.Object

edu.iu.dsc.tws.api.tset.fn.BaseTFunction<T,T>

edu.iu.dsc.tws.api.tset.fn.BaseSinkFunc<java.util.Iterator<T>>

edu.iu.dsc.tws.tset.sinks.StoreIterSink<T,T1>

edu.iu.dsc.tws.tset.sinks.BaseDiskPersistIterSink<T,T1>

Type Parameters:

T - TSet data type

All Implemented Interfaces:

SinkFunc<java.util.Iterator<T>>, TFunction<java.util.Iterator<T>,java.util.Iterator<T>>, java.io.Serializable

Direct Known Subclasses:

DiskPersistGatherIterSink, DiskPersistIterIterSink

public abstract class BaseDiskPersistIterSink<T,T1>
extends StoreIterSink<T,T1>

Base class for disk based persisted TSet

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
BaseDiskPersistIterSink(java.lang.String referencePrefix) Creates an instance of DiskPersistIterIterSink with a referencePrefix

Method Summary

Modifier and Type	Method and Description
void	close()
DiskBackedCollectionPartition<T1>	get() Returns the CollectionPartition that would accept the values.
void	prepare(TSetContext ctx) Prepare the function.

Methods inherited from class edu.iu.dsc.tws.tset.sinks.StoreIterSink

add, extractValue

Methods inherited from class edu.iu.dsc.tws.api.tset.fn.BaseTFunction

getInput, getTSetContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.tset.fn.TFunction

end

Constructor Detail

BaseDiskPersistIterSink

public BaseDiskPersistIterSink(java.lang.String referencePrefix)

Creates an instance of DiskPersistIterIterSink with a referencePrefix

Parameters:

referencePrefix - referencePrefix will be used to uniquely identify the set of disk partitions created with this function

Method Detail

prepare

public void prepare(TSetContext ctx)

Description copied from interface: TFunction

Prepare the function. Use this context in case you need to add/get inputs

Specified by:

prepare in interface TFunction<java.util.Iterator<T>,java.util.Iterator<T>>

Overrides:

prepare in class BaseTFunction<java.util.Iterator<T>,java.util.Iterator<T>>

Parameters:

ctx - CONTEXT

close

public void close()

get

public DiskBackedCollectionPartition<T1> get()

Description copied from class: StoreIterSink

Returns the CollectionPartition that would accept the values. This could be an in-mem collection or a disk-backed collection

Specified by:

get in interface SinkFunc<java.util.Iterator<T>>

Specified by:

get in class StoreIterSink<T,T1>

Returns:

collection partition