edu.iu.dsc.tws.tset.ops

Class WindowComputeOp<O,I>

java.lang.Object

edu.iu.dsc.tws.api.compute.nodes.BaseNode

edu.iu.dsc.tws.task.window.api.BaseWindowSink<T>

edu.iu.dsc.tws.task.window.core.AbstractSingleWindowDataSink<T>

edu.iu.dsc.tws.task.window.core.BaseWindowedSink<I>

edu.iu.dsc.tws.tset.ops.WindowComputeOp<O,I>

All Implemented Interfaces:

Closable, Receptor, ICompute<I>, INode, IWindowedSink<I>, IWindowCompute<I>, java.io.Serializable

public class WindowComputeOp<O,I>
extends BaseWindowedSink<I>
implements Receptor, java.io.Serializable

See Also:

Serialized Form

Field Summary

Fields inherited from class edu.iu.dsc.tws.task.window.core.BaseWindowedSink

allowedLateness, collectiveEvents, collectiveOutput, DEFAULT_MAX_LAG, DEFAULT_WATERMARK_INTERVAL, evictionPolicy, iTimestampExtractor, iWindow, maxLagMs, watermarkEventGenerator, watermarkInterval, windowingPolicy, windowLifeCycleListener, windowManager, windowParameter

Fields inherited from class edu.iu.dsc.tws.api.compute.nodes.BaseNode

config, context

Constructor Summary

Constructors

Constructor and Description
WindowComputeOp(ComputeFunc<O,java.util.Iterator<I>> computeFunction, BaseTSet originTSet, java.util.Map<java.lang.String,java.lang.String> receivables, WindowParameter winParam)
WindowComputeOp(ComputeFunc<O,java.util.Iterator<I>> computeFunction, WindowParameter winParam)

Method Summary

Modifier and Type	Method and Description
void	add(java.lang.String key, DataPartition<?> data)
boolean	execute(IMessage<I> content) Execute with an incoming message
boolean	execute(IWindowMessage<I> windowMessage)
boolean	getExpire(IWindowMessage<I> expiredMessages)
ComputeFunc<O,java.util.Iterator<I>>	getFunction()
boolean	getLateMessages(IMessage<I> lateMessages)
IONames	getReceivableNames() This method should return a set of receivable names, that are expected by this receptor.
void	initialize(BaseTSet origin, java.util.Map<java.lang.String,java.lang.String> recvs, WindowParameter winParm)
protected WindowLifeCycleListener<I>	newWindowLifeCycleListener()
void	prepare(Config cfg, TaskContext ctx) Prepare the task to be executed

Methods inherited from class edu.iu.dsc.tws.task.window.core.BaseWindowedSink

close, getEvictionPolicy, getWindowingPolicy, initialize, isTimestamped, reset, setPolicies, start, withAllowedLateness, withCustomTimestampExtractor, withSlidingCountWindow, withSlidingDurationWindow, withTimestampExtractor, withTumblingCountWindow, withTumblingDurationWindow, withWatermarkInterval, withWindow

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.compute.modifiers.Receptor

add

Methods inherited from interface edu.iu.dsc.tws.api.compute.nodes.ICompute

endExecute

Constructor Detail

WindowComputeOp

public WindowComputeOp(ComputeFunc<O,java.util.Iterator<I>> computeFunction,
                       WindowParameter winParam)

WindowComputeOp

public WindowComputeOp(ComputeFunc<O,java.util.Iterator<I>> computeFunction,
                       BaseTSet originTSet,
                       java.util.Map<java.lang.String,java.lang.String> receivables,
                       WindowParameter winParam)

Method Detail

initialize

public void initialize(BaseTSet origin,
                       java.util.Map<java.lang.String,java.lang.String> recvs,
                       WindowParameter winParm)

prepare

public void prepare(Config cfg,
                    TaskContext ctx)

Description copied from interface: INode

Prepare the task to be executed

Specified by:

prepare in interface INode

Overrides:

prepare in class BaseWindowedSink<I>

Parameters:

cfg - the configuration

ctx - the task context, this has runtime information about the task

execute

public boolean execute(IWindowMessage<I> windowMessage)

Specified by:

execute in class BaseWindowedSink<I>

getExpire

public boolean getExpire(IWindowMessage<I> expiredMessages)

Specified by:

getExpire in class BaseWindowedSink<I>

getLateMessages

public boolean getLateMessages(IMessage<I> lateMessages)

Specified by:

getLateMessages in class BaseWindowedSink<I>

execute

public boolean execute(IMessage<I> content)

Description copied from interface: ICompute

Execute with an incoming message

Specified by:

execute in interface ICompute<I>

Specified by:

execute in interface IWindowedSink<I>

Specified by:

execute in interface IWindowCompute<I>

Overrides:

execute in class BaseWindowedSink<I>

newWindowLifeCycleListener

protected WindowLifeCycleListener<I> newWindowLifeCycleListener()

Overrides:

newWindowLifeCycleListener in class BaseWindowedSink<I>

add

public void add(java.lang.String key,
                DataPartition<?> data)

Specified by:

add in interface Receptor

getReceivableNames

public IONames getReceivableNames()

Description copied from interface: Receptor

This method should return a set of receivable names, that are expected by this receptor. These names will be used by task plan builder to cross validate parallelism between two task graphs.

If Collector C of task graph TG1 collects variable "var1" and C's parallelism is n, If Receptor R of task graph TG2 is interested in receiving "var1", R's parallelism should be equal to n and, R should have the same distribution as C among the workers.

Specified by:

getReceivableNames in interface Receptor

Returns:

get the set of names

getFunction

public ComputeFunc<O,java.util.Iterator<I>> getFunction()