edu.iu.dsc.tws.executor.core.streaming

Class TaskStreamingInstance

java.lang.Object

edu.iu.dsc.tws.executor.core.streaming.TaskStreamingInstance

All Implemented Interfaces:

INodeInstance, ISync

public class TaskStreamingInstance
extends java.lang.Object
implements INodeInstance, ISync

The class represents the instance of the executing task

Field Summary

Fields

Modifier and Type	Field and Description
protected Config	config The configuration
protected int	globalTaskId The globally unique task id
protected int	highWaterMark The high water mark for messages
protected java.util.Map<java.lang.String,IParallelOperation>	inParOps Inward parallel operations
protected java.util.Map<java.lang.String,java.util.Set<java.lang.String>>	inputEdges Input edges
protected java.util.concurrent.BlockingQueue<IMessage>	inQueue All the inputs will come through a single queue, otherwise we need to look at different queues for messages
protected int	lowWaterMark The low watermark for queued messages
protected java.util.Map<java.lang.String,java.lang.Object>	nodeConfigs Node configurations
protected java.util.Map<java.lang.String,IParallelOperation>	outParOps Parallel operations
protected OutputCollection	outputCollection The output collection to be used
protected java.util.Map<java.lang.String,java.lang.String>	outputEdges Output edges
protected java.util.concurrent.BlockingQueue<IMessage>	outQueue Output will go throuh a single queue
protected int	parallelism Number of parallel tasks
protected ICompute	task The actual task executing
protected int	taskId The task id
protected int	taskIndex Task index that goes from 0 to parallism - 1
protected java.lang.String	taskName Name of the task
protected TaskSchedulePlan	taskSchedule
protected int	workerId The worker id

Constructor Summary

Constructors

Constructor and Description

TaskStreamingInstance(ICompute task, java.util.concurrent.BlockingQueue<IMessage> inQueue, java.util.concurrent.BlockingQueue<IMessage> outQueue, Config config, java.lang.String tName, int taskId, int globalTaskId, int tIndex, int parallel, int wId, java.util.Map<java.lang.String,java.lang.Object> cfgs, java.util.Map<java.lang.String,java.util.Set<java.lang.String>> inEdges, java.util.Map<java.lang.String,java.lang.String> outEdges, TaskSchedulePlan taskSchedule, CheckpointingClient checkpointingClient, java.lang.String taskGraphName, long tasksVersion)

Method Summary

Modifier and Type	Method and Description
void	close() Calls at the end to clean up
boolean	execute() Executing compute task
int	getIndex()
java.util.concurrent.BlockingQueue<IMessage>	getInQueue()
INode	getNode() Get the node of this instance
void	prepare(Config cfg) Preparing the task
void	registerInParallelOperation(java.lang.String edge, IParallelOperation op)
void	registerOutParallelOperation(java.lang.String edge, IParallelOperation op)
void	scheduleBarriers(java.lang.Long bid)
boolean	sync(java.lang.String edge, byte[] value) Callback for sync

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.compute.executor.INodeInstance

getId, isComplete, reset

Field Detail

task

protected ICompute task

The actual task executing

inQueue

protected java.util.concurrent.BlockingQueue<IMessage> inQueue

All the inputs will come through a single queue, otherwise we need to look at different queues for messages

outQueue

protected java.util.concurrent.BlockingQueue<IMessage> outQueue

Output will go throuh a single queue

config

protected Config config

The configuration

outputCollection

protected OutputCollection outputCollection

The output collection to be used

globalTaskId

protected int globalTaskId

The globally unique task id

taskId

protected int taskId

The task id

taskIndex

protected int taskIndex

Task index that goes from 0 to parallism - 1

parallelism

protected int parallelism

Number of parallel tasks

taskName

protected java.lang.String taskName

Name of the task

nodeConfigs

protected java.util.Map<java.lang.String,java.lang.Object> nodeConfigs

Node configurations

outParOps

protected java.util.Map<java.lang.String,IParallelOperation> outParOps

Parallel operations

inParOps

protected java.util.Map<java.lang.String,IParallelOperation> inParOps

Inward parallel operations

workerId

protected int workerId

The worker id

lowWaterMark

protected int lowWaterMark

The low watermark for queued messages

highWaterMark

protected int highWaterMark

The high water mark for messages

outputEdges

protected java.util.Map<java.lang.String,java.lang.String> outputEdges

Output edges

taskSchedule

protected TaskSchedulePlan taskSchedule

inputEdges

protected java.util.Map<java.lang.String,java.util.Set<java.lang.String>> inputEdges

Input edges

Constructor Detail

TaskStreamingInstance

public TaskStreamingInstance(ICompute task,
                             java.util.concurrent.BlockingQueue<IMessage> inQueue,
                             java.util.concurrent.BlockingQueue<IMessage> outQueue,
                             Config config,
                             java.lang.String tName,
                             int taskId,
                             int globalTaskId,
                             int tIndex,
                             int parallel,
                             int wId,
                             java.util.Map<java.lang.String,java.lang.Object> cfgs,
                             java.util.Map<java.lang.String,java.util.Set<java.lang.String>> inEdges,
                             java.util.Map<java.lang.String,java.lang.String> outEdges,
                             TaskSchedulePlan taskSchedule,
                             CheckpointingClient checkpointingClient,
                             java.lang.String taskGraphName,
                             long tasksVersion)

Method Detail

prepare

public void prepare(Config cfg)

Preparing the task

Specified by:

prepare in interface INodeInstance

Parameters:

cfg - configuration

registerOutParallelOperation

public void registerOutParallelOperation(java.lang.String edge,
                                         IParallelOperation op)

registerInParallelOperation

public void registerInParallelOperation(java.lang.String edge,
                                        IParallelOperation op)

getIndex

public int getIndex()

Specified by:

getIndex in interface INodeInstance

execute

public boolean execute()

Executing compute task

Specified by:

execute in interface INodeInstance

Returns:

true if further execution is needed

scheduleBarriers

public void scheduleBarriers(java.lang.Long bid)

getNode

public INode getNode()

Description copied from interface: INodeInstance

Get the node of this instance

Specified by:

getNode in interface INodeInstance

Returns:

the graph node

close

public void close()

Description copied from interface: INodeInstance

Calls at the end to clean up

Specified by:

close in interface INodeInstance

getInQueue

public java.util.concurrent.BlockingQueue<IMessage> getInQueue()

sync

public boolean sync(java.lang.String edge,
                    byte[] value)

Description copied from interface: ISync

Callback for sync

Specified by:

sync in interface ISync

Parameters:

edge - edge name

value - value, can be null

Returns:

if we handled the sync, return true