edu.iu.dsc.tws.tsched.streaming.datalocalityaware

Class DataLocalityStreamingTaskScheduler

java.lang.Object

edu.iu.dsc.tws.tsched.streaming.datalocalityaware.DataLocalityStreamingTaskScheduler

All Implemented Interfaces:

ITaskScheduler

public class DataLocalityStreamingTaskScheduler
extends java.lang.Object
implements ITaskScheduler

The data locality streaming task scheduler generate the task schedule plan based on the distance calculated between the worker node and the data nodes where the input data resides. Once the allocation is done, it calculates the task instance ram, disk, and cpu values and also it allocates the size of the container with required ram, disk, and cpu values.

Constructor Summary

Constructors

Constructor and Description
DataLocalityStreamingTaskScheduler()

Method Summary

Modifier and Type	Method and Description
void	initialize(Config cfg) This method first initialize the task instance values with default task instance ram, disk, and cpu values from the task scheduler context.
void	initialize(Config cfg, int workerid) Initialize with the worker id
TaskSchedulePlan	schedule(ComputeGraph graph, WorkerPlan workerPlan) This is the base method for the data locality aware task scheduling for scheduling the streaming task instances.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataLocalityStreamingTaskScheduler

public DataLocalityStreamingTaskScheduler()

Method Detail

initialize

public void initialize(Config cfg)

This method first initialize the task instance values with default task instance ram, disk, and cpu values from the task scheduler context.

Specified by:

initialize in interface ITaskScheduler

Parameters:

cfg - configuration object

initialize

public void initialize(Config cfg,
                       int workerid)

Description copied from interface: ITaskScheduler

Initialize with the worker id

Specified by:

initialize in interface ITaskScheduler

Parameters:

cfg - configuration

workerid - this worker id

schedule

public TaskSchedulePlan schedule(ComputeGraph graph,
                                 WorkerPlan workerPlan)

This is the base method for the data locality aware task scheduling for scheduling the streaming task instances. It retrieves the task vertex set of the task graph and send the set to the data locality aware scheduling algorithm to schedule the streaming task instances which are closer to the data nodes.

Specified by:

schedule in interface ITaskScheduler

Parameters:

graph - graph

workerPlan - worker plan

Returns:

the task schedule