edu.iu.dsc.tws.tsched.batch.datalocalityaware

Class DataLocalityBatchTaskScheduler

java.lang.Object

edu.iu.dsc.tws.tsched.batch.datalocalityaware.DataLocalityBatchTaskScheduler

All Implemented Interfaces:

ITaskScheduler

public class DataLocalityBatchTaskScheduler
extends java.lang.Object
implements ITaskScheduler

The data locality batch task scheduler generate the task schedule plan based on the distance calculated between the worker node and the data nodes where the input data resides. Once the allocation is done, it calculates the task instance ram, disk, and cpu values and allocates the size of the container with required ram, disk, and cpu values.

Constructor Summary

Constructors

Constructor and Description
DataLocalityBatchTaskScheduler()

Method Summary

Modifier and Type	Method and Description
void	initialize(Config cfg) This method first initialize the task instance values with default task instance ram, disk, and cpu values from the task scheduler context.
void	initialize(Config cfg, int workerid) Initialize with the worker id
TaskSchedulePlan	schedule(ComputeGraph graph, WorkerPlan workerPlan) This is the base method for the data locality aware task scheduling for scheduling the batch task instances.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataLocalityBatchTaskScheduler

public DataLocalityBatchTaskScheduler()

Method Detail

initialize

public void initialize(Config cfg)

This method first initialize the task instance values with default task instance ram, disk, and cpu values from the task scheduler context.

Specified by:

initialize in interface ITaskScheduler

Parameters:

cfg - configuration object

initialize

public void initialize(Config cfg,
                       int workerid)

Description copied from interface: ITaskScheduler

Initialize with the worker id

Specified by:

initialize in interface ITaskScheduler

Parameters:

cfg - configuration

workerid - this worker id

schedule

public TaskSchedulePlan schedule(ComputeGraph graph,
                                 WorkerPlan workerPlan)

This is the base method for the data locality aware task scheduling for scheduling the batch task instances. It retrieves the task vertex set of the task graph and send the set to the data locality aware scheduling algorithm to allocate the batch task instances which are closer to the data nodes.

Specified by:

schedule in interface ITaskScheduler

Parameters:

graph - graph

workerPlan - worker plan

Returns:

the task schedule