edu.iu.dsc.tws.rsched.schedulers.mesos

Class MesosWorkerController

java.lang.Object

edu.iu.dsc.tws.rsched.schedulers.mesos.MesosWorkerController

All Implemented Interfaces:

IWorkerController

public class MesosWorkerController
extends java.lang.Object
implements IWorkerController

Field Summary

Fields

Modifier and Type	Field and Description
static java.util.logging.Logger	LOG

Constructor Summary

Constructors

Constructor and Description
MesosWorkerController(Config cfg, JobAPI.Job job, java.lang.String ip, int port, int workerID)
MesosWorkerController(Config cfg, JobAPI.Job job, java.lang.String ip, int port, int workerID, JobAPI.ComputeResource computeResource, java.util.Map<java.lang.String,java.lang.Integer> additionalPorts)

Method Summary

Modifier and Type	Method and Description
void	close() needs to close down when finished computation
java.util.List<JobMasterAPI.WorkerInfo>	getAllWorkers() get all workers in the job.
java.util.List<JobMasterAPI.WorkerInfo>	getJoinedWorkers() get all joined workers in this job, including the ones finished execution if there are some workers that have not joined yet, they may not be included in this list.
int	getNumberOfWorkers() return the number of all workers in this job, including non-started ones and finished ones
JobMasterAPI.WorkerInfo	getWorkerInfo() return the WorkerInfo object for this worker
JobMasterAPI.WorkerInfo	getWorkerInfoForID(int id) return the WorkerInfo object for the given ID
void	initializeWithZooKeeper()
void	waitOnBarrier() wait for all workers in the job to arrive at this barrier After waiting for the timeout specified in ControllerContext.maxWaitTimeOnBarrier if some workers still could not arrive at the barrier, throw an exception
void	waitOnBarrier(long timeLimit) wait for all workers in the job to arrive at this barrier After waiting for the timeLimit, if some workers still could not arrive at the barrier, throw an exception
void	waitOnInitBarrier() this barrier is used when initializing the workers.
int	workerRestartCount() get worker restartCount zero means starting for the first time

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.resource.IWorkerController

getCheckpointingClient, getFailureListener

Field Detail

LOG

public static final java.util.logging.Logger LOG

Constructor Detail

MesosWorkerController

public MesosWorkerController(Config cfg,
                             JobAPI.Job job,
                             java.lang.String ip,
                             int port,
                             int workerID)

MesosWorkerController

public MesosWorkerController(Config cfg,
                             JobAPI.Job job,
                             java.lang.String ip,
                             int port,
                             int workerID,
                             JobAPI.ComputeResource computeResource,
                             java.util.Map<java.lang.String,java.lang.Integer> additionalPorts)

Method Detail

getWorkerInfo

public JobMasterAPI.WorkerInfo getWorkerInfo()

Description copied from interface: IWorkerController

return the WorkerInfo object for this worker

Specified by:

getWorkerInfo in interface IWorkerController

getWorkerInfoForID

public JobMasterAPI.WorkerInfo getWorkerInfoForID(int id)

Description copied from interface: IWorkerController

return the WorkerInfo object for the given ID

Specified by:

getWorkerInfoForID in interface IWorkerController

getNumberOfWorkers

public int getNumberOfWorkers()

Description copied from interface: IWorkerController

return the number of all workers in this job, including non-started ones and finished ones

Specified by:

getNumberOfWorkers in interface IWorkerController

getJoinedWorkers

public java.util.List<JobMasterAPI.WorkerInfo> getJoinedWorkers()

Description copied from interface: IWorkerController

get all joined workers in this job, including the ones finished execution if there are some workers that have not joined yet, they may not be included in this list. users can compare the total number of workers to the size of this list and understand whether there are non-joined workers

Specified by:

getJoinedWorkers in interface IWorkerController

workerRestartCount

public int workerRestartCount()

Description copied from interface: IWorkerController

get worker restartCount zero means starting for the first time

Specified by:

workerRestartCount in interface IWorkerController

initializeWithZooKeeper

public void initializeWithZooKeeper()

getAllWorkers

public java.util.List<JobMasterAPI.WorkerInfo> getAllWorkers()
                                                      throws TimeoutException

Description copied from interface: IWorkerController

get all workers in the job. If some workers has not joined the job yet, wait for them. After waiting for the timeout specified in ControllerContext.maxWaitTimeForAllToJoin if some workers still could not join, throw an exception

return all workers in the job including the ones that have already left, if any

Specified by:

getAllWorkers in interface IWorkerController

Throws:

TimeoutException

waitOnBarrier

public void waitOnBarrier()
                   throws TimeoutException

Description copied from interface: IWorkerController

wait for all workers in the job to arrive at this barrier After waiting for the timeout specified in ControllerContext.maxWaitTimeOnBarrier if some workers still could not arrive at the barrier, throw an exception

Specified by:

waitOnBarrier in interface IWorkerController

Throws:

TimeoutException

waitOnBarrier

public void waitOnBarrier(long timeLimit)
                   throws TimeoutException,
                          JobFaultyException

Description copied from interface: IWorkerController

wait for all workers in the job to arrive at this barrier After waiting for the timeLimit, if some workers still could not arrive at the barrier, throw an exception

Specified by:

waitOnBarrier in interface IWorkerController

Throws:

TimeoutException

JobFaultyException

waitOnInitBarrier

public void waitOnInitBarrier()
                       throws TimeoutException

Description copied from interface: IWorkerController

this barrier is used when initializing the workers. when there is a failure in the job, workers synchronize with this barrier this must not be used in other parts of the system

Specified by:

waitOnInitBarrier in interface IWorkerController

Throws:

TimeoutException

close

public void close()

needs to close down when finished computation