edu.iu.dsc.tws.master.worker

Class JMWorkerController

java.lang.Object

edu.iu.dsc.tws.master.worker.JMWorkerController

All Implemented Interfaces:

MessageHandler, IWorkerController

public class JMWorkerController
extends java.lang.Object
implements IWorkerController, MessageHandler

Constructor Summary

Constructors

Constructor and Description
JMWorkerController(Config config, JobMasterAPI.WorkerInfo workerInfo, int numberOfWorkers, int restartCount, RRClient rrClient, CheckpointingClient checkpointingClient)

Method Summary

Modifier and Type	Method and Description
static java.net.InetAddress	convertStringToIP(java.lang.String ipStr) convert the given string to ip address object
java.util.List<JobMasterAPI.WorkerInfo>	getAllWorkers() get all workers in the job.
CheckpointingClient	getCheckpointingClient()
java.util.List<JobMasterAPI.WorkerInfo>	getJoinedWorkers() get all joined workers in this job, including the ones finished execution if there are some workers that have not joined yet, they may not be included in this list.
int	getNumberOfWorkers() return the number of all workers in this job, including non-started ones and finished ones
JobMasterAPI.WorkerInfo	getWorkerInfo() return the WorkerInfo object for this worker
JobMasterAPI.WorkerInfo	getWorkerInfoForID(int id) return the WorkerInfo object for the given ID
void	onMessage(RequestID id, int workerId, Message message) Handles a specific message type
void	scaled(int change, int numOfWorkers) when the job is scaled, we update the number of workers
void	waitOnBarrier() wait for all workers in the job to arrive at this barrier After waiting for the timeout specified in ControllerContext.maxWaitTimeOnBarrier if some workers still could not arrive at the barrier, throw an exception
void	waitOnBarrier(long timeLimit) wait for all workers in the job to arrive at this barrier After waiting for the timeLimit, if some workers still could not arrive at the barrier, throw an exception
void	waitOnInitBarrier() this barrier is used when initializing the workers.
int	workerRestartCount() get worker restartCount zero means starting for the first time

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.resource.IWorkerController

getFailureListener

Constructor Detail

JMWorkerController

public JMWorkerController(Config config,
                          JobMasterAPI.WorkerInfo workerInfo,
                          int numberOfWorkers,
                          int restartCount,
                          RRClient rrClient,
                          CheckpointingClient checkpointingClient)

Method Detail

getWorkerInfo

public JobMasterAPI.WorkerInfo getWorkerInfo()

Description copied from interface: IWorkerController

return the WorkerInfo object for this worker

Specified by:

getWorkerInfo in interface IWorkerController

scaled

public void scaled(int change,
                   int numOfWorkers)

when the job is scaled, we update the number of workers

getWorkerInfoForID

public JobMasterAPI.WorkerInfo getWorkerInfoForID(int id)

Description copied from interface: IWorkerController

return the WorkerInfo object for the given ID

Specified by:

getWorkerInfoForID in interface IWorkerController

getNumberOfWorkers

public int getNumberOfWorkers()

Description copied from interface: IWorkerController

return the number of all workers in this job, including non-started ones and finished ones

Specified by:

getNumberOfWorkers in interface IWorkerController

getJoinedWorkers

public java.util.List<JobMasterAPI.WorkerInfo> getJoinedWorkers()

Description copied from interface: IWorkerController

get all joined workers in this job, including the ones finished execution if there are some workers that have not joined yet, they may not be included in this list. users can compare the total number of workers to the size of this list and understand whether there are non-joined workers

Specified by:

getJoinedWorkers in interface IWorkerController

getAllWorkers

public java.util.List<JobMasterAPI.WorkerInfo> getAllWorkers()
                                                      throws TimeoutException

Description copied from interface: IWorkerController

get all workers in the job. If some workers has not joined the job yet, wait for them. After waiting for the timeout specified in ControllerContext.maxWaitTimeForAllToJoin if some workers still could not join, throw an exception

return all workers in the job including the ones that have already left, if any

Specified by:

getAllWorkers in interface IWorkerController

Throws:

TimeoutException

onMessage

public void onMessage(RequestID id,
                      int workerId,
                      Message message)

Description copied from interface: MessageHandler

Handles a specific message type

Specified by:

onMessage in interface MessageHandler

Parameters:

id - request id

workerId - worker id

message - protbuf message

waitOnBarrier

public void waitOnBarrier()
                   throws TimeoutException

Description copied from interface: IWorkerController

wait for all workers in the job to arrive at this barrier After waiting for the timeout specified in ControllerContext.maxWaitTimeOnBarrier if some workers still could not arrive at the barrier, throw an exception

Specified by:

waitOnBarrier in interface IWorkerController

Throws:

TimeoutException

waitOnBarrier

public void waitOnBarrier(long timeLimit)
                   throws TimeoutException

Description copied from interface: IWorkerController

wait for all workers in the job to arrive at this barrier After waiting for the timeLimit, if some workers still could not arrive at the barrier, throw an exception

Specified by:

waitOnBarrier in interface IWorkerController

Throws:

TimeoutException

waitOnInitBarrier

public void waitOnInitBarrier()
                       throws TimeoutException

Description copied from interface: IWorkerController

this barrier is used when initializing the workers. when there is a failure in the job, workers synchronize with this barrier this must not be used in other parts of the system

Specified by:

waitOnInitBarrier in interface IWorkerController

Throws:

TimeoutException

convertStringToIP

public static java.net.InetAddress convertStringToIP(java.lang.String ipStr)

convert the given string to ip address object

getCheckpointingClient

public CheckpointingClient getCheckpointingClient()

Specified by:

getCheckpointingClient in interface IWorkerController

workerRestartCount

public int workerRestartCount()

Description copied from interface: IWorkerController

get worker restartCount zero means starting for the first time

Specified by:

workerRestartCount in interface IWorkerController