edu.iu.dsc.tws.common.zk

Class JobZNodeManager

java.lang.Object

edu.iu.dsc.tws.common.zk.JobZNodeManager

public final class JobZNodeManager
extends java.lang.Object

Field Summary

Fields

Modifier and Type	Field and Description
static java.util.logging.Logger	LOG

Method Summary

Modifier and Type	Method and Description
static boolean	checkJstZNodeWaitIfNeeded(CuratorFramework client, java.lang.String rootPath, java.lang.String jobID, long jsTime) Job master creates job submission time znode under job znode, as the last action to create job related znodes at ZK server workers wait for the job master to create this znode.
static void	createJobEndTimeZNode(CuratorFramework client, java.lang.String rootPath, java.lang.String jobID) Create job end time znode
static void	createJobZNode(CuratorFramework client, java.lang.String rootPath, JobAPI.Job job) Create job znode Assumes that there is no znode exists in the ZooKeeper Add job object as its body
static void	createJstZNode(CuratorFramework client, java.lang.String rootPath, java.lang.String jobID, long jsTime) Create job submission time znode
static void	deleteJobZNode(CuratorFramework client, java.lang.String rootPath, java.lang.String jobID) delete job znode from zk server
static java.util.List<JobWithState>	getJobs(CuratorFramework client, java.lang.String rootPath) return all jobs
static boolean	isThereJobZNode(CuratorFramework clnt, java.lang.String rootPath, java.lang.String jobID) check whether there is an active job
static JobWithState	readJobZNode(CuratorFramework client, java.lang.String rootPath, java.lang.String jobID) read the body of job directory znode decode and return
static boolean	updateJob(CuratorFramework client, java.lang.String rootPath, JobAPI.Job job, JobAPI.JobState state)
static boolean	updateJobState(CuratorFramework client, java.lang.String rootPath, java.lang.String jobID, JobAPI.JobState state)
static void	updateJobWorkers(CuratorFramework client, java.lang.String rootPath, java.lang.String jobID, int workerChange) Update number of workers in the job object this is called in case of scaling up/down

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

public static final java.util.logging.Logger LOG

Method Detail

createJobZNode

public static void createJobZNode(CuratorFramework client,
                                  java.lang.String rootPath,
                                  JobAPI.Job job)

Create job znode Assumes that there is no znode exists in the ZooKeeper Add job object as its body

readJobZNode

public static JobWithState readJobZNode(CuratorFramework client,
                                        java.lang.String rootPath,
                                        java.lang.String jobID)

read the body of job directory znode decode and return

isThereJobZNode

public static boolean isThereJobZNode(CuratorFramework clnt,
                                      java.lang.String rootPath,
                                      java.lang.String jobID)

check whether there is an active job

updateJob

public static boolean updateJob(CuratorFramework client,
                                java.lang.String rootPath,
                                JobAPI.Job job,
                                JobAPI.JobState state)
                         throws Twister2Exception

Throws:

Twister2Exception

updateJobState

public static boolean updateJobState(CuratorFramework client,
                                     java.lang.String rootPath,
                                     java.lang.String jobID,
                                     JobAPI.JobState state)
                              throws Twister2Exception

Throws:

Twister2Exception

deleteJobZNode

public static void deleteJobZNode(CuratorFramework client,
                                  java.lang.String rootPath,
                                  java.lang.String jobID)

delete job znode from zk server

updateJobWorkers

public static void updateJobWorkers(CuratorFramework client,
                                    java.lang.String rootPath,
                                    java.lang.String jobID,
                                    int workerChange)
                             throws Twister2Exception

Update number of workers in the job object this is called in case of scaling up/down

Throws:

Twister2Exception

getJobs

public static java.util.List<JobWithState> getJobs(CuratorFramework client,
                                                   java.lang.String rootPath)
                                            throws Twister2Exception

return all jobs

Throws:

Twister2Exception

createJstZNode

public static void createJstZNode(CuratorFramework client,
                                  java.lang.String rootPath,
                                  java.lang.String jobID,
                                  long jsTime)

Create job submission time znode

createJobEndTimeZNode

public static void createJobEndTimeZNode(CuratorFramework client,
                                         java.lang.String rootPath,
                                         java.lang.String jobID)

Create job end time znode

checkJstZNodeWaitIfNeeded

public static boolean checkJstZNodeWaitIfNeeded(CuratorFramework client,
                                                java.lang.String rootPath,
                                                java.lang.String jobID,
                                                long jsTime)
                                         throws Twister2Exception

Job master creates job submission time znode under job znode, as the last action to create job related znodes at ZK server workers wait for the job master to create this znode. They proceed after seeing that this jst znode is created

this jst znode may exist from previous runs in the case of restarting from a checkpoint because of this, its value has to be compared

Throws:

Twister2Exception