edu.iu.dsc.tws.rsched.uploaders.scp

Class ScpContext

java.lang.Object

edu.iu.dsc.tws.api.config.Context

edu.iu.dsc.tws.api.config.SchedulerContext

edu.iu.dsc.tws.rsched.uploaders.scp.ScpContext

public class ScpContext
extends SchedulerContext

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	DOWNLOAD_DIRECTORY
static java.lang.String	TWISTER2_UPLOADER_SCP_CONNECTION
static java.lang.String	TWISTER2_UPLOADER_SCP_OPTIONS
static java.lang.String	TWISTER2_UPLOADER_SSH_CONNECTION
static java.lang.String	TWISTER2_UPLOADER_SSH_OPTIONS
static java.lang.String	UPLOAD_DIRECTORY

Fields inherited from class edu.iu.dsc.tws.api.config.SchedulerContext

ADDITIONAL_PORTS, CLUSTER_TYPE, CONFIG_DIR, COPY_SYSTEM_PACKAGE, CORE_PACKAGE_FILENAME, CORE_PACKAGE_FILENAME_DEFAULT, CORE_PACKAGE_URL, DATACENTER_LABEL_KEY, DATACENTERS_LIST, DEBUG, DOWNLOAD_METHOD, DRIVER_CLASS, JOB_ARCHIVE_TEMP_DIR, JOB_DESCRIPTION_FILE_CMD_VAR, JOB_MASTER_PROVIDED_IP, JOB_PACKAGE_FILENAME, JOB_PACKAGE_FILENAME_DEFAULT, JOB_PACKAGE_URI, JOB_PACKAGE_URL, K8S_CHECK_PODS_REACHABLE, K8S_CHECK_PODS_REACHABLE_DEFAULT, LAUNCHER_CLASS, NETWORK_INTERFACES, NFS_SERVER_ADDRESS, NFS_SERVER_PATH, PERSISTENT_VOLUME_PER_WORKER, PERSISTENT_VOLUME_PER_WORKER_DEFAULT, RACK_LABEL_KEY, RACKS_LIST, SYSTEM_PACKAGE_URI, TEMPORARY_PACKAGES_PATH, THREADS_PER_WORKER, TWISTER_2_HOME, TWISTER2_PACKAGES_PATH, UPLOADER_CLASS, USER_JOB_FILE, USER_JOB_TYPE, WORKER_CLASS, WORKER_COMPUTE_RESOURCES, WORKING_DIRECTORY

Fields inherited from class edu.iu.dsc.tws.api.config.Context

AURORA_SCRIPT, CHECKPOINT_YAML, CLUSTER, CLUSTER_CONF, CLUSTER_HOME, CORE_YAML, DATA_YAML, defaults, GRAPH_TYPE, HOME, JAVA_HOME, JOB, JOB_ARCHIVE_DIRECTORY, JOB_ID, JOB_NAME, JOB_OBJECT, NETWORK_YAML, OPERATION_NAME, OVERRIDE_YAML, RESOURCE_SCHEDULER_YAML, STREAMING, substitutions, TASK_YAML, TWISTER2_BANDWIDTH, TWISTER2_BIN, TWISTER2_CLUSTER_TYPE, TWISTER2_COMMON_CONF_DIR, TWISTER2_CONF, TWISTER2_CONTAINER_ID, TWISTER2_DIRECT_EDGE, TWISTER2_DIST, TWISTER2_GRAPH_JOB, TWISTER2_HOME, TWISTER2_LATENCY, TWISTER2_LIB, TWISTER2_MAX_TASK_INSTANCES_PER_WORKER, TWISTER2_TASK_INSTANCE_ODD_PARALLELISM, TWISTER2_TSET_JOB, TWISTER2_WORKER_INSTANCES, TWISTER2_WORKER_INSTANCES_DEFAULT, USER_NAME, VERBOSE

Constructor Summary

Constructors

Constructor and Description
ScpContext()

Method Summary

Modifier and Type	Method and Description
static java.lang.String	downloadDirectory(Config config)
static java.lang.String	scpConnection(Config config)
static java.lang.String	scpOptions(Config config)
static java.lang.String	sshConnection(Config config)
static java.lang.String	sshOptions(Config config)
static java.lang.String	uploaderJobDirectory(Config cfg) Get the directory to upload the file

Methods inherited from class edu.iu.dsc.tws.api.config.SchedulerContext

additionalPorts, checkPodsReachable, copySystemPackage, corePackageFileName, corePackageUrl, createJobDescriptionFileName, downloadMethod, driverClass, getJobMasterProvidedIp, getNodeInfo, isLocalFileSystemUploader, jobArchiveTempDirectory, jobPackageFileName, jobPackageUri, jobPackageUrl, launcherClass, networkInterfaces, nfsServerAddress, nfsServerPath, numberOfAdditionalPorts, packagesPath, persistentVolumePerWorker, persistentVolumeRequested, systemPackageUrl, temporaryPackagesPath, uploaderClass, useOpenMPI, userJobJarFile, userJobType, workerClass, workerEndSyncWaitTime

Methods inherited from class edu.iu.dsc.tws.api.config.Context

auroraScript, checkpointCofigurationFile, checkpointConfigurationFile, clusterType, commonConfDir, conf, containerId, dataConfigurationFile, distDirectory, getDefaults, getDoublePropertyValue, getIntPropertyValue, getLongPropertyValue, getStringPropertyValue, isKubernetesCluster, jobId, jobName, libDirectory, networkConfigurationFile, resourceSchedulerConfigurationFile, systemConfigurationFile, taskConfigurationFile, twister2Home, userName, verbose, workerInstances

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

UPLOAD_DIRECTORY

public static final java.lang.String UPLOAD_DIRECTORY

See Also:

Constant Field Values

DOWNLOAD_DIRECTORY

public static final java.lang.String DOWNLOAD_DIRECTORY

See Also:

Constant Field Values

TWISTER2_UPLOADER_SCP_OPTIONS

public static final java.lang.String TWISTER2_UPLOADER_SCP_OPTIONS

See Also:

Constant Field Values

TWISTER2_UPLOADER_SCP_CONNECTION

public static final java.lang.String TWISTER2_UPLOADER_SCP_CONNECTION

See Also:

Constant Field Values

TWISTER2_UPLOADER_SSH_OPTIONS

public static final java.lang.String TWISTER2_UPLOADER_SSH_OPTIONS

See Also:

Constant Field Values

TWISTER2_UPLOADER_SSH_CONNECTION

public static final java.lang.String TWISTER2_UPLOADER_SSH_CONNECTION

See Also:

Constant Field Values

Constructor Detail

ScpContext

public ScpContext()

Method Detail

uploaderJobDirectory

public static final java.lang.String uploaderJobDirectory(Config cfg)

Get the directory to upload the file

Returns:

full path as a string

downloadDirectory

public static java.lang.String downloadDirectory(Config config)

scpOptions

public static java.lang.String scpOptions(Config config)

scpConnection

public static java.lang.String scpConnection(Config config)

sshOptions

public static java.lang.String sshOptions(Config config)

sshConnection

public static java.lang.String sshConnection(Config config)