edu.iu.dsc.tws.rsched.uploaders.hdfs

Class HdfsUploader

java.lang.Object

edu.iu.dsc.tws.rsched.uploaders.hdfs.HdfsUploader

All Implemented Interfaces:

IUploader, java.lang.AutoCloseable

public class HdfsUploader
extends java.lang.Object
implements IUploader

Constructor Summary

Constructors

Constructor and Description
HdfsUploader()

Method Summary

Modifier and Type	Method and Description
void	close() This is to for disposing or cleaning up any internal state accumulated by the uploader
protected HdfsController	getHdfsController()
void	initialize(Config ipconfig, java.lang.String jobID) Initialize the uploader with the incoming context.
protected boolean	isLocalFileExists(java.lang.String file)
boolean	undo() Undo uploading.
java.net.URI	uploadPackage(java.lang.String sourceLocation) UploadPackage will upload the job package to the given location.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.scheduler.IUploader

complete

Constructor Detail

HdfsUploader

public HdfsUploader()

Method Detail

initialize

public void initialize(Config ipconfig,
                       java.lang.String jobID)

Description copied from interface: IUploader

Initialize the uploader with the incoming context.

Specified by:

initialize in interface IUploader

getHdfsController

protected HdfsController getHdfsController()

isLocalFileExists

protected boolean isLocalFileExists(java.lang.String file)

uploadPackage

public java.net.URI uploadPackage(java.lang.String sourceLocation)
                           throws UploaderException

Description copied from interface: IUploader

UploadPackage will upload the job package to the given location.

Specified by:

uploadPackage in interface IUploader

Parameters:

sourceLocation - the source location with all the files

Returns:

destination URI of where the job package has been uploaded if successful, or null if failed.

Throws:

UploaderException

undo

public boolean undo()

Description copied from interface: IUploader

Undo uploading. Remove uploaded files.

Specified by:

undo in interface IUploader

close

public void close()

Description copied from interface: IUploader

This is to for disposing or cleaning up any internal state accumulated by the uploader

Specified by:

close in interface IUploader

Specified by:

close in interface java.lang.AutoCloseable