edu.iu.dsc.tws.task.dataobjects

Class DataObjectSource<T>

java.lang.Object

edu.iu.dsc.tws.api.compute.nodes.BaseNode

edu.iu.dsc.tws.api.compute.nodes.BaseSource

edu.iu.dsc.tws.task.dataobjects.DataObjectSource<T>

All Implemented Interfaces:

Closable, INode, ISource, java.io.Serializable

public class DataObjectSource<T>
extends BaseSource

This class is responsible for partition the datapoints which is based on the task parallelism value. This class may use either the "LocalFixedInputPartitioner" or "LocalTextInputPartitioner" to partition the datapoints. Finally, write the partitioned datapoints into their respective edges.

See Also:

Serialized Form

Field Summary

Fields inherited from class edu.iu.dsc.tws.api.compute.nodes.BaseNode

config, context

Constructor Summary

Constructors

Constructor and Description
DataObjectSource()
DataObjectSource(java.lang.String edgename, java.lang.String dataDirectory)

Method Summary

Modifier and Type	Method and Description
void	execute() This method get the partitioned datapoints using the task index and write those values using the respective edge name.
java.lang.String	getDataDirectory()
java.lang.String	getEdgeName() Getter property to set the edge name
void	prepare(Config cfg, TaskContext context) Prepare the task to be executed
void	setDataDirectory(java.lang.String dataDirectory)
void	setEdgeName(java.lang.String edgeName) Setter property to set the edge name

Methods inherited from class edu.iu.dsc.tws.api.compute.nodes.BaseNode

close, reset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataObjectSource

public DataObjectSource()

DataObjectSource

public DataObjectSource(java.lang.String edgename,
                        java.lang.String dataDirectory)

Method Detail

getDataDirectory

public java.lang.String getDataDirectory()

setDataDirectory

public void setDataDirectory(java.lang.String dataDirectory)

getEdgeName

public java.lang.String getEdgeName()

Getter property to set the edge name

setEdgeName

public void setEdgeName(java.lang.String edgeName)

Setter property to set the edge name

execute

public void execute()

This method get the partitioned datapoints using the task index and write those values using the respective edge name.

prepare

public void prepare(Config cfg,
                    TaskContext context)

Description copied from interface: INode

Prepare the task to be executed

Specified by:

prepare in interface INode

Overrides:

prepare in class BaseNode

Parameters:

cfg - the configuration

context - the task context, this has runtime information about the task