edu.iu.dsc.tws.task.dataobjects

Class DataFileSplittedReadSource<T>

java.lang.Object

edu.iu.dsc.tws.api.compute.nodes.BaseNode

edu.iu.dsc.tws.api.compute.nodes.BaseSource

edu.iu.dsc.tws.task.dataobjects.DataFileSplittedReadSource<T>

All Implemented Interfaces:

Closable, INode, ISource, java.io.Serializable

public class DataFileSplittedReadSource<T>
extends BaseSource

This class is responsible for partition the datapoints which is based on the task parallelism value. This class may use either the "LocalFixedInputPartitioner" or "LocalTextInputPartitioner" to partition the datapoints. Finally, write the partitioned datapoints into their respective edges.

See Also:

Serialized Form

Field Summary

Fields inherited from class edu.iu.dsc.tws.api.compute.nodes.BaseNode

config, context

Constructor Summary

Constructors

Constructor and Description
DataFileSplittedReadSource(java.lang.String edgename)

Method Summary

Modifier and Type	Method and Description
void	execute() This method get the partitioned datapoints using the task index and write those values using the respective edge name.
java.lang.String	getDataDirectory()
java.lang.String	getEdgeName() Getter property to set the edge name
void	prepare(Config cfg, TaskContext context) Retrieve the data input directory using the DataObjectConstants and the config file.
void	setDataDirectory(java.lang.String dataDirectory)
void	setEdgeName(java.lang.String edgeName) Setter property to set the edge name

Methods inherited from class edu.iu.dsc.tws.api.compute.nodes.BaseNode

close, reset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataFileSplittedReadSource

public DataFileSplittedReadSource(java.lang.String edgename)

Method Detail

getDataDirectory

public java.lang.String getDataDirectory()

setDataDirectory

public void setDataDirectory(java.lang.String dataDirectory)

getEdgeName

public java.lang.String getEdgeName()

Getter property to set the edge name

Returns:

setEdgeName

public void setEdgeName(java.lang.String edgeName)

Setter property to set the edge name

Parameters:

edgeName -

execute

public void execute()

This method get the partitioned datapoints using the task index and write those values using the respective edge name.

prepare

public void prepare(Config cfg,
                    TaskContext context)

Retrieve the data input directory using the DataObjectConstants and the config file.

Specified by:

prepare in interface INode

Overrides:

prepare in class BaseNode

Parameters:

cfg -

context -