edu.iu.dsc.tws.data.api.formatters

Class SharedTextInputPartitioner

java.lang.Object

edu.iu.dsc.tws.data.api.formatters.FileInputPartitioner<java.lang.String>

edu.iu.dsc.tws.data.api.formatters.SharedTextInputPartitioner

All Implemented Interfaces:

InputPartitioner<java.lang.String,FileInputSplit<java.lang.String>>, java.io.Serializable

public class SharedTextInputPartitioner
extends FileInputPartitioner<java.lang.String>

See Also:

Serialized Form

Field Summary

Fields inherited from class edu.iu.dsc.tws.data.api.formatters.FileInputPartitioner

config, filePath, numSplits, READ_WHOLE_SPLIT_FLAG, stream

Constructor Summary

Constructors

Constructor and Description
SharedTextInputPartitioner(Path filePath)
SharedTextInputPartitioner(Path filePath, int numTasks, Config config)

Method Summary

Modifier and Type	Method and Description
protected FileInputSplit	createSplit(int num, Path file, long start, long length, java.lang.String[] hosts)
LocatableInputSplitAssigner<java.lang.String>	getInputSplitAssigner(FileInputSplit<java.lang.String>[] inputSplits) Return the input split asigner

Methods inherited from class edu.iu.dsc.tws.data.api.formatters.FileInputPartitioner

configure, createInputSplits

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SharedTextInputPartitioner

public SharedTextInputPartitioner(Path filePath)

SharedTextInputPartitioner

public SharedTextInputPartitioner(Path filePath,
                                  int numTasks,
                                  Config config)

Method Detail

createSplit

protected FileInputSplit createSplit(int num,
                                     Path file,
                                     long start,
                                     long length,
                                     java.lang.String[] hosts)

Specified by:

createSplit in class FileInputPartitioner<java.lang.String>

getInputSplitAssigner

public LocatableInputSplitAssigner<java.lang.String> getInputSplitAssigner(FileInputSplit<java.lang.String>[] inputSplits)

Description copied from interface: InputPartitioner

Return the input split asigner

Parameters:

inputSplits - the input splits to be assigned

Returns:

assigner