edu.iu.dsc.tws.data.api.formatters

Class LocalFixedInputPartitioner<T>

java.lang.Object

edu.iu.dsc.tws.data.api.formatters.FixedInputPartitioner<T>

edu.iu.dsc.tws.data.api.formatters.LocalFixedInputPartitioner<T>

All Implemented Interfaces:

InputPartitioner<T,FileInputSplit<T>>, java.io.Serializable

public class LocalFixedInputPartitioner<T>
extends FixedInputPartitioner<T>

See Also:

Serialized Form

Field Summary

Fields inherited from class edu.iu.dsc.tws.data.api.formatters.FixedInputPartitioner

config, filePath, stream

Constructor Summary

Constructors

Constructor and Description
LocalFixedInputPartitioner(Path filePath, int numTasks)
LocalFixedInputPartitioner(Path filePath, int numTasks, Config config, int datasize)

Method Summary

Modifier and Type	Method and Description
protected TextInputSplit	createSplit(int num, Path file, long start, long length, java.lang.String[] hosts)
OrderedInputSplitAssigner<T>	getInputSplitAssigner(FileInputSplit<T>[] inputSplits) Return the input split asigner

Methods inherited from class edu.iu.dsc.tws.data.api.formatters.FixedInputPartitioner

configure, createInputSplits

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LocalFixedInputPartitioner

public LocalFixedInputPartitioner(Path filePath,
                                  int numTasks)

LocalFixedInputPartitioner

public LocalFixedInputPartitioner(Path filePath,
                                  int numTasks,
                                  Config config,
                                  int datasize)

Method Detail

createSplit

protected TextInputSplit createSplit(int num,
                                     Path file,
                                     long start,
                                     long length,
                                     java.lang.String[] hosts)

Specified by:

createSplit in class FixedInputPartitioner<T>

getInputSplitAssigner

public OrderedInputSplitAssigner<T> getInputSplitAssigner(FileInputSplit<T>[] inputSplits)

Description copied from interface: InputPartitioner

Return the input split asigner

Specified by:

getInputSplitAssigner in interface InputPartitioner<T,FileInputSplit<T>>

Overrides:

getInputSplitAssigner in class FixedInputPartitioner<T>

Parameters:

inputSplits - the input splits to be assigned

Returns:

assigner