edu.iu.dsc.tws.data.api.formatters

Class LocalBinaryInputPartitioner

java.lang.Object

edu.iu.dsc.tws.data.api.formatters.FileInputPartitioner<byte[]>

edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner

edu.iu.dsc.tws.data.api.formatters.LocalBinaryInputPartitioner

All Implemented Interfaces:

InputPartitioner<byte[],FileInputSplit<byte[]>>, java.io.Serializable

public class LocalBinaryInputPartitioner
extends BinaryInputPartitioner

See Also:

Serialized Form

Field Summary

Fields inherited from class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner

numSplits

Fields inherited from class edu.iu.dsc.tws.data.api.formatters.FileInputPartitioner

filePath, READ_WHOLE_SPLIT_FLAG, stream

Constructor Summary

Constructors

Constructor and Description
LocalBinaryInputPartitioner(Path filePath, int recordLen)
LocalBinaryInputPartitioner(Path filePath, int nTasks, int recordLen, Config cfg)

Method Summary

Modifier and Type	Method and Description
protected BinaryInputSplit	createSplit(int num, Path file, long start, long length, java.lang.String[] hosts)
InputSplitAssigner	getInputSplitAssigner(FileInputSplit[] inputSplits) Return the input split asigner

Methods inherited from class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner

configure, createInputSplits

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LocalBinaryInputPartitioner

public LocalBinaryInputPartitioner(Path filePath,
                                   int recordLen)

LocalBinaryInputPartitioner

public LocalBinaryInputPartitioner(Path filePath,
                                   int nTasks,
                                   int recordLen,
                                   Config cfg)

Method Detail

createSplit

protected BinaryInputSplit createSplit(int num,
                                       Path file,
                                       long start,
                                       long length,
                                       java.lang.String[] hosts)

Overrides:

createSplit in class BinaryInputPartitioner

getInputSplitAssigner

public InputSplitAssigner getInputSplitAssigner(FileInputSplit[] inputSplits)

Description copied from interface: InputPartitioner

Return the input split asigner

Specified by:

getInputSplitAssigner in interface InputPartitioner<byte[],FileInputSplit<byte[]>>

Overrides:

getInputSplitAssigner in class BinaryInputPartitioner

Parameters:

inputSplits - the input splits to be assigned

Returns:

assigner