edu.iu.dsc.tws.data.api.formatters

Class LocalCSVInputPartitioner

java.lang.Object

edu.iu.dsc.tws.data.api.formatters.CSVInputPartitioner<java.lang.String>

edu.iu.dsc.tws.data.api.formatters.LocalCSVInputPartitioner

All Implemented Interfaces:

InputPartitioner<java.lang.String,FileInputSplit<java.lang.String>>, java.io.Serializable

public class LocalCSVInputPartitioner
extends CSVInputPartitioner<java.lang.String>

See Also:

Serialized Form

Field Summary

Fields inherited from class edu.iu.dsc.tws.data.api.formatters.CSVInputPartitioner

config, filePath, numSplits

Constructor Summary

Constructors

Constructor and Description
LocalCSVInputPartitioner(Path filePath, int numTasks, Config config)
LocalCSVInputPartitioner(Path filePath, int numTasks, int datasize, Config config)

Method Summary

Modifier and Type	Method and Description
protected CSVInputSplit	createSplit(int num, Path file, long start, long length, java.lang.String[] hosts)
InputSplitAssigner	getInputSplitAssigner(FileInputSplit[] inputSplits) Return the input split asigner

Methods inherited from class edu.iu.dsc.tws.data.api.formatters.CSVInputPartitioner

configure, createInputSplits

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LocalCSVInputPartitioner

public LocalCSVInputPartitioner(Path filePath,
                                int numTasks,
                                Config config)

LocalCSVInputPartitioner

public LocalCSVInputPartitioner(Path filePath,
                                int numTasks,
                                int datasize,
                                Config config)

Method Detail

createSplit

protected CSVInputSplit createSplit(int num,
                                    Path file,
                                    long start,
                                    long length,
                                    java.lang.String[] hosts)

Specified by:

createSplit in class CSVInputPartitioner<java.lang.String>

getInputSplitAssigner

public InputSplitAssigner getInputSplitAssigner(FileInputSplit[] inputSplits)

Description copied from interface: InputPartitioner

Return the input split asigner

Specified by:

getInputSplitAssigner in interface InputPartitioner<java.lang.String,FileInputSplit<java.lang.String>>

Overrides:

getInputSplitAssigner in class CSVInputPartitioner<java.lang.String>

Parameters:

inputSplits - the input splits to be assigned

Returns:

assigner