edu.iu.dsc.tws.data.api.splits

Class ArrowInputSplit

java.lang.Object

edu.iu.dsc.tws.data.api.splits.LocatableInputSplit<OT>

edu.iu.dsc.tws.data.api.splits.FileInputSplit<java.lang.Object>

edu.iu.dsc.tws.data.api.splits.ArrowInputSplit

All Implemented Interfaces:

InputSplit<java.lang.Object>, java.io.Serializable

public class ArrowInputSplit
extends FileInputSplit<java.lang.Object>

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class edu.iu.dsc.tws.data.api.splits.FileInputSplit

FileInputSplit.InputSplitOpenThread

Field Summary

Fields inherited from class edu.iu.dsc.tws.data.api.splits.FileInputSplit

enumerateNestedFiles, MAX_SPLIT_SIZE_DISCREPANCY, minSplitSize, numSplits, openTimeout, splitLength, splitStart, stream

Constructor Summary

Constructors

Constructor and Description
ArrowInputSplit(int num, Path file, long start, long length, java.lang.String[] hosts)
ArrowInputSplit(int num, Path file, java.lang.String[] hosts)

Method Summary

Modifier and Type	Method and Description
java.lang.Object	nextRecord(java.lang.Object reuse) Reads the next record from the input.
boolean	reachedEnd() Method used to check if the end of the input is reached.

Methods inherited from class edu.iu.dsc.tws.data.api.splits.FileInputSplit

close, configure, equals, getLength, getMinSplitSize, getNumSplits, getPath, getStart, hashCode, isEnumerateNestedFiles, open, open, setEnumerateNestedFiles, setMinSplitSize, setNumSplits, toString

Methods inherited from class edu.iu.dsc.tws.data.api.splits.LocatableInputSplit

getHostnames, getSplitNumber

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

ArrowInputSplit

public ArrowInputSplit(int num,
                       Path file,
                       long start,
                       long length,
                       java.lang.String[] hosts)

ArrowInputSplit

public ArrowInputSplit(int num,
                       Path file,
                       java.lang.String[] hosts)

Method Detail

reachedEnd

public boolean reachedEnd()
                   throws java.io.IOException

Description copied from interface: InputSplit

Method used to check if the end of the input is reached.

When this method is called, the input format it guaranteed to be opened.

Returns:

True if the end is reached, otherwise false.

Throws:

java.io.IOException - Thrown, if an I/O error occurred.

nextRecord

public java.lang.Object nextRecord(java.lang.Object reuse)
                            throws java.io.IOException

Description copied from interface: InputSplit

Reads the next record from the input.

When this method is called, the input format it guaranteed to be opened.

Parameters:

reuse - Object that may be reused.

Returns:

Read record.

Throws:

java.io.IOException - Thrown, if an I/O error occurred.