edu.iu.dsc.tws.tset.fn.impl

Class ArrowBasedSinkFunction<T>

java.lang.Object

edu.iu.dsc.tws.api.tset.fn.BaseTFunction<T,T>

edu.iu.dsc.tws.api.tset.fn.BaseSinkFunc<java.util.Iterator<T>>

edu.iu.dsc.tws.tset.fn.impl.ArrowBasedSinkFunction<T>

Type Parameters:

T -

All Implemented Interfaces:

SinkFunc<java.util.Iterator<T>>, TFunction<java.util.Iterator<T>,java.util.Iterator<T>>, java.io.Serializable

public class ArrowBasedSinkFunction<T>
extends BaseSinkFunc<java.util.Iterator<T>>
implements java.io.Serializable

This class is responsible for calling the twister2 arrow file writer class and add the data to the list in the arrow file writer and commit the data.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
ArrowBasedSinkFunction(java.lang.String filepath, java.lang.String filename, java.lang.String schema)

Method Summary

Modifier and Type	Method and Description
boolean	add(java.util.Iterator<T> value) Every time an edge produces a value, this method is called.
void	close()
void	prepare(TSetContext context) Prepare the function.

Methods inherited from class edu.iu.dsc.tws.api.tset.fn.BaseTFunction

getInput, getTSetContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface edu.iu.dsc.tws.api.tset.fn.SinkFunc

get

Methods inherited from interface edu.iu.dsc.tws.api.tset.fn.TFunction

end

Constructor Detail

ArrowBasedSinkFunction

public ArrowBasedSinkFunction(java.lang.String filepath,
                              java.lang.String filename,
                              java.lang.String schema)

Method Detail

prepare

public void prepare(TSetContext context)

Description copied from interface: TFunction

Prepare the function. Use this context in case you need to add/get inputs

Specified by:

prepare in interface TFunction<java.util.Iterator<T>,java.util.Iterator<T>>

Overrides:

prepare in class BaseTFunction<java.util.Iterator<T>,java.util.Iterator<T>>

Parameters:

context - CONTEXT

close

public void close()

Specified by:

close in interface TFunction<java.util.Iterator<T>,java.util.Iterator<T>>

add

public boolean add(java.util.Iterator<T> value)

Description copied from interface: SinkFunc

Every time an edge produces a value, this method is called.

Specified by:

add in interface SinkFunc<java.util.Iterator<T>>

Parameters:

value - the value to add

Returns:

true if success