edu.iu.dsc.tws.comms.utils

Class SortJoinUtils

java.lang.Object

edu.iu.dsc.tws.comms.utils.SortJoinUtils

public final class SortJoinUtils
extends java.lang.Object

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	SortJoinUtils.ListBasedRestorableIterator

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	CONFIG_USE_SORT_JOIN_CACHE

Method Summary

Modifier and Type	Method and Description
static java.util.List<java.lang.Object>	fullOuterJoin(java.util.List<Tuple> leftRelation, java.util.List<Tuple> rightRelation, KeyComparatorWrapper comparator) Full Outer join the left and right relation using the tuple key
static java.util.Iterator<JoinedTuple>	fullOuterJoin(RestorableIterator<Tuple<?,?>> leftIt, RestorableIterator<Tuple<?,?>> rightIt, KeyComparatorWrapper comparator) Full Outer join the left and right relation using the tuple key
static java.util.List<java.lang.Object>	innerJoin(java.util.List<Tuple> leftRelation, java.util.List<Tuple> rightRelation, KeyComparatorWrapper comparator) Inner join the left and right relation using the tuple key
static java.util.Iterator<JoinedTuple>	innerJoin(RestorableIterator<Tuple<?,?>> leftIt, RestorableIterator<Tuple<?,?>> rightIt, KeyComparatorWrapper comparator) This util can be used to perform disk based inner join operations.
static java.util.Iterator<JoinedTuple>	join(java.util.List<Tuple> leftRelation, java.util.List<Tuple> rightRelation, KeyComparatorWrapper comparator, CommunicationContext.JoinType joinType)
static java.util.Iterator<JoinedTuple>	join(RestorableIterator<Tuple<?,?>> leftIt, RestorableIterator<Tuple<?,?>> rightIt, KeyComparatorWrapper comparator, CommunicationContext.JoinType joinType)
static java.util.Iterator<JoinedTuple>	joinWithCache(RestorableIterator<Tuple<?,?>> leftIt, RestorableIterator<Tuple<?,?>> rightIt, KeyComparatorWrapper comparator, CommunicationContext.JoinType joinType, Config config) This method avoid having to scan back and forth of the files by reading data iterators once and backup them into a DiskBasedList, which has a memory buffer
static java.util.List<java.lang.Object>	leftOuterJoin(java.util.List<Tuple> leftRelation, java.util.List<Tuple> rightRelation, KeyComparatorWrapper comparator) Left Outer join the left and right relation using the tuple key
static java.util.Iterator<JoinedTuple>	leftOuterJoin(RestorableIterator<Tuple<?,?>> leftIt, RestorableIterator<Tuple<?,?>> rightIt, KeyComparatorWrapper comparator) Left Outer join the left and right relation using the tuple key
static java.util.Iterator<JoinedTuple>	outerJoin(RestorableIterator<Tuple<?,?>> leftIt, RestorableIterator<Tuple<?,?>> rightIt, KeyComparatorWrapper comparator, CommunicationContext.JoinType outerJoinType) This util can be used to perform disk based inner join operations.
static java.util.List<java.lang.Object>	rightOuterJoin(java.util.List<Tuple> leftRelation, java.util.List<Tuple> rightRelation, KeyComparatorWrapper comparator) Right Outer join the left and right relation using the tuple key
static java.util.Iterator<JoinedTuple>	rightOuterJoin(RestorableIterator<Tuple<?,?>> leftIt, RestorableIterator<Tuple<?,?>> rightIt, KeyComparatorWrapper comparator) Right Outer join the left and right relation using the tuple key

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CONFIG_USE_SORT_JOIN_CACHE

public static final java.lang.String CONFIG_USE_SORT_JOIN_CACHE

See Also:

Constant Field Values

Method Detail

join

public static java.util.Iterator<JoinedTuple> join(java.util.List<Tuple> leftRelation,
                                                   java.util.List<Tuple> rightRelation,
                                                   KeyComparatorWrapper comparator,
                                                   CommunicationContext.JoinType joinType)

join

public static java.util.Iterator<JoinedTuple> join(RestorableIterator<Tuple<?,?>> leftIt,
                                                   RestorableIterator<Tuple<?,?>> rightIt,
                                                   KeyComparatorWrapper comparator,
                                                   CommunicationContext.JoinType joinType)

innerJoin

public static java.util.List<java.lang.Object> innerJoin(java.util.List<Tuple> leftRelation,
                                                         java.util.List<Tuple> rightRelation,
                                                         KeyComparatorWrapper comparator)

Inner join the left and right relation using the tuple key

Parameters:

leftRelation - left relation

rightRelation - right relation

comparator - comparator

Returns:

the joined relation

joinWithCache

public static java.util.Iterator<JoinedTuple> joinWithCache(RestorableIterator<Tuple<?,?>> leftIt,
                                                            RestorableIterator<Tuple<?,?>> rightIt,
                                                            KeyComparatorWrapper comparator,
                                                            CommunicationContext.JoinType joinType,
                                                            Config config)

This method avoid having to scan back and forth of the files by reading data iterators once and backup them into a DiskBasedList, which has a memory buffer

innerJoin

public static java.util.Iterator<JoinedTuple> innerJoin(RestorableIterator<Tuple<?,?>> leftIt,
                                                        RestorableIterator<Tuple<?,?>> rightIt,
                                                        KeyComparatorWrapper comparator)

This util can be used to perform disk based inner join operations.

outerJoin

public static java.util.Iterator<JoinedTuple> outerJoin(RestorableIterator<Tuple<?,?>> leftIt,
                                                        RestorableIterator<Tuple<?,?>> rightIt,
                                                        KeyComparatorWrapper comparator,
                                                        CommunicationContext.JoinType outerJoinType)

This util can be used to perform disk based inner join operations.

fullOuterJoin

public static java.util.Iterator<JoinedTuple> fullOuterJoin(RestorableIterator<Tuple<?,?>> leftIt,
                                                            RestorableIterator<Tuple<?,?>> rightIt,
                                                            KeyComparatorWrapper comparator)

Full Outer join the left and right relation using the tuple key

leftOuterJoin

public static java.util.Iterator<JoinedTuple> leftOuterJoin(RestorableIterator<Tuple<?,?>> leftIt,
                                                            RestorableIterator<Tuple<?,?>> rightIt,
                                                            KeyComparatorWrapper comparator)

Left Outer join the left and right relation using the tuple key

rightOuterJoin

public static java.util.Iterator<JoinedTuple> rightOuterJoin(RestorableIterator<Tuple<?,?>> leftIt,
                                                             RestorableIterator<Tuple<?,?>> rightIt,
                                                             KeyComparatorWrapper comparator)

Right Outer join the left and right relation using the tuple key

fullOuterJoin

public static java.util.List<java.lang.Object> fullOuterJoin(java.util.List<Tuple> leftRelation,
                                                             java.util.List<Tuple> rightRelation,
                                                             KeyComparatorWrapper comparator)

Full Outer join the left and right relation using the tuple key

leftOuterJoin

public static java.util.List<java.lang.Object> leftOuterJoin(java.util.List<Tuple> leftRelation,
                                                             java.util.List<Tuple> rightRelation,
                                                             KeyComparatorWrapper comparator)

Left Outer join the left and right relation using the tuple key

rightOuterJoin

public static java.util.List<java.lang.Object> rightOuterJoin(java.util.List<Tuple> leftRelation,
                                                              java.util.List<Tuple> rightRelation,
                                                              KeyComparatorWrapper comparator)

Right Outer join the left and right relation using the tuple key