Skip navigation links
A B C D E F G H I J K L M N O P Q R S T U V W X Y Z 

A

AbstractIterableDataCompute<T> - Class in edu.iu.dsc.tws.task.typed
 
AbstractIterableDataCompute() - Constructor for class edu.iu.dsc.tws.task.typed.AbstractIterableDataCompute
 
AbstractKeyedOpsConfig<T extends AbstractOpsConfig> - Class in edu.iu.dsc.tws.task.impl.ops
 
AbstractKeyedOpsConfig(String, String, ComputeConnection) - Constructor for class edu.iu.dsc.tws.task.impl.ops.AbstractKeyedOpsConfig
 
AbstractListDataCompute<T> - Class in edu.iu.dsc.tws.task.window.core
 
AbstractListDataCompute() - Constructor for class edu.iu.dsc.tws.task.window.core.AbstractListDataCompute
 
AbstractMemoryManager - Class in edu.iu.dsc.tws.data.memory
Abstract Memory Manager.
AbstractMemoryManager() - Constructor for class edu.iu.dsc.tws.data.memory.AbstractMemoryManager
 
AbstractOp - Interface in edu.iu.dsc.tws.comms.functions.reduction
 
AbstractOpsConfig<T extends AbstractOpsConfig> - Class in edu.iu.dsc.tws.task.impl.ops
 
AbstractOpsConfig(String, String, ComputeConnection) - Constructor for class edu.iu.dsc.tws.task.impl.ops.AbstractOpsConfig
 
AbstractParallelOperation - Class in edu.iu.dsc.tws.executor.comms
 
AbstractParallelOperation(Config, Communicator, LogicalPlan, String) - Constructor for class edu.iu.dsc.tws.executor.comms.AbstractParallelOperation
 
AbstractPythonProcessor - Class in edu.iu.dsc.tws.python.processors
 
AbstractSingleDataCompute<T> - Class in edu.iu.dsc.tws.task.typed
 
AbstractSingleDataCompute() - Constructor for class edu.iu.dsc.tws.task.typed.AbstractSingleDataCompute
 
AbstractSingleWindowDataCompute<T> - Class in edu.iu.dsc.tws.task.window.core
 
AbstractSingleWindowDataCompute() - Constructor for class edu.iu.dsc.tws.task.window.core.AbstractSingleWindowDataCompute
 
AbstractSingleWindowDataSink<T> - Class in edu.iu.dsc.tws.task.window.core
 
AbstractSingleWindowDataSink() - Constructor for class edu.iu.dsc.tws.task.window.core.AbstractSingleWindowDataSink
 
AcceptingData<T> - Interface in edu.iu.dsc.tws.api.tset.sets
Adds the capability for TSets to accept data from another TSet as an input.
AccuracyAverager - Class in edu.iu.dsc.tws.examples.ml.svm.tset
 
AccuracyAverager(int) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.tset.AccuracyAverager
 
ack(Object) - Method in class org.apache.storm.spout.CheckpointSpout
 
ack(Object) - Method in interface org.apache.storm.spout.ISpout
Storm has determined that the tuple emitted by this spout with the msgId identifier has been fully processed.
ack(Tuple) - Method in interface org.apache.storm.task.IOutputCollector
 
ack(Tuple) - Method in class org.apache.storm.task.OutputCollector
 
ack(Object) - Method in class org.apache.storm.topology.base.BaseRichSpout
 
Action - Enum in edu.iu.dsc.tws.task.window.constant
 
activate() - Method in interface org.apache.storm.spout.ISpout
Called when a spout has been activated out of a deactivated mode.
activate() - Method in class org.apache.storm.topology.base.BaseRichSpout
 
active() - Method in class edu.iu.dsc.tws.common.zk.JobWithState
 
add(String, DataObject<?>) - Method in interface edu.iu.dsc.tws.api.compute.modifiers.Receptor
Deprecated.
add(String, DataPartition<?>) - Method in interface edu.iu.dsc.tws.api.compute.modifiers.Receptor
 
add(T) - Method in interface edu.iu.dsc.tws.api.tset.fn.SinkFunc
Every time an edge produces a value, this method is called.
add(Row) - Method in class edu.iu.dsc.tws.common.table.ArrowTableBuilder
 
add(Row) - Method in interface edu.iu.dsc.tws.common.table.TableBuilder
Add a row to build the tbale
add(T) - Method in class edu.iu.dsc.tws.common.util.IterativeLinkedList
Add the element at the end of the list
add(T) - Method in class edu.iu.dsc.tws.common.util.IterativeLinkedList.ILLIterator
Add the element to list
add(Tuple) - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedMerger
 
add(Object, byte[], int) - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedMerger
Add the data to the file
add(Object, byte[], int) - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMerger
Add the data to the file
add(Tuple) - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMerger2
Add the data to the file
add(Object, byte[], int) - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMerger2
Add the data to the file
add(byte[], int) - Method in class edu.iu.dsc.tws.comms.shuffle.FSMerger
Add the data to the file
add(Tuple) - Method in interface edu.iu.dsc.tws.comms.shuffle.Shuffle
Add tuple with byte value and key
add(Object, byte[], int) - Method in interface edu.iu.dsc.tws.comms.shuffle.Shuffle
Add an object with a key
add(byte[], int) - Method in interface edu.iu.dsc.tws.comms.shuffle.Shuffle
Add object
add(Object) - Method in class edu.iu.dsc.tws.comms.utils.DiskBasedList
 
add(int, Object) - Method in class edu.iu.dsc.tws.comms.utils.DiskBasedList
 
add(int, T) - Method in class edu.iu.dsc.tws.dataset.DataSink
 
add(T) - Method in class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
 
add(T) - Method in class edu.iu.dsc.tws.dataset.partition.CollectionPartition
 
add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.batch.cdfw.KMeansConnectedDataflowExample.KMeansSourceTask
 
add(String, DataPartition<?>) - Method in class edu.iu.dsc.tws.examples.batch.cdfw.KMeansConnectedDataflowExample.KMeansSourceTask
 
add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.batch.kmeans.CSVInputFormatTest.TestSource
 
add(String, DataPartition<?>) - Method in class edu.iu.dsc.tws.examples.batch.kmeans.KMeansComputeJob.KMeansSourceTask
 
add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.ml.svm.compute.IterativeStreamingCompute
 
add(String, DataObject<?>) - Method in interface edu.iu.dsc.tws.examples.ml.svm.integration.test.IReceptor
This method is called when the data is available
add(double[], double[]) - Static method in class edu.iu.dsc.tws.examples.ml.svm.math.Matrix
 
add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.ml.svm.streamer.InputDataStreamer
 
add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.ml.svm.streamer.IterativeDataStream
 
add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.ml.svm.streamer.IterativePredictionDataStreamer
 
add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.ml.svm.streamer.IterativeStreamingDataStreamer
 
add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.ml.svm.test.PredictionSourceTask
 
add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation.SourceTask
 
add(String, DataPartition<?>) - Method in class edu.iu.dsc.tws.task.cdfw.task.ConnectedSource
 
add(IMessage<T>) - Method in interface edu.iu.dsc.tws.task.window.manage.IManager
 
add(IMessage<T>) - Method in class edu.iu.dsc.tws.task.window.manage.WindowManager
 
add(IMessage<T>, long) - Method in class edu.iu.dsc.tws.task.window.manage.WindowManager
 
add(Event<T>) - Method in class edu.iu.dsc.tws.task.window.manage.WindowManager
 
add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.tsched.utils.TaskSchedulerClassTest.TestSource
 
add(Iterator<T>) - Method in class edu.iu.dsc.tws.tset.fn.impl.ArrowBasedSinkFunction
 
add(String, DataPartition<?>) - Method in class edu.iu.dsc.tws.tset.ops.BaseOp
 
add(String, DataPartition<?>) - Method in class edu.iu.dsc.tws.tset.ops.WindowComputeOp
 
add(T) - Method in class edu.iu.dsc.tws.tset.sinks.CacheSingleSink
 
add(T) - Method in class edu.iu.dsc.tws.tset.sinks.DiskPersistSingleSink
 
add(Iterator<T>) - Method in class edu.iu.dsc.tws.tset.sinks.FileIterSink
 
add(T) - Method in class edu.iu.dsc.tws.tset.sinks.FileSink
 
add(Iterator<T>) - Method in class edu.iu.dsc.tws.tset.sinks.StoreIterSink
 
add(T) - Method in class edu.iu.dsc.tws.tset.sinks.StreamingCacheSink
 
add(T) - Method in class edu.iu.dsc.tws.tset.sinks.StreamingDiskPersistSink
 
add(T) - Method in class org.apache.beam.runners.twister2.translators.functions.SideInputSinkFunction
 
add(T) - Method in class org.apache.beam.runners.twister2.translators.functions.Twister2SinkFunction
 
add(T) - Method in class org.apache.storm.windowing.WindowManager
Add an event into the window, with System.currentTimeMillis() as the tracking ts.
add(T, long) - Method in class org.apache.storm.windowing.WindowManager
Add an event into the window, with the given ts as the tracking ts.
add(Event<T>) - Method in class org.apache.storm.windowing.WindowManager
Tracks a window event
addAll(Collection) - Method in class edu.iu.dsc.tws.comms.utils.DiskBasedList
 
addAll(int, Collection) - Method in class edu.iu.dsc.tws.comms.utils.DiskBasedList
 
addAll(Collection<T>) - Method in class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
 
addAll(Collection<T>) - Method in class edu.iu.dsc.tws.dataset.partition.CollectionPartition
 
addAllJoinedListener(IAllJoinedListener) - Method in class edu.iu.dsc.tws.common.zk.ZKWorkerController
add a single IAllJoinedListener if additional IAllJoinedListener tried to be added, do not add and return false
addAllJoinedListener(IAllJoinedListener) - Static method in class edu.iu.dsc.tws.master.worker.JMWorkerAgent
only one IAllJoinedListener can be added if the second IAllJoinedListener tried to be added, false returned
addAllJoinedListener(IAllJoinedListener) - Static method in class edu.iu.dsc.tws.rsched.core.WorkerRuntime
Add IAllJoinedListener It may return false, if a listener already added
addAllJoinedListener(IAllJoinedListener) - Method in class edu.iu.dsc.tws.rsched.schedulers.standalone.MPIWorkerController
 
addAllProperties(Map<String, Object>) - Method in class edu.iu.dsc.tws.common.net.NetworkInfo
 
addBuffer(DataBuffer) - Method in class edu.iu.dsc.tws.api.comms.messaging.ChannelMessage
 
addBufferAndCalculate(DataBuffer) - Method in class edu.iu.dsc.tws.comms.dfw.InMessage
Add a buffer and calculate weather we have seen all the buffers for an object
addBuffers(List<DataBuffer>) - Method in class edu.iu.dsc.tws.api.comms.messaging.ChannelMessage
 
addBuiltMessage(ChannelMessage) - Method in class edu.iu.dsc.tws.comms.dfw.InMessage
 
addChild(Node) - Method in class edu.iu.dsc.tws.comms.routing.Node
 
addChildren(List<Node>) - Method in class edu.iu.dsc.tws.comms.routing.Node
 
addChildToGraph(TBase) - Method in class edu.iu.dsc.tws.tset.links.BaseTLink
 
addChildToGraph(TBase) - Method in class edu.iu.dsc.tws.tset.sets.BaseTSet
 
addChildToGraph(TBase, TBase) - Method in class edu.iu.dsc.tws.tset.sets.BaseTSet
 
addCompute(String, ICompute) - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
Add a compute node to the graph
addCompute(String, ICompute, int) - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
Add a compute node to the graph
addComputeResource(double, int, int) - Method in class edu.iu.dsc.tws.api.Twister2Job.Twister2JobBuilder
 
addComputeResource(double, int, int, boolean) - Method in class edu.iu.dsc.tws.api.Twister2Job.Twister2JobBuilder
 
addComputeResource(double, int, double, int) - Method in class edu.iu.dsc.tws.api.Twister2Job.Twister2JobBuilder
 
addComputeResource(double, int, double, int, boolean) - Method in class edu.iu.dsc.tws.api.Twister2Job.Twister2JobBuilder
 
addComputeResource(double, int, double, int, int) - Method in class edu.iu.dsc.tws.api.Twister2Job.Twister2JobBuilder
 
addComputeResource(double, int, double, int, boolean, int) - Method in class edu.iu.dsc.tws.api.Twister2Job.Twister2JobBuilder
 
addConfig(String, Object) - Method in class edu.iu.dsc.tws.python.BootstrapPoint
 
addConfigMapParam(String, String, String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
add a new parameter the job ConfigMap
addConfiguration(String, Object) - Method in class edu.iu.dsc.tws.api.compute.graph.Vertex
 
addConfiguration(String, String, Object) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
 
addConfiguration(String, Object) - Method in interface org.apache.storm.topology.ComponentConfigurationDeclarer
 
addConfiguration(String, Object) - Method in class org.apache.storm.topology.twister2.Twister2BoltDeclarer
 
addConfiguration(String, Object) - Method in class org.apache.storm.topology.twister2.Twister2SpoutDeclarer
 
addConfigurations(Map) - Method in interface org.apache.storm.topology.ComponentConfigurationDeclarer
 
addConfigurations(Map) - Method in class org.apache.storm.topology.twister2.Twister2BoltDeclarer
 
addConfigurations(Map) - Method in class org.apache.storm.topology.twister2.Twister2SpoutDeclarer
 
addCreatedStatefulSetName(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.JobSubmissionStatus
 
addCurrentKeyedObject() - Method in class edu.iu.dsc.tws.comms.dfw.InMessage
 
addCurrentObject() - Method in class edu.iu.dsc.tws.comms.dfw.InMessage
 
addDataFlowJobConfig(DataFlowJobConfig) - Method in class edu.iu.dsc.tws.task.cdfw.DataFlowGraph
 
addDirectChild(int) - Method in class edu.iu.dsc.tws.comms.routing.Node
 
addDirectChildren(List<Integer>) - Method in class edu.iu.dsc.tws.comms.routing.Node
 
addDirectoryToArchive(String) - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
add all files in the given directory to the tar.gz file add the given prefix to all files in tar names do not copy files recursively.
addEdge(DefaultEdge) - Method in class edu.iu.dsc.tws.graphapi.vertex.DefaultVertex
 
addEdge(DefaultEdge) - Method in class edu.iu.dsc.tws.graphapi.vertex.SsspDefaultVertex
 
addEdge(E) - Method in interface edu.iu.dsc.tws.graphapi.vertex.Vertex
Add an edge for this vertex (happens immediately)
addEdge() - Method in class edu.iu.dsc.tws.tset.test.graph.BasicGraphTests
 
addExternalRoute(int) - Method in class edu.iu.dsc.tws.comms.dfw.RoutingParameters
 
addExternalRoutes(Collection<Integer>) - Method in class edu.iu.dsc.tws.comms.dfw.RoutingParameters
 
addFailureListener(IWorkerFailureListener) - Method in class edu.iu.dsc.tws.common.zk.ZKWorkerController
add a single IWorkerFailureListener if additional IWorkerFailureListener tried to be added, do not add and return false
addFileToArchive(String) - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
add one file to tar.gz file
addFileToArchive(File, String) - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
add one file to tar.gz file
addFileToArchive(String, byte[]) - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
add one file to tar.gz file file is created from the given byte array
addGraphConstraints(Map<String, String>) - Method in class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
 
addGraphConstraints(String, String) - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
Adding Graph Constraints
addGraphConstraints(Map<String, String>) - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
Adding Graph Constraints
addInboundFieldsForEdge(String, Fields) - Method in class org.apache.storm.topology.twister2.Twister2Bolt
 
addInput(String, StorableTBase<?>) - Method in interface edu.iu.dsc.tws.api.tset.sets.AcceptingData
Allows users to pass in other TSets as inputs for a TSet
addInput(String, StorableTBase<?>) - Method in interface edu.iu.dsc.tws.api.tset.sets.batch.BatchTSet
Adds data to this TSet
addInput(String, StorableTBase<?>) - Method in interface edu.iu.dsc.tws.api.tset.sets.batch.BatchTupleTSet
Adds inputs to BatchTupleTSets
addInput(String, DataPartition<?>) - Method in class edu.iu.dsc.tws.api.tset.TSetContext
Adds a input object into the map
addInput(String, String, String) - Method in class edu.iu.dsc.tws.task.cdfw.DataFlowGraph
 
addInput(ComputeGraph, ExecutionPlan, String, String, DataObject<?>) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
Deprecated.
Inputs are automatically handled now
addInput(IExecutor, String, String, DataObject<?>) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
Deprecated.
Inputs are automatically handled now
addInput(String, DataObject) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
 
addInput(String, String, String) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
Adds a TSet to another TSet as an input that will be identified by the inputKey
addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.BatchTSetImpl
 
addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.BatchTupleTSetImpl
 
addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.CachedTSet
 
addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.ComputeTSet
 
addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.KeyedPersistedTSet
 
addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.KeyedSourceTSet
 
addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.PersistedTSet
 
addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.row.BatchRowTSetImpl
 
addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.row.RowPersistedTSet
 
addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.row.RowSinkTSet
 
addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.SinkTSet
 
addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.SourceTSet
 
addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.StoredTSet
 
addInputMap(Map<String, DataPartition<?>>) - Method in class edu.iu.dsc.tws.api.tset.TSetContext
Adds the given map into TSetContext.inputMap
AddInputsExample - Class in edu.iu.dsc.tws.examples.tset.batch
 
AddInputsExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.AddInputsExample
 
addInstance(Integer, String) - Method in class edu.iu.dsc.tws.tsched.builder.TaskSchedulePlanBuilder
 
addInstance(Scorer<Container>, String) - Method in class edu.iu.dsc.tws.tsched.builder.TaskSchedulePlanBuilder
It will add the task instance to the container based on the container score value.
addInteranlRoute(int) - Method in class edu.iu.dsc.tws.comms.dfw.RoutingParameters
 
addInternalRoutes(Collection<Integer>) - Method in class edu.iu.dsc.tws.comms.dfw.RoutingParameters
 
ADDITIONAL_PORTS - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
 
additionalPorts(Config) - Static method in class edu.iu.dsc.tws.api.config.SchedulerContext
 
addJMFailureListener(IJobMasterFailureListener) - Method in class edu.iu.dsc.tws.common.zk.ZKWorkerController
TODO: jm restarted implemented, but jm failed not implemented yet Supports multiple IJobMasterFailureListeners
addJMFailureListener(IJobMasterFailureListener) - Static method in class edu.iu.dsc.tws.rsched.core.WorkerRuntime
add a IJobMasterFailureListener Currently failure notification is only implemented with ZKWorkerController A listener can be only added when ZKWorkerController is used.
addJobClass(String) - Method in class edu.iu.dsc.tws.local.util.LocalClassLoader
 
addJobEndListener(JobEndListener) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.client.JobEndWatcher
add a listener
addJobFaultListener(JobFaultListener) - Method in class edu.iu.dsc.tws.master.server.JobFailureWatcher
 
addJoinedWorkers(List<WorkerWithState>) - Method in class edu.iu.dsc.tws.master.server.WorkerMonitor
when the job master restarts, it adds already joined workers with this method.
addLoggingHandler(Handler) - Static method in class edu.iu.dsc.tws.common.logging.LoggingHelper
 
addLogicalIdToWorker(int, int) - Method in class edu.iu.dsc.tws.api.comms.LogicalPlan
 
addMessage(int, List<Object>, Object) - Method in class edu.iu.dsc.tws.comms.dfw.io.allgather.BcastGatheStreamingReceiver
 
addMessage(int, List<Object>, Object) - Method in class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastBatchFinalReceiver
 
addMessage(int, List<Object>, Object) - Method in class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastStreamingFinalReceiver
 
addMessage(int, List<Object>, Object) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetPartialReceiver
 
addMessage(int, List<Object>, Object) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetReceiver
 
addNode(T) - Method in class edu.iu.dsc.tws.tset.graph.DAGMutableGraph
 
addNode(T) - Method in interface edu.iu.dsc.tws.tset.graph.MutableGraph
Adds node if it is not already present.
addNode() - Method in class edu.iu.dsc.tws.tset.test.graph.BasicGraphTests
 
addNodeConstraints(Map<String, Map<String, String>>) - Method in class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
 
addNodeConstraints(String, Map<String, String>) - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
 
addNodes(String, int, INodeInstance) - Method in class edu.iu.dsc.tws.api.compute.executor.ExecutionPlan
Add a node instance of this execution
addOperation(int, DataMessageType) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
 
addOperation(int, DataMessageType, DataMessageType) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
 
addOperation(int, DataMessageType) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
At this level the method does not return an OperationMemoryManager since the implementaion does not handle OperationMemoryManager's
addOperation(int, DataMessageType, DataMessageType) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
 
addOperation(int, DataMessageType) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
Add an memory manager instance for the given operation
addOperation(int, DataMessageType, DataMessageType) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
 
addOps(IParallelOperation) - Method in class edu.iu.dsc.tws.api.compute.executor.ExecutionPlan
 
addOutput(String, String) - Method in class edu.iu.dsc.tws.task.cdfw.DataFlowGraph
 
addOverFlowBuffers(List<DataBuffer>) - Method in class edu.iu.dsc.tws.api.comms.messaging.ChannelMessage
 
addPartition(DataPartition<T>) - Method in interface edu.iu.dsc.tws.api.dataset.DataObject
Add a partition to the data object
addPartition(DataPartition) - Method in class edu.iu.dsc.tws.api.dataset.EmptyDataObject
 
addPartition(DataPartition<T>) - Method in class edu.iu.dsc.tws.dataset.DataObjectImpl
 
addProperties(Map<String, Object>) - Method in class edu.iu.dsc.tws.api.compute.graph.Edge
Add the properties to the edge
addProperty(String, Object) - Method in class edu.iu.dsc.tws.api.compute.graph.Edge
Add a property to the edge
addProperty(String, Object) - Method in class edu.iu.dsc.tws.api.compute.schedule.elements.Worker
 
addProperty(String, Object) - Method in class edu.iu.dsc.tws.common.net.NetworkInfo
 
addReadRequest(TCPMessage) - Method in class edu.iu.dsc.tws.common.net.tcp.BaseNetworkChannel
 
addReadRequest(TCPMessage) - Method in class edu.iu.dsc.tws.common.net.tcp.DynamicBufferChannel
 
addReadRequest(TCPMessage) - Method in class edu.iu.dsc.tws.common.net.tcp.FixedBufferChannel
 
addReceiverFromDriver(IReceiverFromDriver) - Method in class edu.iu.dsc.tws.master.worker.JMDriverAgent
only one IReceiverFromDriver can be added if the second IReceiverFromDriver tried to be added, returns false
addReceiverFromDriver(IReceiverFromDriver) - Static method in class edu.iu.dsc.tws.master.worker.JMWorkerAgent
only one IReceiverFromDriver can be added if the second IReceiverFromDriver tried to be added, returns false
addReceiverFromDriver(IReceiverFromDriver) - Static method in class edu.iu.dsc.tws.rsched.core.WorkerRuntime
Add IReceiverFromDriver It may return false, if a listener already added or if there is no Driver in the job
addRuntimeObject(String, Object) - Static method in class edu.iu.dsc.tws.api.config.MPIContext
 
addScalerListener(IScalerListener) - Method in class edu.iu.dsc.tws.common.zk.ZKWorkerController
add a single IScalerListener if additional IScalerListener tried to be added, do not add and return false
addScalerListener(IScalerListener) - Static method in class edu.iu.dsc.tws.master.worker.JMWorkerAgent
only one IScalerListener can be added if the second IScalerListener tried to be added, false returned
addScalerListener(IScalerListener) - Static method in class edu.iu.dsc.tws.rsched.core.WorkerRuntime
Add IScalerListener It may return false, if a listener already added or if there is no Driver in the job
addShutdownHook(boolean) - Method in class edu.iu.dsc.tws.master.server.JobMaster
A job can be terminated in two ways: a) workers end a job: workers either successfully complete or fail all workers complete their work and send COMPLETED messages to the Job Master.
addShutdownHook(IWorkerStatusUpdater) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.worker.K8sWorkerStarter
if the worker is killed by scaling down, we need to let ZooKeeper know about it and delete worker znode if zookeeper is used
addSource(String, ISource) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
 
addSource(String, ISource, int) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
 
addSource(String, ISource) - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
Add a source node to the graph
addSource(String, ISource, int) - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
Add a source node to the graph
addSourceInput(ComputeGraph, ExecutionPlan, String, DataObject<Object>) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
Deprecated.
Inputs are handled automatically now
addSourceInput(IExecutor, String, DataObject<Object>) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
Deprecated.
Inputs are handled automatically now
addSourceTSet(BuildableTSet) - Method in class edu.iu.dsc.tws.tset.TBaseGraph
Specific method to add sources
addState(int) - Method in class edu.iu.dsc.tws.executor.core.batch.InstanceState
 
addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.allgather.BcastGatherBatchReceiver
 
addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.allgather.BcastGatheStreamingReceiver
 
addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastBatchFinalReceiver
 
addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastStreamingFinalReceiver
 
addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.direct.DirectBatchFinalReceiver
 
addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.direct.DirectStreamingFinalReceiver
 
addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.partition.PartitionPartialReceiver
 
addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetFinalReceiver
 
addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetPartialReceiver
 
addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetReceiver
Add a sync message
addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.allgather.BcastGatherBatchReceiver
 
addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.allgather.BcastGatheStreamingReceiver
 
addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastBatchFinalReceiver
 
addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastStreamingFinalReceiver
 
addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.direct.DirectBatchFinalReceiver
 
addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.direct.DirectStreamingFinalReceiver
 
addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetFinalReceiver
 
addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetPartialReceiver
 
addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetReceiver
Add a sync message
addTarGzipToArchive(String) - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
given tar.gz file will be copied to this tar.gz file.
addTask(String, ICompute) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
 
addTask(String, ICompute, int) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
 
addTaskEdge(TV, TV) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
If the task edge is not null and the task edge is not available in the task edge set, it will add the task edge to the edge set.
addTaskEdge(TV, TV, TE) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
This method first check whether the task edge is null or not, then it will validate both the source and target vertex and create the directed dataflow edge between those task vertices.
addTaskEdge(TV, TV) - Method in interface edu.iu.dsc.tws.api.compute.graph.ITaskGraph
This method receives the source and target task vertex and create the task edge between the source and target task vertex.
addTaskEdge(TV, TV, TE) - Method in interface edu.iu.dsc.tws.api.compute.graph.ITaskGraph
This method returns true if the task edge is created between the source task vertex and target task vertex.
addTaskVertex(TV) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
If the task vertex is not null and the task vertex is not available in the task vertex set, it will add the task vertex to the vertices set.
addTaskVertex(String, Vertex) - Method in class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
This method is responsible for adding the task vertex to the task map.
addTaskVertex(TV) - Method in interface edu.iu.dsc.tws.api.compute.graph.ITaskGraph
This method returns true if the task vertex is created successfully in the graph.
addToBuffer(ByteBuffer, byte[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ByteArrayPacker
 
addToBuffer(ByteBuffer, int, byte[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ByteArrayPacker
 
addToBuffer(ByteBuffer, Byte) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.BytePacker
 
addToBuffer(ByteBuffer, int, Byte) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.BytePacker
 
addToBuffer(ByteBuffer, char[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.CharArrayPacker
 
addToBuffer(ByteBuffer, int, char[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.CharArrayPacker
 
addToBuffer(ByteBuffer, Character) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.CharPacker
 
addToBuffer(ByteBuffer, int, Character) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.CharPacker
 
addToBuffer(ByteBuffer, double[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.DoubleArrayPacker
 
addToBuffer(ByteBuffer, int, double[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.DoubleArrayPacker
 
addToBuffer(ByteBuffer, Double) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.DoublePacker
 
addToBuffer(ByteBuffer, int, Double) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.DoublePacker
 
addToBuffer(ByteBuffer, float[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.FloatArrayPacker
 
addToBuffer(ByteBuffer, int, float[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.FloatArrayPacker
 
addToBuffer(ByteBuffer, Float) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.FloatPacker
 
addToBuffer(ByteBuffer, int, Float) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.FloatPacker
 
addToBuffer(ByteBuffer, int[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.IntegerArrayPacker
 
addToBuffer(ByteBuffer, int, int[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.IntegerArrayPacker
 
addToBuffer(ByteBuffer, Integer) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.IntegerPacker
 
addToBuffer(ByteBuffer, int, Integer) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.IntegerPacker
 
addToBuffer(ByteBuffer, long[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.LongArrayPacker
 
addToBuffer(ByteBuffer, int, long[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.LongArrayPacker
 
addToBuffer(ByteBuffer, Long) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.LongPacker
 
addToBuffer(ByteBuffer, int, Long) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.LongPacker
 
addToBuffer(ByteBuffer, A, int) - Method in interface edu.iu.dsc.tws.api.comms.packing.types.primitive.PrimitiveArrayPacker
Adds data[index] to the byteBuffer, position will be updated
addToBuffer(ByteBuffer, int, A, int) - Method in interface edu.iu.dsc.tws.api.comms.packing.types.primitive.PrimitiveArrayPacker
Adds data[index] to the byteBuffer, position will not be updated
addToBuffer(ByteBuffer, T) - Method in interface edu.iu.dsc.tws.api.comms.packing.types.primitive.PrimitivePacker
This method should put data to byteBuffer and update the position of buffer
addToBuffer(ByteBuffer, int, T) - Method in interface edu.iu.dsc.tws.api.comms.packing.types.primitive.PrimitivePacker
This method should insert to byteBuffer's index.
addToBuffer(ByteBuffer, short[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ShortArrayPacker
 
addToBuffer(ByteBuffer, int, short[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ShortArrayPacker
 
addToBuffer(ByteBuffer, Short) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ShortPacker
 
addToBuffer(ByteBuffer, int, Short) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ShortPacker
 
addToDefaults(String, String) - Method in class edu.iu.dsc.tws.deeplearning.common.ParameterTool
 
addToOverFlowBuffer(DataBuffer) - Method in class edu.iu.dsc.tws.api.comms.messaging.ChannelMessage
 
addTSet(TBase, TBase) - Method in class edu.iu.dsc.tws.tset.TBaseGraph
for intermediate nodes.
addValue(byte[]) - Method in class edu.iu.dsc.tws.common.table.arrow.BinaryColumn
 
addValue(Float) - Method in class edu.iu.dsc.tws.common.table.arrow.Float4Column
 
addValue(Double) - Method in class edu.iu.dsc.tws.common.table.arrow.Float8Column
 
addValue(Integer) - Method in class edu.iu.dsc.tws.common.table.arrow.Int4Column
 
addValue(Long) - Method in class edu.iu.dsc.tws.common.table.arrow.Int8Column
 
addValue(Text) - Method in class edu.iu.dsc.tws.common.table.arrow.StringColumn
 
addValue(Character) - Method in class edu.iu.dsc.tws.common.table.arrow.UInt2Column
 
addValue(T) - Method in interface edu.iu.dsc.tws.common.table.ArrowColumn
 
addWorker(Worker) - Method in class edu.iu.dsc.tws.api.compute.schedule.elements.WorkerPlan
 
addWorkerFailureListener(IWorkerFailureListener) - Static method in class edu.iu.dsc.tws.master.worker.JMWorkerAgent
only one IWorkerFailureListener can be added if the second IWorkerFailureListener tried to be added, returns false
addWorkerFailureListener(IWorkerFailureListener) - Method in class edu.iu.dsc.tws.master.worker.JMWorkerStatusUpdater
only one IWorkerFailureListener can be added if the second IWorkerFailureListener tried to be added, returns false
addWorkerFailureListener(IWorkerFailureListener) - Static method in class edu.iu.dsc.tws.rsched.core.WorkerRuntime
add a IWorkerFailureListener Currently failure notification is only implemented with ZKWorkerController A listener can be only added when ZKWorkerController is used.
addWriteRequest(TCPMessage) - Method in class edu.iu.dsc.tws.common.net.tcp.BaseNetworkChannel
 
addZipToArchive(String) - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
given tar.gz file will be copied to this tar.gz file.
addZipToArchive(String, String) - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
given tar.gz file will be copied to this tar.gz file.
after() - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedMergerTest
 
after() - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMergerTest
 
after() - Method in class edu.iu.dsc.tws.comms.shuffle.FSMergerTest
 
afterClass() - Static method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedMergerTest
 
afterClass() - Static method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMergerTest
 
afterClass() - Static method in class edu.iu.dsc.tws.comms.shuffle.FSMergerTest
 
afterExecution() - Method in interface edu.iu.dsc.tws.api.compute.executor.IExecutionHook
Every IExecitor should execute this method after it finishes an execution
afterExecution() - Method in class edu.iu.dsc.tws.task.impl.ExecutionHookImpl
 
aggregate(int, boolean, boolean) - Method in class edu.iu.dsc.tws.comms.dfw.io.gather.BaseGatherBatchReceiver
 
aggregate(int, boolean, boolean) - Method in class edu.iu.dsc.tws.comms.dfw.io.gather.GatherStreamingPartialReceiver
 
aggregate(int, boolean, boolean) - Method in class edu.iu.dsc.tws.comms.dfw.io.reduce.ReduceBatchReceiver
 
aggregate(int, boolean, boolean) - Method in class edu.iu.dsc.tws.comms.dfw.io.reduce.ReduceStreamingReceiver
 
aggregate(int, boolean, boolean) - Method in class edu.iu.dsc.tws.comms.dfw.io.SourceReceiver
Aggregate values from sources for a target, assumes every source has a value
aggregate(int[]) - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowEventTimeExample.DirectAggregateWindowedTask
 
aggregate(int[]) - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowExample.DirectAggregateWindowedTask
 
aggregate(T) - Method in class edu.iu.dsc.tws.task.window.collectives.AggregateWindow
 
aggregate(AggregateFunc<O>) - Method in class edu.iu.dsc.tws.tset.sets.streaming.WindowComputeTSet
This method reduces the values inside a window
AggregatedObjects<T> - Class in edu.iu.dsc.tws.comms.dfw.io
 
AggregatedObjects(int) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.AggregatedObjects
 
AggregatedObjects() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.AggregatedObjects
 
AggregatedObjects(Collection<? extends T>) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.AggregatedObjects
 
AggregateFunc<T> - Interface in edu.iu.dsc.tws.tset.fn
 
AggregateFunctionImpl(int, int) - Constructor for class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowEventTimeExample.AggregateFunctionImpl
 
AggregateFunctionImpl(int, int) - Constructor for class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowExample.AggregateFunctionImpl
 
aggregateLateMessages(int[]) - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowEventTimeExample.DirectAggregateWindowedTask
 
aggregateLateMessages(int[]) - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowExample.DirectAggregateWindowedTask
 
aggregateLateMessages(T) - Method in class edu.iu.dsc.tws.task.window.collectives.AggregateWindow
 
AggregateWindow<T> - Class in edu.iu.dsc.tws.task.window.collectives
 
AggregateWindow(AggregateWindowedFunction) - Constructor for class edu.iu.dsc.tws.task.window.collectives.AggregateWindow
 
AggregateWindowedFunction<T> - Interface in edu.iu.dsc.tws.task.window.function
 
Aggregator() - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.HelloExample.Aggregator
 
Aggregator() - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.ParallelDataFlowsExample.Aggregator
 
Aggregator() - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.TwoDataFlowsExample.Aggregator
 
Aggregator() - Constructor for class edu.iu.dsc.tws.examples.batch.kmeans.TaskGraphBuildTest.Aggregator
 
Aggregator() - Constructor for class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowAddNodeExperiment.Aggregator
 
Aggregator() - Constructor for class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowNodeExperiment.Aggregator
 
Aggregator() - Constructor for class edu.iu.dsc.tws.examples.internal.taskgraph.MultiComputeTasksGraphExample.Aggregator
 
Aggregator() - Constructor for class edu.iu.dsc.tws.tsched.utils.TaskSchedulerClassTest.Aggregator
 
Aggregator1() - Constructor for class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowAddNodeExperiment.Aggregator1
 
Aggregator1() - Constructor for class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowNodeExperiment.Aggregator1
 
AggregatorListTest - Class in edu.iu.dsc.tws.comms.dfw.io
 
AggregatorListTest() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.AggregatorListTest
 
all() - Method in class edu.iu.dsc.tws.dashboard.controllers.JobController
 
allArrived() - Method in interface edu.iu.dsc.tws.api.resource.InitBarrierListener
invoked when all workers in a job arrived at the barrier
allArrived(JobMasterAPI.BarrierType) - Method in interface edu.iu.dsc.tws.master.barrier.BarrierResponder
this method is invoked when all workers arrived at the barrier all workers shall be released from the barrier
allArrived(JobMasterAPI.BarrierType) - Method in class edu.iu.dsc.tws.master.barrier.JMBarrierHandler
 
allArrived(JobMasterAPI.BarrierType) - Method in class edu.iu.dsc.tws.master.barrier.ZKBarrierHandler
publish all arrived event
allArrived() - Method in class edu.iu.dsc.tws.master.server.JobFailureWatcher
this is only called for INIT barrier
allContainersReady(List<V1ContainerStatus>) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
 
allDeleted() - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.ClientJobKillHandler
check whether Job resources deleted log deleted resources return true if all deleted
ALLGATHER - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
 
ALLGATHER - Static variable in class edu.iu.dsc.tws.api.compute.OperationNames
 
allGather() - Method in interface edu.iu.dsc.tws.api.tset.sets.batch.BatchTSet
 
allGather() - Method in interface edu.iu.dsc.tws.api.tset.sets.streaming.StreamingTSet
 
allGather() - Method in interface edu.iu.dsc.tws.api.tset.sets.TSet
Same as gather, but all the target TSet instances would receive the gathered result in the runtime.
AllGather - Class in edu.iu.dsc.tws.comms.dfw
 
AllGather(Config, TWSChannel, LogicalPlan, Set<Integer>, Set<Integer>, int, BulkReceiver, MessageType, int, int, boolean, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.dfw.AllGather
 
allGather(Iterator<Tuple<Integer, int[]>>) - Method in class edu.iu.dsc.tws.examples.task.batch.BTAllGatherExample.AllGatherSinkTask
 
allGather(Iterator<Tuple<Integer, int[]>>) - Method in class edu.iu.dsc.tws.examples.task.streaming.STAllGatherExample.AllGatherSinkTask
 
allgather(String) - Method in class edu.iu.dsc.tws.task.impl.ComputeConnection
Create an allgather config
allGather(Iterator<Tuple<Integer, T>>) - Method in class edu.iu.dsc.tws.task.typed.AllGatherCompute
 
allGather() - Method in class edu.iu.dsc.tws.tset.sets.batch.BatchTSetImpl
 
allGather() - Method in class edu.iu.dsc.tws.tset.sets.batch.StoredTSet
 
allGather() - Method in class edu.iu.dsc.tws.tset.sets.streaming.StreamingTSetImpl
 
AllGatherBatchFinalReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.allgather
 
AllGatherBatchFinalReceiver(TreeBroadcast) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.allgather.AllGatherBatchFinalReceiver
 
AllGatherBatchOperation - Class in edu.iu.dsc.tws.executor.comms.batch
 
AllGatherBatchOperation(Config, Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Edge) - Constructor for class edu.iu.dsc.tws.executor.comms.batch.AllGatherBatchOperation
 
AllGatherCompute<T> - Class in edu.iu.dsc.tws.task.typed
 
AllGatherCompute() - Constructor for class edu.iu.dsc.tws.task.typed.AllGatherCompute
 
AllGatherConfig - Class in edu.iu.dsc.tws.task.impl.ops
 
AllGatherConfig(String, ComputeConnection) - Constructor for class edu.iu.dsc.tws.task.impl.ops.AllGatherConfig
 
AllGatherExample - Class in edu.iu.dsc.tws.examples.tset.batch
 
AllGatherExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.AllGatherExample
 
AllGatherSinkTask() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTAllGatherExample.AllGatherSinkTask
 
AllGatherSinkTask() - Constructor for class edu.iu.dsc.tws.examples.task.streaming.STAllGatherExample.AllGatherSinkTask
 
AllGatherStreamingFinalReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.allgather
 
AllGatherStreamingFinalReceiver(TreeBroadcast) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.allgather.AllGatherStreamingFinalReceiver
 
AllGatherStreamingOperation - Class in edu.iu.dsc.tws.executor.comms.streaming
 
AllGatherStreamingOperation(Config, Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Edge) - Constructor for class edu.iu.dsc.tws.executor.comms.streaming.AllGatherStreamingOperation
 
AllGatherTLink<T> - Class in edu.iu.dsc.tws.tset.links.batch
Represent a data set created by an all gather operation
AllGatherTLink(BatchEnvironment, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.links.batch.AllGatherTLink
 
allGrouping(String) - Method in interface org.apache.storm.topology.InputDeclarer
 
allGrouping(String, String) - Method in interface org.apache.storm.topology.InputDeclarer
 
allGrouping(String) - Method in class org.apache.storm.topology.twister2.Twister2BoltDeclarer
 
allGrouping(String, String) - Method in class org.apache.storm.topology.twister2.Twister2BoltDeclarer
 
allJoined() - Method in interface edu.iu.dsc.tws.master.server.IWorkerEventSender
all workers joined the job
allJoined() - Method in class edu.iu.dsc.tws.master.server.JMWorkerHandler
 
allJoined() - Method in class edu.iu.dsc.tws.master.server.ZKMasterController
 
allocate(int) - Method in class edu.iu.dsc.tws.comms.table.ArrowAllocator
 
allocate(int) - Method in interface edu.iu.dsc.tws.comms.table.channel.Allocator
 
Allocator - Interface in edu.iu.dsc.tws.comms.table.channel
 
allowedLateness - Variable in class edu.iu.dsc.tws.task.window.core.BaseWindowedSink
 
allowsSelfLoops() - Method in class edu.iu.dsc.tws.tset.graph.DAGMutableGraph
 
allowsSelfLoops() - Method in interface edu.iu.dsc.tws.tset.graph.MutableGraph
Returns true if this graph allows self-loops (edges that connect a node to itself).
allQueuesEmpty(Map<Integer, Queue<Object>>) - Method in class edu.iu.dsc.tws.comms.dfw.io.SourceReceiver
Check weather there is nothing left in the queues
ALLREDUCE - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
 
ALLREDUCE - Static variable in class edu.iu.dsc.tws.api.compute.OperationNames
 
allReduce(ReduceFunc<T>) - Method in interface edu.iu.dsc.tws.api.tset.sets.batch.BatchTSet
 
allReduce(ReduceFunc<T>) - Method in interface edu.iu.dsc.tws.api.tset.sets.streaming.StreamingTSet
 
allReduce(ReduceFunc<T>) - Method in interface edu.iu.dsc.tws.api.tset.sets.TSet
Similar to reduce, but all instances of the target TSet would receive the reduced result.
AllReduce - Class in edu.iu.dsc.tws.comms.dfw
 
AllReduce(Config, TWSChannel, LogicalPlan, Set<Integer>, Set<Integer>, int, ReduceFunction, SingularReceiver, MessageType, int, int, boolean, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.dfw.AllReduce
 
allReduce(byte[]) - Method in class edu.iu.dsc.tws.examples.batch.terasort.TeraSort.SamplerReduce
 
allReduce(int[]) - Method in class edu.iu.dsc.tws.examples.task.batch.BTAllReduceExample.AllReduceSinkTask
 
allReduce(int[]) - Method in class edu.iu.dsc.tws.examples.task.streaming.STAllReduceExample.AllReduceSinkTask
 
allreduce(String) - Method in class edu.iu.dsc.tws.task.impl.ComputeConnection
Create an allreduce config
allReduce(T) - Method in class edu.iu.dsc.tws.task.typed.AllReduceCompute
 
allReduce(ReduceFunc<T>) - Method in class edu.iu.dsc.tws.tset.sets.batch.BatchTSetImpl
 
allReduce(ReduceFunc<T>) - Method in class edu.iu.dsc.tws.tset.sets.batch.StoredTSet
 
allReduce(ReduceFunc<T>) - Method in class edu.iu.dsc.tws.tset.sets.streaming.StreamingTSetImpl
 
AllReduceBatchFinalReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.allreduce
 
AllReduceBatchFinalReceiver(ReduceFunction, TreeBroadcast) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.allreduce.AllReduceBatchFinalReceiver
 
AllReduceBatchOperation - Class in edu.iu.dsc.tws.executor.comms.batch
 
AllReduceBatchOperation(Config, Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Edge) - Constructor for class edu.iu.dsc.tws.executor.comms.batch.AllReduceBatchOperation
 
AllReduceBatchOperation.ReduceFnImpl - Class in edu.iu.dsc.tws.executor.comms.batch
 
AllReduceCompute<T> - Class in edu.iu.dsc.tws.task.typed
 
AllReduceCompute() - Constructor for class edu.iu.dsc.tws.task.typed.AllReduceCompute
 
AllReduceConfig - Class in edu.iu.dsc.tws.task.impl.ops
 
AllReduceConfig(String, ComputeConnection) - Constructor for class edu.iu.dsc.tws.task.impl.ops.AllReduceConfig
 
AllReduceExample - Class in edu.iu.dsc.tws.examples.tset.batch
 
AllReduceExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.AllReduceExample
 
AllReduceSinkTask() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTAllReduceExample.AllReduceSinkTask
 
AllReduceSinkTask() - Constructor for class edu.iu.dsc.tws.examples.task.streaming.STAllReduceExample.AllReduceSinkTask
 
AllReduceStreamingFinalReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.allreduce
 
AllReduceStreamingFinalReceiver(ReduceFunction, TreeBroadcast) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.allreduce.AllReduceStreamingFinalReceiver
 
AllReduceStreamingOperation - Class in edu.iu.dsc.tws.executor.comms.streaming
 
AllReduceStreamingOperation(Config, Communicator, LogicalPlan, IFunction, Set<Integer>, Set<Integer>, Edge) - Constructor for class edu.iu.dsc.tws.executor.comms.streaming.AllReduceStreamingOperation
 
AllReduceTLink<T> - Class in edu.iu.dsc.tws.tset.links.batch
Represent a data set create by a all reduce opration
AllReduceTLink(BatchEnvironment, ReduceFunc<T>, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.links.batch.AllReduceTLink
 
AllSharingBatchExecutor - Class in edu.iu.dsc.tws.executor.threading.ft
 
AllSharingBatchExecutor(Config, int, TWSChannel, ExecutionPlan, IExecutionHook) - Constructor for class edu.iu.dsc.tws.executor.threading.ft.AllSharingBatchExecutor
 
AllSharingStremingExecutor - Class in edu.iu.dsc.tws.executor.threading.ft
 
AllSharingStremingExecutor(Config, int, TWSChannel, ExecutionPlan, IExecutionHook) - Constructor for class edu.iu.dsc.tws.executor.threading.ft.AllSharingStremingExecutor
 
allSyncsPresent(int) - Method in class edu.iu.dsc.tws.comms.dfw.io.SourceReceiver
Checks weather all syncs are present
ALLTOALL_ALGO_KEY - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
 
ALLTOALL_ALGO_RING - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
 
ALLTOALL_ALGO_SIMPLE - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
 
allWorkersJoined(List<JobMasterAPI.WorkerInfo>) - Method in class edu.iu.dsc.tws.api.driver.DefaultDriver
 
allWorkersJoined(List<JobMasterAPI.WorkerInfo>) - Method in interface edu.iu.dsc.tws.api.driver.IDriver
this method is invoked when all workers joined the job initially and also, after each scale up operation,
allWorkersJoined(List<JobMasterAPI.WorkerInfo>) - Method in interface edu.iu.dsc.tws.api.resource.IAllJoinedListener
this method is invoked when all workers joined the job initially and also, after each scale up operation, when all new workers joined the job, it is invoked
allWorkersJoined(List<JobMasterAPI.WorkerInfo>) - Method in class edu.iu.dsc.tws.examples.internal.rsched.DriverExample
 
allWorkersJoined() - Method in class edu.iu.dsc.tws.master.server.WorkerMonitor
if all workers are in one of these states: STARTED, RESTARTED or COMPLETED.
allWorkersJoined(List<JobMasterAPI.WorkerInfo>) - Method in class edu.iu.dsc.tws.task.cdfw.BaseDriver
 
allWorkersJoined(List<JobMasterAPI.WorkerInfo>) - Method in class edu.iu.dsc.tws.task.cdfw.CDFWEnv
 
allWorkersJoined(List<JobMasterAPI.WorkerInfo>) - Method in class edu.iu.dsc.tws.task.impl.cdfw.CDFWRuntime
 
ALPHA - Static variable in class edu.iu.dsc.tws.data.utils.MLDataObjectConstants.SgdSvmDataObjectConstants
 
alpha - Variable in class edu.iu.dsc.tws.examples.ml.svm.sgd.SgdSvm
 
alpha - Variable in class edu.iu.dsc.tws.examples.ml.svm.util.Model
Learning rate
ALPHANUM - Static variable in class edu.iu.dsc.tws.examples.utils.RandomString
 
api() - Method in class edu.iu.dsc.tws.dashboard.SwaggerConfig
 
APPEND - Static variable in class edu.iu.dsc.tws.common.logging.Twister2FileLogHandler
 
append(Path) - Method in class edu.iu.dsc.tws.data.hdfs.HadoopFileSystem
 
append(int, ByteBuffer, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
 
append(int, String, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
 
append(int, ByteBuffer, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
 
append(int, String, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
 
append(int, ByteBuffer, ByteBuffer) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
Appends the given byte buffer to the current value in the store.
append(int, String, ByteBuffer) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
 
append(ByteBuffer, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
 
append(String, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
 
appendBulk(int, String, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
Buffers the inputs before submitting to the store.
appendToFile() - Static method in class edu.iu.dsc.tws.common.logging.LoggingContext
 
apply(T) - Method in interface edu.iu.dsc.tws.api.tset.fn.ApplyFunc
 
apply(Object) - Method in class edu.iu.dsc.tws.python.tset.fn.ApplyFunctions.ApplyFuncImpl
 
apply() - Method in class edu.iu.dsc.tws.python.tset.fn.TSetFunctions
 
apply(<any>) - Method in class org.apache.beam.runners.twister2.examples.WordCount.FormatAsTextFn
 
ApplyFunc<T> - Interface in edu.iu.dsc.tws.api.tset.fn
Applies a function to data
ApplyFunctions - Class in edu.iu.dsc.tws.python.tset.fn
 
ApplyFunctions() - Constructor for class edu.iu.dsc.tws.python.tset.fn.ApplyFunctions
 
ApplyFunctions.ApplyFuncImpl - Class in edu.iu.dsc.tws.python.tset.fn
 
applyOp(Object, Object, AbstractOp) - Method in class edu.iu.dsc.tws.comms.functions.reduction.ReduceOperationFunction
Applying the operation on data
areReceiversComplete(Lock, MessageReceiver, Lock, MessageReceiver) - Static method in class edu.iu.dsc.tws.comms.utils.OperationUtils
Progress the receivers and return true if needs further progress
ARG_BENCHMARK_METADATA - Static variable in class edu.iu.dsc.tws.examples.utils.bench.BenchmarkMetadata
 
ARG_INPUT_FILE - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
 
ARG_KEY_SEED - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
 
ARG_KEY_SIZE - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
 
ARG_OUTPUT_FOLDER - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
 
ARG_RESOURCE_CPU - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
 
ARG_RESOURCE_INSTANCES - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
 
ARG_RESOURCE_MEMORY - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
 
ARG_RESOURCE_MEMORY - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARG_RUN_BENCHMARK - Static variable in class edu.iu.dsc.tws.examples.utils.bench.BenchmarkMetadata
 
ARG_SIZE - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
 
ARG_TASKS_SINKS - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
 
ARG_TASKS_SOURCES - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
 
ARG_TUNE_MAX_BYTES_IN_MEMORY - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
 
ARG_TUNE_MAX_SHUFFLE_FILE_SIZE - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
 
ARG_VALUE_SIZE - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
 
ARGS_BYTE_STORAGE_TYPE - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
 
ARGS_CINPUT - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
 
ARGS_CSIZE - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
 
ARGS_DATA_TYPE - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_DIMENSIONS - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
 
ARGS_DINPUT - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
 
ARGS_DSIZE - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
 
ARGS_FNAME - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_GAP - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_INIT_ITERATIONS - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_INPUT_DIRECTORY - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_ITERATIONS - Static variable in class edu.iu.dsc.tws.data.utils.DataObjectConstants
 
ARGS_ITERATIONS - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
 
ARGS_ITR - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_NUMBER_OF_DIMENSIONS - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
 
ARGS_NUMBER_OF_FILES - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_NUMBER_OF_ROWS - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
 
ARGS_OPERATION - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_OUTPUT_DIRECTORY - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_OUTPUT_FILE - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
 
ARGS_OUTSTANDING - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_PARALLEL - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_PARALLELISM_VALUE - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
 
ARGS_PRINT_INTERVAL - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_SHARED_FILE_SYSTEM - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_SIZE - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_STREAM - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_TASK_STAGES - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_TASKS - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_THREADS - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_VERIFY - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_WARMPU_ITR - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_WINDOW - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
ARGS_WORKERS - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
 
ARGS_WORKERS - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
 
array - Variable in class edu.iu.dsc.tws.dataset.BaseArray
The array
arrayFromString(String) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.DataUtils
 
arrayFromString(String, String) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.DataUtils
 
arrayFromString(String, String, boolean) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.DataUtils
 
arrivedAtDefault(int, long) - Method in class edu.iu.dsc.tws.master.barrier.BarrierMonitor
a worker arrived at the default barrier
arrivedAtInit(int, long) - Method in class edu.iu.dsc.tws.master.barrier.BarrierMonitor
a worker arrived at the init barrier
ARROW_DIRECTORY - Static variable in class edu.iu.dsc.tws.data.utils.DataObjectConstants
 
ARROW_TABLE - Static variable in class edu.iu.dsc.tws.api.comms.messaging.types.MessageTypes
 
ArrowAllocator - Class in edu.iu.dsc.tws.comms.table
 
ArrowAllocator(RootAllocator) - Constructor for class edu.iu.dsc.tws.comms.table.ArrowAllocator
 
ArrowAllToAll - Class in edu.iu.dsc.tws.comms.table
This class gets values as normal format and converts them into a row format before invoking the communication.
ArrowAllToAll(Config, IWorkerController, Set<Integer>, Set<Integer>, LogicalPlan, int, ArrowCallback, Schema, RootAllocator) - Constructor for class edu.iu.dsc.tws.comms.table.ArrowAllToAll
 
ArrowBasedSinkFunction<T> - Class in edu.iu.dsc.tws.tset.fn.impl
This class is responsible for calling the twister2 arrow file writer class and add the data to the list in the arrow file writer and commit the data.
ArrowBasedSinkFunction(String, String, String) - Constructor for class edu.iu.dsc.tws.tset.fn.impl.ArrowBasedSinkFunction
 
ArrowBasedSourceFunction - Class in edu.iu.dsc.tws.tset.fn.impl
 
ArrowBasedSourceFunction(String, String, int, String) - Constructor for class edu.iu.dsc.tws.tset.fn.impl.ArrowBasedSourceFunction
 
ArrowCallback - Interface in edu.iu.dsc.tws.comms.table
 
ArrowChannelBuffer - Class in edu.iu.dsc.tws.comms.table
 
ArrowChannelBuffer(ArrowBuf, int) - Constructor for class edu.iu.dsc.tws.comms.table.ArrowChannelBuffer
 
ArrowColumn<T> - Interface in edu.iu.dsc.tws.common.table
We are going to represent and arrow vector as a column to facilitate easy access and building of vectors, this class is only for internal use and should not be exposed to the users
ArrowInputSplit - Class in edu.iu.dsc.tws.data.api.splits
 
ArrowInputSplit(int, Path, long, long, String[]) - Constructor for class edu.iu.dsc.tws.data.api.splits.ArrowInputSplit
 
ArrowInputSplit(int, Path, String[]) - Constructor for class edu.iu.dsc.tws.data.api.splits.ArrowInputSplit
 
ArrowRow - Class in edu.iu.dsc.tws.common.table
 
ArrowRow(Object[]) - Constructor for class edu.iu.dsc.tws.common.table.ArrowRow
 
ArrowTable - Class in edu.iu.dsc.tws.common.table.arrow
 
ArrowTable(int, List<ArrowColumn>) - Constructor for class edu.iu.dsc.tws.common.table.arrow.ArrowTable
 
ArrowTable(Schema, int, List<ArrowColumn>) - Constructor for class edu.iu.dsc.tws.common.table.arrow.ArrowTable
 
ArrowTable(Schema, List<FieldVector>) - Constructor for class edu.iu.dsc.tws.common.table.arrow.ArrowTable
 
ArrowTableBuilder - Class in edu.iu.dsc.tws.common.table
 
ArrowTableBuilder(Schema, BufferAllocator) - Constructor for class edu.iu.dsc.tws.common.table.ArrowTableBuilder
 
ArrowTableType - Class in edu.iu.dsc.tws.api.comms.messaging.types
 
ArrowTableType() - Constructor for class edu.iu.dsc.tws.api.comms.messaging.types.ArrowTableType
 
ArrowTSetSourceExample - Class in edu.iu.dsc.tws.examples.arrow
 
ArrowTSetSourceExample() - Constructor for class edu.iu.dsc.tws.examples.arrow.ArrowTSetSourceExample
 
ArrowTypes - Class in edu.iu.dsc.tws.common.table.arrow
 
AssignWindowsFunction<T> - Class in org.apache.beam.runners.twister2.translators.functions
Assign Windows function.
AssignWindowsFunction(<any>) - Constructor for class org.apache.beam.runners.twister2.translators.functions.AssignWindowsFunction
 
AssignWindowTranslatorBatch<T> - Class in org.apache.beam.runners.twister2.translators.batch
Assign Window translator.
AssignWindowTranslatorBatch() - Constructor for class org.apache.beam.runners.twister2.translators.batch.AssignWindowTranslatorBatch
 
AURORA_CLUSTER_NAME - Static variable in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraContext
 
AURORA_SCRIPT - Static variable in class edu.iu.dsc.tws.api.config.Context
 
AURORA_WORKER_CLASS - Static variable in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraContext
 
auroraClusterName(Config) - Static method in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraContext
 
AuroraContext - Class in edu.iu.dsc.tws.rsched.schedulers.aurora
State parameters for Aurora Client
AuroraContext() - Constructor for class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraContext
 
AuroraField - Enum in edu.iu.dsc.tws.rsched.schedulers.aurora
Field names passed to aurora controllers during job creation
AuroraLauncher - Class in edu.iu.dsc.tws.rsched.schedulers.aurora
submit a job to Aurora Scheduler using AuroraClientController
AuroraLauncher() - Constructor for class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraLauncher
 
auroraScript(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
 
auroraWorkerClass(Config) - Static method in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraContext
 
AuroraWorkerStarter - Class in edu.iu.dsc.tws.rsched.schedulers.aurora
 
available() - Method in class edu.iu.dsc.tws.comms.dfw.io.ByteArrayInputStream
 
available() - Method in class edu.iu.dsc.tws.data.fs.local.LocalDataInputStream
 
available() - Method in class edu.iu.dsc.tws.data.hdfs.HadoopDataInputStream
 
average(double[], int) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.DataUtils
 
averageDiff(String, String, boolean) - Static method in class edu.iu.dsc.tws.examples.utils.bench.Timing
 

B

B2MB - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.TimingConstants
 
BAllGather - Class in edu.iu.dsc.tws.comms.batch
Batch ALLGather Operation
BAllGather(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, BulkReceiver, MessageType, int, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BAllGather
Construct a AllGather operation
BAllGather(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, BulkReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BAllGather
 
BAllGather(Communicator, LogicalPlanBuilder, BulkReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BAllGather
 
BAllGatherExample - Class in edu.iu.dsc.tws.examples.comms.batch
 
BAllGatherExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BAllGatherExample
 
BAllGatherExample.FinalSingularReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
 
BAllReduce - Class in edu.iu.dsc.tws.comms.batch
Batch ALLReduce Operation
BAllReduce(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, ReduceFunction, SingularReceiver, MessageType, int, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BAllReduce
 
BAllReduce(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, ReduceFunction, SingularReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BAllReduce
Construct a Batch AllReduce operation
BAllReduce(Communicator, LogicalPlanBuilder, ReduceFunction, SingularReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BAllReduce
 
BAllReduceExample - Class in edu.iu.dsc.tws.examples.comms.batch
 
BAllReduceExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BAllReduceExample
 
BAllReduceExample.FinalSingularReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
 
barrierFailed(JobMasterAPI.BarrierType, JobMasterAPI.BarrierResult) - Method in interface edu.iu.dsc.tws.master.barrier.BarrierResponder
this method is called when the barrier failed all waiting workers shall be released with a failure message
barrierFailed(JobMasterAPI.BarrierType, JobMasterAPI.BarrierResult) - Method in class edu.iu.dsc.tws.master.barrier.JMBarrierHandler
 
barrierFailed(JobMasterAPI.BarrierType, JobMasterAPI.BarrierResult) - Method in class edu.iu.dsc.tws.master.barrier.ZKBarrierHandler
 
BarrierMonitor - Class in edu.iu.dsc.tws.master.barrier
implements barrier logic
BarrierMonitor(WorkerMonitor, InitBarrierListener) - Constructor for class edu.iu.dsc.tws.master.barrier.BarrierMonitor
 
BarrierResponder - Interface in edu.iu.dsc.tws.master.barrier
 
barriers - Variable in class edu.iu.dsc.tws.comms.dfw.io.SourceReceiver
The barriers for each target
barriers - Variable in class edu.iu.dsc.tws.comms.dfw.io.TargetFinalReceiver
The barriers for each target
barriers - Variable in class edu.iu.dsc.tws.comms.dfw.io.TargetPartialReceiver
The barriers for each source
BaseApplyFunc<T> - Class in edu.iu.dsc.tws.api.tset.fn
 
BaseApplyFunc() - Constructor for class edu.iu.dsc.tws.api.tset.fn.BaseApplyFunc
 
BaseArray<T> - Class in edu.iu.dsc.tws.dataset
 
BaseArray(T, int, int) - Constructor for class edu.iu.dsc.tws.dataset.BaseArray
 
BaseBasicBolt - Class in org.apache.storm.topology.base
 
BaseBasicBolt() - Constructor for class org.apache.storm.topology.base.BaseBasicBolt
 
BaseComponent - Class in org.apache.storm.topology.base
 
BaseComponent() - Constructor for class org.apache.storm.topology.base.BaseComponent
 
BaseCompute<T> - Class in edu.iu.dsc.tws.api.compute.nodes
 
BaseCompute() - Constructor for class edu.iu.dsc.tws.api.compute.nodes.BaseCompute
 
BaseComputeCollectorFunc<O,I> - Class in edu.iu.dsc.tws.api.tset.fn
Extended ComputeCollectorFunc with access to TSetContext
BaseComputeCollectorFunc() - Constructor for class edu.iu.dsc.tws.api.tset.fn.BaseComputeCollectorFunc
 
BaseComputeFunc<O,I> - Class in edu.iu.dsc.tws.api.tset.fn
Extended ComputeFunc with access to TSetContext
BaseComputeFunc() - Constructor for class edu.iu.dsc.tws.api.tset.fn.BaseComputeFunc
 
BaseComputeOp<I> - Class in edu.iu.dsc.tws.tset.ops
takes care of preparing the compute instances and creating the MultiEdgeOpAdapter
BaseComputeOp() - Constructor for class edu.iu.dsc.tws.tset.ops.BaseComputeOp
 
BaseComputeOp(BaseTSet, Map<String, String>) - Constructor for class edu.iu.dsc.tws.tset.ops.BaseComputeOp
 
BaseDataflowTaskGraph<TV,TE> - Class in edu.iu.dsc.tws.api.compute.graph
It is the base class for the dataflow task graph which implements the IDataflowTaskGraph interface.
BaseDataflowTaskGraph() - Constructor for class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
 
BaseDataflowTaskGraph(Comparator<TV>, Comparator<TE>) - Constructor for class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
 
BaseDiskPersistIterSink<T,T1> - Class in edu.iu.dsc.tws.tset.sinks
Base class for disk based persisted TSet
BaseDiskPersistIterSink(String) - Constructor for class edu.iu.dsc.tws.tset.sinks.BaseDiskPersistIterSink
Creates an instance of DiskPersistIterIterSink with a referencePrefix
BaseDriver - Class in edu.iu.dsc.tws.task.cdfw
 
BaseDriver() - Constructor for class edu.iu.dsc.tws.task.cdfw.BaseDriver
 
BaseGatherBatchReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.gather
 
BaseGatherBatchReceiver() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.gather.BaseGatherBatchReceiver
 
BaseMapFunc<O,I> - Class in edu.iu.dsc.tws.api.tset.fn
Extended MapFunc with access to TSetContext
BaseMapFunc() - Constructor for class edu.iu.dsc.tws.api.tset.fn.BaseMapFunc
 
BaseNetworkChannel - Class in edu.iu.dsc.tws.common.net.tcp
Base network channel
BaseNode - Class in edu.iu.dsc.tws.api.compute.nodes
 
BaseNode() - Constructor for class edu.iu.dsc.tws.api.compute.nodes.BaseNode
 
BaseOp - Class in edu.iu.dsc.tws.tset.ops
Every tset op is a Receptor.
BaseOp() - Constructor for class edu.iu.dsc.tws.tset.ops.BaseOp
 
BaseOp(BaseTSet) - Constructor for class edu.iu.dsc.tws.tset.ops.BaseOp
 
BaseOp(BaseTSet, Map<String, String>) - Constructor for class edu.iu.dsc.tws.tset.ops.BaseOp
 
BaseOperation - Class in edu.iu.dsc.tws.api.comms
 
BaseOperation(Communicator, boolean, String) - Constructor for class edu.iu.dsc.tws.api.comms.BaseOperation
Create the base operation
BaseReduceBatchFinalReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.reduce
 
BaseReduceBatchFinalReceiver(ReduceFunction) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.reduce.BaseReduceBatchFinalReceiver
 
BaseRichBolt - Class in org.apache.storm.topology.base
 
BaseRichBolt() - Constructor for class org.apache.storm.topology.base.BaseRichBolt
 
BaseRichSpout - Class in org.apache.storm.topology.base
 
BaseRichSpout() - Constructor for class org.apache.storm.topology.base.BaseRichSpout
 
BaseSerializer - Class in edu.iu.dsc.tws.comms.dfw.io
 
BaseSerializer() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.BaseSerializer
 
BaseSerializeTest - Class in edu.iu.dsc.tws.comms.dfw.io
 
BaseSerializeTest() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.BaseSerializeTest
 
BaseSinkFunc<T> - Class in edu.iu.dsc.tws.api.tset.fn
Extended SinkFunc with access to TSetContext
BaseSinkFunc() - Constructor for class edu.iu.dsc.tws.api.tset.fn.BaseSinkFunc
 
BaseSource - Class in edu.iu.dsc.tws.api.compute.nodes
 
BaseSource() - Constructor for class edu.iu.dsc.tws.api.compute.nodes.BaseSource
 
BaseSourceFunc<T> - Class in edu.iu.dsc.tws.api.tset.fn
Extended SourceFunc with access to TSetContext
BaseSourceFunc() - Constructor for class edu.iu.dsc.tws.api.tset.fn.BaseSourceFunc
 
BaseStatefulWindowedBolt<T extends State> - Class in org.apache.storm.topology.base
 
BaseStatefulWindowedBolt() - Constructor for class org.apache.storm.topology.base.BaseStatefulWindowedBolt
 
BaseTFunction<O,I> - Class in edu.iu.dsc.tws.api.tset.fn
 
BaseTFunction() - Constructor for class edu.iu.dsc.tws.api.tset.fn.BaseTFunction
 
BaseTLink<T1,T0> - Class in edu.iu.dsc.tws.tset.links
Base link impl for all the links
BaseTLink(TSetEnvironment, String) - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLink
 
BaseTLink(TSetEnvironment, String, int) - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLink
 
BaseTLink(TSetEnvironment, String, int, int) - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLink
 
BaseTLink() - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLink
 
BaseTLinkWithSchema<T1,T0> - Class in edu.iu.dsc.tws.tset.links
 
BaseTLinkWithSchema(TSetEnvironment, String, Schema) - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLinkWithSchema
 
BaseTLinkWithSchema(TSetEnvironment, String, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLinkWithSchema
 
BaseTLinkWithSchema(TSetEnvironment, String, int, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLinkWithSchema
 
BaseTLinkWithSchema() - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLinkWithSchema
 
BaseTSet<T> - Class in edu.iu.dsc.tws.tset.sets
 
BaseTSet() - Constructor for class edu.iu.dsc.tws.tset.sets.BaseTSet
 
BaseTSet(TSetEnvironment, String) - Constructor for class edu.iu.dsc.tws.tset.sets.BaseTSet
 
BaseTSet(TSetEnvironment, String, int) - Constructor for class edu.iu.dsc.tws.tset.sets.BaseTSet
 
BaseTSet.StateType - Enum in edu.iu.dsc.tws.tset.sets
Possible Types of state in a TSet
BaseTSetBatchWorker - Class in edu.iu.dsc.tws.examples.tset
We need to keep variable static as this class is serialized
BaseTSetBatchWorker() - Constructor for class edu.iu.dsc.tws.examples.tset.BaseTSetBatchWorker
 
BaseTSetBatchWorker.TestBaseSource - Class in edu.iu.dsc.tws.examples.tset
 
BaseTSetWithSchema<T> - Class in edu.iu.dsc.tws.tset.sets
 
BaseTSetWithSchema() - Constructor for class edu.iu.dsc.tws.tset.sets.BaseTSetWithSchema
 
BaseTSetWithSchema(TSetEnvironment, String, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.BaseTSetWithSchema
General constructor for TSets
BaseTSetWithSchema(TSetEnvironment, String, int, Schema, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.BaseTSetWithSchema
 
BaseWindow - Class in edu.iu.dsc.tws.task.window.api
 
BaseWindow(long, long) - Constructor for class edu.iu.dsc.tws.task.window.api.BaseWindow
 
BaseWindowCompute<T> - Class in edu.iu.dsc.tws.task.window
 
BaseWindowCompute() - Constructor for class edu.iu.dsc.tws.task.window.BaseWindowCompute
 
BaseWindowedBolt - Class in org.apache.storm.topology.base
 
BaseWindowedBolt() - Constructor for class org.apache.storm.topology.base.BaseWindowedBolt
 
BaseWindowedBolt.Count - Class in org.apache.storm.topology.base
Holds a count value for count based windows and sliding intervals.
BaseWindowedBolt.Duration - Class in org.apache.storm.topology.base
Holds a Time duration for time based windows and sliding intervals.
BaseWindowedSink<T> - Class in edu.iu.dsc.tws.task.window.core
 
BaseWindowedSink() - Constructor for class edu.iu.dsc.tws.task.window.core.BaseWindowedSink
 
BaseWindowSink<T> - Class in edu.iu.dsc.tws.task.window.api
 
BaseWindowSink() - Constructor for class edu.iu.dsc.tws.task.window.api.BaseWindowSink
 
BaseWindowSource - Class in edu.iu.dsc.tws.task.window
 
BaseWindowSource() - Constructor for class edu.iu.dsc.tws.task.window.BaseWindowSource
 
BaseWindowStrategy<T> - Class in edu.iu.dsc.tws.task.window.strategy
 
BaseWindowStrategy(IWindow) - Constructor for class edu.iu.dsc.tws.task.window.strategy.BaseWindowStrategy
 
BasicAuroraContainer - Class in edu.iu.dsc.tws.examples.internal.rsched
 
BasicAuroraContainer() - Constructor for class edu.iu.dsc.tws.examples.internal.rsched.BasicAuroraContainer
 
BasicAuroraJob - Class in edu.iu.dsc.tws.examples.internal.rsched
 
BasicComputation - Class in edu.iu.dsc.tws.graphapi.api
 
BasicComputation() - Constructor for class edu.iu.dsc.tws.graphapi.api.BasicComputation
 
BasicComputation.ComputeTask - Class in edu.iu.dsc.tws.graphapi.api
 
BasicComputation.GraphInitialization - Class in edu.iu.dsc.tws.graphapi.api
 
BasicComputation.GraphPartiton - Class in edu.iu.dsc.tws.graphapi.api
 
BasicComputation.ReductionFunction - Class in edu.iu.dsc.tws.graphapi.api
 
BasicComputation.SourceTask - Class in edu.iu.dsc.tws.graphapi.api
 
BasicGraphTests - Class in edu.iu.dsc.tws.tset.test.graph
 
BasicGraphTests() - Constructor for class edu.iu.dsc.tws.tset.test.graph.BasicGraphTests
 
BasicK8sWorker - Class in edu.iu.dsc.tws.examples.internal.rsched
 
BasicK8sWorker() - Constructor for class edu.iu.dsc.tws.examples.internal.rsched.BasicK8sWorker
 
BasicKubernetesJob - Class in edu.iu.dsc.tws.examples.internal.rsched
 
BasicMesosContainer - Class in edu.iu.dsc.tws.examples.internal.rsched
 
BasicMesosContainer() - Constructor for class edu.iu.dsc.tws.examples.internal.rsched.BasicMesosContainer
 
BasicMesosJob - Class in edu.iu.dsc.tws.examples.internal.rsched
 
BasicMesosWorker - Class in edu.iu.dsc.tws.examples.internal.rsched
 
BasicMesosWorker() - Constructor for class edu.iu.dsc.tws.examples.internal.rsched.BasicMesosWorker
 
BasicMpiJob - Class in edu.iu.dsc.tws.examples.internal.rsched
 
BasicNetworkTest - Class in edu.iu.dsc.tws.examples.internal
 
BasicNetworkTest() - Constructor for class edu.iu.dsc.tws.examples.internal.BasicNetworkTest
 
BasicOutputCollector - Class in org.apache.storm.topology
 
BasicOutputCollector(OutputCollector, String) - Constructor for class org.apache.storm.topology.BasicOutputCollector
 
BATCH_EXECUTOR - Static variable in class edu.iu.dsc.tws.api.compute.executor.ExecutorContext
 
BATCH_EXECUTOR_SHARING - Static variable in class edu.iu.dsc.tws.api.compute.executor.ExecutorContext
 
BATCH_EXECUTOR_SHARING_SEP_COMM - Static variable in class edu.iu.dsc.tws.api.compute.executor.ExecutorContext
 
BatchChkPntEnvironment - Class in edu.iu.dsc.tws.tset.env
Extension to the BatchEnvironment with checkpointing capability.
BatchChkPntEnvironment(WorkerEnvironment) - Constructor for class edu.iu.dsc.tws.tset.env.BatchChkPntEnvironment
 
batchDone - Variable in class edu.iu.dsc.tws.comms.dfw.io.KeyedReceiver
Tracks if the partial receiver has completed processing for a given target
BatchEnvironment - Class in edu.iu.dsc.tws.tset.env
Implementation of TSetEnvironment for batch OperationMode.
BatchEnvironment(WorkerEnvironment) - Constructor for class edu.iu.dsc.tws.tset.env.BatchEnvironment
 
BatchEnvironment() - Constructor for class edu.iu.dsc.tws.tset.env.BatchEnvironment
 
BatchGatherLink<T> - Class in edu.iu.dsc.tws.tset.links.batch
This is the Tlinks used by gather operations.
BatchGatherLink() - Constructor for class edu.iu.dsc.tws.tset.links.batch.BatchGatherLink
 
BatchIteratorLink<T> - Class in edu.iu.dsc.tws.tset.links.batch
 
BatchIteratorLink() - Constructor for class edu.iu.dsc.tws.tset.links.batch.BatchIteratorLink
 
BatchIteratorLinkWrapper<T> - Class in edu.iu.dsc.tws.tset.links.batch
Wrapper class for BatchIteratorLink that implements StorableTBase related methods.
BatchIteratorLinkWrapper() - Constructor for class edu.iu.dsc.tws.tset.links.batch.BatchIteratorLinkWrapper
 
BatchRowTLink - Interface in edu.iu.dsc.tws.api.tset.link.batch
Table based communication links.
BatchRowTSet - Interface in edu.iu.dsc.tws.api.tset.sets.batch
 
BatchRowTSetImpl - Class in edu.iu.dsc.tws.tset.sets.batch.row
 
BatchRowTSetImpl(BatchEnvironment, String, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.batch.row.BatchRowTSetImpl
 
BatchRowTSetImpl() - Constructor for class edu.iu.dsc.tws.tset.sets.batch.row.BatchRowTSetImpl
 
BatchSharingExecutor - Class in edu.iu.dsc.tws.executor.threading
 
BatchSharingExecutor(Config, int, TWSChannel, ExecutionPlan, IExecutionHook) - Constructor for class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor
 
BatchSharingExecutor.BatchWorker - Class in edu.iu.dsc.tws.executor.threading
 
BatchSharingExecutor.CommunicationWorker - Class in edu.iu.dsc.tws.executor.threading
 
BatchSharingExecutor2 - Class in edu.iu.dsc.tws.executor.threading
 
BatchSharingExecutor2(Config, int, TWSChannel, ExecutionPlan, IExecutionHook) - Constructor for class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor2
 
BatchSharingExecutor2.BatchWorker - Class in edu.iu.dsc.tws.executor.threading
 
BatchSharingExecutor2.CommunicationWorker - Class in edu.iu.dsc.tws.executor.threading
 
BatchSingleLink<T> - Class in edu.iu.dsc.tws.tset.links.batch
 
BatchTaskScheduler - Class in edu.iu.dsc.tws.tsched.batch.batchscheduler
This scheduler is capable of handling of single task graph as well as multiple task graphs.
BatchTaskScheduler() - Constructor for class edu.iu.dsc.tws.tsched.batch.batchscheduler.BatchTaskScheduler
 
BatchTaskSchedulerExample - Class in edu.iu.dsc.tws.examples.internal.batchscheduler
 
BatchTaskSchedulerExample() - Constructor for class edu.iu.dsc.tws.examples.internal.batchscheduler.BatchTaskSchedulerExample
 
BatchTaskSchedulerTest - Class in edu.iu.dsc.tws.tsched.batch.batchscheduler
 
BatchTaskSchedulerTest() - Constructor for class edu.iu.dsc.tws.tsched.batch.batchscheduler.BatchTaskSchedulerTest
 
batchTaskSchedulingClass(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
 
batchTaskSchedulingMode(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
 
BatchTLink<T1,T0> - Interface in edu.iu.dsc.tws.api.tset.link.batch
Batch extension of TLink with the capability of StoringData.
BatchTLinkImpl<T1,T0> - Class in edu.iu.dsc.tws.tset.links.batch
 
BatchTLinkImpl() - Constructor for class edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl
 
batchTraining() - Method in class edu.iu.dsc.tws.examples.ml.svm.compute.IterativeSVMCompute
This method is used to do batch mode training *
batchTraining() - Method in class edu.iu.dsc.tws.examples.ml.svm.compute.SVMCompute
This method is used to do batch mode training *
BatchTransformTranslator<TransformT extends PTransform> - Interface in org.apache.beam.runners.twister2.translators
doc.
BatchTSet<T> - Interface in edu.iu.dsc.tws.api.tset.sets.batch
Batch extension of TSet interface.
BatchTSetBaseDriver - Class in edu.iu.dsc.tws.tset.cdfw
The base driver class for TSet API when using connected dataflow
BatchTSetBaseDriver() - Constructor for class edu.iu.dsc.tws.tset.cdfw.BatchTSetBaseDriver
 
BatchTSetCDFWEnvironment - Class in edu.iu.dsc.tws.tset.cdfw
 
BatchTSetCDFWEnvironment(CDFWEnv) - Constructor for class edu.iu.dsc.tws.tset.cdfw.BatchTSetCDFWEnvironment
 
BatchTsetExample - Class in edu.iu.dsc.tws.examples.tset.batch
 
BatchTsetExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.BatchTsetExample
 
BatchTSetImpl<T> - Class in edu.iu.dsc.tws.tset.sets.batch
 
BatchTSetImpl() - Constructor for class edu.iu.dsc.tws.tset.sets.batch.BatchTSetImpl
 
BatchTupleTSet<K,V> - Interface in edu.iu.dsc.tws.api.tset.sets.batch
Batch extension of TupleTSet interface with AcceptingData and StoringData capabilities.
BatchTupleTSetImpl<K,V> - Class in edu.iu.dsc.tws.tset.sets.batch
Attaches a key to the oncoming data.
BatchTupleTSetImpl() - Constructor for class edu.iu.dsc.tws.tset.sets.batch.BatchTupleTSetImpl
 
BatchWordSource - Class in edu.iu.dsc.tws.examples.batch.wordcount.comms
 
BatchWordSource(BKeyedReduce, int, int, int) - Constructor for class edu.iu.dsc.tws.examples.batch.wordcount.comms.BatchWordSource
 
BatchWorker(List<INodeInstance>, AtomicBoolean[]) - Constructor for class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor.BatchWorker
 
BatchWorker(INodeInstance) - Constructor for class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor.BatchWorker
 
BatchWorker(List<INodeInstance>, AtomicBoolean[]) - Constructor for class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor2.BatchWorker
 
BBroadcast - Class in edu.iu.dsc.tws.comms.batch
 
BBroadcast(Communicator, LogicalPlan, int, Set<Integer>, BulkReceiver, MessageType, int, MessageSchema, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BBroadcast
Construct a Streaming Reduce operation
BBroadcast(Communicator, LogicalPlan, int, Set<Integer>, BulkReceiver, MessageType, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BBroadcast
 
BBroadcast(Communicator, LogicalPlan, int, Set<Integer>, BulkReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BBroadcast
Construct a Streaming Reduce operation
BBroadcast(Communicator, LogicalPlanBuilder, BulkReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BBroadcast
 
BBroadcast(Communicator, LogicalPlanBuilder, BulkReceiver, MessageType, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BBroadcast
 
BBroadcast(Communicator, LogicalPlan, int, Set<Integer>, BulkReceiver, MessageType, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BBroadcast
 
BBroadCastCompute<T> - Class in edu.iu.dsc.tws.task.typed.batch
 
BBroadCastCompute() - Constructor for class edu.iu.dsc.tws.task.typed.batch.BBroadCastCompute
 
BBroadcastExample - Class in edu.iu.dsc.tws.examples.comms.batch
 
BBroadcastExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BBroadcastExample
 
BBroadcastExample.BCastReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
 
bcast(int, Object, int) - Method in class edu.iu.dsc.tws.comms.batch.BBroadcast
Send a message to be reduced
bcast(int, Object, int) - Method in class edu.iu.dsc.tws.comms.stream.SBroadCast
Send a message to be reduced
BcastBatchFinalReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.bcast
 
BcastBatchFinalReceiver(SingularReceiver) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastBatchFinalReceiver
 
BcastGatherBatchReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.allgather
 
BcastGatherBatchReceiver(BulkReceiver) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.allgather.BcastGatherBatchReceiver
 
BcastGatheStreamingReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.allgather
 
BcastGatheStreamingReceiver(BulkReceiver) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.allgather.BcastGatheStreamingReceiver
 
BCastReceiver() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BBroadcastExample.BCastReceiver
 
BCastReceiver() - Constructor for class edu.iu.dsc.tws.examples.comms.stream.SBroadcastExample.BCastReceiver
 
BcastReceiver() - Constructor for class edu.iu.dsc.tws.executor.comms.batch.BroadcastBatchOperation.BcastReceiver
 
BcastReceiver() - Constructor for class edu.iu.dsc.tws.executor.comms.streaming.BroadcastStreamingOperation.BcastReceiver
 
BcastStreamingFinalReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.bcast
 
BcastStreamingFinalReceiver(SingularReceiver) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastStreamingFinalReceiver
 
BDirect - Class in edu.iu.dsc.tws.comms.batch
 
BDirect(Communicator, LogicalPlan, List<Integer>, List<Integer>, BulkReceiver, MessageType, int, MessageSchema, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BDirect
 
BDirect(Communicator, LogicalPlan, List<Integer>, List<Integer>, BulkReceiver, MessageType, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BDirect
 
BDirect(Communicator, LogicalPlan, List<Integer>, List<Integer>, BulkReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BDirect
Construct a Batch AllReduce operation
BDirect(Communicator, LogicalPlanBuilder, BulkReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BDirect
 
BDirect(Communicator, LogicalPlanBuilder, BulkReceiver, MessageType, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BDirect
 
BDirect(Communicator, LogicalPlan, List<Integer>, List<Integer>, BulkReceiver, MessageType, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BDirect
 
BDirectExample - Class in edu.iu.dsc.tws.examples.comms.batch
 
BDirectExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BDirectExample
 
BDirectExample.DirectReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
 
BDJoinExample - Class in edu.iu.dsc.tws.examples.comms.batch
 
BDJoinExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BDJoinExample
 
BDJoinExample.JoinReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
 
BDKeyedGatherExample - Class in edu.iu.dsc.tws.examples.comms.batch
todo fix verification
BDKeyedGatherExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BDKeyedGatherExample
 
BDKeyedGatherExample.FinalReduceReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
 
BeamBatchTSetEnvironment - Class in org.apache.beam.runners.twister2
This is a shell tset environment which is used on as a central driver model to fit what beam expects.
BeamBatchTSetEnvironment() - Constructor for class org.apache.beam.runners.twister2.BeamBatchTSetEnvironment
 
BeamBatchWorker - Class in org.apache.beam.runners.twister2
 
BeamBatchWorker() - Constructor for class org.apache.beam.runners.twister2.BeamBatchWorker
 
before() - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedMergerTest
 
before() - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMergerTest
 
before() - Method in class edu.iu.dsc.tws.comms.shuffle.FSMergerTest
 
beforeClass() - Static method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedMergerTest
 
beforeClass() - Static method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMergerTest
 
beforeClass() - Static method in class edu.iu.dsc.tws.comms.shuffle.FSMergerTest
 
beforeExecution() - Method in interface edu.iu.dsc.tws.api.compute.executor.IExecutionHook
Every IExecutor should execute this method before it begins an execution
beforeExecution() - Method in class edu.iu.dsc.tws.task.impl.ExecutionHookImpl
 
BenchmarkArg - Class in edu.iu.dsc.tws.examples.utils.bench
 
BenchmarkArg() - Constructor for class edu.iu.dsc.tws.examples.utils.bench.BenchmarkArg
 
BenchmarkConstants - Class in edu.iu.dsc.tws.examples.utils.bench
 
BenchmarkMetadata - Class in edu.iu.dsc.tws.examples.utils.bench
 
BenchmarkMetadata() - Constructor for class edu.iu.dsc.tws.examples.utils.bench.BenchmarkMetadata
 
BenchmarkResultsRecorder - Class in edu.iu.dsc.tws.examples.utils.bench
 
BenchmarkResultsRecorder(Config, boolean) - Constructor for class edu.iu.dsc.tws.examples.utils.bench.BenchmarkResultsRecorder
 
BenchmarkUtils - Class in edu.iu.dsc.tws.examples.utils.bench
 
BenchTaskWorker - Class in edu.iu.dsc.tws.examples.task
 
BenchTaskWorker() - Constructor for class edu.iu.dsc.tws.examples.task.BenchTaskWorker
 
BenchTaskWorker.SourceTask - Class in edu.iu.dsc.tws.examples.task
 
BenchTaskWorker.SourceWindowTask - Class in edu.iu.dsc.tws.examples.task
 
BenchTaskWorker.SourceWindowTimeStampTask - Class in edu.iu.dsc.tws.examples.task
 
BenchWindowTaskWorker - Class in edu.iu.dsc.tws.examples.task
 
BenchWindowTaskWorker() - Constructor for class edu.iu.dsc.tws.examples.task.BenchWindowTaskWorker
 
BenchWindowTaskWorker.SourceWindowTask - Class in edu.iu.dsc.tws.examples.task
 
BenchWorker - Class in edu.iu.dsc.tws.examples.comms
 
BenchWorker() - Constructor for class edu.iu.dsc.tws.examples.comms.BenchWorker
 
BenchWorker.MapWorker - Class in edu.iu.dsc.tws.examples.comms
 
BGather - Class in edu.iu.dsc.tws.comms.batch
Batch Gather Operation
BGather(Communicator, LogicalPlan, Set<Integer>, int, MessageType, BulkReceiver, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BGather
Construct a Streaming Gather operation
BGather(Communicator, LogicalPlanBuilder, MessageType, BulkReceiver, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BGather
 
BGather(Communicator, LogicalPlan, Set<Integer>, int, MessageType, BulkReceiver, boolean, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BGather
 
BGather(Communicator, LogicalPlan, Set<Integer>, int, MessageType, BulkReceiver, boolean, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BGather
 
BGatherExample - Class in edu.iu.dsc.tws.examples.comms.batch
 
BGatherExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BGatherExample
 
BGatherExample.FinalReduceReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
 
BINARY_FILED_TYPE - Static variable in class edu.iu.dsc.tws.common.table.arrow.ArrowTypes
 
BinaryBatchModel - Class in edu.iu.dsc.tws.examples.ml.svm.util
This class is an extended Model which is specialized to hold the parameters involved in the Binary Batch based training
BinaryBatchModel() - Constructor for class edu.iu.dsc.tws.examples.ml.svm.util.BinaryBatchModel
 
BinaryBatchModel(int, int, double[], double[]) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.util.BinaryBatchModel
 
BinaryBatchModel(int, int, double[], double[], double[][]) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.util.BinaryBatchModel
 
BinaryBatchModel(int, int, double[], double[], double, double[][]) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.util.BinaryBatchModel
 
BinaryBatchModel(int, int, double[], double[], double, double[][], int) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.util.BinaryBatchModel
 
BinaryColumn - Class in edu.iu.dsc.tws.common.table.arrow
 
BinaryColumn(VarBinaryVector) - Constructor for class edu.iu.dsc.tws.common.table.arrow.BinaryColumn
 
BinaryInputPartitioner - Class in edu.iu.dsc.tws.data.api.formatters
Input formatter class that reads binary files
BinaryInputPartitioner(Path, int) - Constructor for class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner
 
BinaryInputPartitioner(Path, int, Config) - Constructor for class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner
 
BinaryInputPartitioner(Path, int, int) - Constructor for class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner
 
BinaryInputPartitioner(Path, int, int, Config) - Constructor for class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner
 
BinaryInputSplit - Class in edu.iu.dsc.tws.data.api.splits
 
BinaryInputSplit(int, Path, long, long, String[]) - Constructor for class edu.iu.dsc.tws.data.api.splits.BinaryInputSplit
Constructs a split with host information.
BinaryInputSplit(int, Path, int, String[]) - Constructor for class edu.iu.dsc.tws.data.api.splits.BinaryInputSplit
 
BinaryTree - Class in edu.iu.dsc.tws.comms.routing
 
BinaryTree(int, int, LogicalPlan, int, Set<Integer>) - Constructor for class edu.iu.dsc.tws.comms.routing.BinaryTree
 
BinaryTreeRouter - Class in edu.iu.dsc.tws.comms.routing
 
BinaryTreeRouter(Config, LogicalPlan, int, Set<Integer>) - Constructor for class edu.iu.dsc.tws.comms.routing.BinaryTreeRouter
Initialize the data structure
BinaryTreeTest - Class in edu.iu.dsc.tws.comms.routing
 
BinaryTreeTest() - Constructor for class edu.iu.dsc.tws.comms.routing.BinaryTreeTest
 
bindWorkerToCPU(Config) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesContext
 
BJoin - Class in edu.iu.dsc.tws.comms.batch
Batch Join operation
BJoin(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Set<Integer>, MessageType, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, int, int, CommunicationContext.JoinType, CommunicationContext.JoinAlgorithm, MessageSchema, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BJoin
Construct a Batch partition operation
BJoin(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Set<Integer>, MessageType, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, CommunicationContext.JoinType, CommunicationContext.JoinAlgorithm, MessageSchema, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BJoin
 
BJoin(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Set<Integer>, MessageType, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, CommunicationContext.JoinType, CommunicationContext.JoinAlgorithm) - Constructor for class edu.iu.dsc.tws.comms.batch.BJoin
 
BJoin(Communicator, LogicalPlanBuilder, MessageType, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, CommunicationContext.JoinType, CommunicationContext.JoinAlgorithm) - Constructor for class edu.iu.dsc.tws.comms.batch.BJoin
 
BJoin(Communicator, LogicalPlanBuilder, Set<Integer>, Set<Integer>, MessageType, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, CommunicationContext.JoinType, CommunicationContext.JoinAlgorithm) - Constructor for class edu.iu.dsc.tws.comms.batch.BJoin
 
BJoinCompute<K,L,R> - Class in edu.iu.dsc.tws.task.typed.batch
 
BJoinCompute() - Constructor for class edu.iu.dsc.tws.task.typed.batch.BJoinCompute
 
BJoinExample - Class in edu.iu.dsc.tws.examples.comms.batch
 
BJoinExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BJoinExample
 
BJoinExample.JoinReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
 
BJoinStudentExample - Class in edu.iu.dsc.tws.examples.comms.batch
This example join performs a join between two tables, 1 : | Student ID | Name | and 2 : | Student ID | Course ID |.
BJoinStudentExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BJoinStudentExample
 
BJoinStudentExample.JoinReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
The final result receiver class, it will get an iterator object which contains the key and value pairs of each result from the join operation
BJoinStudentExample.MapWorker - Class in edu.iu.dsc.tws.examples.comms.batch
This class is responsible of generating and sending the message to the join operation, This is essentially the source task for this join example.
BKeyedGather - Class in edu.iu.dsc.tws.comms.batch
 
BKeyedGather(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
Creates an instance of BKeyedGather without shuffling
BKeyedGather(Communicator, LogicalPlanBuilder, MessageType, MessageType, BulkReceiver, DestinationSelector) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
 
BKeyedGather(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
 
BKeyedGather(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, boolean, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
 
BKeyedGather(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
 
BKeyedGather(Communicator, LogicalPlanBuilder, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
 
BKeyedGather(Communicator, LogicalPlanBuilder, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, boolean, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
 
BKeyedGather(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, boolean, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
Creates an instance of BKeyedGather with key comparator
BKeyedGatherExample - Class in edu.iu.dsc.tws.examples.comms.batch
 
BKeyedGatherExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BKeyedGatherExample
 
BKeyedGatherExample.FinalReduceReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
 
BKeyedGatherGroupedCompute<K,T> - Class in edu.iu.dsc.tws.task.typed.batch
 
BKeyedGatherGroupedCompute() - Constructor for class edu.iu.dsc.tws.task.typed.batch.BKeyedGatherGroupedCompute
 
BKeyedGatherUnGroupedCompute<K,T> - Class in edu.iu.dsc.tws.task.typed.batch
 
BKeyedGatherUnGroupedCompute() - Constructor for class edu.iu.dsc.tws.task.typed.batch.BKeyedGatherUnGroupedCompute
 
BKeyedPartition - Class in edu.iu.dsc.tws.comms.batch
 
BKeyedPartition(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedPartition
 
BKeyedPartition(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedPartition
 
BKeyedPartition(Communicator, LogicalPlanBuilder, MessageType, MessageType, BulkReceiver, DestinationSelector) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedPartition
 
BKeyedPartition(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedPartition
 
BKeyedPartitionCompute<K,T> - Class in edu.iu.dsc.tws.task.typed.batch
 
BKeyedPartitionCompute() - Constructor for class edu.iu.dsc.tws.task.typed.batch.BKeyedPartitionCompute
 
BKeyedPartitionExample - Class in edu.iu.dsc.tws.examples.comms.batch
This class is a example use of the keyed partition function
BKeyedPartitionExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BKeyedPartitionExample
 
BKeyedPartitionExample.PartitionReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
 
BKeyedPartitionSinkTask() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTPartitionKeyedExample.BKeyedPartitionSinkTask
 
BKeyedReduce - Class in edu.iu.dsc.tws.comms.batch
Example class for Batch keyed reduce.
BKeyedReduce(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, ReduceFunction, BulkReceiver, MessageType, MessageType, DestinationSelector, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedReduce
 
BKeyedReduce(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, ReduceFunction, BulkReceiver, MessageType, MessageType, DestinationSelector) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedReduce
 
BKeyedReduce(Communicator, LogicalPlanBuilder, ReduceFunction, BulkReceiver, MessageType, MessageType, DestinationSelector) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedReduce
 
BKeyedReduce(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, ReduceFunction, BulkReceiver, MessageType, MessageType, DestinationSelector, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedReduce
 
BKeyedReduceCompute<K,T> - Class in edu.iu.dsc.tws.task.typed.batch
 
BKeyedReduceCompute() - Constructor for class edu.iu.dsc.tws.task.typed.batch.BKeyedReduceCompute
 
BKeyedReduceExample - Class in edu.iu.dsc.tws.examples.comms.batch
 
BKeyedReduceExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BKeyedReduceExample
 
BKeyedReduceExample.FinalBulkReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
 
BlockingSendException - Exception in edu.iu.dsc.tws.api.exceptions.net
 
BlockingSendException(BlockingSendFailureReason, String, Throwable) - Constructor for exception edu.iu.dsc.tws.api.exceptions.net.BlockingSendException
 
BlockingSendFailureReason - Enum in edu.iu.dsc.tws.api.exceptions.net
Failure reasons for blocking send operations
BlockLocation - Interface in edu.iu.dsc.tws.api.data
A BlockLocation lists hosts, offset and length of block.
Bolt - Class in org.apache.storm.generated
 
Bolt() - Constructor for class org.apache.storm.generated.Bolt
 
BoltDeclarer - Interface in org.apache.storm.topology
 
boltExecute(List<Tuple>, List<Tuple>, List<Tuple>, Long) - Method in class org.apache.storm.topology.WindowedBoltExecutor
 
boltExecute(Supplier<Iterator<Tuple>>, Supplier<Iterator<Tuple>>, Supplier<Iterator<Tuple>>, Long) - Method in class org.apache.storm.topology.WindowedBoltExecutor
 
BootstrapPoint - Class in edu.iu.dsc.tws.python
 
BootstrapPoint() - Constructor for class edu.iu.dsc.tws.python.BootstrapPoint
 
BPartition - Class in edu.iu.dsc.tws.comms.batch
Streaming Partition Operation
BPartition(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, BulkReceiver, DestinationSelector, boolean, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BPartition
Construct a Batch partition operation
BPartition(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, BulkReceiver, DestinationSelector, boolean, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BPartition
 
BPartition(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, BulkReceiver, DestinationSelector, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BPartition
 
BPartition(Communicator, LogicalPlanBuilder, MessageType, BulkReceiver, DestinationSelector, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BPartition
 
BPartitionCompute<T> - Class in edu.iu.dsc.tws.task.typed.batch
 
BPartitionCompute() - Constructor for class edu.iu.dsc.tws.task.typed.batch.BPartitionCompute
 
BPartitionExample - Class in edu.iu.dsc.tws.examples.comms.batch
 
BPartitionExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BPartitionExample
 
BPartitionExample.PartitionReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
 
BranchingExample - Class in edu.iu.dsc.tws.examples.tset.batch
 
BranchingExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.BranchingExample
 
BReduce - Class in edu.iu.dsc.tws.comms.batch
Batch Reduce Operation
BReduce(Communicator, LogicalPlan, Set<Integer>, int, ReduceFunction, SingularReceiver, MessageType, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BReduce
Construct a Streaming Reduce operation
BReduce(Communicator, LogicalPlan, Set<Integer>, int, ReduceFunction, SingularReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BReduce
 
BReduce(Communicator, LogicalPlanBuilder, ReduceFunction, SingularReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BReduce
 
BReduceExample - Class in edu.iu.dsc.tws.examples.comms.batch
 
BReduceExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BReduceExample
 
BReduceExample.FinalSingularReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
 
BROADCAST - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
 
BROADCAST - Static variable in class edu.iu.dsc.tws.api.compute.OperationNames
 
broadcast(Iterator<int[]>) - Method in class edu.iu.dsc.tws.examples.task.batch.BTBroadCastExample.BroadcastSinkTask
 
broadcast(int[]) - Method in class edu.iu.dsc.tws.examples.task.streaming.STBroadCastExample.BroadCastSinkTask
 
broadcast(String) - Method in class edu.iu.dsc.tws.task.impl.ComputeConnection
Create a broadcast configuration
broadcast(Iterator<T>) - Method in class edu.iu.dsc.tws.task.typed.batch.BBroadCastCompute
 
broadcast(T) - Method in class edu.iu.dsc.tws.task.typed.streaming.SBroadCastCompute
 
BroadcastBatchOperation - Class in edu.iu.dsc.tws.executor.comms.batch
 
BroadcastBatchOperation(Config, Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Edge) - Constructor for class edu.iu.dsc.tws.executor.comms.batch.BroadcastBatchOperation
 
BroadcastBatchOperation.BcastReceiver - Class in edu.iu.dsc.tws.executor.comms.batch
 
BroadcastConfig - Class in edu.iu.dsc.tws.task.impl.ops
 
BroadcastConfig(String, ComputeConnection) - Constructor for class edu.iu.dsc.tws.task.impl.ops.BroadcastConfig
 
BroadcastExample - Class in edu.iu.dsc.tws.examples.tset.batch
 
BroadcastExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.BroadcastExample
 
broadcastMessage(Message) - Method in class edu.iu.dsc.tws.master.server.WorkerMonitor
 
BroadcastSinkTask() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTBroadCastExample.BroadcastSinkTask
 
BroadCastSinkTask() - Constructor for class edu.iu.dsc.tws.examples.task.streaming.STBroadCastExample.BroadCastSinkTask
 
BroadcastStreamingOperation - Class in edu.iu.dsc.tws.executor.comms.streaming
 
BroadcastStreamingOperation(Config, Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Edge) - Constructor for class edu.iu.dsc.tws.executor.comms.streaming.BroadcastStreamingOperation
 
BroadcastStreamingOperation.BcastReceiver - Class in edu.iu.dsc.tws.executor.comms.streaming
 
broadcastToAllWorkers(Message) - Method in interface edu.iu.dsc.tws.api.driver.IDriverMessenger
send a protocol buffer message to all workers in the job
broadcastToAllWorkers(Message) - Method in class edu.iu.dsc.tws.master.driver.DriverMessenger
send this message to all workers in the job
BTAllGatherExample - Class in edu.iu.dsc.tws.examples.task.batch
 
BTAllGatherExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTAllGatherExample
 
BTAllGatherExample.AllGatherSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
 
BTAllReduceExample - Class in edu.iu.dsc.tws.examples.task.batch
 
BTAllReduceExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTAllReduceExample
 
BTAllReduceExample.AllReduceSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
 
BTAllToAll - Class in edu.iu.dsc.tws.examples.comms.batch
 
BTAllToAll() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BTAllToAll
 
BTBroadCastExample - Class in edu.iu.dsc.tws.examples.task.batch
 
BTBroadCastExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTBroadCastExample
 
BTBroadCastExample.BroadcastSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
 
BTDirectExample - Class in edu.iu.dsc.tws.examples.task.batch
 
BTDirectExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTDirectExample
 
BTDirectExample.PartitionSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
 
BTGatherExample - Class in edu.iu.dsc.tws.examples.task.batch
 
BTGatherExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTGatherExample
 
BTGatherExample.GatherSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
 
BTJoinExample - Class in edu.iu.dsc.tws.examples.task.batch
 
BTJoinExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTJoinExample
 
BTJoinExample.JoinSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
 
BTJoinExample.JoinSource - Class in edu.iu.dsc.tws.examples.task.batch
 
BTKeyedGatherExample - Class in edu.iu.dsc.tws.examples.task.batch
 
BTKeyedGatherExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTKeyedGatherExample
 
BTKeyedGatherExample.KeyedGatherGroupedSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
 
BTKeyedReduceExample - Class in edu.iu.dsc.tws.examples.task.batch
 
BTKeyedReduceExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTKeyedReduceExample
 
BTKeyedReduceExample.KeyedReduceSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
 
BTPartition - Class in edu.iu.dsc.tws.comms.table.ops
 
BTPartition(Communicator, IWorkerController, Set<Integer>, Set<Integer>, LogicalPlan, DestinationSelector, List<Integer>, Schema, BulkReceiver, RootAllocator, String) - Constructor for class edu.iu.dsc.tws.comms.table.ops.BTPartition
 
BTPartitionExample - Class in edu.iu.dsc.tws.examples.task.batch
 
BTPartitionExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTPartitionExample
 
BTPartitionExample.PartitionSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
 
BTPartitionKeyedExample - Class in edu.iu.dsc.tws.examples.task.batch
 
BTPartitionKeyedExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTPartitionKeyedExample
 
BTPartitionKeyedExample.BKeyedPartitionSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
 
BTReduceExample - Class in edu.iu.dsc.tws.examples.task.batch
 
BTReduceExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTReduceExample
 
BTReduceExample.ReduceSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
 
buf - Variable in class edu.iu.dsc.tws.comms.dfw.io.ByteArrayOutputStream
The buffer where data is stored.
buffer - Variable in class edu.iu.dsc.tws.comms.table.channel.TRequest
 
BUFFER_SIZE - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
 
BufferedCollectionPartition<T> - Class in edu.iu.dsc.tws.dataset.partition
 
BufferedCollectionPartition(long, MessageType, long, Config, String) - Constructor for class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
Creates an instance of BufferedCollectionPartition
BufferedCollectionPartition(long, Config) - Constructor for class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
Create a disk based partition with default buffer size(10MB) and without a MessageType If MessageType is not defined, it will assume as ObjectType.
BufferedCollectionPartition(long, Config, String) - Constructor for class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
 
BufferedCollectionPartition(long, MessageType, Config) - Constructor for class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
Creates an instance with default bugger size 10MB
BufferedCollectionPartition(MessageType, long, Config) - Constructor for class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
Creates an 100% disk based instance.
BufferedCollectionPartition(MessageType, long, Config, String) - Constructor for class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
Loads an disk based partition from file system.
BufferedMemoryManager - Class in edu.iu.dsc.tws.data.memory
Inserts into the memory store in batches.
BufferedMemoryManager(Path) - Constructor for class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
 
BufferReceiveCallback - Interface in edu.iu.dsc.tws.comms.table
 
bufferSize(Config) - Static method in class edu.iu.dsc.tws.api.comms.CommunicationContext
 
bufs - Variable in class edu.iu.dsc.tws.comms.dfw.io.ByteArrayInputStream
 
build() - Method in class edu.iu.dsc.tws.api.comms.messaging.MessageHeader.Builder
 
build(Object, int) - Method in interface edu.iu.dsc.tws.api.comms.packing.MessageDeSerializer
Serilize a message
build(Object, Object) - Method in interface edu.iu.dsc.tws.api.comms.packing.MessageSerializer
This method will be called repeatedly until the message is fully built
build(Config, ComputeGraph, TaskSchedulePlan) - Method in interface edu.iu.dsc.tws.api.compute.executor.IExecutionPlanBuilder
Schedule and execution
build() - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
Build the internal structures of the graph, so that it can be searched
build() - Method in class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
This method is responsible for storing the directed edges between the source and target task vertex in a map.
build() - Method in class edu.iu.dsc.tws.api.config.Config.Builder
 
build() - Method in class edu.iu.dsc.tws.api.Twister2Job.Twister2JobBuilder
 
build() - Method in class edu.iu.dsc.tws.checkpointing.worker.CheckpointingWorkerEnv.Builder
build the checkpointing worker env
build() - Method in class edu.iu.dsc.tws.common.table.ArrowTableBuilder
 
build() - Method in interface edu.iu.dsc.tws.common.table.TableBuilder
Build the table at the end
build(Object, Object) - Method in class edu.iu.dsc.tws.comms.dfw.io.BaseSerializer
 
build(Object, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.DataDeserializer
Builds the message from the data buffers in the partialObject.
build(Object, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.FixedSchemaDataDeserializer
Builds the message from the data buffers in the partialObject.
build(Object, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.FixedSchemaKeyedDataDeSerializer
Builds the message from the data buffers in the partialObject.
build(Object, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.KeyedDataDeSerializer
Builds the message from the data buffers in the partialObject.
build() - Method in class edu.iu.dsc.tws.comms.utils.LogicalPlanBuilder
Builds the LogicalPlan
build(Config) - Static method in class edu.iu.dsc.tws.examples.batch.cdfw.CDFJobParameters
This method is to build the job parameters which is based on the configuration value.
build(Config) - Static method in class edu.iu.dsc.tws.examples.comms.JobParameters
 
build(Config) - Static method in class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowJobParameters
This method is to build the job parameters which is based on the configuration value.
build(Config) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.SVMJobParameters
Builds the Job Parameters relevant SVM Algorithm
build(Config, ComputeGraph, TaskSchedulePlan) - Method in class edu.iu.dsc.tws.executor.core.ExecutionPlanBuilder
 
build(Edge, Edge, Set<Integer>, Set<Integer>, Set<Integer>, OperationMode, Map<Integer, Integer>, Map<Integer, Integer>) - Method in class edu.iu.dsc.tws.executor.core.ParallelOperationFactory
 
build(Edge, Set<Integer>, Set<Integer>, OperationMode, Map<Integer, Integer>, Map<Integer, Integer>) - Method in class edu.iu.dsc.tws.executor.core.ParallelOperationFactory
Building the parallel operation based on the batch or streaming tasks.
build(int, List<JobMasterAPI.WorkerInfo>, TaskSchedulePlan, TaskIdGenerator) - Static method in class edu.iu.dsc.tws.executor.core.TaskPlanBuilder
Create a task plan based on the resource plan from resources and scheduled plan
build(Config) - Static method in class edu.iu.dsc.tws.graphapi.api.WorkerParameter
This method is to build the job parameters which is based on the configuration value.
build(Config) - Static method in class edu.iu.dsc.tws.graphapi.pagerank.PageRankWorkerParameters
This method is to build the job parameters which is based on the configuration value.
build(Config) - Static method in class edu.iu.dsc.tws.graphapi.sssp.SsspParameters
This method is to build the job parameters which is based on the configuration value.
build(Object, Object, Object) - Method in class edu.iu.dsc.tws.python.numpy.NumpyHolderBuilder
 
build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.ApplyFunctions
 
build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.ComparatorFunctions
 
build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.ComputeFunctions
 
build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.ComputeWithCollectorFunctions
 
build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.FlatMapFunctions
 
build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.MapFunctions
 
build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.PartitionFunctions
This method builds a partition function
build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.ReduceFunctions
 
build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.SinkFunctions
 
build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.TFunc
 
build() - Method in class edu.iu.dsc.tws.task.cdfw.DataFlowGraph
 
build(ComputeGraph...) - Method in class edu.iu.dsc.tws.task.ComputeEnvironment
 
build() - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
 
build() - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
 
build() - Method in class edu.iu.dsc.tws.tsched.builder.TaskSchedulePlanBuilder
This method first validates the available resource settings and invoke the build container plans method to build the container based on the task instance ram, disk, and cpu map values.
build(GraphBuilder, Collection<? extends TBase>) - Method in interface edu.iu.dsc.tws.tset.Buildable
Builds the underlying node or edge
build(TaskExecutor) - Method in class edu.iu.dsc.tws.tset.env.BuildContext
 
build(GraphBuilder, Collection<? extends TBase>) - Method in class edu.iu.dsc.tws.tset.links.batch.JoinTLink
Uses a different build pattern than the usual TLinks
build(GraphBuilder, Collection<? extends TBase>) - Method in interface edu.iu.dsc.tws.tset.links.BuildableTLink
 
build(GraphBuilder, Collection<? extends TBase>) - Method in interface edu.iu.dsc.tws.tset.sets.BuildableTSet
 
build() - Method in class edu.iu.dsc.tws.tset.TBaseGraph
Builds the entire graph
build(BuildableTSet) - Method in class edu.iu.dsc.tws.tset.TBaseGraph
Builds a subgraph of TSets from the specified TSet
Buildable - Interface in edu.iu.dsc.tws.tset
Interface that provides buildable functionality for sets and links
BuildableTLink - Interface in edu.iu.dsc.tws.tset.links
 
BuildableTSet - Interface in edu.iu.dsc.tws.tset.sets
 
buildAndExecute(ComputeGraphBuilder) - Method in class edu.iu.dsc.tws.task.ComputeEnvironment
for single task graph runs
buildCentroidsTG(String, int, int, int, Config, String) - Static method in class edu.iu.dsc.tws.examples.batch.kmeans.KMeansComputeJob
 
buildComputationSsspTG(int, Config) - Static method in class edu.iu.dsc.tws.graphapi.sssp.SingleSourceShortestPathWorker
 
buildComputationTG(int, Config, BasicComputation.SourceTask, BasicComputation.ComputeTask, BasicComputation.ReductionFunction, PrimitiveMessageTypes) - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation
 
buildComputationTG(int, Config) - Static method in class edu.iu.dsc.tws.graphapi.pagerank.PageRankWorker
 
buildConfig(String) - Static method in class edu.iu.dsc.tws.examples.internal.jobmaster.ZKJobMasterRegistrarExample
construct a Config object
BuildContext - Class in edu.iu.dsc.tws.tset.env
TSet build context holds references for executed tset, build sequence of that tset, compute graph
BuildContext(String, Set<BuildableTSet>, Set<TBase>, OperationMode) - Constructor for class edu.iu.dsc.tws.tset.env.BuildContext
 
buildDataPointsTG(String, int, int, int, Config, String) - Static method in class edu.iu.dsc.tws.examples.batch.kmeans.KMeansComputeJob
 
buildDataPointsTG(String, int, int, Config) - Static method in class edu.iu.dsc.tws.graphapi.pagerank.PageRankWorker
 
buildDataPointsTG(String, int, int, String, Config) - Static method in class edu.iu.dsc.tws.graphapi.sssp.SingleSourceShortestPathWorker
 
Builder() - Constructor for class edu.iu.dsc.tws.api.config.Config.Builder
 
buildGraphInitialaizationTG(String, int, int, Config, BasicComputation.GraphInitialization) - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation
 
buildGraphInitialValueTG(String, int, int, Config) - Static method in class edu.iu.dsc.tws.graphapi.pagerank.PageRankWorker
 
buildGraphPartitionTG(String, int, int, Config, BasicComputation.GraphPartiton) - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation
 
buildHeader(DataBuffer, int) - Method in interface edu.iu.dsc.tws.api.comms.packing.MessageDeSerializer
Read the header from the buffer
buildHeader(DataBuffer, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.DataDeserializer
Builds the header object from the data in the data buffer
buildHeader(DataBuffer, OutMessage, int) - Static method in class edu.iu.dsc.tws.comms.dfw.io.DFWIOUtils
Builds the header of the message.
buildHeader(DataBuffer, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.KeyedDataDeSerializer
Builds the header object from the data in the data buffer
buildInterGroupTree(int) - Method in class edu.iu.dsc.tws.comms.routing.BinaryTree
Building the tree
buildKMeansTG(int, Config) - Static method in class edu.iu.dsc.tws.examples.batch.kmeans.KMeansComputeJob
 
buildOne(BuildableTSet) - Method in class edu.iu.dsc.tws.tset.TBaseGraph
Builds only one TSet (NOT the subgraph)
buildSsspInitialTG(String, int, int, String, Config) - Static method in class edu.iu.dsc.tws.graphapi.sssp.SingleSourceShortestPathWorker
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTAllGatherExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTAllReduceExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTBroadCastExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTDirectExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTGatherExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTJoinExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTKeyedGatherExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTKeyedReduceExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTPartitionExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTPartitionKeyedExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTReduceExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.BenchTaskWorker
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.BenchWindowTaskWorker
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STAllGatherExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STAllReduceExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STBroadCastExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STGatherExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STKeyedGatherExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STKeyedReduceExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STPartitionExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STPartitionKeyedExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STReduceExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowCustomExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowEventTimeExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowExample
 
buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowMPI
 
buildTestConfig(String) - Static method in class edu.iu.dsc.tws.examples.internal.jobmaster.ZKJobMasterFinderExample
construct a test Config object
buildTestingDataPointsTG(int, SVMJobParameters, Config, OperationMode) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.TGUtils
 
buildTopology() - Method in class edu.iu.dsc.tws.examples.compatibility.storm.MultiSpoutTopology
 
buildTopology() - Method in class edu.iu.dsc.tws.examples.compatibility.storm.SentenceWordCountTopology
 
buildTopology() - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.IntervalWindowTopology
 
buildTopology() - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.SlidingWindowTopology
 
buildTopology() - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.TumblingWindowTopology
 
buildTopology() - Method in class edu.iu.dsc.tws.examples.compatibility.storm.WordCountTopology
 
buildTopology() - Method in class org.apache.storm.topology.twister2.Twister2StormWorker
 
buildTrainingDataPointsTG(int, SVMJobParameters, Config, OperationMode) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.TGUtils
 
buildWeightVectorTG(Config, int, SVMJobParameters, OperationMode) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.TGUtils
 
BULK_MM_STEP_SIZE - Static variable in class edu.iu.dsc.tws.data.memory.MemoryManagerContext
Default step size of the Bulk Memory Manager.
bulkCopyToBuffer(char[], ByteBuffer, int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.CharArrayPacker
 
bulkCopyToBuffer(double[], ByteBuffer, int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.DoubleArrayPacker
 
bulkCopyToBuffer(float[], ByteBuffer, int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.FloatArrayPacker
 
bulkCopyToBuffer(int[], ByteBuffer, int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.IntegerArrayPacker
 
bulkCopyToBuffer(long[], ByteBuffer, int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.LongArrayPacker
 
bulkCopyToBuffer(A, ByteBuffer, int, int) - Method in interface edu.iu.dsc.tws.api.comms.packing.types.primitive.PrimitiveArrayPacker
 
bulkCopyToBuffer(short[], ByteBuffer, int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ShortArrayPacker
 
bulkReadFromBuffer(ByteBuffer, char[], int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.CharArrayPacker
 
bulkReadFromBuffer(ByteBuffer, double[], int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.DoubleArrayPacker
 
bulkReadFromBuffer(ByteBuffer, float[], int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.FloatArrayPacker
 
bulkReadFromBuffer(ByteBuffer, int[], int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.IntegerArrayPacker
 
bulkReadFromBuffer(ByteBuffer, long[], int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.LongArrayPacker
 
bulkReadFromBuffer(ByteBuffer, A, int, int) - Method in interface edu.iu.dsc.tws.api.comms.packing.types.primitive.PrimitiveArrayPacker
 
bulkReadFromBuffer(ByteBuffer, short[], int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ShortArrayPacker
 
BulkReceiver - Interface in edu.iu.dsc.tws.api.comms
Receiver for multiple values
BulkReceiverWrapper - Class in edu.iu.dsc.tws.comms.dfw.io.join
 
BulkReceiverWrapper(JoinBatchCombinedReceiver, JoinRelation) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.join.BulkReceiverWrapper
 
bundleExpiredWindowIMessage(List<IMessage<T>>) - Method in class edu.iu.dsc.tws.task.window.manage.WindowManager
This method bundles data into a IWindowMessage for creating expired IWindowMessages
bundleNonExpiredWindowIMessage(List<IMessage<T>>) - Method in class edu.iu.dsc.tws.task.window.manage.WindowManager
This method bundles data into a IWindowMessage for creating non-expired IWindowMessages
bundleWindowMessage(List<Event<T>>) - Method in class edu.iu.dsc.tws.task.window.manage.WindowManager
 
BYTE - Static variable in class edu.iu.dsc.tws.api.comms.messaging.types.MessageTypes
 
BYTE_ARRAY - Static variable in class edu.iu.dsc.tws.api.comms.messaging.types.MessageTypes
 
BYTE_TYPE - Static variable in class edu.iu.dsc.tws.data.utils.DataObjectConstants
 
ByteArrayInputStream - Class in edu.iu.dsc.tws.comms.dfw.io
This is a specialized input stream targetted to reading a twister object message expanding to multiple MPI buffers.
ByteArrayInputStream(List<DataBuffer>, int) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.ByteArrayInputStream
 
ByteArrayOutputStream - Class in edu.iu.dsc.tws.comms.dfw.io
 
ByteArrayOutputStream() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.ByteArrayOutputStream
 
ByteArrayOutputStream(int) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.ByteArrayOutputStream
 
ByteArrayPacker - Class in edu.iu.dsc.tws.api.comms.packing.types.primitive
 
BytePacker - Class in edu.iu.dsc.tws.api.comms.packing.types.primitive
 
ByteSelector - Class in edu.iu.dsc.tws.examples.batch.sortop
 
ByteSelector() - Constructor for class edu.iu.dsc.tws.examples.batch.sortop.ByteSelector
 
ByteToWindowFunction<K,V> - Class in org.apache.beam.runners.twister2.translators.functions
ByteToWindow function.
ByteToWindowFunction(<any>, <any>) - Constructor for class org.apache.beam.runners.twister2.translators.functions.ByteToWindowFunction
 
ByteUtils - Class in edu.iu.dsc.tws.common.net.tcp.request
Utility methods

C

C - Static variable in class edu.iu.dsc.tws.data.utils.MLDataObjectConstants.SgdSvmDataObjectConstants
 
cache() - Method in interface edu.iu.dsc.tws.api.tset.StoringData
Runs this TSet and caches the data to an in-memory DataPartition and exposes the data as another TSet.
cache() - Method in class edu.iu.dsc.tws.tset.links.batch.AllReduceTLink
 
cache() - Method in class edu.iu.dsc.tws.tset.links.batch.BatchGatherLink
 
cache() - Method in class edu.iu.dsc.tws.tset.links.batch.BatchIteratorLinkWrapper
 
cache() - Method in class edu.iu.dsc.tws.tset.links.batch.BatchSingleLink
 
cache() - Method in class edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl
 
cache() - Method in class edu.iu.dsc.tws.tset.links.batch.KeyedBatchIteratorLinkWrapper
 
cache() - Method in class edu.iu.dsc.tws.tset.links.batch.KeyedPipeTLink
 
cache() - Method in class edu.iu.dsc.tws.tset.links.batch.PipeTLink
 
cache() - Method in class edu.iu.dsc.tws.tset.links.batch.ReduceTLink
 
cache() - Method in class edu.iu.dsc.tws.tset.links.batch.row.RowBatchTLinkImpl
 
cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.BatchTSetImpl
 
cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.BatchTupleTSetImpl
 
cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.CachedTSet
 
cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.KeyedCachedTSet
 
cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.KeyedPersistedTSet
 
cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.PersistedTSet
 
cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.row.BatchRowTSetImpl
 
cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.row.RowCachedTSet
 
cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.row.RowPersistedTSet
 
CachedTSet<T> - Class in edu.iu.dsc.tws.tset.sets.batch
Cached tset
CachedTSet(BatchEnvironment, SinkFunc<?>, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.batch.CachedTSet
 
CacheExample - Class in edu.iu.dsc.tws.examples.tset.batch
 
CacheExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.CacheExample
 
CacheGatherSink<T> - Class in edu.iu.dsc.tws.tset.sinks
 
CacheGatherSink() - Constructor for class edu.iu.dsc.tws.tset.sinks.CacheGatherSink
 
CacheIterSink<T> - Class in edu.iu.dsc.tws.tset.sinks
An in-memory cached TSet
CacheIterSink() - Constructor for class edu.iu.dsc.tws.tset.sinks.CacheIterSink
 
CacheSingleSink<T> - Class in edu.iu.dsc.tws.tset.sinks
 
CacheSingleSink() - Constructor for class edu.iu.dsc.tws.tset.sinks.CacheSingleSink
 
calculateWorkerID(JobAPI.Job, String, String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.worker.K8sWorkerUtils
calculate the workerID from the given parameters
calculateWorkerIDInSS(int, int, int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.worker.K8sWorkerUtils
calculate the workerID in the given StatefulSet
calculation(Iterator) - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation.ComputeTask
 
canAcceptMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetFinalReceiver
 
canAcceptMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetPartialReceiver
 
canAcceptMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetReceiver
Check weather we can accept a message
cancel() - Method in class org.apache.beam.runners.twister2.Twister2PiplineResult
 
cancelTransfer() - Method in class edu.iu.dsc.tws.rsched.uploaders.k8s.UploaderToPod
 
canProgress() - Method in class edu.iu.dsc.tws.comms.dfw.ControlledProgressTracker
 
canProgress() - Method in class edu.iu.dsc.tws.comms.dfw.ProgressionTracker
 
cast(Object) - Method in interface edu.iu.dsc.tws.api.comms.messaging.types.MessageType
 
CDFConstants - Class in edu.iu.dsc.tws.examples.batch.cdfw
 
CDFConstants() - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
 
CDFJobParameters - Class in edu.iu.dsc.tws.examples.batch.cdfw
 
CDFJobParameters(int) - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.CDFJobParameters
 
CDFWEnv - Class in edu.iu.dsc.tws.task.cdfw
 
CDFWEnv(Config, IScaler, IDriverMessenger, List<JobMasterAPI.WorkerInfo>) - Constructor for class edu.iu.dsc.tws.task.cdfw.CDFWEnv
 
CDFWExecutor - Class in edu.iu.dsc.tws.task.cdfw
 
CDFWExecutor(CDFWEnv, IDriverMessenger) - Constructor for class edu.iu.dsc.tws.task.cdfw.CDFWExecutor
 
CDFWRuntime - Class in edu.iu.dsc.tws.task.impl.cdfw
 
CDFWRuntime(Config, int, IWorkerController) - Constructor for class edu.iu.dsc.tws.task.impl.cdfw.CDFWRuntime
Connected Dataflow Runtime
CDFWScheduler - Class in edu.iu.dsc.tws.task.cdfw
This schedule is the base method for making decisions to run the part of the task graph which will be improved further with the complex logic.
CDFWScheduler(List<JobMasterAPI.WorkerInfo>) - Constructor for class edu.iu.dsc.tws.task.cdfw.CDFWScheduler
 
CDFWWorker - Class in edu.iu.dsc.tws.task.impl.cdfw
This is an implementation of IWorker to support easy deployment of task graphs.
CDFWWorker() - Constructor for class edu.iu.dsc.tws.task.impl.cdfw.CDFWWorker
 
CenterSource(String) - Constructor for class edu.iu.dsc.tws.examples.batch.kmeans.KMeansTsetJob.CenterSource
 
CentroidAggregator() - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.KMeansConnectedDataflowExample.CentroidAggregator
 
CentroidAggregator() - Constructor for class edu.iu.dsc.tws.examples.batch.kmeans.KMeansComputeJob.CentroidAggregator
 
cfg - Variable in class edu.iu.dsc.tws.connectors.kafka.KafkaSource
 
changeJobState(String, JobState) - Method in interface edu.iu.dsc.tws.dashboard.repositories.JobRepository
 
changeNumberOfWorkers(String, Integer) - Method in interface edu.iu.dsc.tws.dashboard.repositories.JobRepository
 
changeState(String, StateChangeRequest<JobState>) - Method in class edu.iu.dsc.tws.dashboard.controllers.JobController
 
changeState(String, Long, StateChangeRequest<WorkerState>) - Method in class edu.iu.dsc.tws.dashboard.controllers.WorkerController
 
changeState(String, StateChangeRequest<JobState>) - Method in class edu.iu.dsc.tws.dashboard.services.JobService
 
changeState(String, Long, StateChangeRequest<WorkerState>) - Method in class edu.iu.dsc.tws.dashboard.services.WorkerService
 
changeStateOfAllWorkers(String, WorkerState, WorkerState) - Method in interface edu.iu.dsc.tws.dashboard.repositories.WorkerRepository
 
changeStateOfAllWorkers(String, WorkerState) - Method in class edu.iu.dsc.tws.dashboard.services.WorkerService
 
changeWorkerState(String, Long, WorkerState) - Method in interface edu.iu.dsc.tws.dashboard.repositories.WorkerRepository
 
channel - Variable in class edu.iu.dsc.tws.api.comms.BaseOperation
THe underlying channel
channel - Variable in class edu.iu.dsc.tws.executor.comms.AbstractParallelOperation
 
channel - Variable in class edu.iu.dsc.tws.executor.threading.ThreadSharingExecutor
Channel
channel - Variable in class edu.iu.dsc.tws.task.impl.cdfw.CDFWWorker
The channel
CHANNEL_PENDING_SIZE - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
 
ChannelBuffer - Interface in edu.iu.dsc.tws.comms.table.channel
 
ChannelDataFlowOperation - Class in edu.iu.dsc.tws.comms.dfw
 
channelHandler - Variable in class edu.iu.dsc.tws.common.net.tcp.BaseNetworkChannel
 
ChannelHandler - Interface in edu.iu.dsc.tws.common.net.tcp
Listen to channel events
ChannelListener - Interface in edu.iu.dsc.tws.api.comms.channel
A listener for getting notifications about completion of network events
ChannelMessage - Class in edu.iu.dsc.tws.api.comms.messaging
 
ChannelMessage() - Constructor for class edu.iu.dsc.tws.api.comms.messaging.ChannelMessage
 
ChannelMessage(int, MessageType, MessageDirection, ChannelMessageReleaseCallback) - Constructor for class edu.iu.dsc.tws.api.comms.messaging.ChannelMessage
 
ChannelMessageReleaseCallback - Interface in edu.iu.dsc.tws.api.comms.messaging
 
ChannelReceiveCallback - Interface in edu.iu.dsc.tws.comms.table.channel
 
ChannelReceiver - Interface in edu.iu.dsc.tws.api.comms.channel
Get notifications about receives and sends
ChannelSendCallback - Interface in edu.iu.dsc.tws.comms.table.channel
 
CHAR - Static variable in class edu.iu.dsc.tws.api.comms.messaging.types.MessageTypes
 
CHAR_ARRAY - Static variable in class edu.iu.dsc.tws.api.comms.messaging.types.MessageTypes
 
CharArrayPacker - Class in edu.iu.dsc.tws.api.comms.packing.types.primitive
 
CharPacker - Class in edu.iu.dsc.tws.api.comms.packing.types.primitive
 
checkBarrierFailure() - Method in class edu.iu.dsc.tws.master.barrier.BarrierMonitor
this method is called periodically by Job Master to check for the barrier failure barriers fail for two reasons: the barrier times out: barrier failure message should be broadcasted to all waiting workers job becomes faulty: default barrier fails in this case only
checkCycle(T, T) - Method in class edu.iu.dsc.tws.tset.graph.DAGMutableGraph
check if adding this edge to the graph creates an cycle
checkCycle() - Method in class edu.iu.dsc.tws.tset.test.graph.BasicGraphTests
 
checkData(int, int) - Method in class edu.iu.dsc.tws.examples.ml.svm.data.DataPartitioner
 
checkForInstantiationError(Class<? extends FileSystem>) - Static method in class edu.iu.dsc.tws.data.utils.InstantiationUtils
 
checkIfEmptyIsSent(int) - Method in class edu.iu.dsc.tws.comms.dfw.io.gather.keyed.DKGatherBatchFinalReceiver
checks if the Empty message was sent for this target and sends it if not sent and possible to send.
checkIfEmptyIsSent(int) - Method in class edu.iu.dsc.tws.comms.dfw.io.KeyedReceiver
checks if the Empty message was sent for this target and sends it if not sent and possible to send
checkJstZNodeWaitIfNeeded(CuratorFramework, String, String, long) - Static method in class edu.iu.dsc.tws.common.zk.JobZNodeManager
Job master creates job submission time znode under job znode, as the last action to create job related znodes at ZK server workers wait for the job master to create this znode.
checkNotNull(T, String) - Static method in class edu.iu.dsc.tws.data.utils.PreConditions
 
checkNotNull(String, String) - Static method in class edu.iu.dsc.tws.data.utils.PreConditions
 
checkNotNull(T, String) - Static method in class edu.iu.dsc.tws.deeplearning.common.ParameterTool
 
checkPodsReachable(Config) - Static method in class edu.iu.dsc.tws.api.config.SchedulerContext
 
checkpoint(long, CheckpointableTask, SnapshotImpl, StateStore, String, int, CheckpointingClient) - Static method in class edu.iu.dsc.tws.executor.core.TaskCheckpointUtils
 
CHECKPOINT_COMPONENT_ID - Static variable in class org.apache.storm.spout.CheckpointSpout
 
CHECKPOINT_FIELD_ACTION - Static variable in class org.apache.storm.spout.CheckpointSpout
 
CHECKPOINT_FIELD_TXID - Static variable in class org.apache.storm.spout.CheckpointSpout
 
CHECKPOINT_STREAM_ID - Static variable in class org.apache.storm.spout.CheckpointSpout
 
CHECKPOINT_YAML - Static variable in class edu.iu.dsc.tws.api.config.Context
 
CheckpointablePythonWorker() - Constructor for class edu.iu.dsc.tws.python.PythonWorker.CheckpointablePythonWorker
 
CheckpointableTask - Interface in edu.iu.dsc.tws.checkpointing.task
 
checkpointAvailable(String) - Method in interface edu.iu.dsc.tws.api.checkpointing.Snapshot
Weater a checkpoint available for a kye
checkpointAvailable(String) - Method in class edu.iu.dsc.tws.checkpointing.api.SnapshotImpl
 
checkpointCofigurationFile(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
 
checkpointConfigurationFile(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
 
CheckpointedSourceOp<T> - Class in edu.iu.dsc.tws.tset.ops
 
CheckpointedSourceOp(DiskPartitionBackedSourceWrapper<T>, BaseTSet, Map<String, String>) - Constructor for class edu.iu.dsc.tws.tset.ops.CheckpointedSourceOp
 
CheckpointedTSet<T> - Class in edu.iu.dsc.tws.tset.sets.batch
This is a shadow PersistedTSet to add the checkpointing capability.
CheckpointedTSet(BatchEnvironment, DiskPartitionBackedSource<T>, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.batch.CheckpointedTSet
 
CHECKPOINTING_ENABLED - Static variable in class edu.iu.dsc.tws.checkpointing.util.CheckpointingContext
 
CHECKPOINTING_RESTORE_JOB - Static variable in class edu.iu.dsc.tws.checkpointing.util.CheckpointingContext
 
CHECKPOINTING_SOURCE_FREQUNCY - Static variable in class edu.iu.dsc.tws.checkpointing.util.CheckpointingContext
 
CHECKPOINTING_STORE_CLASS - Static variable in class edu.iu.dsc.tws.checkpointing.util.CheckpointingContext
 
CHECKPOINTING_STORE_FS_DIR - Static variable in class edu.iu.dsc.tws.checkpointing.stores.LocalFileStateStore
 
CheckpointingClient - Interface in edu.iu.dsc.tws.api.checkpointing
todo This class was added as an temp solution to resolve a cyclic dependency issue.
CheckpointingClientImpl - Class in edu.iu.dsc.tws.checkpointing.client
This client can be used to communicate with CheckpointManager
CheckpointingClientImpl(RRClient, long) - Constructor for class edu.iu.dsc.tws.checkpointing.client.CheckpointingClientImpl
 
CheckpointingContext - Class in edu.iu.dsc.tws.checkpointing.util
 
CheckpointingExample - Class in edu.iu.dsc.tws.examples.tset.checkpointing
 
CheckpointingExample() - Constructor for class edu.iu.dsc.tws.examples.tset.checkpointing.CheckpointingExample
 
CheckpointingSGatherSink - Class in edu.iu.dsc.tws.checkpointing.task
 
CheckpointingSGatherSink(String) - Constructor for class edu.iu.dsc.tws.checkpointing.task.CheckpointingSGatherSink
 
CheckpointingTaskExample - Class in edu.iu.dsc.tws.examples.checkpointing
 
CheckpointingTaskExample() - Constructor for class edu.iu.dsc.tws.examples.checkpointing.CheckpointingTaskExample
 
CheckpointingTaskExample.ComputeTask - Class in edu.iu.dsc.tws.examples.checkpointing
 
CheckpointingTaskExample.SinkTask - Class in edu.iu.dsc.tws.examples.checkpointing
 
CheckpointingTaskExample.SourceTask - Class in edu.iu.dsc.tws.examples.checkpointing
 
CheckpointingWorkerEnv - Class in edu.iu.dsc.tws.checkpointing.worker
 
CheckpointingWorkerEnv.Builder - Class in edu.iu.dsc.tws.checkpointing.worker
 
CheckpointManager - Class in edu.iu.dsc.tws.checkpointing.master
 
CheckpointManager(RRServer, StateStore, String) - Constructor for class edu.iu.dsc.tws.checkpointing.master.CheckpointManager
 
CheckpointSpout - Class in org.apache.storm.spout
Emits checkpoint tuples which is used to save the state of the IStatefulComponent across the topology.
CheckpointSpout() - Constructor for class org.apache.storm.spout.CheckpointSpout
 
CheckPointState - Class in org.apache.storm.spout
Captures the current state of the transaction in CheckpointSpout.
CheckPointState(long, CheckPointState.State) - Constructor for class org.apache.storm.spout.CheckPointState
 
CheckPointState() - Constructor for class org.apache.storm.spout.CheckPointState
 
CheckPointState.Action - Enum in org.apache.storm.spout
 
CheckPointState.State - Enum in org.apache.storm.spout
 
CheckpointStatus - Class in edu.iu.dsc.tws.checkpointing.master
 
CheckpointStatus(String, int) - Constructor for class edu.iu.dsc.tws.checkpointing.master.CheckpointStatus
 
CheckpointUtils - Class in edu.iu.dsc.tws.checkpointing.util
 
checkPwdFreeSsh(Config) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesContext
 
checkSelfCycle() - Method in class edu.iu.dsc.tws.tset.test.graph.BasicGraphTests
 
childOfTask(Vertex, String) - Method in class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
 
childrenOfTask(TV) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
This method is helpful to find out the children of the task vertex (t).
childrenOfTask(String) - Method in class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
 
chooseTasks(int, List<Object>) - Method in interface org.apache.storm.grouping.CustomStreamGrouping
This function implements a custom stream grouping.
CINPUT_DIRECTORY - Static variable in class edu.iu.dsc.tws.data.utils.DataObjectConstants
 
classesToLoad - Variable in class edu.iu.dsc.tws.local.util.LocalClassLoader
 
clean() - Method in interface edu.iu.dsc.tws.api.comms.messaging.MessageReceiver
Clean any state associated with the receiver and go to initial state
clean() - Method in class edu.iu.dsc.tws.comms.dfw.io.gather.DGatherBatchFinalReceiver
 
clean() - Method in class edu.iu.dsc.tws.comms.dfw.io.partition.DPartitionBatchFinalReceiver
 
clean() - Method in class edu.iu.dsc.tws.comms.dfw.io.partition.PartitionPartialReceiver
 
clean() - Method in class edu.iu.dsc.tws.comms.dfw.io.SourceReceiver
 
clean() - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetFinalReceiver
 
clean() - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetPartialReceiver
 
clean() - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedMerger
Cleanup the directories
clean() - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMerger
Cleanup the directories
clean() - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMerger2
Cleanup the directories
clean() - Method in class edu.iu.dsc.tws.comms.shuffle.FSMerger
Cleanup the directories
clean - Static variable in class edu.iu.dsc.tws.comms.shuffle.MemoryMapUtils
 
clean() - Method in interface edu.iu.dsc.tws.comms.shuffle.Shuffle
Clean the file system
cleanup() - Method in interface org.apache.storm.task.IBolt
Called when an IBolt is going to be shutdown.
cleanup() - Method in class org.apache.storm.topology.base.BaseBasicBolt
 
cleanup() - Method in class org.apache.storm.topology.base.BaseRichBolt
 
cleanup() - Method in class org.apache.storm.topology.base.BaseWindowedBolt
 
cleanup() - Method in interface org.apache.storm.topology.IBasicBolt
 
cleanup() - Method in interface org.apache.storm.topology.IStatefulBolt
 
cleanup() - Method in interface org.apache.storm.topology.IWindowedBolt
 
cleanup() - Method in class org.apache.storm.topology.WindowedBoltExecutor
 
clear() - Method in interface edu.iu.dsc.tws.api.dataset.DataPartition
 
clear() - Method in class edu.iu.dsc.tws.common.net.tcp.BaseNetworkChannel
 
clear() - Method in class edu.iu.dsc.tws.comms.utils.DiskBasedList
 
clear() - Method in class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
 
clear() - Method in class edu.iu.dsc.tws.dataset.partition.CollectionPartition
 
clear() - Method in class org.apache.storm.generated.GlobalStreamId
 
clearAllJobs(Config) - Static method in class edu.iu.dsc.tws.rsched.job.Twister2Submitter
Clear left over resources for all checkpointed jobs that are not currently running: The Job package for the checkpointed job stored in user home directory Checkpointed data that are saved when jobs failed.
clearData(String) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
This method can be used to clear DataPartitions collected from previous task graphs, which are no longer required
clearJob(String, Config) - Static method in class edu.iu.dsc.tws.rsched.job.Twister2Submitter
 
clearRestorePoint() - Method in class edu.iu.dsc.tws.comms.shuffle.ControlledFileReader
 
clearRestorePoint() - Method in class edu.iu.dsc.tws.comms.shuffle.ControlledMemoryReader
 
clearRestorePoint() - Method in interface edu.iu.dsc.tws.comms.shuffle.Restorable
 
clearRestorePoint() - Method in class edu.iu.dsc.tws.comms.utils.SortJoinUtils.ListBasedRestorableIterator
 
clearTarget(int) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetReceiver
Clear all the buffers for the target, to ready for the next
clearTemporaryFiles(String) - Method in class edu.iu.dsc.tws.rsched.core.ResourceAllocator
clear temporary files
clearWindow() - Method in interface edu.iu.dsc.tws.task.window.manage.IWindowingPolicyManager
 
Client - Class in edu.iu.dsc.tws.common.net.tcp
 
Client(String, int, Config, Progress, ChannelHandler) - Constructor for class edu.iu.dsc.tws.common.net.tcp.Client
 
Client(String, int, Config, Progress, ChannelHandler, boolean) - Constructor for class edu.iu.dsc.tws.common.net.tcp.Client
 
client - Variable in class edu.iu.dsc.tws.master.server.ZKMasterController
 
CLIENT_ID - Static variable in class edu.iu.dsc.tws.common.net.tcp.request.RRServer
The client id
clientChannel - Variable in class edu.iu.dsc.tws.common.net.tcp.request.RRServer
the client channel,
clientChannels - Variable in class edu.iu.dsc.tws.common.net.tcp.TCPChannel
client channels with workerIDs
ClientConnectHandler() - Constructor for class edu.iu.dsc.tws.master.worker.JMWorkerAgent.ClientConnectHandler
 
ClientJobKillHandler - Class in edu.iu.dsc.tws.rsched.schedulers.k8s
Watch whether job resources are killed by Job Master If necessary, kill the job resources from Twister2 client
ClientJobKillHandler(String, KubernetesController) - Constructor for class edu.iu.dsc.tws.rsched.schedulers.k8s.ClientJobKillHandler
 
cloneWithRam(double) - Method in class edu.iu.dsc.tws.api.compute.schedule.elements.Resource
 
cloneWorkers() - Method in class edu.iu.dsc.tws.common.zk.ZKWorkerController
 
Closable - Interface in edu.iu.dsc.tws.api.compute.modifiers
A task which needs to clean up resources at the end should implement this method
close() - Method in class edu.iu.dsc.tws.api.comms.BaseOperation
 
close() - Method in interface edu.iu.dsc.tws.api.comms.channel.TWSChannel
Close the channel
close() - Method in class edu.iu.dsc.tws.api.comms.Communicator
Terminate the communicator
close() - Method in interface edu.iu.dsc.tws.api.comms.DataFlowOperation
Close the operation
close() - Method in interface edu.iu.dsc.tws.api.comms.messaging.MessageReceiver
Close the receiver
close() - Method in interface edu.iu.dsc.tws.api.compute.executor.IExecution
Cleanup the execution
close() - Method in interface edu.iu.dsc.tws.api.compute.executor.IExecutor
Terminate the executor
close() - Method in interface edu.iu.dsc.tws.api.compute.executor.INodeInstance
Calls at the end to clean up
close() - Method in interface edu.iu.dsc.tws.api.compute.executor.IParallelOperation
Close the parallel operation
close() - Method in interface edu.iu.dsc.tws.api.compute.modifiers.Closable
Close method for cleaning up the resources
close() - Method in class edu.iu.dsc.tws.api.compute.nodes.BaseNode
 
close() - Method in class edu.iu.dsc.tws.api.data.FSDataOutputStream
Closes the output stream.
close() - Method in class edu.iu.dsc.tws.api.resource.WorkerEnvironment
Close the worker environment
close() - Method in interface edu.iu.dsc.tws.api.scheduler.IController
 
close() - Method in interface edu.iu.dsc.tws.api.scheduler.ILauncher
Cleanup any resources
close() - Method in interface edu.iu.dsc.tws.api.scheduler.IUploader
This is to for disposing or cleaning up any internal state accumulated by the uploader
close() - Method in interface edu.iu.dsc.tws.api.tset.fn.RecordCollector
Closes the collector
close() - Method in interface edu.iu.dsc.tws.api.tset.fn.SourceFunc
Closes the source
close() - Method in interface edu.iu.dsc.tws.api.tset.fn.TFunction
 
close() - Static method in class edu.iu.dsc.tws.api.util.CommonThreadPool
 
close() - Method in class edu.iu.dsc.tws.common.logging.Twister2FileLogHandler
 
close() - Method in class edu.iu.dsc.tws.common.zk.ZKJobMasterFinder
 
close() - Method in class edu.iu.dsc.tws.common.zk.ZKJobMasterRegistrar
 
close() - Method in class edu.iu.dsc.tws.common.zk.ZKWorkerController
close all local entities.
close() - Method in class edu.iu.dsc.tws.comms.batch.BJoin
 
close() - Method in class edu.iu.dsc.tws.comms.dfw.AllGather
 
close() - Method in class edu.iu.dsc.tws.comms.dfw.AllReduce
 
close() - Method in class edu.iu.dsc.tws.comms.dfw.ChannelDataFlowOperation
 
close() - Method in class edu.iu.dsc.tws.comms.dfw.ControlledChannelOperation
 
close() - Method in class edu.iu.dsc.tws.comms.dfw.io.ByteArrayInputStream
 
close() - Method in class edu.iu.dsc.tws.comms.dfw.io.ByteArrayOutputStream
 
close() - Method in class edu.iu.dsc.tws.comms.dfw.io.gather.DGatherBatchFinalReceiver
 
close() - Method in class edu.iu.dsc.tws.comms.dfw.io.partition.DPartitionBatchFinalReceiver
 
close() - Method in class edu.iu.dsc.tws.comms.dfw.MToNChain
 
close() - Method in class edu.iu.dsc.tws.comms.dfw.MToNRing
 
close() - Method in class edu.iu.dsc.tws.comms.dfw.MToNSimple
 
close() - Method in class edu.iu.dsc.tws.comms.dfw.MToOneTree
 
close() - Method in class edu.iu.dsc.tws.comms.dfw.OneToOne
 
close() - Method in class edu.iu.dsc.tws.comms.dfw.TreeBroadcast
 
close() - Method in class edu.iu.dsc.tws.comms.mpi.TWSMPIChannel
 
close() - Method in class edu.iu.dsc.tws.comms.shuffle.OpenFile
 
close() - Method in class edu.iu.dsc.tws.comms.table.ArrowAllToAll
 
close() - Method in class edu.iu.dsc.tws.comms.table.channel.MPIChannel
Close the channel and clear any allocated memory by the channel
close() - Method in class edu.iu.dsc.tws.comms.table.ops.BTPartition
 
close() - Method in class edu.iu.dsc.tws.comms.table.ops.STPartition
 
close() - Method in class edu.iu.dsc.tws.comms.table.SimpleAllToAll
 
close() - Method in class edu.iu.dsc.tws.comms.tcp.TWSTCPChannel
 
close() - Method in class edu.iu.dsc.tws.comms.ucx.TWSUCXChannel
 
close() - Method in class edu.iu.dsc.tws.data.api.out.CSVOutputWriter
 
close() - Method in class edu.iu.dsc.tws.data.api.out.FileOutputWriter
 
close() - Method in class edu.iu.dsc.tws.data.api.out.TextOutputWriter
 
close() - Method in interface edu.iu.dsc.tws.data.api.OutputWriter
Close the writer, flush everything
close() - Method in class edu.iu.dsc.tws.data.api.splits.CSVInputSplit
Closes the input by releasing all buffers and closing the file input stream.
close() - Method in class edu.iu.dsc.tws.data.api.splits.DelimitedInputSplit
Closes the input by releasing all buffers and closing the file input stream.
close() - Method in class edu.iu.dsc.tws.data.api.splits.FileInputSplit
 
close() - Method in class edu.iu.dsc.tws.data.arrow.Twister2ArrowFileWriter
 
close() - Method in class edu.iu.dsc.tws.data.arrow.Twister2ArrowOutputStream
 
close() - Method in interface edu.iu.dsc.tws.data.fs.io.InputSplit
Method that marks the end of the life-cycle of an input split.
close() - Method in class edu.iu.dsc.tws.data.fs.local.LocalDataInputStream
 
close() - Method in class edu.iu.dsc.tws.data.fs.local.LocalDataOutputStream
 
close() - Method in class edu.iu.dsc.tws.data.hdfs.HadoopDataInputStream
 
close() - Method in class edu.iu.dsc.tws.data.hdfs.HadoopDataOutputStream
 
close() - Method in class edu.iu.dsc.tws.data.hdfs.HadoopFileSystem
 
close(int, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
 
close(int, String) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
Closing the key will make the BufferedMemoryManager to flush the current data into the store and delete all the key information.
close(int, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
 
close(int, String) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
 
close(int, ByteBuffer) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
flush and close the given key.
close(int, String) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
 
close(ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
 
close(String) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
 
close() - Method in class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
 
close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BAllGatherExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BAllReduceExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BBroadcastExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BDirectExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BDJoinExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BDKeyedGatherExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BGatherExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BJoinExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BJoinStudentExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BKeyedGatherExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BKeyedPartitionExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BKeyedReduceExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BPartitionExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BReduceExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.BenchWorker
 
close() - Method in class edu.iu.dsc.tws.examples.comms.KeyedBenchWorker
 
close() - Method in class edu.iu.dsc.tws.examples.comms.stream.SAllGatherExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.stream.SAllReduceExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.stream.SBroadcastExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.stream.SDirectExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.stream.SGatherExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.stream.SPartitionExample
 
close() - Method in class edu.iu.dsc.tws.examples.comms.stream.SReduceExample
 
close() - Method in class edu.iu.dsc.tws.examples.ml.svm.comms.CommsWorker
 
close() - Method in class edu.iu.dsc.tws.examples.ml.svm.comms.SVMCommsReducer
 
close() - Method in class edu.iu.dsc.tws.executor.comms.AbstractParallelOperation
 
close() - Method in class edu.iu.dsc.tws.executor.comms.batch.JoinBatchOperation
 
close() - Method in class edu.iu.dsc.tws.executor.core.batch.SourceBatchInstance
 
close() - Method in class edu.iu.dsc.tws.executor.core.batch.TaskBatchInstance
 
close() - Method in class edu.iu.dsc.tws.executor.core.streaming.SourceStreamingInstance
 
close() - Method in class edu.iu.dsc.tws.executor.core.streaming.TaskStreamingInstance
 
close() - Method in class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor2
 
close() - Method in class edu.iu.dsc.tws.executor.threading.NullExecutor
 
close() - Method in class edu.iu.dsc.tws.executor.threading.StreamingAllSharingExecutor
 
close() - Method in class edu.iu.dsc.tws.executor.threading.StreamingAllSharingExecutor2
 
close() - Method in class edu.iu.dsc.tws.executor.threading.ThreadSharingExecutor
 
close() - Method in class edu.iu.dsc.tws.master.barrier.ZKBarrierHandler
close all local entities.
close() - Method in class edu.iu.dsc.tws.master.dashclient.DashboardClient
 
close() - Method in class edu.iu.dsc.tws.master.server.ZKMasterController
close all local entities.
close() - Method in class edu.iu.dsc.tws.master.worker.JMWorkerAgent
stop the JMWorkerAgent
close() - Method in class edu.iu.dsc.tws.python.EntryPoint
 
close() - Static method in class edu.iu.dsc.tws.rsched.core.WorkerRuntime
 
close() - Method in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraLauncher
Close up any resources
close() - Method in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraWorkerStarter
needs to close down when finished computation
close() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
 
close() - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesLauncher
Close up any resources
close() - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.master.JobKillWatcher
 
close() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.PodWatchUtils
 
close() - Method in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosLauncher
 
close() - Method in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosWorkerController
needs to close down when finished computation
close() - Method in class edu.iu.dsc.tws.rsched.schedulers.nomad.NomadController
 
close() - Method in class edu.iu.dsc.tws.rsched.schedulers.nomad.NomadLauncher
 
close() - Method in class edu.iu.dsc.tws.rsched.schedulers.standalone.MPIController
 
close() - Method in class edu.iu.dsc.tws.rsched.schedulers.standalone.MPILauncher
 
close() - Method in class edu.iu.dsc.tws.rsched.uploaders.hdfs.HdfsUploader
 
close() - Method in class edu.iu.dsc.tws.rsched.uploaders.k8s.DirectUploader
 
close() - Method in class edu.iu.dsc.tws.rsched.uploaders.k8s.K8sUploader
 
close() - Method in class edu.iu.dsc.tws.rsched.uploaders.k8s.UploaderToWebServers
 
close() - Method in class edu.iu.dsc.tws.rsched.uploaders.localfs.LocalFileSystemUploader
 
close() - Method in class edu.iu.dsc.tws.rsched.uploaders.NullUploader
This is to for disposing or cleaning up any internal state accumulated by the uploader
close() - Method in class edu.iu.dsc.tws.rsched.uploaders.s3.S3Uploader
 
close() - Method in class edu.iu.dsc.tws.rsched.uploaders.scp.ScpUploader
 
close() - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
close the tar stream
close() - Method in class edu.iu.dsc.tws.task.cdfw.CDFWEnv
 
close() - Method in class edu.iu.dsc.tws.task.ComputeEnvironment
Closes the task environment
close() - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
 
close() - Method in class edu.iu.dsc.tws.task.window.core.BaseWindowedSink
 
close() - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
Close the environment
close() - Method in class edu.iu.dsc.tws.tset.fn.FlatMapCompute
 
close() - Method in class edu.iu.dsc.tws.tset.fn.FlatMapIterCompute
 
close() - Method in class edu.iu.dsc.tws.tset.fn.ForEachCompute
 
close() - Method in class edu.iu.dsc.tws.tset.fn.ForEachIterCompute
 
close() - Method in class edu.iu.dsc.tws.tset.fn.GatherFlatMapCompute
 
close() - Method in class edu.iu.dsc.tws.tset.fn.GatherForEachCompute
 
close() - Method in class edu.iu.dsc.tws.tset.fn.GatherMapCompute
 
close() - Method in class edu.iu.dsc.tws.tset.fn.impl.ArrowBasedSinkFunction
 
close() - Method in class edu.iu.dsc.tws.tset.fn.MapCompute
 
close() - Method in class edu.iu.dsc.tws.tset.fn.MapIterCompute
 
close() - Method in class edu.iu.dsc.tws.tset.fn.ProcessWindowCompute
 
close() - Method in class edu.iu.dsc.tws.tset.fn.row.RowFlatMapCompute
 
close() - Method in class edu.iu.dsc.tws.tset.fn.row.RowForEachCompute
 
close() - Method in class edu.iu.dsc.tws.tset.fn.row.RowMapCompute
 
close() - Method in class edu.iu.dsc.tws.tset.ops.ComputeCollectorOp
 
close() - Method in class edu.iu.dsc.tws.tset.ops.ComputeCollectorToTupleOp
 
close() - Method in class edu.iu.dsc.tws.tset.ops.ComputeOp
 
close() - Method in class edu.iu.dsc.tws.tset.ops.ComputeToTupleOp
 
close() - Method in class edu.iu.dsc.tws.tset.ops.row.RowComupteCollectorOp
 
close() - Method in class edu.iu.dsc.tws.tset.ops.row.RowItrComputeCollectorOp
 
close() - Method in class edu.iu.dsc.tws.tset.ops.row.RowSinkOp
 
close() - Method in class edu.iu.dsc.tws.tset.ops.SinkOp
 
close() - Method in class edu.iu.dsc.tws.tset.ops.SourceOp
 
close() - Method in class edu.iu.dsc.tws.tset.sinks.BaseDiskPersistIterSink
 
close() - Method in class edu.iu.dsc.tws.tset.sinks.DiskPersistSingleSink
 
close() - Method in class edu.iu.dsc.tws.tset.sinks.FileIterSink
 
close() - Method in class edu.iu.dsc.tws.tset.sinks.FileSink
 
close() - Method in class edu.iu.dsc.tws.tset.sinks.StreamingDiskPersistSink
 
close() - Method in class org.apache.beam.runners.twister2.translators.functions.SideInputSinkFunction
 
close() - Method in class org.apache.beam.runners.twister2.translators.functions.Twister2SinkFunction
 
close() - Method in interface org.apache.storm.spout.ISpout
Called when an ISpout is going to be shutdown.
close() - Method in class org.apache.storm.topology.base.BaseRichSpout
 
closeClient() - Static method in class edu.iu.dsc.tws.common.zk.ZKUtils
 
closeConnection(int) - Method in class edu.iu.dsc.tws.common.net.tcp.TCPChannel
 
closeExecution() - Method in interface edu.iu.dsc.tws.api.compute.executor.IExecutor
Wait for the execution to complete
closeExecution() - Method in class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor
 
closeExecution() - Method in class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor2
 
closeExecution() - Method in class edu.iu.dsc.tws.executor.threading.StreamingAllSharingExecutor
 
closeExecution() - Method in class edu.iu.dsc.tws.executor.threading.StreamingAllSharingExecutor2
 
closeExecution() - Method in class edu.iu.dsc.tws.executor.threading.StreamingSharingExecutor
 
closeWorker() - Static method in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosDockerWorker
last method to call to close the worker
closeWorker() - Static method in class edu.iu.dsc.tws.rsched.schedulers.mesos.mpi.MesosMPIWorkerStarter
last method to call to close the worker
closeWorker() - Method in class edu.iu.dsc.tws.rsched.schedulers.nomad.NomadWorkerStarter
last method to call to close the worker
CLUSTER - Static variable in class edu.iu.dsc.tws.api.config.Context
 
Cluster - Class in edu.iu.dsc.tws.dashboard.data_models
 
Cluster() - Constructor for class edu.iu.dsc.tws.dashboard.data_models.Cluster
 
CLUSTER_CONF - Static variable in class edu.iu.dsc.tws.api.config.Context
 
CLUSTER_HOME - Static variable in class edu.iu.dsc.tws.api.config.Context
 
CLUSTER_TYPE - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
 
ClusterController - Class in edu.iu.dsc.tws.dashboard.controllers
 
ClusterController(ClusterService, NodeService) - Constructor for class edu.iu.dsc.tws.dashboard.controllers.ClusterController
 
ClusterRepository - Interface in edu.iu.dsc.tws.dashboard.repositories
 
ClusterService - Class in edu.iu.dsc.tws.dashboard.services
 
ClusterService() - Constructor for class edu.iu.dsc.tws.dashboard.services.ClusterService
 
clusterType(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
 
collect(String, IMessage) - Method in interface edu.iu.dsc.tws.api.compute.OutputCollection
Collects a message on the given edge
collect(T) - Method in interface edu.iu.dsc.tws.api.tset.fn.RecordCollector
Collects the record
collect(String, IMessage) - Method in class edu.iu.dsc.tws.executor.core.DefaultOutputCollection
 
collectData(Config, ExecutionPlan, Map<String, DataObject>) - Static method in class edu.iu.dsc.tws.task.impl.TaskExecutor
This method collects all the output from the provided ExecutionPlan.
CollectionPartition<T> - Class in edu.iu.dsc.tws.dataset.partition
 
CollectionPartition(int) - Constructor for class edu.iu.dsc.tws.dataset.partition.CollectionPartition
Deprecated.
use default constructor instead
CollectionPartition() - Constructor for class edu.iu.dsc.tws.dataset.partition.CollectionPartition
 
CollectionSource<T> - Class in edu.iu.dsc.tws.tset.sources
 
CollectionSource(Collection<T>) - Constructor for class edu.iu.dsc.tws.tset.sources.CollectionSource
 
collectiveEvents - Variable in class edu.iu.dsc.tws.task.window.core.BaseWindowedSink
 
collectiveOutput - Variable in class edu.iu.dsc.tws.task.window.core.BaseWindowedSink
 
Collector - Interface in edu.iu.dsc.tws.api.compute.modifiers
Special task for collecting the output from tasks
COLUMN_AVERAGE_TIME - Static variable in class edu.iu.dsc.tws.examples.utils.bench.BenchmarkConstants
 
COLUMN_TOTAL_TIME - Static variable in class edu.iu.dsc.tws.examples.utils.bench.BenchmarkConstants
 
com.twitter.bazel.checkstyle - package com.twitter.bazel.checkstyle
 
combineLabelAndData(double[], double) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.DataUtils
This method combines the label and features in the data point This can be use to submit a single message in the stream
commandAsAString(String[]) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.mpi.MPIMasterStarter
 
commentPrefix - Variable in class edu.iu.dsc.tws.data.fs.local.LocalCSVReader
 
commit(int, int) - Method in interface edu.iu.dsc.tws.api.comms.DestinationSelector
Say that we have used the obtained destination
commit(int, int) - Method in interface edu.iu.dsc.tws.api.compute.TaskPartitioner
Indicate that we are using this partition
commit(int, int) - Method in interface edu.iu.dsc.tws.api.tset.fn.PartitionFunc
Commit the partition
commit(int, int) - Method in class edu.iu.dsc.tws.comms.selectors.HashingSelector
 
commit(int, int) - Method in class edu.iu.dsc.tws.comms.selectors.LoadBalanceSelector
 
commit(int, int) - Method in class edu.iu.dsc.tws.comms.selectors.SimpleKeyBasedSelector
 
commit(int, int) - Method in class edu.iu.dsc.tws.examples.batch.sortop.ByteSelector
 
commit(int, int) - Method in class edu.iu.dsc.tws.examples.batch.terasort.TaskPartitionerForRandom
 
commit(int, int) - Method in class edu.iu.dsc.tws.examples.utils.partitioners.DeterministicTaskPartitioner
 
commit(int, int) - Method in class edu.iu.dsc.tws.executor.comms.DefaultDestinationSelector
 
commit() - Method in class edu.iu.dsc.tws.tset.env.BatchChkPntEnvironment
Commits the snapshot
commit(int, int) - Method in class edu.iu.dsc.tws.tset.fn.HashingPartitioner
 
commit(int, int) - Method in class edu.iu.dsc.tws.tset.fn.LoadBalancePartitioner
 
commit(int, int) - Method in class edu.iu.dsc.tws.tset.fn.OneToOnePartitioner
 
commit() - Method in class org.apache.storm.state.InMemoryKeyValueState
 
commit(long) - Method in class org.apache.storm.state.InMemoryKeyValueState
 
commit(long) - Method in interface org.apache.storm.state.State
Commit a previously prepared transaction.
commit() - Method in interface org.apache.storm.state.State
Persist the current state.
commitArrowData() - Method in interface edu.iu.dsc.tws.data.arrow.ITwister2ArrowFileWriter
 
commitArrowData() - Method in class edu.iu.dsc.tws.data.arrow.Twister2ArrowFileWriter
 
commitSnapshot() - Method in class edu.iu.dsc.tws.checkpointing.worker.CheckpointingWorkerEnv
 
commitState(StateStore, String, int, SnapshotImpl, CheckpointingClient, MessageHandler) - Static method in class edu.iu.dsc.tws.checkpointing.util.CheckpointUtils
 
commonConfDir(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
 
CommonThreadPool - Class in edu.iu.dsc.tws.api.util
 
COMMS_RUNNER - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
 
commsType - Variable in class edu.iu.dsc.tws.examples.ml.svm.comms.CommsWorker
 
CommsWorker - Class in edu.iu.dsc.tws.examples.ml.svm.comms
 
CommsWorker() - Constructor for class edu.iu.dsc.tws.examples.ml.svm.comms.CommsWorker
 
CommsWorker.DataStreamer - Class in edu.iu.dsc.tws.examples.ml.svm.comms
 
CommunicationContext - Class in edu.iu.dsc.tws.api.comms
 
CommunicationContext() - Constructor for class edu.iu.dsc.tws.api.comms.CommunicationContext
 
CommunicationContext.JoinAlgorithm - Enum in edu.iu.dsc.tws.api.comms
 
CommunicationContext.JoinType - Enum in edu.iu.dsc.tws.api.comms
 
CommunicationWorker(BlockingQueue<INodeInstance>) - Constructor for class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor.CommunicationWorker
 
CommunicationWorker(BlockingQueue<INodeInstance>) - Constructor for class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor2.CommunicationWorker
 
CommunicationWorker(BlockingQueue<INodeInstance>) - Constructor for class edu.iu.dsc.tws.executor.threading.StreamingAllSharingExecutor.CommunicationWorker
 
CommunicationWorker(BlockingQueue<INodeInstance>) - Constructor for class edu.iu.dsc.tws.executor.threading.StreamingAllSharingExecutor2.CommunicationWorker
 
Communicator - Class in edu.iu.dsc.tws.api.comms
Communicator that keeps the information about.
Communicator(Config, TWSChannel) - Constructor for class edu.iu.dsc.tws.api.comms.Communicator
 
Communicator(Config, TWSChannel, List<String>) - Constructor for class edu.iu.dsc.tws.api.comms.Communicator
 
Communicator(Config, TWSChannel, String) - Constructor for class edu.iu.dsc.tws.api.comms.Communicator
 
Communicator(Config, TWSChannel, EdgeGenerator, TaskIdGenerator, List<String>) - Constructor for class edu.iu.dsc.tws.api.comms.Communicator
 
communicator - Variable in class edu.iu.dsc.tws.task.impl.cdfw.CDFWWorker
Communicator
compactWindow() - Method in class edu.iu.dsc.tws.task.window.manage.WindowManager
 
compactWindow() - Method in class org.apache.storm.windowing.StatefulWindowManager
 
compactWindow() - Method in class org.apache.storm.windowing.WindowManager
expires events that fall out of the window every EXPIRE_EVENTS_THRESHOLD so that the window does not grow too big.
comparator() - Method in class edu.iu.dsc.tws.python.tset.fn.TSetFunctions
 
ComparatorFunctions - Class in edu.iu.dsc.tws.python.tset.fn
 
ComparatorFunctions() - Constructor for class edu.iu.dsc.tws.python.tset.fn.ComparatorFunctions
 
ComparatorFunctions.ComparatorImpl - Class in edu.iu.dsc.tws.python.tset.fn
 
compare(String, String) - Method in class edu.iu.dsc.tws.api.compute.graph.ComputeGraph.StringComparator
 
compare(Tuple, Tuple) - Method in class edu.iu.dsc.tws.comms.utils.KeyComparatorWrapper
 
compare(byte[], byte[]) - Method in class edu.iu.dsc.tws.examples.batch.terasort.TeraSort.ByteArrayComparator
 
compare(byte[], byte[]) - Method in class edu.iu.dsc.tws.examples.tset.tutorial.terasort.TSetTeraSort.ByteArrayComparator
 
compare(int[], int[]) - Method in class edu.iu.dsc.tws.examples.verification.comparators.IntArrayComparator
 
compare(Integer, Integer) - Method in class edu.iu.dsc.tws.examples.verification.comparators.IntComparator
 
compare(Iterator<int[]>, Iterator<int[]>) - Method in class edu.iu.dsc.tws.examples.verification.comparators.IntIteratorComparator
 
compare(Iterator<V>, Iterator<V>) - Method in class edu.iu.dsc.tws.examples.verification.comparators.IteratorComparator
 
compare(List<int[]>, List<int[]>) - Method in class edu.iu.dsc.tws.examples.verification.comparators.ListOfIntArraysComparator
 
compare(Tuple<K, V>, Tuple<K, V>) - Method in class edu.iu.dsc.tws.examples.verification.comparators.TupleComparator
 
compare(D, D) - Method in interface edu.iu.dsc.tws.examples.verification.ResultsComparator
 
compare(Object, Object) - Method in class edu.iu.dsc.tws.python.tset.fn.ComparatorFunctions.ComparatorImpl
 
compareTo(TaskInstancePlan) - Method in class edu.iu.dsc.tws.api.compute.schedule.elements.TaskInstancePlan
 
compareTo(WorkerSchedulePlan) - Method in class edu.iu.dsc.tws.api.compute.schedule.elements.WorkerSchedulePlan
 
compareTo(ControlledReader) - Method in class edu.iu.dsc.tws.comms.shuffle.ControlledFileReader
 
compareTo(ControlledReader<Tuple>) - Method in class edu.iu.dsc.tws.comms.shuffle.ControlledMemoryReader
 
compareTo(HeapNode<K, V>) - Method in class edu.iu.dsc.tws.comms.utils.HeapNode
 
compareTo(BlockLocation) - Method in class edu.iu.dsc.tws.data.fs.local.LocalBlockLocation
 
compareTo(BlockLocation) - Method in class edu.iu.dsc.tws.data.hdfs.HadoopBlockLocation
 
compareTo(DataTransferTimeCalculator) - Method in class edu.iu.dsc.tws.tsched.utils.DataTransferTimeCalculator
 
compareTo(RequiredRam) - Method in class edu.iu.dsc.tws.tsched.utils.RequiredRam
 
complete - Variable in class edu.iu.dsc.tws.api.comms.messaging.ChannelMessage
Keep whether we have all the buffers added
complete() - Method in interface edu.iu.dsc.tws.api.scheduler.IUploader
if uploader is threaded, this method will wait for the threaded uploading to finish
complete - Variable in class edu.iu.dsc.tws.comms.dfw.InMessage
Keep whether we have all the buffers added
complete() - Method in class edu.iu.dsc.tws.rsched.uploaders.k8s.DirectUploader
DirectUploader should run until the job completes it should upload the job package in case of failures and job scaling up new workers
complete() - Method in class edu.iu.dsc.tws.rsched.uploaders.k8s.K8sUploader
 
complete() - Method in class edu.iu.dsc.tws.rsched.uploaders.k8s.UploaderToWebServers
 
complete() - Method in class edu.iu.dsc.tws.rsched.uploaders.s3.S3Uploader
 
CompleteArrowInputPartitioner<OT> - Class in edu.iu.dsc.tws.data.api.formatters
 
CompleteArrowInputPartitioner(Path, Config) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CompleteArrowInputPartitioner
 
CompleteArrowInputPartitioner(Path, Config, int) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CompleteArrowInputPartitioner
 
CompleteCSVInputPartitioner<OT> - Class in edu.iu.dsc.tws.data.api.formatters
 
CompleteCSVInputPartitioner(Path, Config) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CompleteCSVInputPartitioner
 
CompleteCSVInputPartitioner(Path, Config, int) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CompleteCSVInputPartitioner
 
completed(int) - Method in interface edu.iu.dsc.tws.api.resource.IWorkerStatusListener
 
completed() - Method in class edu.iu.dsc.tws.common.zk.WorkerWithState
if the worker state is COMPLETED
completed(int) - Method in class edu.iu.dsc.tws.master.server.WorkerMonitor
called when a worker COMPLETED the job
CompleteFileInputPartitioner<OT> - Class in edu.iu.dsc.tws.data.api.formatters
Base class for File input formats for specific file types the methods
CompleteFileInputPartitioner(Path) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CompleteFileInputPartitioner
 
CompleteFileInputPartitioner(Path, Config) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CompleteFileInputPartitioner
 
ComponentConfigurationDeclarer<T extends ComponentConfigurationDeclarer> - Interface in org.apache.storm.topology
 
computation() - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation
 
computation() - Method in class edu.iu.dsc.tws.graphapi.impl.TestForPagerank
 
computation() - Method in class edu.iu.dsc.tws.graphapi.impl.TestForSSSP
 
compute(I, RecordCollector<O>) - Method in interface edu.iu.dsc.tws.api.tset.fn.ComputeCollectorFunc
 
compute(I) - Method in interface edu.iu.dsc.tws.api.tset.fn.ComputeFunc
 
compute(ComputeCollectorFunc<Row, Iterator<Row>>) - Method in interface edu.iu.dsc.tws.api.tset.link.batch.BatchRowTLink
 
compute(ComputeFunc<O, T1>) - Method in interface edu.iu.dsc.tws.api.tset.link.batch.BatchTLink
 
compute(ComputeCollectorFunc<O, T1>) - Method in interface edu.iu.dsc.tws.api.tset.link.batch.BatchTLink
 
compute(ComputeFunc<O, T1>) - Method in interface edu.iu.dsc.tws.api.tset.link.streaming.StreamingTLink
 
compute(ComputeCollectorFunc<O, T1>) - Method in interface edu.iu.dsc.tws.api.tset.link.streaming.StreamingTLink
 
compute(ComputeFunc<O, T1>) - Method in interface edu.iu.dsc.tws.api.tset.link.TLink
Creates a Compute TSet based on the ComputeFunc provided.
compute(ComputeCollectorFunc<O, T1>) - Method in interface edu.iu.dsc.tws.api.tset.link.TLink
Creates a Compute TSet based on the ComputeCollectorFunc provided.
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BAllGatherExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BAllReduceExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BBroadcastExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BDirectExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BDJoinExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BDKeyedGatherExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BGatherExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BJoinExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BJoinStudentExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BKeyedGatherExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BKeyedPartitionExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BKeyedReduceExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BPartitionExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BReduceExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.BenchWorker
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.KeyedBenchWorker
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SAllGatherExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SAllReduceExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SBroadcastExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SDirectExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SGatherExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SKeyedGatherExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SKeyedPartitionExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SKeyedReduceExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SPartitionExample
 
compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SReduceExample
 
compute() - Method in class edu.iu.dsc.tws.examples.ml.svm.streamer.IterativeDataStream
 
compute() - Method in class edu.iu.dsc.tws.examples.ml.svm.streamer.IterativePredictionDataStreamer
 
compute(Object) - Method in class edu.iu.dsc.tws.python.tset.fn.ComputeFunctions.ComputeFuncImpl
 
compute(Object, RecordCollector) - Method in class edu.iu.dsc.tws.python.tset.fn.ComputeWithCollectorFunctions.ComputeFuncImpl
 
compute() - Method in class edu.iu.dsc.tws.python.tset.fn.TSetFunctions
 
compute(I, RecordCollector<O>) - Method in class edu.iu.dsc.tws.tset.fn.FlatMapCompute
 
compute(Iterator<I>, RecordCollector<O>) - Method in class edu.iu.dsc.tws.tset.fn.FlatMapIterCompute
 
compute(T) - Method in class edu.iu.dsc.tws.tset.fn.ForEachCompute
 
compute(Iterator<T>) - Method in class edu.iu.dsc.tws.tset.fn.ForEachIterCompute
 
compute(Iterator<Tuple<Integer, I>>, RecordCollector<O>) - Method in class edu.iu.dsc.tws.tset.fn.GatherFlatMapCompute
 
compute(Iterator<Tuple<Integer, T>>) - Method in class edu.iu.dsc.tws.tset.fn.GatherForEachCompute
 
compute(Iterator<Tuple<Integer, I>>, RecordCollector<O>) - Method in class edu.iu.dsc.tws.tset.fn.GatherMapCompute
 
compute(I) - Method in class edu.iu.dsc.tws.tset.fn.MapCompute
 
compute(Iterator<I>, RecordCollector<O>) - Method in class edu.iu.dsc.tws.tset.fn.MapIterCompute
 
compute(Iterator<I>) - Method in class edu.iu.dsc.tws.tset.fn.ProcessWindowCompute
 
compute(Iterator<Row>, RecordCollector<Row>) - Method in class edu.iu.dsc.tws.tset.fn.row.RowFlatMapCompute
 
compute(Iterator<Row>, RecordCollector<Row>) - Method in class edu.iu.dsc.tws.tset.fn.row.RowForEachCompute
 
compute(Iterator<Row>, RecordCollector<Row>) - Method in class edu.iu.dsc.tws.tset.fn.row.RowMapCompute
 
compute(String, ComputeFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl
 
compute(String, ComputeCollectorFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl
 
compute(ComputeFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl
 
compute(ComputeCollectorFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl
 
compute(String, ComputeCollectorFunc<Row, Iterator<Row>>) - Method in class edu.iu.dsc.tws.tset.links.batch.row.RowBatchTLinkImpl
 
compute(ComputeCollectorFunc<Row, Iterator<Row>>) - Method in class edu.iu.dsc.tws.tset.links.batch.row.RowBatchTLinkImpl
 
compute(String, ComputeCollectorFunc<Row, Iterator<Row>>) - Method in class edu.iu.dsc.tws.tset.links.batch.row.RowPartitionTLink
 
compute(String, ComputeFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.streaming.StreamingTLinkImpl
 
compute(String, ComputeCollectorFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.streaming.StreamingTLinkImpl
 
compute(ComputeFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.streaming.StreamingTLinkImpl
 
compute(ComputeCollectorFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.streaming.StreamingTLinkImpl
 
compute(Iterator<<any>>, RecordCollector<<any>>) - Method in class org.apache.beam.runners.twister2.translators.functions.AssignWindowsFunction
 
compute(Iterator<<any>>, RecordCollector<RawUnionValue>) - Method in class org.apache.beam.runners.twister2.translators.functions.DoFnFunction
 
compute(Iterator<RawUnionValue>, RecordCollector<<any>>) - Method in class org.apache.beam.runners.twister2.translators.functions.OutputTagFilter
 
ComputeCollectExample - Class in edu.iu.dsc.tws.examples.tset.batch
 
ComputeCollectExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.ComputeCollectExample
 
computeCollector() - Method in class edu.iu.dsc.tws.python.tset.fn.TSetFunctions
 
ComputeCollectorFunc<O,I> - Interface in edu.iu.dsc.tws.api.tset.fn
Computes an output of type O based on an input of type I and the output would be passed on to a RecordCollector object.
ComputeCollectorOp<O,I> - Class in edu.iu.dsc.tws.tset.ops
Performs the compute function on the value received for the imessage and write it to edges
ComputeCollectorOp() - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeCollectorOp
 
ComputeCollectorOp(ComputeCollectorFunc<O, I>, BaseTSet, Map<String, String>) - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeCollectorOp
 
ComputeCollectorToTupleOp<K,O,I> - Class in edu.iu.dsc.tws.tset.ops
 
ComputeCollectorToTupleOp() - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeCollectorToTupleOp
 
ComputeCollectorToTupleOp(ComputeCollectorFunc<Tuple<K, O>, I>, BaseTSet, Map<String, String>) - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeCollectorToTupleOp
 
computeConnection - Variable in class edu.iu.dsc.tws.examples.task.BenchTaskWorker
 
computeConnection - Variable in class edu.iu.dsc.tws.examples.task.BenchWindowTaskWorker
 
ComputeConnection - Class in edu.iu.dsc.tws.task.impl
Represents a compute connection.
computeConnection - Variable in class edu.iu.dsc.tws.task.impl.ops.AbstractOpsConfig
 
ComputeConnectionUtils - Class in edu.iu.dsc.tws.task.impl
 
ComputeEnvironment - Class in edu.iu.dsc.tws.task
Task environment.
computeEnvironment - Variable in class edu.iu.dsc.tws.task.impl.TaskWorker
 
ComputeExample - Class in edu.iu.dsc.tws.examples.tset.batch
 
ComputeExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.ComputeExample
 
computeFold() - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowEventTimeExample.FoldFunctionImpl
 
computeFold() - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowExample.FoldFunctionImpl
 
computeFold() - Method in interface edu.iu.dsc.tws.task.window.function.FoldWindowedFunction
 
ComputeFunc<O,I> - Interface in edu.iu.dsc.tws.api.tset.fn
Computes an output of type O based on an input of type I
ComputeFunctions - Class in edu.iu.dsc.tws.python.tset.fn
 
ComputeFunctions() - Constructor for class edu.iu.dsc.tws.python.tset.fn.ComputeFunctions
 
ComputeFunctions.ComputeFuncImpl - Class in edu.iu.dsc.tws.python.tset.fn
 
ComputeGraph - Class in edu.iu.dsc.tws.api.compute.graph
This class extends the base data flow task graph which is mainly responsible for building the task graph for the task vertex and the task edge.
ComputeGraph() - Constructor for class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
 
ComputeGraph(OperationMode) - Constructor for class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
 
ComputeGraph(OperationMode, String) - Constructor for class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
 
computeGraph - Variable in class edu.iu.dsc.tws.examples.task.BenchTaskWorker
 
computeGraph - Variable in class edu.iu.dsc.tws.examples.task.BenchWindowTaskWorker
 
ComputeGraph.StringComparator - Class in edu.iu.dsc.tws.api.compute.graph
 
computeGraphBuilder - Variable in class edu.iu.dsc.tws.examples.task.BenchTaskWorker
 
computeGraphBuilder - Variable in class edu.iu.dsc.tws.examples.task.BenchWindowTaskWorker
 
ComputeGraphBuilder - Class in edu.iu.dsc.tws.task.impl
This is the entry point for creating a task graph by the user.
ComputeOp<O,I> - Class in edu.iu.dsc.tws.tset.ops
Performs the compute function on the value received for the imessage and write it to edges
ComputeOp() - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeOp
 
ComputeOp(ComputeFunc<O, I>, BaseTSet, Map<String, String>) - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeOp
 
ComputeResource - Class in edu.iu.dsc.tws.dashboard.data_models
 
ComputeResource() - Constructor for class edu.iu.dsc.tws.dashboard.data_models.ComputeResource
 
ComputeResource - Class in edu.iu.dsc.tws.master.dashclient.models
The ComputeResource to send with json to Dashboard from JobMaster
ComputeResource() - Constructor for class edu.iu.dsc.tws.master.dashclient.models.ComputeResource
 
ComputeResource(JobAPI.ComputeResource) - Constructor for class edu.iu.dsc.tws.master.dashclient.models.ComputeResource
 
ComputeResource - Class in edu.iu.dsc.tws.python.config
 
ComputeResource(double, int, int) - Constructor for class edu.iu.dsc.tws.python.config.ComputeResource
 
ComputeResourceId - Class in edu.iu.dsc.tws.dashboard.data_models.composite_ids
 
ComputeResourceId() - Constructor for class edu.iu.dsc.tws.dashboard.data_models.composite_ids.ComputeResourceId
 
ComputeResourceRepository - Interface in edu.iu.dsc.tws.dashboard.repositories
 
ComputeResourceService - Class in edu.iu.dsc.tws.dashboard.services
 
ComputeResourceService() - Constructor for class edu.iu.dsc.tws.dashboard.services.ComputeResourceService
 
computeResourcesToPrint(JobAPI.Job) - Static method in class edu.iu.dsc.tws.rsched.utils.JobUtils
 
ComputeResourceUtils - Class in edu.iu.dsc.tws.proto.utils
 
ComputeTask() - Constructor for class edu.iu.dsc.tws.examples.checkpointing.CheckpointingTaskExample.ComputeTask
 
ComputeTask() - Constructor for class edu.iu.dsc.tws.graphapi.api.BasicComputation.ComputeTask
 
ComputeToTupleOp<K,O,I> - Class in edu.iu.dsc.tws.tset.ops
 
ComputeToTupleOp() - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeToTupleOp
 
ComputeToTupleOp(ComputeFunc<Tuple<K, O>, I>, BaseTSet, Map<String, String>) - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeToTupleOp
 
ComputeTSet<O,I> - Class in edu.iu.dsc.tws.tset.sets.batch
 
ComputeTSet() - Constructor for class edu.iu.dsc.tws.tset.sets.batch.ComputeTSet
 
ComputeTSet(BatchEnvironment, ComputeFunc<O, I>, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.batch.ComputeTSet
 
ComputeTSet(BatchEnvironment, ComputeCollectorFunc<O, I>, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.batch.ComputeTSet
 
ComputeTSet(BatchEnvironment, String, ComputeFunc<O, I>, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.batch.ComputeTSet
 
ComputeTSet(BatchEnvironment, String, ComputeCollectorFunc<O, I>, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.batch.ComputeTSet
 
ComputeWithCollectorFunctions - Class in edu.iu.dsc.tws.python.tset.fn
 
ComputeWithCollectorFunctions() - Constructor for class edu.iu.dsc.tws.python.tset.fn.ComputeWithCollectorFunctions
 
ComputeWithCollectorFunctions.ComputeFuncImpl - Class in edu.iu.dsc.tws.python.tset.fn
 
conf(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
 
config - Variable in class edu.iu.dsc.tws.api.compute.nodes.BaseNode
 
Config - Class in edu.iu.dsc.tws.api.config
Config is an Immutable Map of <String, Object> The get/set API that uses Key objects should be favored over Strings.
Config(Config.Builder) - Constructor for class edu.iu.dsc.tws.api.config.Config
 
config - Variable in class edu.iu.dsc.tws.data.api.formatters.CompleteArrowInputPartitioner
Config file required for Hdfs connection
config - Variable in class edu.iu.dsc.tws.data.api.formatters.CompleteCSVInputPartitioner
Config file required for Hdfs connection
config - Variable in class edu.iu.dsc.tws.data.api.formatters.CompleteFileInputPartitioner
Config file required for Hdfs connection
config - Variable in class edu.iu.dsc.tws.data.api.formatters.CSVInputPartitioner
 
config - Variable in class edu.iu.dsc.tws.data.api.formatters.FileInputPartitioner
 
config - Variable in class edu.iu.dsc.tws.data.api.formatters.FixedInputPartitioner
 
config - Variable in class edu.iu.dsc.tws.executor.comms.AbstractParallelOperation
 
config - Variable in class edu.iu.dsc.tws.executor.core.streaming.TaskStreamingInstance
The configuration
config - Variable in class edu.iu.dsc.tws.executor.threading.ThreadSharingExecutor
The configuration
config - Variable in class edu.iu.dsc.tws.master.server.ZKMasterController
 
config - Variable in class edu.iu.dsc.tws.rsched.schedulers.standalone.MPICommand
 
config - Variable in class edu.iu.dsc.tws.task.impl.cdfw.CDFWWorker
Configuration
config - Variable in class edu.iu.dsc.tws.task.impl.TaskWorker
Configuration
Config - Class in org.apache.storm
Topology configs are specified as a plain old map.
Config() - Constructor for class org.apache.storm.Config
 
Config.Builder - Class in edu.iu.dsc.tws.api.config
 
CONFIG_DIR - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
 
CONFIG_FILE - Static variable in class edu.iu.dsc.tws.data.utils.DataObjectConstants
 
CONFIG_USE_SORT_JOIN_CACHE - Static variable in class edu.iu.dsc.tws.comms.utils.SortJoinUtils
 
CONFIG_WAIT_TIME - Static variable in class edu.iu.dsc.tws.checkpointing.client.CheckpointingClientImpl
 
ConfigEntry - Class in edu.iu.dsc.tws.api.config
 
ConfigEntry(String, String, ConfigEntry.Type, String) - Constructor for class edu.iu.dsc.tws.api.config.ConfigEntry
 
ConfigEntry(String) - Constructor for class edu.iu.dsc.tws.api.config.ConfigEntry
 
ConfigEntry(String, ConfigEntry.Type) - Constructor for class edu.iu.dsc.tws.api.config.ConfigEntry
 
ConfigEntry(String, String) - Constructor for class edu.iu.dsc.tws.api.config.ConfigEntry
 
ConfigEntry(String, String, String) - Constructor for class edu.iu.dsc.tws.api.config.ConfigEntry
 
ConfigEntry.Type - Enum in edu.iu.dsc.tws.api.config
 
ConfigLoader - Class in edu.iu.dsc.tws.common.config
 
ConfigReader - Class in edu.iu.dsc.tws.common.config
Loads config file in Yaml file format.
ConfigSerializer - Class in edu.iu.dsc.tws.common.config
 
configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner
 
configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteArrowInputPartitioner
 
configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteCSVInputPartitioner
 
configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteFileInputPartitioner
 
configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.CSVInputPartitioner
 
configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.FileInputPartitioner
 
configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.FixedInputPartitioner
 
configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalCompleteArrowInputPartitioner
 
configure(Config) - Method in interface edu.iu.dsc.tws.data.api.InputPartitioner
Configures this input format.
configure(Config) - Method in class edu.iu.dsc.tws.data.api.out.FileOutputWriter
 
configure(Config) - Method in interface edu.iu.dsc.tws.data.api.OutputWriter
Configure the output writer
configure(Config) - Method in class edu.iu.dsc.tws.data.api.splits.BinaryInputSplit
Configures this input format by reading the path to the file from the configuration and setting the record length
configure(Config) - Method in class edu.iu.dsc.tws.data.api.splits.CSVInputSplit
Configures this input format by reading the path to the file from the configuration and the string that defines the record delimiter.
configure(Config) - Method in class edu.iu.dsc.tws.data.api.splits.DelimitedInputSplit
Configures this input format by reading the path to the file from the configuration and the string that defines the record delimiter.
configure(Config) - Method in class edu.iu.dsc.tws.data.api.splits.FileInputSplit
 
configure(Config) - Method in class edu.iu.dsc.tws.data.api.splits.GenericCSVInputSplit
 
configure(Config) - Method in class edu.iu.dsc.tws.data.api.splits.TextInputSplit
 
configure(Config) - Method in interface edu.iu.dsc.tws.data.fs.io.InputSplit
Configure the split with parameters
configureInterpreter(JepConfig) - Method in class edu.iu.dsc.tws.python.processors.TSharedInterpreter
 
connect() - Method in class edu.iu.dsc.tws.common.net.tcp.Client
 
connect() - Method in class edu.iu.dsc.tws.common.net.tcp.request.RRClient
 
connect() - Static method in class edu.iu.dsc.tws.deeplearning.pytorch.PytorchSampleJob
 
connect(String, String, String, String) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
 
connect(String, String, String, String, IFunction) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
 
connect(String, String, String, String, MessageType, MessageType) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
 
connect(String, String, String, String, IFunction, MessageType, MessageType) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
 
connect(String, String, String, String, IFunction, MessageType, MessageType, TaskPartitioner) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
 
connect(String, String, String, String, MessageType) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
 
connect(String, String, Edge) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
 
connect() - Method in class edu.iu.dsc.tws.task.impl.ops.AbstractOpsConfig
 
connect() - Method in class edu.iu.dsc.tws.task.impl.ops.JoinConfig
 
connectedChannels - Variable in class edu.iu.dsc.tws.common.net.tcp.request.RRServer
We keep track of connected channels here to make sure we close them
connectedChildTask(TV, TE) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
This method is used to calculate the connected child tasks between the task vertex(t) and the task edge (TE)
connectEdge(ComputeConnection, String, Edge) - Static method in class edu.iu.dsc.tws.task.impl.ComputeConnectionUtils
 
connectedParentTask(TV, TE) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
This method returns the connected parent tasks between the task vertex(t) and the task edge(TE)
ConnectedSink - Class in edu.iu.dsc.tws.task.cdfw.task
 
ConnectedSink() - Constructor for class edu.iu.dsc.tws.task.cdfw.task.ConnectedSink
 
ConnectedSink(String) - Constructor for class edu.iu.dsc.tws.task.cdfw.task.ConnectedSink
 
ConnectedSource - Class in edu.iu.dsc.tws.task.cdfw.task
Connected source for the connected dataflow example
ConnectedSource() - Constructor for class edu.iu.dsc.tws.task.cdfw.task.ConnectedSource
 
ConnectedSource(String) - Constructor for class edu.iu.dsc.tws.task.cdfw.task.ConnectedSource
 
ConnectedSource(String, String) - Constructor for class edu.iu.dsc.tws.task.cdfw.task.ConnectedSource
 
ConnectHandler - Interface in edu.iu.dsc.tws.api.net.request
Handle a connection
connectHandler - Variable in class edu.iu.dsc.tws.common.net.tcp.request.RRServer
Connection handler
connectToServer(String) - Static method in class edu.iu.dsc.tws.common.zk.ZKUtils
connect to ZooKeeper server
connectToServer(String, int) - Static method in class edu.iu.dsc.tws.common.zk.ZKUtils
connect to ZooKeeper server
connectTSets(TBase, TBase) - Method in class edu.iu.dsc.tws.tset.TBaseGraph
connect two tsets
Constants - Class in edu.iu.dsc.tws.examples.comms
 
Constants - Class in edu.iu.dsc.tws.examples.ml.svm.constant
 
Constants.SimpleGraphConfig - Class in edu.iu.dsc.tws.examples.ml.svm.constant
 
ConstraintTaskExample - Class in edu.iu.dsc.tws.examples.internal.batchscheduler
 
ConstraintTaskExample() - Constructor for class edu.iu.dsc.tws.examples.internal.batchscheduler.ConstraintTaskExample
 
constructAffinity(V1PodSpec) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
 
constructContainer() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.master.JobMasterRequestObject
construct a container
constructContainer(ComputeResource, int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
construct a container
constructDataStr(HashMap<String, VertexStatus>, IMessage) - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation.GraphInitialization
 
constructDataStr(IMessage) - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation.GraphPartiton
 
ConstructDataStr - Class in edu.iu.dsc.tws.graphapi.api
 
ConstructDataStr(String, int, int) - Constructor for class edu.iu.dsc.tws.graphapi.api.ConstructDataStr
 
constructEnvironmentVariables(int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.master.JobMasterRequestObject
set environment variables for containers
constructEnvironmentVariables(String, int, int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
set environment variables for containers
constructEnvVariables(Config, JobAPI.Job) - Static method in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraLauncher
put relevant config parameters to a HashMap to be used as environment variables when submitting jobs
constructEventPath(String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKEventsManager
construct the next event path increase the eventCounter by one
constructJobMasterPath(Config, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKJobMasterRegistrar
construct job master path
constructPodTemplate() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.master.JobMasterRequestObject
construct pod template
constructPodTemplate(ComputeResource) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
construct pod template
ConsumerBolt() - Constructor for class edu.iu.dsc.tws.examples.compatibility.storm.WordCountTopology.ConsumerBolt
 
Container - Class in edu.iu.dsc.tws.tsched.builder
This class is for the logical representation of container and it has getter and setter property to retrieve and set the task instances allocated to the container.
Container(int, Resource, int) - Constructor for class edu.iu.dsc.tws.tsched.builder.Container
 
CONTAINER_NAME_PREFIX - Static variable in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesConstants
 
CONTAINER_PER_WORKER - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
 
containerCpuPadding(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
 
containerDiskPadding(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
 
containerId(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
 
ContainerIdScorer - Class in edu.iu.dsc.tws.tsched.builder
This class is to sort the container in an ascending order.
ContainerIdScorer() - Constructor for class edu.iu.dsc.tws.tsched.builder.ContainerIdScorer
 
containerInstanceBandwidth(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
 
containerInstanceCpu(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
 
containerInstanceDisk(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
 
containerInstanceLatency(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
 
containerInstanceNetwork(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
 
containerInstanceRam(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
 
containerPaddingPercentage(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
 
containerPerWorker(Config) - Static method in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
 
containerRamPadding(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
 
contains(String) - Method in interface edu.iu.dsc.tws.api.checkpointing.StateStore
Check weather the specified key is in the store
contains(String) - Method in class edu.iu.dsc.tws.checkpointing.stores.HDFSFileStateStore
 
contains(String) - Method in class edu.iu.dsc.tws.checkpointing.stores.LocalFileStateStore
 
contains(Object) - Method in class edu.iu.dsc.tws.comms.utils.DiskBasedList
 
contains(String[], Protos.Offer) - Method in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosScheduler
 
contains(<any>) - Method in class org.apache.beam.runners.twister2.utils.Twister2SideInputReader
 
contains(String) - Method in class org.apache.storm.tuple.Fields
Checks if this contains the specified name of the field
contains(String) - Method in interface org.apache.storm.tuple.Tuple
Returns true if this tuple contains the specified name of the field.
contains(String) - Method in class org.apache.storm.tuple.Twister2Tuple
 
containsAll(Collection) - Method in class edu.iu.dsc.tws.comms.utils.DiskBasedList
 
containsJobInStore(String, StateStore) - Static method in class edu.iu.dsc.tws.checkpointing.util.CheckpointUtils
 
containsKey(int, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
 
containsKey(int, String) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
 
containsKey(int, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
 
containsKey(int, String) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
 
containsKey(int, ByteBuffer) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
checks if the given key is in the memory manager
containsKey(int, String) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
checks if the given key is in the memory manager
containsKey(ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
 
containsKey(String) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
 
containsTaskEdge(TE) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
This method is used to identify the duplicate task edge for the same two tasks in the graph.
containsTaskEdge(TV, TV) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
This method is to validate that whether the source and target task vertex has task edge.
containsTaskEdge(TV, TV, TE) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
 
containsTaskEdge(TV, TV) - Method in interface edu.iu.dsc.tws.api.compute.graph.ITaskGraph
This method returns true if the task edge persists in the graph between the source task vertex TV and target task vertex TV.
containsTaskEdge(TE) - Method in interface edu.iu.dsc.tws.api.compute.graph.ITaskGraph
This method returns true if the task edge persists in the graph.
containsTaskVertex(TV) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
This method is to validate whether the task graph vertices has the task vertex(TV)
containsTaskVertex(TV) - Method in interface edu.iu.dsc.tws.api.compute.graph.ITaskGraph
This method returns true if the task vertex exists in the graph.
context - Variable in class edu.iu.dsc.tws.api.compute.nodes.BaseNode
 
Context - Class in edu.iu.dsc.tws.api.config
 
Context() - Constructor for class edu.iu.dsc.tws.api.config.Context
 
context - Variable in class edu.iu.dsc.tws.connectors.kafka.KafkaSource
 
contextLoads() - Method in class edu.iu.dsc.tws.dashboard.DashboardApplicationTests
 
ControlledChannelOperation - Class in edu.iu.dsc.tws.comms.dfw
 
ControlledFileReader - Class in edu.iu.dsc.tws.comms.shuffle
 
ControlledFileReader(ControlledFileReaderFlags, String, MessageType, MessageType, Comparator) - Constructor for class edu.iu.dsc.tws.comms.shuffle.ControlledFileReader
 
ControlledFileReaderFlags - Class in edu.iu.dsc.tws.comms.shuffle
Memory mappable limit can be increased in linux with following command.
ControlledFileReaderFlags(long, Comparator) - Constructor for class edu.iu.dsc.tws.comms.shuffle.ControlledFileReaderFlags
 
ControlledFileReaderFlags(long, long, Comparator) - Constructor for class edu.iu.dsc.tws.comms.shuffle.ControlledFileReaderFlags
This constructor can be used to configure an instance with an arbitrary amount of mem maps.
ControlledMemoryReader - Class in edu.iu.dsc.tws.comms.shuffle
Wrapper for tuples in memory.
ControlledMemoryReader(List<Tuple>, Comparator) - Constructor for class edu.iu.dsc.tws.comms.shuffle.ControlledMemoryReader
 
ControlledProgressTracker - Class in edu.iu.dsc.tws.comms.dfw
 
ControlledProgressTracker(List<IntArrayList>) - Constructor for class edu.iu.dsc.tws.comms.dfw.ControlledProgressTracker
 
ControlledReader<T> - Interface in edu.iu.dsc.tws.comms.shuffle
A interface for reading a a continous data set stored in eighther memory or file system
ControllerContext - Class in edu.iu.dsc.tws.api.resource
 
convertStringToIP(String) - Static method in class edu.iu.dsc.tws.master.worker.JMWorkerController
convert the given string to ip address object
convertToK8sFormat(String, int) - Static method in class edu.iu.dsc.tws.api.util.JobIDUtils
we perform the following actions: shorten the length of the job name if needed replace underscore and dot characters with dashes convert all letters to lower case characters delete non-alphanumeric characters excluding dots and dashes replace the first char with "a", if it is not a letter in between a-z replace the last char with "z", if it is dash
copy() - Method in class edu.iu.dsc.tws.checkpointing.api.SnapshotImpl
 
COPY_SYSTEM_PACKAGE - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
 
copyDirectory(String, String) - Static method in class edu.iu.dsc.tws.rsched.utils.FileUtils
 
copyDirectoryToDirectory(String, String) - Static method in class edu.iu.dsc.tws.rsched.utils.FileUtils
 
copyFileToDirectory(String, String) - Static method in class edu.iu.dsc.tws.rsched.utils.FileUtils
 
copyFromLocalDirectory(String, String) - Method in class edu.iu.dsc.tws.rsched.uploaders.scp.ScpController
 
copyFromLocalFile(String, String) - Method in class edu.iu.dsc.tws.rsched.uploaders.hdfs.HdfsController
 
copyFromLocalFile(String, String) - Method in class edu.iu.dsc.tws.rsched.uploaders.scp.ScpController
 
copyPartToByteArray(int, byte[], int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.DataBuffer
Copies a part of the ByteBuffer to the given byte array
copySystemPackage(Config) - Static method in class edu.iu.dsc.tws.api.config.SchedulerContext
 
CORE_PACKAGE_ENV - Static variable in class edu.iu.dsc.tws.rsched.schedulers.nomad.NomadContext
 
CORE_PACKAGE_FILENAME - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
 
CORE_PACKAGE_FILENAME_DEFAULT - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
 
CORE_PACKAGE_URL - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
 
CORE_YAML - Static variable in class edu.iu.dsc.tws.api.config.Context
 
corePackageFileName(Config) - Static method in class edu.iu.dsc.tws.api.config.SchedulerContext
 
corePackageUrl(Config) - Static method in class edu.iu.dsc.tws.api.config.SchedulerContext
 
corsConfigurer() - Method in class edu.iu.dsc.tws.dashboard.DashboardSpringConfig
 
COUNT - Static variable in class edu.iu.dsc.tws.common.logging.Twister2FileLogHandler
 
count - Variable in class edu.iu.dsc.tws.comms.dfw.io.ByteArrayOutputStream
The number of valid bytes in the buffer.
COUNT - Static variable in class edu.iu.dsc.tws.examples.tset.batch.BatchTsetExample
 
count - Variable in class edu.iu.dsc.tws.graphapi.api.BasicComputation.SourceTask
 
Count(long) - Constructor for class edu.iu.dsc.tws.task.window.config.WindowConfig.Count
 
Count(int) - Constructor for class org.apache.storm.topology.base.BaseWindowedBolt.Count
 
CountEvictionPolicy<T> - Class in edu.iu.dsc.tws.task.window.policy.eviction.count
 
CountEvictionPolicy(long) - Constructor for class edu.iu.dsc.tws.task.window.policy.eviction.count.CountEvictionPolicy
 
CountEvictionPolicy<T> - Class in org.apache.storm.windowing
An eviction policy that tracks event counts and can evict based on a threshold count.
CountEvictionPolicy(int) - Constructor for class org.apache.storm.windowing.CountEvictionPolicy
 
CountTriggerPolicy<T> - Class in org.apache.storm.windowing
A trigger that tracks event counts and calls back TriggerHandler.onTrigger() when the count threshold is hit.
CountTriggerPolicy(int, TriggerHandler, EvictionPolicy<T, ?>) - Constructor for class org.apache.storm.windowing.CountTriggerPolicy
 
countWindow(long) - Method in class edu.iu.dsc.tws.tset.links.streaming.StreamingTLinkImpl
 
countWindow(long, long) - Method in class edu.iu.dsc.tws.tset.links.streaming.StreamingTLinkImpl
 
CountWindowPolicy<T> - Class in edu.iu.dsc.tws.task.window.policy.trigger.count
 
CountWindowPolicy(long, IManager, IEvictionPolicy<T>) - Constructor for class edu.iu.dsc.tws.task.window.policy.trigger.count.CountWindowPolicy
 
CountWords() - Constructor for class org.apache.beam.runners.twister2.examples.WordCount.CountWords
 
countWorkersUpToSS(JobAPI.Job, int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.worker.K8sWorkerUtils
calculate the number of workers in the earlier statefulsets
CppCheckstyle - Class in com.twitter.bazel.checkstyle
Verifies that the c, cpp and header source styles conform to the google styles in cpplint.
CPUS_PER_CONTAINER - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
 
CPUS_PER_NODE - Static variable in class edu.iu.dsc.tws.data.utils.WorkerConstants
 
cpusPerContainer(Config) - Static method in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
 
create(Path) - Method in class edu.iu.dsc.tws.api.data.FileSystem
Create a file system with the OVERWRITE
create(Path, FileSystem.WriteMode) - Method in class edu.iu.dsc.tws.api.data.FileSystem
Create a file system with the specific write mdoe
create(Gson, <any>) - Method in class edu.iu.dsc.tws.common.util.RuntimeTypeAdapterFactory
doc.
create(Path) - Method in class edu.iu.dsc.tws.data.fs.local.LocalFileSystem
 
create(Path, FileSystem.WriteMode) - Method in class edu.iu.dsc.tws.data.fs.local.LocalFileSystem
 
create(Path) - Method in class edu.iu.dsc.tws.data.hdfs.HadoopFileSystem
 
create(Path, FileSystem.WriteMode) - Method in class edu.iu.dsc.tws.data.hdfs.HadoopFileSystem
 
createArrowSource(String, String, int, String) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
 
createArrowSource(String, int) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
 
createArrowSource(String, int) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
 
createArrowSource(String, String, int, String) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
 
createArrowSource(String, int) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
 
createAuroraWorker() - Static method in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraWorkerStarter
create a AuroraWorkerStarter object by getting values from system property
createBarrierDir(CuratorFramework, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
create parent directory for barrier
createBuffer(int) - Method in interface edu.iu.dsc.tws.api.comms.channel.TWSChannel
Create a buffer
createBuffer(int) - Method in class edu.iu.dsc.tws.comms.mpi.TWSMPIChannel
 
createBuffer(int) - Method in class edu.iu.dsc.tws.comms.tcp.TWSTCPChannel
 
createBuffer(int) - Method in class edu.iu.dsc.tws.comms.ucx.TWSUCXChannel
 
createCluster(Cluster) - Method in class edu.iu.dsc.tws.dashboard.controllers.ClusterController
 
createCluster(Cluster) - Method in class edu.iu.dsc.tws.dashboard.services.ClusterService
 
createCM(KubernetesController, JobAPI.Job) - Static method in class edu.iu.dsc.tws.examples.internal.rsched.K8sControllerExample
 
createCMWatcher(KubernetesController, String) - Static method in class edu.iu.dsc.tws.examples.internal.rsched.K8sControllerExample
 
createComputeResource(String, ComputeResource) - Method in class edu.iu.dsc.tws.dashboard.controllers.JobController
 
createComputeResource(int, double, int, double) - Static method in class edu.iu.dsc.tws.proto.utils.ComputeResourceUtils
 
createComputeResource(Number, Number, Number) - Method in class edu.iu.dsc.tws.python.BootstrapPoint
 
createComputerResourceId(String, Integer) - Method in class edu.iu.dsc.tws.dashboard.services.ComputeResourceService
 
createConfigMap(V1ConfigMap) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
create the given ConfigMap on Kubernetes master
createConfigMap(JobAPI.Job) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
create a ConfigMap object It will have start counts for workers
createContainerName(int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
create container name with the given containerIndex each container in a pod will have a unique name with this index
createCopyCommand(String, String, String, String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
create file copy command to a pod
createCoreV1Api() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
create CoreV1Api that does not time out
createCSVSource(String, int, int, String) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
 
createCSVSource(String, int, int, String) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
 
createCSVSource(String, int, int, String) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
 
createData(int, MessageType) - Static method in class edu.iu.dsc.tws.comms.dfw.io.DataSerializerTest
 
createDataObject(int, MessageType) - Method in class edu.iu.dsc.tws.comms.dfw.io.BaseSerializeTest
 
createDataQueue(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.BaseSerializeTest
 
createDefaultBarrierDir(CuratorFramework, String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
create parent directory for default barrier
createDirectory(String) - Static method in class edu.iu.dsc.tws.rsched.utils.FileUtils
 
createEphemDir(CuratorFramework, String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKEphemStateManager
create parent directory for ephemeral worker znodes
createEventsZNode(CuratorFramework, String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKEventsManager
Create job znode for persistent states Assumes that there is no znode exists in the ZooKeeper This method should be called by the submitting client
createExecution(ComputeGraph, ExecutionPlan) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
Execute a plan and a graph.
createExecution(ComputeGraph) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
Execute a plan and a graph.
createHadoopSource(Configuration, Class<F>, int) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
 
createHadoopSource(Configuration, Class<F>, int, MapFunc<I, Tuple<K, V>>) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
 
createHDFSFileSystem() - Method in class edu.iu.dsc.tws.data.utils.HdfsUtils
This method create and return the file system respective to the configuration file.
createHeadlessServiceObject(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
 
createHostFile(ArrayList<String>, int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.mpi.MPIMasterStarter
create hostfile for mpirun command first line in the file is the ip of this pod other lines are unordered each line has one ip
createInitBarrierDir(CuratorFramework, String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
create parent directory for init barrier
createInput(Config, TaskContext, InputPartitioner<T, O>) - Method in class edu.iu.dsc.tws.executor.core.ExecutionRuntime
 
createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner
Computes the input splits for the file.
createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteArrowInputPartitioner
It creates the split for the complete file.
createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteCSVInputPartitioner
It creates the split for the complete file.
createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteFileInputPartitioner
It creates the split for the complete file.
createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.CSVInputPartitioner
 
createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.FileInputPartitioner
Computes the input splits for the file.
createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.FixedInputPartitioner
This method create the input splits which is based on the number of lines in the input and the parallelism value.
createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalCompleteArrowInputPartitioner
 
createInputSplits(int) - Method in interface edu.iu.dsc.tws.data.api.InputPartitioner
Create the input splits
createJMWorkerAgent(Config, WorkerInfo, String, int, int, int) - Static method in class edu.iu.dsc.tws.master.worker.JMWorkerAgent
create the singleton JMWorkerAgent if it is already created, return the previous one.
createJob(Job) - Method in class edu.iu.dsc.tws.dashboard.controllers.JobController
 
createJob(Job) - Method in class edu.iu.dsc.tws.dashboard.services.JobService
 
createJob(String, String, JobAPI.Job) - Method in class edu.iu.dsc.tws.rsched.schedulers.standalone.MPIController
Create a slurm job.
createJobDescriptionFileName(String) - Static method in class edu.iu.dsc.tws.api.config.SchedulerContext
 
createJobEndTimeZNode(CuratorFramework, String, String) - Static method in class edu.iu.dsc.tws.common.zk.JobZNodeManager
Create job end time znode
createJobLabels(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
all twister2 resources have these two labels One is to distinguish twister2 resources from others the other is to distinguish job resources from others
createJobMasterHeadlessServiceObject() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.master.JobMasterRequestObject
create headless service for job master
createJobMasterPersState(CuratorFramework, String, String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKPersStateManager
create job master persistent state at ZooKeeper server this method must be called if isJobMasterRestarting returns false
createJobMasterPodName(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
create pod name for the job master there will be one pod for the job master we add a suffix to statefulset name
createJobMasterServiceName(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
create service name for the job master
createJobMasterServiceObject() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.master.JobMasterRequestObject
create regular service for job master
createJobMasterStatefulSetName(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
create StatefulSet name for the given job name add a suffix to job name
createJobPackageFileName(String) - Static method in class edu.iu.dsc.tws.rsched.utils.JobUtils
 
createJobServiceObject() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
 
createJobZNode(CuratorFramework, String, JobAPI.Job) - Static method in class edu.iu.dsc.tws.common.zk.JobZNodeManager
Create job znode Assumes that there is no znode exists in the ZooKeeper Add job object as its body
createJstZNode(CuratorFramework, String, String, long) - Static method in class edu.iu.dsc.tws.common.zk.JobZNodeManager
Create job submission time znode
createKeyedData(int, MessageType, MessageType) - Method in class edu.iu.dsc.tws.comms.dfw.io.BaseSerializeTest
 
createKeyedData(int, MessageType, int, MessageType) - Method in class edu.iu.dsc.tws.comms.dfw.io.BaseSerializeTest
 
createKeyedHadoopSource(Configuration, Class<F>, int, MapFunc<Tuple<K2, V2>, Tuple<K, V>>) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
 
createKeyedSource(byte[], int) - Method in class edu.iu.dsc.tws.python.Twister2Environment
 
createKeyedSource(SourceFunc<Tuple<K, V>>, int) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
 
createKeyedSource(String, SourceFunc<Tuple<K, V>>, int) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
 
createKeyedSource(SourceFunc<Tuple<K, V>>, int) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
 
createKeyedSource(String, SourceFunc<Tuple<K, V>>, int) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
 
createKeyedSource(SourceFunc<Tuple<K, V>>, int) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
Creates a Keyed Source TSet based on the SourceFunc that produces a Tuple
createKeyedSource(String, SourceFunc<Tuple<K, V>>, int) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
Same as above, but a source tset name can be provided at the instantiation
createKeyObject(MessageType, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.BaseSerializeTest
 
createKeyObject(MessageType) - Method in class edu.iu.dsc.tws.comms.dfw.io.BaseSerializeTest
 
createNode(Node) - Method in class edu.iu.dsc.tws.dashboard.controllers.NodeController
 
createNode(Node) - Method in class edu.iu.dsc.tws.dashboard.services.NodeService
 
createNode(NodeId) - Method in class edu.iu.dsc.tws.dashboard.services.NodeService
 
createNodeId(Node) - Method in class edu.iu.dsc.tws.dashboard.services.NodeService
 
createNodeInfo(String, String, String) - Static method in class edu.iu.dsc.tws.proto.utils.NodeInfoUtils
do not set if any one of the parameters are null
createNodePortServiceObject() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
create service for NodePort
createOption(String, boolean, String, boolean) - Static method in class edu.iu.dsc.tws.examples.Utils
 
createOrGetCluster(String) - Method in class edu.iu.dsc.tws.dashboard.services.ClusterService
This util method creates a cluster for a given data center name.
createOutput(int, FSDataOutputStream) - Method in class edu.iu.dsc.tws.data.api.out.CSVOutputWriter
 
createOutput() - Method in class edu.iu.dsc.tws.data.api.out.CSVOutputWriter
 
createOutput(int, FSDataOutputStream) - Method in class edu.iu.dsc.tws.data.api.out.FileOutputWriter
Create a suitable output
createOutput(int, FSDataOutputStream) - Method in class edu.iu.dsc.tws.data.api.out.TextOutputWriter
 
createOutput() - Method in class edu.iu.dsc.tws.data.api.out.TextOutputWriter
 
createPersistentEphemeralZnode(String, byte[]) - Static method in class edu.iu.dsc.tws.common.zk.ZKUtils
create a PersistentNode object in the given path it is ephemeral and persistent it will be deleted after the worker leaves or fails it will be persistent for occasional network problems
createPersistentJobDirName(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosController
 
createPersistentJobDirName(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.nomad.NomadController
 
createPersistentVolume(V1PersistentVolume) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
create the given service on Kubernetes master
createPersistentVolume(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
 
createPersistentVolumeClaim(V1PersistentVolumeClaim) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
create the given PersistentVolumeClaim on Kubernetes master
createPersistentVolumeClaimObject(int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
 
createPersistentVolumeName(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
create storage claim name name from job name
createPersistentVolumeObject(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
we initially used this method to create PersistentVolumes we no longer use this method it is just here in case we may need it for some reason at one point
createPersistentZnode(String, byte[]) - Static method in class edu.iu.dsc.tws.common.zk.ZKUtils
create a PersistentNode object in the given path it needs to be deleted explicitly, not ephemeral it will be persistent for occasional network problems
createPersStateDir(CuratorFramework, String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKPersStateManager
Create job znode for persistent states Assumes that there is no znode exists in the ZooKeeper This method should be called by the submitting client
createPropertiesFile(String) - Method in class edu.iu.dsc.tws.deeplearning.common.ParameterTool
Create a properties file with all the known parameters (call after the last get*() call).
createPropertiesFile(String, boolean) - Method in class edu.iu.dsc.tws.deeplearning.common.ParameterTool
Create a properties file with all the known parameters (call after the last get*() call).
createReduceTaskPlan(Config, int, List<JobMasterAPI.WorkerInfo>, int) - Static method in class edu.iu.dsc.tws.examples.Utils
Let assume we have 2 tasks per container and one additional for first container, which will be the destination
createRestartJobMasterKey() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
create the key for job master restart count to be used in ConfigMap
createRestartWorkerKey(int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
create the key for worker restart count to be used in ConfigMap
createRestorePoint() - Method in class edu.iu.dsc.tws.comms.shuffle.ControlledFileReader
 
createRestorePoint() - Method in class edu.iu.dsc.tws.comms.shuffle.ControlledMemoryReader
 
createRestorePoint() - Method in interface edu.iu.dsc.tws.comms.shuffle.Restorable
 
createRestorePoint() - Method in class edu.iu.dsc.tws.comms.utils.SortJoinUtils.ListBasedRestorableIterator
 
createRowSource(String, SourceFunc<Row>, int) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
 
createSecretVolume(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
 
createService(V1Service) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
create the given service on Kubernetes master
createServiceName(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
create service name for workers
createSource(byte[], int) - Method in class edu.iu.dsc.tws.python.Twister2Environment
 
createSource(SourceFunc<T>, int) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
 
createSource(String, SourceFunc<T>, int) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
 
createSource(SourceFunc<T>, int) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
 
createSource(String, SourceFunc<T>, int) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
 
createSource(SourceFunc<T>, int) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
Creates a source TSet based on the SourceFunc
createSource(String, SourceFunc<T>, int) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
Same as above, but a source tset name can be provided at the instantiation
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner
 
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteArrowInputPartitioner
 
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteCSVInputPartitioner
 
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteFileInputPartitioner
 
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.CSVInputPartitioner
 
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.FileInputPartitioner
 
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.FixedInputPartitioner
 
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalBinaryInputPartitioner
 
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalCompleteArrowInputPartitioner
 
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalCompleteCSVInputPartitioner
 
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalCompleteTextInputPartitioner
 
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalCSVInputPartitioner
 
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalFixedInputPartitioner
 
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalTextInputPartitioner
 
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.SharedTextInputPartitioner
 
createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.examples.ml.svm.integration.test.LocalTextInputPartitioner1
 
createStageLogicalPlan(WorkerEnvironment, List<Integer>) - Static method in class edu.iu.dsc.tws.examples.Utils
Create task plan according to stages
createStatefulSet(V1StatefulSet) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
create the given StatefulSet on Kubernetes master
createStatefulSetForWorkers(ComputeResource) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
create StatefulSet object for a job
createStatefulSetObject() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.master.JobMasterRequestObject
create StatefulSet object for a job
createTarGzipPacker(String, Config) - Static method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
create TarGzipPacker object
createTarPackage(String, String, String, boolean, boolean) - Static method in class edu.iu.dsc.tws.rsched.utils.ProcessUtils
 
createTaskPlan(int, int, int) - Static method in class edu.iu.dsc.tws.comms.routing.RoutingTestUtils
 
createTextSource(String, int, int, String) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
 
createTextSource(String, int, int, String) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
 
createTextSource(String, int, int, String) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
 
createTopology() - Method in class org.apache.storm.topology.TopologyBuilder
 
createVolatileVolume(double) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
 
createWordCountPlan(Config, int, List<JobMasterAPI.WorkerInfo>, int) - Static method in class edu.iu.dsc.tws.examples.utils.WordCountUtils
Let assume we have 2 tasks per container and one additional for first container, which will be the destination
createWorker(WorkerCreateRequest) - Method in class edu.iu.dsc.tws.dashboard.controllers.WorkerController
 
createWorker(WorkerCreateRequest) - Method in class edu.iu.dsc.tws.dashboard.services.WorkerService
 
createWorkerInfo(int, String, int) - Static method in class edu.iu.dsc.tws.proto.utils.WorkerInfoUtils
 
createWorkerInfo(int, String, int, NodeInfo) - Static method in class edu.iu.dsc.tws.proto.utils.WorkerInfoUtils
 
createWorkerInfo(int, String, int, NodeInfo, JobAPI.ComputeResource) - Static method in class edu.iu.dsc.tws.proto.utils.WorkerInfoUtils
 
createWorkerInfo(int, String, int, NodeInfo, JobAPI.ComputeResource, Map<String, Integer>) - Static method in class edu.iu.dsc.tws.proto.utils.WorkerInfoUtils
 
createWorkerInfoMap(Intracomm) - Method in class edu.iu.dsc.tws.rsched.schedulers.standalone.MPIWorkerStarter
create a AllocatedResources
createWorkerPersState(CuratorFramework, String, String, WorkerInfo) - Static method in class edu.iu.dsc.tws.common.zk.ZKPersStateManager
Initialize worker persistent state at ZooKeeper server This method must be called after making sure that there is no pers state znode for this worker at zk
createWorkerPlan(List<JobMasterAPI.WorkerInfo>) - Static method in class edu.iu.dsc.tws.examples.internal.task.TaskUtils
 
createWorkersStatefulSetName(String, int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
create StatefulSet name for workers add the given index a suffix to the job name
createWorkerZNode(CuratorFramework, String, long) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
create a worker znode at the barrier directory
createWorkerZnode(CuratorFramework, String, String, int) - Static method in class edu.iu.dsc.tws.common.zk.ZKEphemStateManager
 
createWorkerZNodeAtDefault(CuratorFramework, String, String, int, long) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
create a worker znode at the default barrier directory
createWorkerZNodeAtInit(CuratorFramework, String, String, int, long) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
create a worker znode at the init barrier directory
CROSS_VALIDATION_DATA - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
 
CROSS_VALIDATION_DATA_DIR - Static variable in class edu.iu.dsc.tws.data.utils.MLDataObjectConstants
 
CSIZE - Static variable in class edu.iu.dsc.tws.data.utils.DataObjectConstants
 
CSVBasedSourceFunction - Class in edu.iu.dsc.tws.tset.fn.impl
 
CSVBasedSourceFunction(String, int, int, String) - Constructor for class edu.iu.dsc.tws.tset.fn.impl.CSVBasedSourceFunction
 
CSVInputFormatTest - Class in edu.iu.dsc.tws.examples.batch.kmeans
 
CSVInputFormatTest() - Constructor for class edu.iu.dsc.tws.examples.batch.kmeans.CSVInputFormatTest
 
CSVInputFormatTest.TestSink - Class in edu.iu.dsc.tws.examples.batch.kmeans
 
CSVInputFormatTest.TestSource - Class in edu.iu.dsc.tws.examples.batch.kmeans
This is the test source class
CSVInputPartitioner<OT> - Class in edu.iu.dsc.tws.data.api.formatters
 
CSVInputPartitioner(Path, Config) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CSVInputPartitioner
 
CSVInputPartitioner(Path, Config, int) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CSVInputPartitioner
 
CSVInputSplit - Class in edu.iu.dsc.tws.data.api.splits
This class is primarily responsible for reading the split of a CSV file.
CSVInputSplit(int, Path, long, long, String[]) - Constructor for class edu.iu.dsc.tws.data.api.splits.CSVInputSplit
Constructs a split with host information.
CSVOutputWriter - Class in edu.iu.dsc.tws.data.api.out
 
CSVOutputWriter(FileSystem.WriteMode, Path) - Constructor for class edu.iu.dsc.tws.data.api.out.CSVOutputWriter
 
CSVOutputWriter(FileSystem.WriteMode, Path, Config) - Constructor for class edu.iu.dsc.tws.data.api.out.CSVOutputWriter
 
CSVOutputWriter(FileSystem.WriteMode, Path, String, String, String, Config, String) - Constructor for class edu.iu.dsc.tws.data.api.out.CSVOutputWriter
 
CSVTSetSourceExample - Class in edu.iu.dsc.tws.examples.batch.csv
 
CSVTSetSourceExample() - Constructor for class edu.iu.dsc.tws.examples.batch.csv.CSVTSetSourceExample
 
CUR_DIR - Static variable in class edu.iu.dsc.tws.api.data.Path
The current directory
curlPackage(String, String, boolean, boolean) - Static method in class edu.iu.dsc.tws.rsched.utils.ProcessUtils
 
currentBufferIndex - Variable in class edu.iu.dsc.tws.comms.dfw.io.ByteArrayInputStream
 
currentCount - Variable in class edu.iu.dsc.tws.task.window.policy.eviction.count.CountEvictionPolicy
 
currentCount - Variable in class org.apache.storm.windowing.CountEvictionPolicy
 
currentCount - Variable in class org.apache.storm.windowing.WatermarkCountEvictionPolicy
 
currentReader - Variable in class edu.iu.dsc.tws.tset.sources.HadoopSource
The current record reader
currentSize() - Method in class edu.iu.dsc.tws.common.table.arrow.BinaryColumn
 
currentSize() - Method in class edu.iu.dsc.tws.common.table.arrow.Float4Column
 
currentSize() - Method in class edu.iu.dsc.tws.common.table.arrow.Float8Column
 
currentSize() - Method in class edu.iu.dsc.tws.common.table.arrow.Int4Column
 
currentSize() - Method in class edu.iu.dsc.tws.common.table.arrow.Int8Column
 
currentSize() - Method in class edu.iu.dsc.tws.common.table.arrow.StringColumn
 
currentSize() - Method in class edu.iu.dsc.tws.common.table.arrow.UInt2Column
 
currentSize() - Method in interface edu.iu.dsc.tws.common.table.ArrowColumn
 
currentSize() - Method in class edu.iu.dsc.tws.common.table.ArrowTableBuilder
 
currentSize() - Method in interface edu.iu.dsc.tws.common.table.TableBuilder
Get the current size of the table
customGrouping(String, CustomStreamGrouping) - Method in interface org.apache.storm.topology.InputDeclarer
 
customGrouping(String, String, CustomStreamGrouping) - Method in interface org.apache.storm.topology.InputDeclarer
 
customGrouping(String, CustomStreamGrouping) - Method in class org.apache.storm.topology.twister2.Twister2BoltDeclarer
 
customGrouping(String, String, CustomStreamGrouping) - Method in class org.apache.storm.topology.twister2.Twister2BoltDeclarer
 
CustomStreamGrouping - Interface in org.apache.storm.grouping
 

D

DAGMutableGraph<T extends TBase> - Class in edu.iu.dsc.tws.tset.graph
DAG graph implementation
DAGMutableGraph() - Constructor for class edu.iu.dsc.tws.tset.graph.DAGMutableGraph
 
DASHBOARD_HOST - Static variable in class edu.iu.dsc.tws.master.JobMasterContext
 
DashboardApplication - Class in edu.iu.dsc.tws.dashboard
 
DashboardApplicationTests - Class in edu.iu.dsc.tws.dashboard
 
DashboardApplicationTests() - Constructor for class edu.iu.dsc.tws.dashboard.DashboardApplicationTests
 
DashboardClient - Class in edu.iu.dsc.tws.master.dashclient
This client is used to send messages to Dashboard by JobMaster
DashboardClient(String, String, int) - Constructor for class edu.iu.dsc.tws.master.dashclient.DashboardClient
 
DashboardClientExample - Class in edu.iu.dsc.tws.examples.internal.jobmaster
 
dashboardHost(Config) - Static method in class edu.iu.dsc.tws.master.JobMasterContext
 
DashboardSpringConfig - Class in edu.iu.dsc.tws.dashboard
 
DashboardSpringConfig() - Constructor for class edu.iu.dsc.tws.dashboard.DashboardSpringConfig
 
data - Variable in class edu.iu.dsc.tws.comms.utils.HeapNode
 
data - Variable in class edu.iu.dsc.tws.deeplearning.common.ParameterTool
 
DATA_BUFF_INIT_CAP - Static variable in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManagerContext
 
DATA_EDGE - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
 
DATA_INPUT - Static variable in class edu.iu.dsc.tws.data.utils.DataObjectConstants
 
DATA_OBJECT_COMPUTE - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
 
DATA_OBJECT_COMPUTE_TESTING - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
 
DATA_OBJECT_SINK - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
 
DATA_OBJECT_SINK_TESTING - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
 
DATA_OBJECT_SOURCE - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
 
DATA_OBJECT_SOURCE_TESTING - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
 
DATA_YAML - Static variable in class edu.iu.dsc.tws.api.config.Context
 
DataBuffer - Class in edu.iu.dsc.tws.api.comms.packing
Keep track of a byte buffer with capacity and size
DataBuffer(ByteBuffer) - Constructor for class edu.iu.dsc.tws.api.comms.packing.DataBuffer
Create a buffer
DATACENTER_LABEL_KEY - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
 
datacenterLabelKeyForK8s(Config) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesContext
 
DATACENTERS_LIST - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
 
dataConfigurationFile(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
 
DataConstants - Class in edu.iu.dsc.tws.api.data
Class that holds common config constants and there default values
DataContext - Class in edu.iu.dsc.tws.data.utils
 
DataContext() - Constructor for class edu.iu.dsc.tws.data.utils.DataContext
 
DataDeserializer - Class in edu.iu.dsc.tws.comms.dfw.io
 
DataDeserializer() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.DataDeserializer
 
dataDirectory - Static variable in class edu.iu.dsc.tws.graphapi.api.BasicComputation
 
DataFileReader - Class in edu.iu.dsc.tws.data.utils
This class acts as an interface for reading the input datapoints and centroid values from the local file system or from the distributed file system (HDFS).
DataFileReader(Config, String) - Constructor for class edu.iu.dsc.tws.data.utils.DataFileReader
 
DataFileReplicatedReadSource - Class in edu.iu.dsc.tws.task.dataobjects
This class partition the datapoints using the LocalCompleteTextInputPartitioner to partition the complete file as a one partition.
DataFileReplicatedReadSource(String, String) - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataFileReplicatedReadSource
 
DataFileReplicatedReadSource(String, String, int) - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataFileReplicatedReadSource
 
DataFileReplicatedReadSource() - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataFileReplicatedReadSource
 
DataFileSink<T> - Class in edu.iu.dsc.tws.task.dataobjects
This class receives the message from the DataFileSource and writes the output into the DataObject
DataFileSink() - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataFileSink
 
DataFileSplittedReadSource<T> - Class in edu.iu.dsc.tws.task.dataobjects
This class is responsible for partition the datapoints which is based on the task parallelism value.
DataFileSplittedReadSource(String) - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataFileSplittedReadSource
 
DataflowAddNodeExperiment - Class in edu.iu.dsc.tws.examples.internal.dataflowexperiment
 
DataflowAddNodeExperiment() - Constructor for class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowAddNodeExperiment
 
DataflowAddNodeExperiment.Aggregator - Class in edu.iu.dsc.tws.examples.internal.dataflowexperiment
 
DataflowAddNodeExperiment.Aggregator1 - Class in edu.iu.dsc.tws.examples.internal.dataflowexperiment
 
DataFlowGraph - Class in edu.iu.dsc.tws.task.cdfw
 
DataFlowJobConfig - Class in edu.iu.dsc.tws.task.cdfw
 
DataFlowJobConfig() - Constructor for class edu.iu.dsc.tws.task.cdfw.DataFlowJobConfig
 
DataflowJobParameters - Class in edu.iu.dsc.tws.examples.internal.dataflowexperiment
 
DataflowJobParameters() - Constructor for class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowJobParameters
 
DataflowNodeExperiment - Class in edu.iu.dsc.tws.examples.internal.dataflowexperiment
 
DataflowNodeExperiment() - Constructor for class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowNodeExperiment
 
DataflowNodeExperiment.Aggregator - Class in edu.iu.dsc.tws.examples.internal.dataflowexperiment
 
DataflowNodeExperiment.Aggregator1 - Class in edu.iu.dsc.tws.examples.internal.dataflowexperiment
 
DataFlowOperation - Interface in edu.iu.dsc.tws.api.comms
The communication operation interface.
dataFlowOperation - Variable in class edu.iu.dsc.tws.comms.dfw.io.KeyedReceiver
The dataflow operation that is related to the class instance.
DataGenerator - Class in edu.iu.dsc.tws.examples.comms
 
DataGenerator - Class in edu.iu.dsc.tws.examples.internal.batchscheduler
 
DataGenerator(Config, int) - Constructor for class edu.iu.dsc.tws.examples.internal.batchscheduler.DataGenerator
 
DataGenerator(Config) - Constructor for class edu.iu.dsc.tws.examples.internal.batchscheduler.DataGenerator
 
DataGenerator - Class in edu.iu.dsc.tws.examples.utils
Generate a data set
DataGenerator - Class in edu.iu.dsc.tws.tsched.utils
 
DataGenerator(Config, int) - Constructor for class edu.iu.dsc.tws.tsched.utils.DataGenerator
 
DataGenerator(Config) - Constructor for class edu.iu.dsc.tws.tsched.utils.DataGenerator
 
DataGeneratorSink - Class in edu.iu.dsc.tws.examples.batch.cdfw
 
DataGeneratorSink() - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.DataGeneratorSink
 
DataGeneratorSource - Class in edu.iu.dsc.tws.examples.batch.cdfw
 
DataGeneratorSource() - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.DataGeneratorSource
 
DataGeneratorSource(String, int, int, int, String, String) - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.DataGeneratorSource
 
DataInitializationSinkTask - Class in edu.iu.dsc.tws.graphapi.api
 
DataInitializationSinkTask(String) - Constructor for class edu.iu.dsc.tws.graphapi.api.DataInitializationSinkTask
 
dataList - Variable in class edu.iu.dsc.tws.dataset.partition.CollectionPartition
 
DataLoadingTask - Class in edu.iu.dsc.tws.examples.ml.svm.tset
 
DataLoadingTask(BinaryBatchModel) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.tset.DataLoadingTask
 
DataLoadingTask(BinaryBatchModel, SVMJobParameters) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.tset.DataLoadingTask
 
DataLoadingTask(BinaryBatchModel, SVMJobParameters, String) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.tset.DataLoadingTask
 
dataLoadingTime - Variable in class edu.iu.dsc.tws.examples.ml.svm.sgd.SgdSvm
 
DataLocalityBatchTaskScheduler - Class in edu.iu.dsc.tws.tsched.batch.datalocalityaware
The data locality batch task scheduler generate the task schedule plan based on the distance calculated between the worker node and the data nodes where the input data resides.
DataLocalityBatchTaskScheduler() - Constructor for class edu.iu.dsc.tws.tsched.batch.datalocalityaware.DataLocalityBatchTaskScheduler
 
DataLocalityBatchTaskSchedulerTest - Class in edu.iu.dsc.tws.tsched.batch.datalocality
 
DataLocalityBatchTaskSchedulerTest() - Constructor for class edu.iu.dsc.tws.tsched.batch.datalocality.DataLocalityBatchTaskSchedulerTest
 
DataLocalityStreamingTaskScheduler - Class in edu.iu.dsc.tws.tsched.streaming.datalocalityaware
The data locality streaming task scheduler generate the task schedule plan based on the distance calculated between the worker node and the data nodes where the input data resides.
DataLocalityStreamingTaskScheduler() - Constructor for class edu.iu.dsc.tws.tsched.streaming.datalocalityaware.DataLocalityStreamingTaskScheduler
 
DataLocalityTaskSchedulerTest - Class in edu.iu.dsc.tws.tsched.streaming.datalocality
 
DataLocalityTaskSchedulerTest() - Constructor for class edu.iu.dsc.tws.tsched.streaming.datalocality.DataLocalityTaskSchedulerTest
 
DataMessageType - Enum in edu.iu.dsc.tws.data.memory.utils
 
datanodeInstanceBandwidth(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
 
datanodeInstanceLatency(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
 
DataNodeLocatorUtils - Class in edu.iu.dsc.tws.data.utils
This class is to find out the location of the datanodes corresponding to the input file names.
DataNodeLocatorUtils(Config) - Constructor for class edu.iu.dsc.tws.data.utils.DataNodeLocatorUtils
 
DataObject<T> - Interface in edu.iu.dsc.tws.api.dataset
Distributed data set
DataObjectCompute - Class in edu.iu.dsc.tws.graphapi.pagerank
 
DataObjectCompute(String, int, int) - Constructor for class edu.iu.dsc.tws.graphapi.pagerank.DataObjectCompute
 
DataObjectCompute(String, int) - Constructor for class edu.iu.dsc.tws.graphapi.pagerank.DataObjectCompute
 
DataObjectConstants - Class in edu.iu.dsc.tws.data.utils
The input parameters required to create, partition, and read the input data points.
DataObjectConstants() - Constructor for class edu.iu.dsc.tws.data.utils.DataObjectConstants
 
DataObjectCSVSource - Class in edu.iu.dsc.tws.task.dataobjects
 
DataObjectCSVSource() - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataObjectCSVSource
 
DataObjectCSVSource(String, String) - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataObjectCSVSource
 
DataObjectImpl<T> - Class in edu.iu.dsc.tws.dataset
 
DataObjectImpl(Config) - Constructor for class edu.iu.dsc.tws.dataset.DataObjectImpl
 
DataObjectImpl(String, Config) - Constructor for class edu.iu.dsc.tws.dataset.DataObjectImpl
 
DataObjectSink - Class in edu.iu.dsc.tws.graphapi.pagerank
 
DataObjectSink(String) - Constructor for class edu.iu.dsc.tws.graphapi.pagerank.DataObjectSink
 
DataObjectSink<T> - Class in edu.iu.dsc.tws.task.dataobjects
This class receives the message from the DataObjectSource and writes the output into the DataObject.
DataObjectSink() - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataObjectSink
 
DataObjectSource<T> - Class in edu.iu.dsc.tws.task.dataobjects
This class is responsible for partition the datapoints which is based on the task parallelism value.
DataObjectSource() - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataObjectSource
 
DataObjectSource(String, String) - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataObjectSource
 
DataPacker<D,W> - Interface in edu.iu.dsc.tws.api.comms.packing
The data packer interface.
DataPackerProxy - Class in edu.iu.dsc.tws.comms.dfw.io
 
DataParallelJob - Class in edu.iu.dsc.tws.examples.task.dataparallel
 
DataParallelTask - Class in edu.iu.dsc.tws.examples.task.dataparallel
 
DataParallelTask() - Constructor for class edu.iu.dsc.tws.examples.task.dataparallel.DataParallelTask
 
DataParallelWorker - Class in edu.iu.dsc.tws.examples.task.dataparallel
This example demonstrates the use of a data parallel job.
DataParallelWorker() - Constructor for class edu.iu.dsc.tws.examples.task.dataparallel.DataParallelWorker
 
DataPartition<T> - Interface in edu.iu.dsc.tws.api.dataset
Partition of a distributed set
DataPartitionConsumer<T> - Interface in edu.iu.dsc.tws.api.dataset
The partition consumer
DataPartitioner - Class in edu.iu.dsc.tws.examples.ml.svm.data
This class can provide a config like a map where taskindex is paired with the number of data points per partition.
DataPartitioner() - Constructor for class edu.iu.dsc.tws.examples.ml.svm.data.DataPartitioner
 
DataPartitioner(int, int) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.data.DataPartitioner
 
DataPartitionSourceFunc<T> - Class in edu.iu.dsc.tws.tset.sources
 
DataPartitionSourceFunc(String) - Constructor for class edu.iu.dsc.tws.tset.sources.DataPartitionSourceFunc
 
DataPartitionType - Enum in edu.iu.dsc.tws.examples.ml.svm.config
 
DataSerializer - Class in edu.iu.dsc.tws.comms.dfw.io
Builds the message and copies it into data buffers.The structure of the message depends on the type of message that is sent, for example if it is a keyed message or not.
DataSerializer() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.DataSerializer
 
DataSerializerTest - Class in edu.iu.dsc.tws.comms.dfw.io
 
DataSerializerTest() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.DataSerializerTest
 
dataSets - Variable in class org.apache.beam.runners.twister2.Twister2TranslationContext
 
DataSink<T> - Class in edu.iu.dsc.tws.dataset
A data sink
DataSink(Config, DataObjectImpl<T>) - Constructor for class edu.iu.dsc.tws.dataset.DataSink
 
DataSink(Config, OutputWriter<T>) - Constructor for class edu.iu.dsc.tws.dataset.DataSink
 
DataSink() - Constructor for class edu.iu.dsc.tws.examples.compatibility.storm.bench.StormBenchmark.DataSink
 
DataSinkTask - Class in edu.iu.dsc.tws.graphapi.api
 
DataSinkTask(String) - Constructor for class edu.iu.dsc.tws.graphapi.api.DataSinkTask
 
DataSource<T,O extends InputSplit<T>> - Class in edu.iu.dsc.tws.dataset
A distributed data source
DataSource(Config, InputPartitioner<T, O>, int) - Constructor for class edu.iu.dsc.tws.dataset.DataSource
 
DataStatus - Enum in edu.iu.dsc.tws.common.net.tcp
 
DataStreamer(int) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.comms.CommsWorker.DataStreamer
 
DataStreamer - Class in edu.iu.dsc.tws.examples.ml.svm.streamer
Deprecated.
This class is deprecated This is the DataStreamer for both batch and streaming mode In streaming mode a single data point is sent continously. But in the batch application an array of data points is sent once.
DataStreamer(OperationMode) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.streamer.DataStreamer
Deprecated.
 
DataStreamer(int, OperationMode) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.streamer.DataStreamer
Deprecated.
 
DataStreamer(OperationMode, boolean, BinaryBatchModel) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.streamer.DataStreamer
Deprecated.
 
DATASTREAMER_SOURCE - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
 
DataTransferTimeCalculator - Class in edu.iu.dsc.tws.tsched.utils
This class has getters and setters property to set the data transfer time for the nodes.
DataTransferTimeCalculator(String, double, String) - Constructor for class edu.iu.dsc.tws.tsched.utils.DataTransferTimeCalculator
 
DataTransferTimeCalculator(String, double) - Constructor for class edu.iu.dsc.tws.tsched.utils.DataTransferTimeCalculator
 
DataUtils - Class in edu.iu.dsc.tws.examples.ml.svm.util
 
days(long) - Static method in class edu.iu.dsc.tws.common.pojo.Time
Set Time with length and days
days() - Method in class edu.iu.dsc.tws.common.pojo.TimeTest
 
days(long) - Static method in class edu.iu.dsc.tws.task.window.config.WindowConfig.Duration
 
days(int) - Static method in class org.apache.storm.topology.base.BaseWindowedBolt.Duration
Returns a BaseWindowedBolt.Duration corresponding to the the given value in days.
DB_NAME - Static variable in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManagerContext
Name of the databse
deactivate() - Method in interface org.apache.storm.spout.ISpout
Called when a spout has been deactivated.
deactivate() - Method in class org.apache.storm.topology.base.BaseRichSpout
 
DEBUG - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
 
declare(String...) - Static method in class edu.iu.dsc.tws.api.compute.modifiers.IONames
 
declare(Collection<String>) - Static method in class edu.iu.dsc.tws.api.compute.modifiers.IONames
 
declare(Fields) - Method in interface org.apache.storm.topology.OutputFieldsDeclarer
Uses default stream id.
declare(boolean, Fields) - Method in interface org.apache.storm.topology.OutputFieldsDeclarer
 
declare(Fields) - Method in class org.apache.storm.topology.twister2.EdgeFieldMap
 
declare(boolean, Fields) - Method in class org.apache.storm.topology.twister2.EdgeFieldMap
 
declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.MultiSpoutTopology.ExclamationBolt
 
declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.MultiSpoutTopology.TestWordSpout
 
declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.SentenceWordCountTopology.FastRandomSentenceSpout
 
declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.SentenceWordCountTopology.SplitSentence
 
declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.SentenceWordCountTopology.WordCount
 
declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.IntervalWindowTopology.IntervalWindowBolt
 
declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.IntervalWindowTopology.TestWordSpout
 
declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.SlidingWindowTopology.SlidingWindowBolt
 
declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.SlidingWindowTopology.TestWordSpout
 
declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.TumblingWindowTopology.TestWordSpout
 
declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.TumblingWindowTopology.TumblingWindowBolt
 
declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.WordCountTopology.ConsumerBolt
 
declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.WordCountTopology.WordSpout
 
declareOutputFields(OutputFieldsDeclarer) - Method in class org.apache.storm.spout.CheckpointSpout
 
declareOutputFields(OutputFieldsDeclarer) - Method in class org.apache.storm.topology.base.BaseWindowedBolt
 
declareOutputFields(OutputFieldsDeclarer) - Method in interface org.apache.storm.topology.IComponent
Declare the output schema for all the streams of this topology.
declareOutputFields(OutputFieldsDeclarer) - Method in class org.apache.storm.topology.WindowedBoltExecutor
 
declareStream(String, Fields) - Method in interface org.apache.storm.topology.OutputFieldsDeclarer
 
declareStream(String, boolean, Fields) - Method in interface org.apache.storm.topology.OutputFieldsDeclarer
 
declareStream(String, Fields) - Method in class org.apache.storm.topology.twister2.EdgeFieldMap
 
declareStream(String, boolean, Fields) - Method in class org.apache.storm.topology.twister2.EdgeFieldMap
 
decode(byte[]) - Static method in class edu.iu.dsc.tws.common.zk.JobWithState
 
decode(byte[]) - Static method in class edu.iu.dsc.tws.common.zk.WorkerWithState
 
decodeJobEvent(byte[]) - Static method in class edu.iu.dsc.tws.common.zk.ZKEventsManager
 
decodeNodeInfo(String) - Static method in class edu.iu.dsc.tws.proto.utils.NodeInfoUtils
decode the given String that is encoded with encodeNodeInfo method each field is separated by a comma
decodeNodeInfoList(String) - Static method in class edu.iu.dsc.tws.proto.utils.NodeInfoUtils
decode the given String that is encoded with the method encodeNodeInfoList each NodeInfoUtils object is separated by others with a semi colon
decodeWorkerZnodeBody(byte[]) - Static method in class edu.iu.dsc.tws.common.zk.ZKEphemStateManager
 
decorate(Kryo) - Method in interface org.apache.storm.serialization.IKryoDecorator
 
decreaseMemoryLoad(int) - Method in class edu.iu.dsc.tws.comms.shuffle.ControlledFileReaderFlags
 
decreaseWorkers(int) - Method in class edu.iu.dsc.tws.task.cdfw.CDFWEnv
 
DedicatedComStreamingExecutor - Class in edu.iu.dsc.tws.executor.threading.ft
This is a dedicated communication thread based streaming executor that halts execution in case of an error.
DedicatedComStreamingExecutor(Config, int, TWSChannel, ExecutionPlan, IExecutionHook) - Constructor for class edu.iu.dsc.tws.executor.threading.ft.DedicatedComStreamingExecutor
 
DedidatedBatchExecutor - Class in edu.iu.dsc.tws.executor.threading.ft
 
DedidatedBatchExecutor(Config, int, TWSChannel, ExecutionPlan, IExecutionHook) - Constructor for class edu.iu.dsc.tws.executor.threading.ft.DedidatedBatchExecutor
 
DEFAULT_APPEND_BUFFER_SIZE - Static variable in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManagerContext
 
DEFAULT_BYTEORDER - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
 
DEFAULT_CHARSET - Static variable in class edu.iu.dsc.tws.data.memory.MemoryManagerContext
Charset used in the memory manager
DEFAULT_CONTAINER_PER_WORKER - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
 
DEFAULT_CPU_AMOUNT - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
 
DEFAULT_DESIRED_NODE - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
 
DEFAULT_DESTINATION - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
 
DEFAULT_DISK_SIZE - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
 
DEFAULT_EDGE - Static variable in class edu.iu.dsc.tws.task.impl.TaskConfigurations
 
DEFAULT_FIELD_DELIMITER - Static variable in class edu.iu.dsc.tws.data.api.splits.CSVInputSplit
 
DEFAULT_FILESYSTEM_SCHEME - Static variable in class edu.iu.dsc.tws.api.data.DataConstants
The default filesystem to be used, if no other scheme is specified in the user-provided URI (= local filesystem)
DEFAULT_FOLDER_PATH - Static variable in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManagerContext
File path to store the LMDB database
DEFAULT_FORMAT - Static variable in class edu.iu.dsc.tws.common.logging.LoggingContext
 
DEFAULT_FORMAT - Static variable in class edu.iu.dsc.tws.common.logging.LoggingHelper
 
DEFAULT_HDFS_FILESYSTEM_SCHEME - Static variable in class edu.iu.dsc.tws.api.data.DataConstants
 
DEFAULT_LINE_DELIMITER - Static variable in class edu.iu.dsc.tws.data.api.splits.CSVInputSplit
 
DEFAULT_MAX_LAG - Static variable in class edu.iu.dsc.tws.task.window.core.BaseWindowedSink
 
DEFAULT_NUMBER_OF_CONTAINERS - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
 
DEFAULT_PARALLELISM - Static variable in class edu.iu.dsc.tws.task.impl.TaskConfigurations
 
DEFAULT_RAM_SIZE - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
 
DEFAULT_RECORD_LENGTH - Static variable in class edu.iu.dsc.tws.data.api.splits.BinaryInputSplit
The default value of the record length
DEFAULT_REF - Static variable in interface edu.iu.dsc.tws.api.dataset.DataPartition
 
DEFAULT_TAB_DELIMITER - Static variable in class edu.iu.dsc.tws.data.api.splits.CSVInputSplit
 
DEFAULT_UNDEFINED - Static variable in class edu.iu.dsc.tws.deeplearning.common.ParameterTool
 
DEFAULT_USE_DOCKER_CONTAINER - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
 
DEFAULT_WATERMARK_INTERVAL - Static variable in class edu.iu.dsc.tws.task.window.core.BaseWindowedSink
 
DEFAULT_WORKER_PORT - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
 
DEFAULT_WRITE_BUFFER_MAP_SIZE - Static variable in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManagerContext
 
defaultBarrierDir(String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKUtils
construct default barrier directory path for the job
defaultData - Variable in class edu.iu.dsc.tws.deeplearning.common.ParameterTool
 
DefaultDestinationSelector - Class in edu.iu.dsc.tws.executor.comms
 
DefaultDestinationSelector(TaskPartitioner, Map<Integer, Integer>, Map<Integer, Integer>) - Constructor for class edu.iu.dsc.tws.executor.comms.DefaultDestinationSelector
 
DefaultDriver - Class in edu.iu.dsc.tws.api.driver
 
DefaultDriver() - Constructor for class edu.iu.dsc.tws.api.driver.DefaultDriver
 
DefaultEdge<I,V> - Class in edu.iu.dsc.tws.graphapi.vertex
 
DefaultEdge() - Constructor for class edu.iu.dsc.tws.graphapi.vertex.DefaultEdge
 
DefaultEvictionContext - Class in edu.iu.dsc.tws.task.window.api
 
DefaultEvictionContext(Long) - Constructor for class edu.iu.dsc.tws.task.window.api.DefaultEvictionContext
 
DefaultEvictionContext(Long, Long) - Constructor for class edu.iu.dsc.tws.task.window.api.DefaultEvictionContext
 
DefaultEvictionContext(Long, Long, Long) - Constructor for class edu.iu.dsc.tws.task.window.api.DefaultEvictionContext
 
DefaultEvictionContext(Long, Long, Long, Long) - Constructor for class edu.iu.dsc.tws.task.window.api.DefaultEvictionContext
 
DefaultEvictionContext - Class in org.apache.storm.windowing
 
DefaultEvictionContext(Long) - Constructor for class org.apache.storm.windowing.DefaultEvictionContext
 
DefaultEvictionContext(Long, Long) - Constructor for class org.apache.storm.windowing.DefaultEvictionContext
 
DefaultEvictionContext(Long, Long, Long) - Constructor for class org.apache.storm.windowing.DefaultEvictionContext
 
DefaultEvictionContext(Long, Long, Long, Long) - Constructor for class org.apache.storm.windowing.DefaultEvictionContext
 
DefaultOutputCollection - Class in edu.iu.dsc.tws.executor.core
 
DefaultOutputCollection(BlockingQueue<IMessage>) - Constructor for class edu.iu.dsc.tws.executor.core.DefaultOutputCollection
 
defaults - Static variable in class edu.iu.dsc.tws.api.config.Context
 
defaultTaskInstancesPerContainer(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
 
DefaultVertex<I,V,E> - Class in edu.iu.dsc.tws.graphapi.vertex
 
DefaultVertex() - Constructor for class edu.iu.dsc.tws.graphapi.vertex.DefaultVertex
 
defineFlag(String, int, boolean) - Static method in class edu.iu.dsc.tws.examples.utils.bench.Timing
This method will allocate initial capacity required for array list
delete(Path, boolean) - Method in class edu.iu.dsc.tws.api.data.FileSystem
 
delete(String, Integer) - Method in class edu.iu.dsc.tws.dashboard.services.ComputeResourceService
 
delete(Path, boolean) - Method in class edu.iu.dsc.tws.data.fs.local.LocalFileSystem
 
delete(Path, boolean) - Method in class edu.iu.dsc.tws.data.hdfs.HadoopFileSystem
 
delete(int, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
 
delete(int, String) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
 
delete(int, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
 
delete(int, String) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
 
delete(int, ByteBuffer) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
delete the given key from the store
delete(int, String) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
delete the given key from the store
delete(ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
 
delete(String) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
 
delete(String) - Method in class edu.iu.dsc.tws.rsched.uploaders.hdfs.HdfsController
 
delete(String) - Method in class edu.iu.dsc.tws.rsched.uploaders.scp.ScpController
 
delete(K) - Method in class org.apache.storm.state.InMemoryKeyValueState
 
delete(K) - Method in interface org.apache.storm.state.KeyValueState
Deletes the value mapped to the key, if there is any
DELETE_OPTIONS_PROPAGATION_POLICY - Static variable in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesConstants
 
DELETE_TAG - Static variable in class edu.iu.dsc.tws.common.zk.ZKEphemStateManager
 
deleteByJob_JobIDAndIndex(String, Integer) - Method in interface edu.iu.dsc.tws.dashboard.repositories.ComputeResourceRepository
 
deleteComputeResource(String, Integer) - Method in class edu.iu.dsc.tws.dashboard.controllers.JobController
 
deleteConfigMap(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
delete the given ConfigMap from Kubernetes master
deleteDir(String) - Static method in class edu.iu.dsc.tws.rsched.utils.FileUtils
 
deleteFile(String) - Static method in class edu.iu.dsc.tws.rsched.utils.FileUtils
 
deleteFromBMM(int, String) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
 
deleteJobMasterZNode() - Method in class edu.iu.dsc.tws.common.zk.ZKJobMasterRegistrar
this method can be used to delete the znode from a previous session if you don't want to wait the ZooKeeper to delete the ephemeral znode if ZKJobMasterRegistrar is not closed properly in the previous session, it takes around 30 seconds for ZooKeeper to delete the ephemeral JobMaster node
deleteJobPackage(List<String>, String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
delete job package file from uploader web server pods currently it does not delete job package file from multiple uploader pods so, It is not in use
deleteJobZNode(CuratorFramework, String, String) - Static method in class edu.iu.dsc.tws.common.zk.JobZNodeManager
delete job znode from zk server
deletePersistentVolume(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
 
deletePersistentVolumeClaim(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
 
deleteService(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
delete the given service from Kubernetes master
deleteStatefulSet(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
delete the given StatefulSet from Kubernetes master
deleteUndeletedResources() - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.ClientJobKillHandler
 
deleteWorkerZNode(CuratorFramework, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
delete the worker znode at a barrier directory
deleteWorkerZNodeFromDefault(CuratorFramework, String, String, int) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
delete the worker znode at the default barrier directory
deleteWorkerZNodeFromInit(CuratorFramework, String, String, int) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
delete the worker znode at the init barrier directory
DelimitedInputSplit<OT> - Class in edu.iu.dsc.tws.data.api.splits
 
DelimitedInputSplit(int, Path, long, long, String[]) - Constructor for class edu.iu.dsc.tws.data.api.splits.DelimitedInputSplit
Constructs a split with host information.
DELIMITER - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
 
deserialize(byte[]) - Method in class edu.iu.dsc.tws.api.util.KryoSerializer
 
deserialize(InputStream) - Method in class edu.iu.dsc.tws.api.util.KryoSerializer
 
deserialize(byte[]) - Static method in class edu.iu.dsc.tws.executor.util.Utils
 
deserialize(ByteBuffer) - Method in interface org.apache.storm.spout.MultiScheme
 
deserialize(ByteBuffer) - Method in interface org.apache.storm.spout.Scheme
 
deserialize(byte[]) - Static method in class org.apache.storm.utils.Utils
 
deserializeDouble(ByteBuffer) - Static method in class edu.iu.dsc.tws.data.utils.MemoryDeserializer
 
deserializeInteger(ByteBuffer) - Static method in class edu.iu.dsc.tws.data.utils.MemoryDeserializer