- AbstractIterableDataCompute<T> - Class in edu.iu.dsc.tws.task.typed
-
- AbstractIterableDataCompute() - Constructor for class edu.iu.dsc.tws.task.typed.AbstractIterableDataCompute
-
- AbstractKeyedOpsConfig<T extends AbstractOpsConfig> - Class in edu.iu.dsc.tws.task.impl.ops
-
- AbstractKeyedOpsConfig(String, String, ComputeConnection) - Constructor for class edu.iu.dsc.tws.task.impl.ops.AbstractKeyedOpsConfig
-
- AbstractListDataCompute<T> - Class in edu.iu.dsc.tws.task.window.core
-
- AbstractListDataCompute() - Constructor for class edu.iu.dsc.tws.task.window.core.AbstractListDataCompute
-
- AbstractMemoryManager - Class in edu.iu.dsc.tws.data.memory
-
Abstract Memory Manager.
- AbstractMemoryManager() - Constructor for class edu.iu.dsc.tws.data.memory.AbstractMemoryManager
-
- AbstractOp - Interface in edu.iu.dsc.tws.comms.functions.reduction
-
- AbstractOpsConfig<T extends AbstractOpsConfig> - Class in edu.iu.dsc.tws.task.impl.ops
-
- AbstractOpsConfig(String, String, ComputeConnection) - Constructor for class edu.iu.dsc.tws.task.impl.ops.AbstractOpsConfig
-
- AbstractParallelOperation - Class in edu.iu.dsc.tws.executor.comms
-
- AbstractParallelOperation(Config, Communicator, LogicalPlan, String) - Constructor for class edu.iu.dsc.tws.executor.comms.AbstractParallelOperation
-
- AbstractPythonProcessor - Class in edu.iu.dsc.tws.python.processors
-
- AbstractSingleDataCompute<T> - Class in edu.iu.dsc.tws.task.typed
-
- AbstractSingleDataCompute() - Constructor for class edu.iu.dsc.tws.task.typed.AbstractSingleDataCompute
-
- AbstractSingleWindowDataCompute<T> - Class in edu.iu.dsc.tws.task.window.core
-
- AbstractSingleWindowDataCompute() - Constructor for class edu.iu.dsc.tws.task.window.core.AbstractSingleWindowDataCompute
-
- AbstractSingleWindowDataSink<T> - Class in edu.iu.dsc.tws.task.window.core
-
- AbstractSingleWindowDataSink() - Constructor for class edu.iu.dsc.tws.task.window.core.AbstractSingleWindowDataSink
-
- AcceptingData<T> - Interface in edu.iu.dsc.tws.api.tset.sets
-
Adds the capability for
TSets to accept data from another TSet as an input.
- AccuracyAverager - Class in edu.iu.dsc.tws.examples.ml.svm.tset
-
- AccuracyAverager(int) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.tset.AccuracyAverager
-
- ack(Object) - Method in class org.apache.storm.spout.CheckpointSpout
-
- ack(Object) - Method in interface org.apache.storm.spout.ISpout
-
Storm has determined that the tuple emitted by this spout with the msgId identifier
has been fully processed.
- ack(Tuple) - Method in interface org.apache.storm.task.IOutputCollector
-
- ack(Tuple) - Method in class org.apache.storm.task.OutputCollector
-
- ack(Object) - Method in class org.apache.storm.topology.base.BaseRichSpout
-
- Action - Enum in edu.iu.dsc.tws.task.window.constant
-
- activate() - Method in interface org.apache.storm.spout.ISpout
-
Called when a spout has been activated out of a deactivated mode.
- activate() - Method in class org.apache.storm.topology.base.BaseRichSpout
-
- active() - Method in class edu.iu.dsc.tws.common.zk.JobWithState
-
- add(String, DataObject<?>) - Method in interface edu.iu.dsc.tws.api.compute.modifiers.Receptor
-
- add(String, DataPartition<?>) - Method in interface edu.iu.dsc.tws.api.compute.modifiers.Receptor
-
- add(T) - Method in interface edu.iu.dsc.tws.api.tset.fn.SinkFunc
-
Every time an edge produces a value, this method is called.
- add(Row) - Method in class edu.iu.dsc.tws.common.table.ArrowTableBuilder
-
- add(Row) - Method in interface edu.iu.dsc.tws.common.table.TableBuilder
-
Add a row to build the tbale
- add(T) - Method in class edu.iu.dsc.tws.common.util.IterativeLinkedList
-
Add the element at the end of the list
- add(T) - Method in class edu.iu.dsc.tws.common.util.IterativeLinkedList.ILLIterator
-
Add the element to list
- add(Tuple) - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedMerger
-
- add(Object, byte[], int) - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedMerger
-
Add the data to the file
- add(Object, byte[], int) - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMerger
-
Add the data to the file
- add(Tuple) - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMerger2
-
Add the data to the file
- add(Object, byte[], int) - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMerger2
-
Add the data to the file
- add(byte[], int) - Method in class edu.iu.dsc.tws.comms.shuffle.FSMerger
-
Add the data to the file
- add(Tuple) - Method in interface edu.iu.dsc.tws.comms.shuffle.Shuffle
-
Add tuple with byte value and key
- add(Object, byte[], int) - Method in interface edu.iu.dsc.tws.comms.shuffle.Shuffle
-
Add an object with a key
- add(byte[], int) - Method in interface edu.iu.dsc.tws.comms.shuffle.Shuffle
-
Add object
- add(Object) - Method in class edu.iu.dsc.tws.comms.utils.DiskBasedList
-
- add(int, Object) - Method in class edu.iu.dsc.tws.comms.utils.DiskBasedList
-
- add(int, T) - Method in class edu.iu.dsc.tws.dataset.DataSink
-
- add(T) - Method in class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
-
- add(T) - Method in class edu.iu.dsc.tws.dataset.partition.CollectionPartition
-
- add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.batch.cdfw.KMeansConnectedDataflowExample.KMeansSourceTask
-
- add(String, DataPartition<?>) - Method in class edu.iu.dsc.tws.examples.batch.cdfw.KMeansConnectedDataflowExample.KMeansSourceTask
-
- add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.batch.kmeans.CSVInputFormatTest.TestSource
-
- add(String, DataPartition<?>) - Method in class edu.iu.dsc.tws.examples.batch.kmeans.KMeansComputeJob.KMeansSourceTask
-
- add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.ml.svm.compute.IterativeStreamingCompute
-
- add(String, DataObject<?>) - Method in interface edu.iu.dsc.tws.examples.ml.svm.integration.test.IReceptor
-
This method is called when the data is available
- add(double[], double[]) - Static method in class edu.iu.dsc.tws.examples.ml.svm.math.Matrix
-
- add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.ml.svm.streamer.InputDataStreamer
-
- add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.ml.svm.streamer.IterativeDataStream
-
- add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.ml.svm.streamer.IterativePredictionDataStreamer
-
- add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.ml.svm.streamer.IterativeStreamingDataStreamer
-
- add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.examples.ml.svm.test.PredictionSourceTask
-
- add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation.SourceTask
-
- add(String, DataPartition<?>) - Method in class edu.iu.dsc.tws.task.cdfw.task.ConnectedSource
-
- add(IMessage<T>) - Method in interface edu.iu.dsc.tws.task.window.manage.IManager
-
- add(IMessage<T>) - Method in class edu.iu.dsc.tws.task.window.manage.WindowManager
-
- add(IMessage<T>, long) - Method in class edu.iu.dsc.tws.task.window.manage.WindowManager
-
- add(Event<T>) - Method in class edu.iu.dsc.tws.task.window.manage.WindowManager
-
- add(String, DataObject<?>) - Method in class edu.iu.dsc.tws.tsched.utils.TaskSchedulerClassTest.TestSource
-
- add(Iterator<T>) - Method in class edu.iu.dsc.tws.tset.fn.impl.ArrowBasedSinkFunction
-
- add(String, DataPartition<?>) - Method in class edu.iu.dsc.tws.tset.ops.BaseOp
-
- add(String, DataPartition<?>) - Method in class edu.iu.dsc.tws.tset.ops.WindowComputeOp
-
- add(T) - Method in class edu.iu.dsc.tws.tset.sinks.CacheSingleSink
-
- add(T) - Method in class edu.iu.dsc.tws.tset.sinks.DiskPersistSingleSink
-
- add(Iterator<T>) - Method in class edu.iu.dsc.tws.tset.sinks.FileIterSink
-
- add(T) - Method in class edu.iu.dsc.tws.tset.sinks.FileSink
-
- add(Iterator<T>) - Method in class edu.iu.dsc.tws.tset.sinks.StoreIterSink
-
- add(T) - Method in class edu.iu.dsc.tws.tset.sinks.StreamingCacheSink
-
- add(T) - Method in class edu.iu.dsc.tws.tset.sinks.StreamingDiskPersistSink
-
- add(T) - Method in class org.apache.beam.runners.twister2.translators.functions.SideInputSinkFunction
-
- add(T) - Method in class org.apache.beam.runners.twister2.translators.functions.Twister2SinkFunction
-
- add(T) - Method in class org.apache.storm.windowing.WindowManager
-
Add an event into the window, with System.currentTimeMillis() as the tracking ts.
- add(T, long) - Method in class org.apache.storm.windowing.WindowManager
-
Add an event into the window, with the given ts as the tracking ts.
- add(Event<T>) - Method in class org.apache.storm.windowing.WindowManager
-
Tracks a window event
- addAll(Collection) - Method in class edu.iu.dsc.tws.comms.utils.DiskBasedList
-
- addAll(int, Collection) - Method in class edu.iu.dsc.tws.comms.utils.DiskBasedList
-
- addAll(Collection<T>) - Method in class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
-
- addAll(Collection<T>) - Method in class edu.iu.dsc.tws.dataset.partition.CollectionPartition
-
- addAllJoinedListener(IAllJoinedListener) - Method in class edu.iu.dsc.tws.common.zk.ZKWorkerController
-
add a single IAllJoinedListener
if additional IAllJoinedListener tried to be added,
do not add and return false
- addAllJoinedListener(IAllJoinedListener) - Static method in class edu.iu.dsc.tws.master.worker.JMWorkerAgent
-
only one IAllJoinedListener can be added
if the second IAllJoinedListener tried to be added, false returned
- addAllJoinedListener(IAllJoinedListener) - Static method in class edu.iu.dsc.tws.rsched.core.WorkerRuntime
-
Add IAllJoinedListener
It may return false, if a listener already added
- addAllJoinedListener(IAllJoinedListener) - Method in class edu.iu.dsc.tws.rsched.schedulers.standalone.MPIWorkerController
-
- addAllProperties(Map<String, Object>) - Method in class edu.iu.dsc.tws.common.net.NetworkInfo
-
- addBuffer(DataBuffer) - Method in class edu.iu.dsc.tws.api.comms.messaging.ChannelMessage
-
- addBufferAndCalculate(DataBuffer) - Method in class edu.iu.dsc.tws.comms.dfw.InMessage
-
Add a buffer and calculate weather we have seen all the buffers for an object
- addBuffers(List<DataBuffer>) - Method in class edu.iu.dsc.tws.api.comms.messaging.ChannelMessage
-
- addBuiltMessage(ChannelMessage) - Method in class edu.iu.dsc.tws.comms.dfw.InMessage
-
- addChild(Node) - Method in class edu.iu.dsc.tws.comms.routing.Node
-
- addChildren(List<Node>) - Method in class edu.iu.dsc.tws.comms.routing.Node
-
- addChildToGraph(TBase) - Method in class edu.iu.dsc.tws.tset.links.BaseTLink
-
- addChildToGraph(TBase) - Method in class edu.iu.dsc.tws.tset.sets.BaseTSet
-
- addChildToGraph(TBase, TBase) - Method in class edu.iu.dsc.tws.tset.sets.BaseTSet
-
- addCompute(String, ICompute) - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
-
Add a compute node to the graph
- addCompute(String, ICompute, int) - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
-
Add a compute node to the graph
- addComputeResource(double, int, int) - Method in class edu.iu.dsc.tws.api.Twister2Job.Twister2JobBuilder
-
- addComputeResource(double, int, int, boolean) - Method in class edu.iu.dsc.tws.api.Twister2Job.Twister2JobBuilder
-
- addComputeResource(double, int, double, int) - Method in class edu.iu.dsc.tws.api.Twister2Job.Twister2JobBuilder
-
- addComputeResource(double, int, double, int, boolean) - Method in class edu.iu.dsc.tws.api.Twister2Job.Twister2JobBuilder
-
- addComputeResource(double, int, double, int, int) - Method in class edu.iu.dsc.tws.api.Twister2Job.Twister2JobBuilder
-
- addComputeResource(double, int, double, int, boolean, int) - Method in class edu.iu.dsc.tws.api.Twister2Job.Twister2JobBuilder
-
- addConfig(String, Object) - Method in class edu.iu.dsc.tws.python.BootstrapPoint
-
- addConfigMapParam(String, String, String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
-
add a new parameter the job ConfigMap
- addConfiguration(String, Object) - Method in class edu.iu.dsc.tws.api.compute.graph.Vertex
-
- addConfiguration(String, String, Object) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
-
- addConfiguration(String, Object) - Method in interface org.apache.storm.topology.ComponentConfigurationDeclarer
-
- addConfiguration(String, Object) - Method in class org.apache.storm.topology.twister2.Twister2BoltDeclarer
-
- addConfiguration(String, Object) - Method in class org.apache.storm.topology.twister2.Twister2SpoutDeclarer
-
- addConfigurations(Map) - Method in interface org.apache.storm.topology.ComponentConfigurationDeclarer
-
- addConfigurations(Map) - Method in class org.apache.storm.topology.twister2.Twister2BoltDeclarer
-
- addConfigurations(Map) - Method in class org.apache.storm.topology.twister2.Twister2SpoutDeclarer
-
- addCreatedStatefulSetName(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.JobSubmissionStatus
-
- addCurrentKeyedObject() - Method in class edu.iu.dsc.tws.comms.dfw.InMessage
-
- addCurrentObject() - Method in class edu.iu.dsc.tws.comms.dfw.InMessage
-
- addDataFlowJobConfig(DataFlowJobConfig) - Method in class edu.iu.dsc.tws.task.cdfw.DataFlowGraph
-
- addDirectChild(int) - Method in class edu.iu.dsc.tws.comms.routing.Node
-
- addDirectChildren(List<Integer>) - Method in class edu.iu.dsc.tws.comms.routing.Node
-
- addDirectoryToArchive(String) - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
-
add all files in the given directory to the tar.gz file
add the given prefix to all files in tar names
do not copy files recursively.
- addEdge(DefaultEdge) - Method in class edu.iu.dsc.tws.graphapi.vertex.DefaultVertex
-
- addEdge(DefaultEdge) - Method in class edu.iu.dsc.tws.graphapi.vertex.SsspDefaultVertex
-
- addEdge(E) - Method in interface edu.iu.dsc.tws.graphapi.vertex.Vertex
-
Add an edge for this vertex (happens immediately)
- addEdge() - Method in class edu.iu.dsc.tws.tset.test.graph.BasicGraphTests
-
- addExternalRoute(int) - Method in class edu.iu.dsc.tws.comms.dfw.RoutingParameters
-
- addExternalRoutes(Collection<Integer>) - Method in class edu.iu.dsc.tws.comms.dfw.RoutingParameters
-
- addFailureListener(IWorkerFailureListener) - Method in class edu.iu.dsc.tws.common.zk.ZKWorkerController
-
add a single IWorkerFailureListener
if additional IWorkerFailureListener tried to be added,
do not add and return false
- addFileToArchive(String) - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
-
add one file to tar.gz file
- addFileToArchive(File, String) - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
-
add one file to tar.gz file
- addFileToArchive(String, byte[]) - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
-
add one file to tar.gz file
file is created from the given byte array
- addGraphConstraints(Map<String, String>) - Method in class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
-
- addGraphConstraints(String, String) - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
-
Adding Graph Constraints
- addGraphConstraints(Map<String, String>) - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
-
Adding Graph Constraints
- addInboundFieldsForEdge(String, Fields) - Method in class org.apache.storm.topology.twister2.Twister2Bolt
-
- addInput(String, StorableTBase<?>) - Method in interface edu.iu.dsc.tws.api.tset.sets.AcceptingData
-
Allows users to pass in other TSets as inputs for a TSet
- addInput(String, StorableTBase<?>) - Method in interface edu.iu.dsc.tws.api.tset.sets.batch.BatchTSet
-
Adds data to this TSet
- addInput(String, StorableTBase<?>) - Method in interface edu.iu.dsc.tws.api.tset.sets.batch.BatchTupleTSet
-
- addInput(String, DataPartition<?>) - Method in class edu.iu.dsc.tws.api.tset.TSetContext
-
Adds a input object into the map
- addInput(String, String, String) - Method in class edu.iu.dsc.tws.task.cdfw.DataFlowGraph
-
- addInput(ComputeGraph, ExecutionPlan, String, String, DataObject<?>) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
-
- addInput(IExecutor, String, String, DataObject<?>) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
-
- addInput(String, DataObject) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
-
- addInput(String, String, String) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
-
Adds a
TSet to another
TSet as an input that will be identified by the inputKey
- addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.BatchTSetImpl
-
- addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.BatchTupleTSetImpl
-
- addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.CachedTSet
-
- addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.ComputeTSet
-
- addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.KeyedPersistedTSet
-
- addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.KeyedSourceTSet
-
- addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.PersistedTSet
-
- addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.row.BatchRowTSetImpl
-
- addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.row.RowPersistedTSet
-
- addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.row.RowSinkTSet
-
- addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.SinkTSet
-
- addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.SourceTSet
-
- addInput(String, StorableTBase<?>) - Method in class edu.iu.dsc.tws.tset.sets.batch.StoredTSet
-
- addInputMap(Map<String, DataPartition<?>>) - Method in class edu.iu.dsc.tws.api.tset.TSetContext
-
- AddInputsExample - Class in edu.iu.dsc.tws.examples.tset.batch
-
- AddInputsExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.AddInputsExample
-
- addInstance(Integer, String) - Method in class edu.iu.dsc.tws.tsched.builder.TaskSchedulePlanBuilder
-
- addInstance(Scorer<Container>, String) - Method in class edu.iu.dsc.tws.tsched.builder.TaskSchedulePlanBuilder
-
It will add the task instance to the container based on the container score value.
- addInteranlRoute(int) - Method in class edu.iu.dsc.tws.comms.dfw.RoutingParameters
-
- addInternalRoutes(Collection<Integer>) - Method in class edu.iu.dsc.tws.comms.dfw.RoutingParameters
-
- ADDITIONAL_PORTS - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- additionalPorts(Config) - Static method in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- addJMFailureListener(IJobMasterFailureListener) - Method in class edu.iu.dsc.tws.common.zk.ZKWorkerController
-
TODO: jm restarted implemented, but jm failed not implemented yet
Supports multiple IJobMasterFailureListeners
- addJMFailureListener(IJobMasterFailureListener) - Static method in class edu.iu.dsc.tws.rsched.core.WorkerRuntime
-
add a IJobMasterFailureListener
Currently failure notification is only implemented with ZKWorkerController
A listener can be only added when ZKWorkerController is used.
- addJobClass(String) - Method in class edu.iu.dsc.tws.local.util.LocalClassLoader
-
- addJobEndListener(JobEndListener) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.client.JobEndWatcher
-
add a listener
- addJobFaultListener(JobFaultListener) - Method in class edu.iu.dsc.tws.master.server.JobFailureWatcher
-
- addJoinedWorkers(List<WorkerWithState>) - Method in class edu.iu.dsc.tws.master.server.WorkerMonitor
-
when the job master restarts, it adds already joined workers with this method.
- addLoggingHandler(Handler) - Static method in class edu.iu.dsc.tws.common.logging.LoggingHelper
-
- addLogicalIdToWorker(int, int) - Method in class edu.iu.dsc.tws.api.comms.LogicalPlan
-
- addMessage(int, List<Object>, Object) - Method in class edu.iu.dsc.tws.comms.dfw.io.allgather.BcastGatheStreamingReceiver
-
- addMessage(int, List<Object>, Object) - Method in class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastBatchFinalReceiver
-
- addMessage(int, List<Object>, Object) - Method in class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastStreamingFinalReceiver
-
- addMessage(int, List<Object>, Object) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetPartialReceiver
-
- addMessage(int, List<Object>, Object) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetReceiver
-
- addNode(T) - Method in class edu.iu.dsc.tws.tset.graph.DAGMutableGraph
-
- addNode(T) - Method in interface edu.iu.dsc.tws.tset.graph.MutableGraph
-
Adds node if it is not already present.
- addNode() - Method in class edu.iu.dsc.tws.tset.test.graph.BasicGraphTests
-
- addNodeConstraints(Map<String, Map<String, String>>) - Method in class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
-
- addNodeConstraints(String, Map<String, String>) - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
-
- addNodes(String, int, INodeInstance) - Method in class edu.iu.dsc.tws.api.compute.executor.ExecutionPlan
-
Add a node instance of this execution
- addOperation(int, DataMessageType) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
-
- addOperation(int, DataMessageType, DataMessageType) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
-
- addOperation(int, DataMessageType) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
-
At this level the method does not return an OperationMemoryManager since the implementaion
does not handle OperationMemoryManager's
- addOperation(int, DataMessageType, DataMessageType) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
-
- addOperation(int, DataMessageType) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
-
Add an memory manager instance for the given operation
- addOperation(int, DataMessageType, DataMessageType) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
-
- addOps(IParallelOperation) - Method in class edu.iu.dsc.tws.api.compute.executor.ExecutionPlan
-
- addOutput(String, String) - Method in class edu.iu.dsc.tws.task.cdfw.DataFlowGraph
-
- addOverFlowBuffers(List<DataBuffer>) - Method in class edu.iu.dsc.tws.api.comms.messaging.ChannelMessage
-
- addPartition(DataPartition<T>) - Method in interface edu.iu.dsc.tws.api.dataset.DataObject
-
Add a partition to the data object
- addPartition(DataPartition) - Method in class edu.iu.dsc.tws.api.dataset.EmptyDataObject
-
- addPartition(DataPartition<T>) - Method in class edu.iu.dsc.tws.dataset.DataObjectImpl
-
- addProperties(Map<String, Object>) - Method in class edu.iu.dsc.tws.api.compute.graph.Edge
-
Add the properties to the edge
- addProperty(String, Object) - Method in class edu.iu.dsc.tws.api.compute.graph.Edge
-
Add a property to the edge
- addProperty(String, Object) - Method in class edu.iu.dsc.tws.api.compute.schedule.elements.Worker
-
- addProperty(String, Object) - Method in class edu.iu.dsc.tws.common.net.NetworkInfo
-
- addReadRequest(TCPMessage) - Method in class edu.iu.dsc.tws.common.net.tcp.BaseNetworkChannel
-
- addReadRequest(TCPMessage) - Method in class edu.iu.dsc.tws.common.net.tcp.DynamicBufferChannel
-
- addReadRequest(TCPMessage) - Method in class edu.iu.dsc.tws.common.net.tcp.FixedBufferChannel
-
- addReceiverFromDriver(IReceiverFromDriver) - Method in class edu.iu.dsc.tws.master.worker.JMDriverAgent
-
only one IReceiverFromDriver can be added
if the second IReceiverFromDriver tried to be added, returns false
- addReceiverFromDriver(IReceiverFromDriver) - Static method in class edu.iu.dsc.tws.master.worker.JMWorkerAgent
-
only one IReceiverFromDriver can be added
if the second IReceiverFromDriver tried to be added, returns false
- addReceiverFromDriver(IReceiverFromDriver) - Static method in class edu.iu.dsc.tws.rsched.core.WorkerRuntime
-
Add IReceiverFromDriver
It may return false, if a listener already added or
if there is no Driver in the job
- addRuntimeObject(String, Object) - Static method in class edu.iu.dsc.tws.api.config.MPIContext
-
- addScalerListener(IScalerListener) - Method in class edu.iu.dsc.tws.common.zk.ZKWorkerController
-
add a single IScalerListener
if additional IScalerListener tried to be added,
do not add and return false
- addScalerListener(IScalerListener) - Static method in class edu.iu.dsc.tws.master.worker.JMWorkerAgent
-
only one IScalerListener can be added
if the second IScalerListener tried to be added, false returned
- addScalerListener(IScalerListener) - Static method in class edu.iu.dsc.tws.rsched.core.WorkerRuntime
-
Add IScalerListener
It may return false, if a listener already added or
if there is no Driver in the job
- addShutdownHook(boolean) - Method in class edu.iu.dsc.tws.master.server.JobMaster
-
A job can be terminated in two ways:
a) workers end a job: workers either successfully complete or fail
all workers complete their work and send COMPLETED messages to the Job Master.
- addShutdownHook(IWorkerStatusUpdater) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.worker.K8sWorkerStarter
-
if the worker is killed by scaling down,
we need to let ZooKeeper know about it and delete worker znode
if zookeeper is used
- addSource(String, ISource) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
-
- addSource(String, ISource, int) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
-
- addSource(String, ISource) - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
-
Add a source node to the graph
- addSource(String, ISource, int) - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
-
Add a source node to the graph
- addSourceInput(ComputeGraph, ExecutionPlan, String, DataObject<Object>) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
-
- addSourceInput(IExecutor, String, DataObject<Object>) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
-
- addSourceTSet(BuildableTSet) - Method in class edu.iu.dsc.tws.tset.TBaseGraph
-
Specific method to add sources
- addState(int) - Method in class edu.iu.dsc.tws.executor.core.batch.InstanceState
-
- addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.allgather.BcastGatherBatchReceiver
-
- addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.allgather.BcastGatheStreamingReceiver
-
- addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastBatchFinalReceiver
-
- addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastStreamingFinalReceiver
-
- addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.direct.DirectBatchFinalReceiver
-
- addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.direct.DirectStreamingFinalReceiver
-
- addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.partition.PartitionPartialReceiver
-
- addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetFinalReceiver
-
- addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetPartialReceiver
-
- addSyncMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetReceiver
-
Add a sync message
- addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.allgather.BcastGatherBatchReceiver
-
- addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.allgather.BcastGatheStreamingReceiver
-
- addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastBatchFinalReceiver
-
- addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastStreamingFinalReceiver
-
- addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.direct.DirectBatchFinalReceiver
-
- addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.direct.DirectStreamingFinalReceiver
-
- addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetFinalReceiver
-
- addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetPartialReceiver
-
- addSyncMessageBarrier(int, int, byte[]) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetReceiver
-
Add a sync message
- addTarGzipToArchive(String) - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
-
given tar.gz file will be copied to this tar.gz file.
- addTask(String, ICompute) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
-
- addTask(String, ICompute, int) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
-
- addTaskEdge(TV, TV) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
-
If the task edge is not null and the task edge is not available in the task edge set,
it will add the task edge to the edge set.
- addTaskEdge(TV, TV, TE) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
-
This method first check whether the task edge is null or not, then it will validate both the
source and target vertex and create the directed dataflow edge between those task vertices.
- addTaskEdge(TV, TV) - Method in interface edu.iu.dsc.tws.api.compute.graph.ITaskGraph
-
This method receives the source and target task vertex and create the task edge between the
source and target task vertex.
- addTaskEdge(TV, TV, TE) - Method in interface edu.iu.dsc.tws.api.compute.graph.ITaskGraph
-
This method returns true if the task edge is created between the source task vertex and target task vertex.
- addTaskVertex(TV) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
-
If the task vertex is not null and the task vertex is not available in the task vertex set,
it will add the task vertex to the vertices set.
- addTaskVertex(String, Vertex) - Method in class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
-
This method is responsible for adding the task vertex to the task map.
- addTaskVertex(TV) - Method in interface edu.iu.dsc.tws.api.compute.graph.ITaskGraph
-
This method returns true if the task vertex is created successfully in the graph.
- addToBuffer(ByteBuffer, byte[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ByteArrayPacker
-
- addToBuffer(ByteBuffer, int, byte[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ByteArrayPacker
-
- addToBuffer(ByteBuffer, Byte) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.BytePacker
-
- addToBuffer(ByteBuffer, int, Byte) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.BytePacker
-
- addToBuffer(ByteBuffer, char[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.CharArrayPacker
-
- addToBuffer(ByteBuffer, int, char[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.CharArrayPacker
-
- addToBuffer(ByteBuffer, Character) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.CharPacker
-
- addToBuffer(ByteBuffer, int, Character) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.CharPacker
-
- addToBuffer(ByteBuffer, double[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.DoubleArrayPacker
-
- addToBuffer(ByteBuffer, int, double[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.DoubleArrayPacker
-
- addToBuffer(ByteBuffer, Double) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.DoublePacker
-
- addToBuffer(ByteBuffer, int, Double) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.DoublePacker
-
- addToBuffer(ByteBuffer, float[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.FloatArrayPacker
-
- addToBuffer(ByteBuffer, int, float[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.FloatArrayPacker
-
- addToBuffer(ByteBuffer, Float) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.FloatPacker
-
- addToBuffer(ByteBuffer, int, Float) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.FloatPacker
-
- addToBuffer(ByteBuffer, int[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.IntegerArrayPacker
-
- addToBuffer(ByteBuffer, int, int[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.IntegerArrayPacker
-
- addToBuffer(ByteBuffer, Integer) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.IntegerPacker
-
- addToBuffer(ByteBuffer, int, Integer) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.IntegerPacker
-
- addToBuffer(ByteBuffer, long[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.LongArrayPacker
-
- addToBuffer(ByteBuffer, int, long[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.LongArrayPacker
-
- addToBuffer(ByteBuffer, Long) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.LongPacker
-
- addToBuffer(ByteBuffer, int, Long) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.LongPacker
-
- addToBuffer(ByteBuffer, A, int) - Method in interface edu.iu.dsc.tws.api.comms.packing.types.primitive.PrimitiveArrayPacker
-
Adds data[index] to the byteBuffer, position will be updated
- addToBuffer(ByteBuffer, int, A, int) - Method in interface edu.iu.dsc.tws.api.comms.packing.types.primitive.PrimitiveArrayPacker
-
Adds data[index] to the byteBuffer, position will not be updated
- addToBuffer(ByteBuffer, T) - Method in interface edu.iu.dsc.tws.api.comms.packing.types.primitive.PrimitivePacker
-
This method should put data to byteBuffer and update the position of buffer
- addToBuffer(ByteBuffer, int, T) - Method in interface edu.iu.dsc.tws.api.comms.packing.types.primitive.PrimitivePacker
-
This method should insert to byteBuffer's index.
- addToBuffer(ByteBuffer, short[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ShortArrayPacker
-
- addToBuffer(ByteBuffer, int, short[], int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ShortArrayPacker
-
- addToBuffer(ByteBuffer, Short) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ShortPacker
-
- addToBuffer(ByteBuffer, int, Short) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ShortPacker
-
- addToDefaults(String, String) - Method in class edu.iu.dsc.tws.deeplearning.common.ParameterTool
-
- addToOverFlowBuffer(DataBuffer) - Method in class edu.iu.dsc.tws.api.comms.messaging.ChannelMessage
-
- addTSet(TBase, TBase) - Method in class edu.iu.dsc.tws.tset.TBaseGraph
-
for intermediate nodes.
- addValue(byte[]) - Method in class edu.iu.dsc.tws.common.table.arrow.BinaryColumn
-
- addValue(Float) - Method in class edu.iu.dsc.tws.common.table.arrow.Float4Column
-
- addValue(Double) - Method in class edu.iu.dsc.tws.common.table.arrow.Float8Column
-
- addValue(Integer) - Method in class edu.iu.dsc.tws.common.table.arrow.Int4Column
-
- addValue(Long) - Method in class edu.iu.dsc.tws.common.table.arrow.Int8Column
-
- addValue(Text) - Method in class edu.iu.dsc.tws.common.table.arrow.StringColumn
-
- addValue(Character) - Method in class edu.iu.dsc.tws.common.table.arrow.UInt2Column
-
- addValue(T) - Method in interface edu.iu.dsc.tws.common.table.ArrowColumn
-
- addWorker(Worker) - Method in class edu.iu.dsc.tws.api.compute.schedule.elements.WorkerPlan
-
- addWorkerFailureListener(IWorkerFailureListener) - Static method in class edu.iu.dsc.tws.master.worker.JMWorkerAgent
-
only one IWorkerFailureListener can be added
if the second IWorkerFailureListener tried to be added, returns false
- addWorkerFailureListener(IWorkerFailureListener) - Method in class edu.iu.dsc.tws.master.worker.JMWorkerStatusUpdater
-
only one IWorkerFailureListener can be added
if the second IWorkerFailureListener tried to be added, returns false
- addWorkerFailureListener(IWorkerFailureListener) - Static method in class edu.iu.dsc.tws.rsched.core.WorkerRuntime
-
add a IWorkerFailureListener
Currently failure notification is only implemented with ZKWorkerController
A listener can be only added when ZKWorkerController is used.
- addWriteRequest(TCPMessage) - Method in class edu.iu.dsc.tws.common.net.tcp.BaseNetworkChannel
-
- addZipToArchive(String) - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
-
given tar.gz file will be copied to this tar.gz file.
- addZipToArchive(String, String) - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
-
given tar.gz file will be copied to this tar.gz file.
- after() - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedMergerTest
-
- after() - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMergerTest
-
- after() - Method in class edu.iu.dsc.tws.comms.shuffle.FSMergerTest
-
- afterClass() - Static method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedMergerTest
-
- afterClass() - Static method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMergerTest
-
- afterClass() - Static method in class edu.iu.dsc.tws.comms.shuffle.FSMergerTest
-
- afterExecution() - Method in interface edu.iu.dsc.tws.api.compute.executor.IExecutionHook
-
Every IExecitor should execute this method after it finishes an execution
- afterExecution() - Method in class edu.iu.dsc.tws.task.impl.ExecutionHookImpl
-
- aggregate(int, boolean, boolean) - Method in class edu.iu.dsc.tws.comms.dfw.io.gather.BaseGatherBatchReceiver
-
- aggregate(int, boolean, boolean) - Method in class edu.iu.dsc.tws.comms.dfw.io.gather.GatherStreamingPartialReceiver
-
- aggregate(int, boolean, boolean) - Method in class edu.iu.dsc.tws.comms.dfw.io.reduce.ReduceBatchReceiver
-
- aggregate(int, boolean, boolean) - Method in class edu.iu.dsc.tws.comms.dfw.io.reduce.ReduceStreamingReceiver
-
- aggregate(int, boolean, boolean) - Method in class edu.iu.dsc.tws.comms.dfw.io.SourceReceiver
-
Aggregate values from sources for a target, assumes every source has a value
- aggregate(int[]) - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowEventTimeExample.DirectAggregateWindowedTask
-
- aggregate(int[]) - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowExample.DirectAggregateWindowedTask
-
- aggregate(T) - Method in class edu.iu.dsc.tws.task.window.collectives.AggregateWindow
-
- aggregate(AggregateFunc<O>) - Method in class edu.iu.dsc.tws.tset.sets.streaming.WindowComputeTSet
-
This method reduces the values inside a window
- AggregatedObjects<T> - Class in edu.iu.dsc.tws.comms.dfw.io
-
- AggregatedObjects(int) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.AggregatedObjects
-
- AggregatedObjects() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.AggregatedObjects
-
- AggregatedObjects(Collection<? extends T>) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.AggregatedObjects
-
- AggregateFunc<T> - Interface in edu.iu.dsc.tws.tset.fn
-
- AggregateFunctionImpl(int, int) - Constructor for class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowEventTimeExample.AggregateFunctionImpl
-
- AggregateFunctionImpl(int, int) - Constructor for class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowExample.AggregateFunctionImpl
-
- aggregateLateMessages(int[]) - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowEventTimeExample.DirectAggregateWindowedTask
-
- aggregateLateMessages(int[]) - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowExample.DirectAggregateWindowedTask
-
- aggregateLateMessages(T) - Method in class edu.iu.dsc.tws.task.window.collectives.AggregateWindow
-
- AggregateWindow<T> - Class in edu.iu.dsc.tws.task.window.collectives
-
- AggregateWindow(AggregateWindowedFunction) - Constructor for class edu.iu.dsc.tws.task.window.collectives.AggregateWindow
-
- AggregateWindowedFunction<T> - Interface in edu.iu.dsc.tws.task.window.function
-
- Aggregator() - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.HelloExample.Aggregator
-
- Aggregator() - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.ParallelDataFlowsExample.Aggregator
-
- Aggregator() - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.TwoDataFlowsExample.Aggregator
-
- Aggregator() - Constructor for class edu.iu.dsc.tws.examples.batch.kmeans.TaskGraphBuildTest.Aggregator
-
- Aggregator() - Constructor for class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowAddNodeExperiment.Aggregator
-
- Aggregator() - Constructor for class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowNodeExperiment.Aggregator
-
- Aggregator() - Constructor for class edu.iu.dsc.tws.examples.internal.taskgraph.MultiComputeTasksGraphExample.Aggregator
-
- Aggregator() - Constructor for class edu.iu.dsc.tws.tsched.utils.TaskSchedulerClassTest.Aggregator
-
- Aggregator1() - Constructor for class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowAddNodeExperiment.Aggregator1
-
- Aggregator1() - Constructor for class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowNodeExperiment.Aggregator1
-
- AggregatorListTest - Class in edu.iu.dsc.tws.comms.dfw.io
-
- AggregatorListTest() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.AggregatorListTest
-
- all() - Method in class edu.iu.dsc.tws.dashboard.controllers.JobController
-
- allArrived() - Method in interface edu.iu.dsc.tws.api.resource.InitBarrierListener
-
invoked when all workers in a job arrived at the barrier
- allArrived(JobMasterAPI.BarrierType) - Method in interface edu.iu.dsc.tws.master.barrier.BarrierResponder
-
this method is invoked when all workers arrived at the barrier
all workers shall be released from the barrier
- allArrived(JobMasterAPI.BarrierType) - Method in class edu.iu.dsc.tws.master.barrier.JMBarrierHandler
-
- allArrived(JobMasterAPI.BarrierType) - Method in class edu.iu.dsc.tws.master.barrier.ZKBarrierHandler
-
publish all arrived event
- allArrived() - Method in class edu.iu.dsc.tws.master.server.JobFailureWatcher
-
this is only called for INIT barrier
- allContainersReady(List<V1ContainerStatus>) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
-
- allDeleted() - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.ClientJobKillHandler
-
check whether Job resources deleted
log deleted resources
return true if all deleted
- ALLGATHER - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
-
- ALLGATHER - Static variable in class edu.iu.dsc.tws.api.compute.OperationNames
-
- allGather() - Method in interface edu.iu.dsc.tws.api.tset.sets.batch.BatchTSet
-
- allGather() - Method in interface edu.iu.dsc.tws.api.tset.sets.streaming.StreamingTSet
-
- allGather() - Method in interface edu.iu.dsc.tws.api.tset.sets.TSet
-
Same as gather, but all the target TSet instances would receive the gathered result in the
runtime.
- AllGather - Class in edu.iu.dsc.tws.comms.dfw
-
- AllGather(Config, TWSChannel, LogicalPlan, Set<Integer>, Set<Integer>, int, BulkReceiver, MessageType, int, int, boolean, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.dfw.AllGather
-
- allGather(Iterator<Tuple<Integer, int[]>>) - Method in class edu.iu.dsc.tws.examples.task.batch.BTAllGatherExample.AllGatherSinkTask
-
- allGather(Iterator<Tuple<Integer, int[]>>) - Method in class edu.iu.dsc.tws.examples.task.streaming.STAllGatherExample.AllGatherSinkTask
-
- allgather(String) - Method in class edu.iu.dsc.tws.task.impl.ComputeConnection
-
Create an allgather config
- allGather(Iterator<Tuple<Integer, T>>) - Method in class edu.iu.dsc.tws.task.typed.AllGatherCompute
-
- allGather() - Method in class edu.iu.dsc.tws.tset.sets.batch.BatchTSetImpl
-
- allGather() - Method in class edu.iu.dsc.tws.tset.sets.batch.StoredTSet
-
- allGather() - Method in class edu.iu.dsc.tws.tset.sets.streaming.StreamingTSetImpl
-
- AllGatherBatchFinalReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.allgather
-
- AllGatherBatchFinalReceiver(TreeBroadcast) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.allgather.AllGatherBatchFinalReceiver
-
- AllGatherBatchOperation - Class in edu.iu.dsc.tws.executor.comms.batch
-
- AllGatherBatchOperation(Config, Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Edge) - Constructor for class edu.iu.dsc.tws.executor.comms.batch.AllGatherBatchOperation
-
- AllGatherCompute<T> - Class in edu.iu.dsc.tws.task.typed
-
- AllGatherCompute() - Constructor for class edu.iu.dsc.tws.task.typed.AllGatherCompute
-
- AllGatherConfig - Class in edu.iu.dsc.tws.task.impl.ops
-
- AllGatherConfig(String, ComputeConnection) - Constructor for class edu.iu.dsc.tws.task.impl.ops.AllGatherConfig
-
- AllGatherExample - Class in edu.iu.dsc.tws.examples.tset.batch
-
- AllGatherExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.AllGatherExample
-
- AllGatherSinkTask() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTAllGatherExample.AllGatherSinkTask
-
- AllGatherSinkTask() - Constructor for class edu.iu.dsc.tws.examples.task.streaming.STAllGatherExample.AllGatherSinkTask
-
- AllGatherStreamingFinalReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.allgather
-
- AllGatherStreamingFinalReceiver(TreeBroadcast) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.allgather.AllGatherStreamingFinalReceiver
-
- AllGatherStreamingOperation - Class in edu.iu.dsc.tws.executor.comms.streaming
-
- AllGatherStreamingOperation(Config, Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Edge) - Constructor for class edu.iu.dsc.tws.executor.comms.streaming.AllGatherStreamingOperation
-
- AllGatherTLink<T> - Class in edu.iu.dsc.tws.tset.links.batch
-
Represent a data set created by an all gather operation
- AllGatherTLink(BatchEnvironment, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.links.batch.AllGatherTLink
-
- allGrouping(String) - Method in interface org.apache.storm.topology.InputDeclarer
-
- allGrouping(String, String) - Method in interface org.apache.storm.topology.InputDeclarer
-
- allGrouping(String) - Method in class org.apache.storm.topology.twister2.Twister2BoltDeclarer
-
- allGrouping(String, String) - Method in class org.apache.storm.topology.twister2.Twister2BoltDeclarer
-
- allJoined() - Method in interface edu.iu.dsc.tws.master.server.IWorkerEventSender
-
all workers joined the job
- allJoined() - Method in class edu.iu.dsc.tws.master.server.JMWorkerHandler
-
- allJoined() - Method in class edu.iu.dsc.tws.master.server.ZKMasterController
-
- allocate(int) - Method in class edu.iu.dsc.tws.comms.table.ArrowAllocator
-
- allocate(int) - Method in interface edu.iu.dsc.tws.comms.table.channel.Allocator
-
- Allocator - Interface in edu.iu.dsc.tws.comms.table.channel
-
- allowedLateness - Variable in class edu.iu.dsc.tws.task.window.core.BaseWindowedSink
-
- allowsSelfLoops() - Method in class edu.iu.dsc.tws.tset.graph.DAGMutableGraph
-
- allowsSelfLoops() - Method in interface edu.iu.dsc.tws.tset.graph.MutableGraph
-
Returns true if this graph allows self-loops (edges that connect a node to itself).
- allQueuesEmpty(Map<Integer, Queue<Object>>) - Method in class edu.iu.dsc.tws.comms.dfw.io.SourceReceiver
-
Check weather there is nothing left in the queues
- ALLREDUCE - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
-
- ALLREDUCE - Static variable in class edu.iu.dsc.tws.api.compute.OperationNames
-
- allReduce(ReduceFunc<T>) - Method in interface edu.iu.dsc.tws.api.tset.sets.batch.BatchTSet
-
- allReduce(ReduceFunc<T>) - Method in interface edu.iu.dsc.tws.api.tset.sets.streaming.StreamingTSet
-
- allReduce(ReduceFunc<T>) - Method in interface edu.iu.dsc.tws.api.tset.sets.TSet
-
Similar to reduce, but all instances of the target
TSet would receive the reduced
result.
- AllReduce - Class in edu.iu.dsc.tws.comms.dfw
-
- AllReduce(Config, TWSChannel, LogicalPlan, Set<Integer>, Set<Integer>, int, ReduceFunction, SingularReceiver, MessageType, int, int, boolean, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.dfw.AllReduce
-
- allReduce(byte[]) - Method in class edu.iu.dsc.tws.examples.batch.terasort.TeraSort.SamplerReduce
-
- allReduce(int[]) - Method in class edu.iu.dsc.tws.examples.task.batch.BTAllReduceExample.AllReduceSinkTask
-
- allReduce(int[]) - Method in class edu.iu.dsc.tws.examples.task.streaming.STAllReduceExample.AllReduceSinkTask
-
- allreduce(String) - Method in class edu.iu.dsc.tws.task.impl.ComputeConnection
-
Create an allreduce config
- allReduce(T) - Method in class edu.iu.dsc.tws.task.typed.AllReduceCompute
-
- allReduce(ReduceFunc<T>) - Method in class edu.iu.dsc.tws.tset.sets.batch.BatchTSetImpl
-
- allReduce(ReduceFunc<T>) - Method in class edu.iu.dsc.tws.tset.sets.batch.StoredTSet
-
- allReduce(ReduceFunc<T>) - Method in class edu.iu.dsc.tws.tset.sets.streaming.StreamingTSetImpl
-
- AllReduceBatchFinalReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.allreduce
-
- AllReduceBatchFinalReceiver(ReduceFunction, TreeBroadcast) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.allreduce.AllReduceBatchFinalReceiver
-
- AllReduceBatchOperation - Class in edu.iu.dsc.tws.executor.comms.batch
-
- AllReduceBatchOperation(Config, Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Edge) - Constructor for class edu.iu.dsc.tws.executor.comms.batch.AllReduceBatchOperation
-
- AllReduceBatchOperation.ReduceFnImpl - Class in edu.iu.dsc.tws.executor.comms.batch
-
- AllReduceCompute<T> - Class in edu.iu.dsc.tws.task.typed
-
- AllReduceCompute() - Constructor for class edu.iu.dsc.tws.task.typed.AllReduceCompute
-
- AllReduceConfig - Class in edu.iu.dsc.tws.task.impl.ops
-
- AllReduceConfig(String, ComputeConnection) - Constructor for class edu.iu.dsc.tws.task.impl.ops.AllReduceConfig
-
- AllReduceExample - Class in edu.iu.dsc.tws.examples.tset.batch
-
- AllReduceExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.AllReduceExample
-
- AllReduceSinkTask() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTAllReduceExample.AllReduceSinkTask
-
- AllReduceSinkTask() - Constructor for class edu.iu.dsc.tws.examples.task.streaming.STAllReduceExample.AllReduceSinkTask
-
- AllReduceStreamingFinalReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.allreduce
-
- AllReduceStreamingFinalReceiver(ReduceFunction, TreeBroadcast) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.allreduce.AllReduceStreamingFinalReceiver
-
- AllReduceStreamingOperation - Class in edu.iu.dsc.tws.executor.comms.streaming
-
- AllReduceStreamingOperation(Config, Communicator, LogicalPlan, IFunction, Set<Integer>, Set<Integer>, Edge) - Constructor for class edu.iu.dsc.tws.executor.comms.streaming.AllReduceStreamingOperation
-
- AllReduceTLink<T> - Class in edu.iu.dsc.tws.tset.links.batch
-
Represent a data set create by a all reduce opration
- AllReduceTLink(BatchEnvironment, ReduceFunc<T>, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.links.batch.AllReduceTLink
-
- AllSharingBatchExecutor - Class in edu.iu.dsc.tws.executor.threading.ft
-
- AllSharingBatchExecutor(Config, int, TWSChannel, ExecutionPlan, IExecutionHook) - Constructor for class edu.iu.dsc.tws.executor.threading.ft.AllSharingBatchExecutor
-
- AllSharingStremingExecutor - Class in edu.iu.dsc.tws.executor.threading.ft
-
- AllSharingStremingExecutor(Config, int, TWSChannel, ExecutionPlan, IExecutionHook) - Constructor for class edu.iu.dsc.tws.executor.threading.ft.AllSharingStremingExecutor
-
- allSyncsPresent(int) - Method in class edu.iu.dsc.tws.comms.dfw.io.SourceReceiver
-
Checks weather all syncs are present
- ALLTOALL_ALGO_KEY - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
-
- ALLTOALL_ALGO_RING - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
-
- ALLTOALL_ALGO_SIMPLE - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
-
- allWorkersJoined(List<JobMasterAPI.WorkerInfo>) - Method in class edu.iu.dsc.tws.api.driver.DefaultDriver
-
- allWorkersJoined(List<JobMasterAPI.WorkerInfo>) - Method in interface edu.iu.dsc.tws.api.driver.IDriver
-
this method is invoked when all workers joined the job initially
and also, after each scale up operation,
- allWorkersJoined(List<JobMasterAPI.WorkerInfo>) - Method in interface edu.iu.dsc.tws.api.resource.IAllJoinedListener
-
this method is invoked when all workers joined the job initially
and also, after each scale up operation, when all new workers joined the job, it is invoked
- allWorkersJoined(List<JobMasterAPI.WorkerInfo>) - Method in class edu.iu.dsc.tws.examples.internal.rsched.DriverExample
-
- allWorkersJoined() - Method in class edu.iu.dsc.tws.master.server.WorkerMonitor
-
if all workers are in one of these states: STARTED, RESTARTED or COMPLETED.
- allWorkersJoined(List<JobMasterAPI.WorkerInfo>) - Method in class edu.iu.dsc.tws.task.cdfw.BaseDriver
-
- allWorkersJoined(List<JobMasterAPI.WorkerInfo>) - Method in class edu.iu.dsc.tws.task.cdfw.CDFWEnv
-
- allWorkersJoined(List<JobMasterAPI.WorkerInfo>) - Method in class edu.iu.dsc.tws.task.impl.cdfw.CDFWRuntime
-
- ALPHA - Static variable in class edu.iu.dsc.tws.data.utils.MLDataObjectConstants.SgdSvmDataObjectConstants
-
- alpha - Variable in class edu.iu.dsc.tws.examples.ml.svm.sgd.SgdSvm
-
- alpha - Variable in class edu.iu.dsc.tws.examples.ml.svm.util.Model
-
Learning rate
- ALPHANUM - Static variable in class edu.iu.dsc.tws.examples.utils.RandomString
-
- api() - Method in class edu.iu.dsc.tws.dashboard.SwaggerConfig
-
- APPEND - Static variable in class edu.iu.dsc.tws.common.logging.Twister2FileLogHandler
-
- append(Path) - Method in class edu.iu.dsc.tws.data.hdfs.HadoopFileSystem
-
- append(int, ByteBuffer, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
-
- append(int, String, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
-
- append(int, ByteBuffer, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
-
- append(int, String, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
-
- append(int, ByteBuffer, ByteBuffer) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
-
Appends the given byte buffer to the current value in the store.
- append(int, String, ByteBuffer) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
-
- append(ByteBuffer, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
-
- append(String, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
-
- appendBulk(int, String, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
-
Buffers the inputs before submitting to the store.
- appendToFile() - Static method in class edu.iu.dsc.tws.common.logging.LoggingContext
-
- apply(T) - Method in interface edu.iu.dsc.tws.api.tset.fn.ApplyFunc
-
- apply(Object) - Method in class edu.iu.dsc.tws.python.tset.fn.ApplyFunctions.ApplyFuncImpl
-
- apply() - Method in class edu.iu.dsc.tws.python.tset.fn.TSetFunctions
-
- apply(<any>) - Method in class org.apache.beam.runners.twister2.examples.WordCount.FormatAsTextFn
-
- ApplyFunc<T> - Interface in edu.iu.dsc.tws.api.tset.fn
-
Applies a function to data
- ApplyFunctions - Class in edu.iu.dsc.tws.python.tset.fn
-
- ApplyFunctions() - Constructor for class edu.iu.dsc.tws.python.tset.fn.ApplyFunctions
-
- ApplyFunctions.ApplyFuncImpl - Class in edu.iu.dsc.tws.python.tset.fn
-
- applyOp(Object, Object, AbstractOp) - Method in class edu.iu.dsc.tws.comms.functions.reduction.ReduceOperationFunction
-
Applying the operation on data
- areReceiversComplete(Lock, MessageReceiver, Lock, MessageReceiver) - Static method in class edu.iu.dsc.tws.comms.utils.OperationUtils
-
Progress the receivers and return true if needs further progress
- ARG_BENCHMARK_METADATA - Static variable in class edu.iu.dsc.tws.examples.utils.bench.BenchmarkMetadata
-
- ARG_INPUT_FILE - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
-
- ARG_KEY_SEED - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
-
- ARG_KEY_SIZE - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
-
- ARG_OUTPUT_FOLDER - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
-
- ARG_RESOURCE_CPU - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
-
- ARG_RESOURCE_INSTANCES - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
-
- ARG_RESOURCE_MEMORY - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
-
- ARG_RESOURCE_MEMORY - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARG_RUN_BENCHMARK - Static variable in class edu.iu.dsc.tws.examples.utils.bench.BenchmarkMetadata
-
- ARG_SIZE - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
-
- ARG_TASKS_SINKS - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
-
- ARG_TASKS_SOURCES - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
-
- ARG_TUNE_MAX_BYTES_IN_MEMORY - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
-
- ARG_TUNE_MAX_SHUFFLE_FILE_SIZE - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
-
- ARG_VALUE_SIZE - Static variable in class edu.iu.dsc.tws.examples.batch.sortop.SortJob
-
- ARGS_BYTE_STORAGE_TYPE - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
-
- ARGS_CINPUT - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
-
- ARGS_CSIZE - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
-
- ARGS_DATA_TYPE - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_DIMENSIONS - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
-
- ARGS_DINPUT - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
-
- ARGS_DSIZE - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
-
- ARGS_FNAME - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_GAP - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_INIT_ITERATIONS - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_INPUT_DIRECTORY - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_ITERATIONS - Static variable in class edu.iu.dsc.tws.data.utils.DataObjectConstants
-
- ARGS_ITERATIONS - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
-
- ARGS_ITR - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_NUMBER_OF_DIMENSIONS - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
-
- ARGS_NUMBER_OF_FILES - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_NUMBER_OF_ROWS - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
-
- ARGS_OPERATION - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_OUTPUT_DIRECTORY - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_OUTPUT_FILE - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
-
- ARGS_OUTSTANDING - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_PARALLEL - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_PARALLELISM_VALUE - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
-
- ARGS_PRINT_INTERVAL - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_SHARED_FILE_SYSTEM - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_SIZE - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_STREAM - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_TASK_STAGES - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_TASKS - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_THREADS - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_VERIFY - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_WARMPU_ITR - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_WINDOW - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- ARGS_WORKERS - Static variable in class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
-
- ARGS_WORKERS - Static variable in class edu.iu.dsc.tws.examples.comms.Constants
-
- array - Variable in class edu.iu.dsc.tws.dataset.BaseArray
-
The array
- arrayFromString(String) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.DataUtils
-
- arrayFromString(String, String) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.DataUtils
-
- arrayFromString(String, String, boolean) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.DataUtils
-
- arrivedAtDefault(int, long) - Method in class edu.iu.dsc.tws.master.barrier.BarrierMonitor
-
a worker arrived at the default barrier
- arrivedAtInit(int, long) - Method in class edu.iu.dsc.tws.master.barrier.BarrierMonitor
-
a worker arrived at the init barrier
- ARROW_DIRECTORY - Static variable in class edu.iu.dsc.tws.data.utils.DataObjectConstants
-
- ARROW_TABLE - Static variable in class edu.iu.dsc.tws.api.comms.messaging.types.MessageTypes
-
- ArrowAllocator - Class in edu.iu.dsc.tws.comms.table
-
- ArrowAllocator(RootAllocator) - Constructor for class edu.iu.dsc.tws.comms.table.ArrowAllocator
-
- ArrowAllToAll - Class in edu.iu.dsc.tws.comms.table
-
This class gets values as normal format and converts them into a row format before invoking the
communication.
- ArrowAllToAll(Config, IWorkerController, Set<Integer>, Set<Integer>, LogicalPlan, int, ArrowCallback, Schema, RootAllocator) - Constructor for class edu.iu.dsc.tws.comms.table.ArrowAllToAll
-
- ArrowBasedSinkFunction<T> - Class in edu.iu.dsc.tws.tset.fn.impl
-
This class is responsible for calling the twister2 arrow file writer class
and add the data to the list in the arrow file writer and commit the data.
- ArrowBasedSinkFunction(String, String, String) - Constructor for class edu.iu.dsc.tws.tset.fn.impl.ArrowBasedSinkFunction
-
- ArrowBasedSourceFunction - Class in edu.iu.dsc.tws.tset.fn.impl
-
- ArrowBasedSourceFunction(String, String, int, String) - Constructor for class edu.iu.dsc.tws.tset.fn.impl.ArrowBasedSourceFunction
-
- ArrowCallback - Interface in edu.iu.dsc.tws.comms.table
-
- ArrowChannelBuffer - Class in edu.iu.dsc.tws.comms.table
-
- ArrowChannelBuffer(ArrowBuf, int) - Constructor for class edu.iu.dsc.tws.comms.table.ArrowChannelBuffer
-
- ArrowColumn<T> - Interface in edu.iu.dsc.tws.common.table
-
We are going to represent and arrow vector as a column to facilitate
easy access and building of vectors, this class is only for internal use
and should not be exposed to the users
- ArrowInputSplit - Class in edu.iu.dsc.tws.data.api.splits
-
- ArrowInputSplit(int, Path, long, long, String[]) - Constructor for class edu.iu.dsc.tws.data.api.splits.ArrowInputSplit
-
- ArrowInputSplit(int, Path, String[]) - Constructor for class edu.iu.dsc.tws.data.api.splits.ArrowInputSplit
-
- ArrowRow - Class in edu.iu.dsc.tws.common.table
-
- ArrowRow(Object[]) - Constructor for class edu.iu.dsc.tws.common.table.ArrowRow
-
- ArrowTable - Class in edu.iu.dsc.tws.common.table.arrow
-
- ArrowTable(int, List<ArrowColumn>) - Constructor for class edu.iu.dsc.tws.common.table.arrow.ArrowTable
-
- ArrowTable(Schema, int, List<ArrowColumn>) - Constructor for class edu.iu.dsc.tws.common.table.arrow.ArrowTable
-
- ArrowTable(Schema, List<FieldVector>) - Constructor for class edu.iu.dsc.tws.common.table.arrow.ArrowTable
-
- ArrowTableBuilder - Class in edu.iu.dsc.tws.common.table
-
- ArrowTableBuilder(Schema, BufferAllocator) - Constructor for class edu.iu.dsc.tws.common.table.ArrowTableBuilder
-
- ArrowTableType - Class in edu.iu.dsc.tws.api.comms.messaging.types
-
- ArrowTableType() - Constructor for class edu.iu.dsc.tws.api.comms.messaging.types.ArrowTableType
-
- ArrowTSetSourceExample - Class in edu.iu.dsc.tws.examples.arrow
-
- ArrowTSetSourceExample() - Constructor for class edu.iu.dsc.tws.examples.arrow.ArrowTSetSourceExample
-
- ArrowTypes - Class in edu.iu.dsc.tws.common.table.arrow
-
- AssignWindowsFunction<T> - Class in org.apache.beam.runners.twister2.translators.functions
-
Assign Windows function.
- AssignWindowsFunction(<any>) - Constructor for class org.apache.beam.runners.twister2.translators.functions.AssignWindowsFunction
-
- AssignWindowTranslatorBatch<T> - Class in org.apache.beam.runners.twister2.translators.batch
-
Assign Window translator.
- AssignWindowTranslatorBatch() - Constructor for class org.apache.beam.runners.twister2.translators.batch.AssignWindowTranslatorBatch
-
- AURORA_CLUSTER_NAME - Static variable in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraContext
-
- AURORA_SCRIPT - Static variable in class edu.iu.dsc.tws.api.config.Context
-
- AURORA_WORKER_CLASS - Static variable in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraContext
-
- auroraClusterName(Config) - Static method in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraContext
-
- AuroraContext - Class in edu.iu.dsc.tws.rsched.schedulers.aurora
-
State parameters for Aurora Client
- AuroraContext() - Constructor for class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraContext
-
- AuroraField - Enum in edu.iu.dsc.tws.rsched.schedulers.aurora
-
Field names passed to aurora controllers during job creation
- AuroraLauncher - Class in edu.iu.dsc.tws.rsched.schedulers.aurora
-
submit a job to Aurora Scheduler using AuroraClientController
- AuroraLauncher() - Constructor for class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraLauncher
-
- auroraScript(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
-
- auroraWorkerClass(Config) - Static method in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraContext
-
- AuroraWorkerStarter - Class in edu.iu.dsc.tws.rsched.schedulers.aurora
-
- available() - Method in class edu.iu.dsc.tws.comms.dfw.io.ByteArrayInputStream
-
- available() - Method in class edu.iu.dsc.tws.data.fs.local.LocalDataInputStream
-
- available() - Method in class edu.iu.dsc.tws.data.hdfs.HadoopDataInputStream
-
- average(double[], int) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.DataUtils
-
- averageDiff(String, String, boolean) - Static method in class edu.iu.dsc.tws.examples.utils.bench.Timing
-
- B2MB - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.TimingConstants
-
- BAllGather - Class in edu.iu.dsc.tws.comms.batch
-
Batch ALLGather Operation
- BAllGather(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, BulkReceiver, MessageType, int, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BAllGather
-
Construct a AllGather operation
- BAllGather(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, BulkReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BAllGather
-
- BAllGather(Communicator, LogicalPlanBuilder, BulkReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BAllGather
-
- BAllGatherExample - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BAllGatherExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BAllGatherExample
-
- BAllGatherExample.FinalSingularReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BAllReduce - Class in edu.iu.dsc.tws.comms.batch
-
Batch ALLReduce Operation
- BAllReduce(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, ReduceFunction, SingularReceiver, MessageType, int, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BAllReduce
-
- BAllReduce(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, ReduceFunction, SingularReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BAllReduce
-
Construct a Batch AllReduce operation
- BAllReduce(Communicator, LogicalPlanBuilder, ReduceFunction, SingularReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BAllReduce
-
- BAllReduceExample - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BAllReduceExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BAllReduceExample
-
- BAllReduceExample.FinalSingularReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
-
- barrierFailed(JobMasterAPI.BarrierType, JobMasterAPI.BarrierResult) - Method in interface edu.iu.dsc.tws.master.barrier.BarrierResponder
-
this method is called when the barrier failed
all waiting workers shall be released with a failure message
- barrierFailed(JobMasterAPI.BarrierType, JobMasterAPI.BarrierResult) - Method in class edu.iu.dsc.tws.master.barrier.JMBarrierHandler
-
- barrierFailed(JobMasterAPI.BarrierType, JobMasterAPI.BarrierResult) - Method in class edu.iu.dsc.tws.master.barrier.ZKBarrierHandler
-
- BarrierMonitor - Class in edu.iu.dsc.tws.master.barrier
-
implements barrier logic
- BarrierMonitor(WorkerMonitor, InitBarrierListener) - Constructor for class edu.iu.dsc.tws.master.barrier.BarrierMonitor
-
- BarrierResponder - Interface in edu.iu.dsc.tws.master.barrier
-
- barriers - Variable in class edu.iu.dsc.tws.comms.dfw.io.SourceReceiver
-
The barriers for each target
- barriers - Variable in class edu.iu.dsc.tws.comms.dfw.io.TargetFinalReceiver
-
The barriers for each target
- barriers - Variable in class edu.iu.dsc.tws.comms.dfw.io.TargetPartialReceiver
-
The barriers for each source
- BaseApplyFunc<T> - Class in edu.iu.dsc.tws.api.tset.fn
-
- BaseApplyFunc() - Constructor for class edu.iu.dsc.tws.api.tset.fn.BaseApplyFunc
-
- BaseArray<T> - Class in edu.iu.dsc.tws.dataset
-
- BaseArray(T, int, int) - Constructor for class edu.iu.dsc.tws.dataset.BaseArray
-
- BaseBasicBolt - Class in org.apache.storm.topology.base
-
- BaseBasicBolt() - Constructor for class org.apache.storm.topology.base.BaseBasicBolt
-
- BaseComponent - Class in org.apache.storm.topology.base
-
- BaseComponent() - Constructor for class org.apache.storm.topology.base.BaseComponent
-
- BaseCompute<T> - Class in edu.iu.dsc.tws.api.compute.nodes
-
- BaseCompute() - Constructor for class edu.iu.dsc.tws.api.compute.nodes.BaseCompute
-
- BaseComputeCollectorFunc<O,I> - Class in edu.iu.dsc.tws.api.tset.fn
-
- BaseComputeCollectorFunc() - Constructor for class edu.iu.dsc.tws.api.tset.fn.BaseComputeCollectorFunc
-
- BaseComputeFunc<O,I> - Class in edu.iu.dsc.tws.api.tset.fn
-
- BaseComputeFunc() - Constructor for class edu.iu.dsc.tws.api.tset.fn.BaseComputeFunc
-
- BaseComputeOp<I> - Class in edu.iu.dsc.tws.tset.ops
-
- BaseComputeOp() - Constructor for class edu.iu.dsc.tws.tset.ops.BaseComputeOp
-
- BaseComputeOp(BaseTSet, Map<String, String>) - Constructor for class edu.iu.dsc.tws.tset.ops.BaseComputeOp
-
- BaseDataflowTaskGraph<TV,TE> - Class in edu.iu.dsc.tws.api.compute.graph
-
It is the base class for the dataflow task graph which implements the IDataflowTaskGraph
interface.
- BaseDataflowTaskGraph() - Constructor for class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
-
- BaseDataflowTaskGraph(Comparator<TV>, Comparator<TE>) - Constructor for class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
-
- BaseDiskPersistIterSink<T,T1> - Class in edu.iu.dsc.tws.tset.sinks
-
Base class for disk based persisted TSet
- BaseDiskPersistIterSink(String) - Constructor for class edu.iu.dsc.tws.tset.sinks.BaseDiskPersistIterSink
-
- BaseDriver - Class in edu.iu.dsc.tws.task.cdfw
-
- BaseDriver() - Constructor for class edu.iu.dsc.tws.task.cdfw.BaseDriver
-
- BaseGatherBatchReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.gather
-
- BaseGatherBatchReceiver() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.gather.BaseGatherBatchReceiver
-
- BaseMapFunc<O,I> - Class in edu.iu.dsc.tws.api.tset.fn
-
- BaseMapFunc() - Constructor for class edu.iu.dsc.tws.api.tset.fn.BaseMapFunc
-
- BaseNetworkChannel - Class in edu.iu.dsc.tws.common.net.tcp
-
Base network channel
- BaseNode - Class in edu.iu.dsc.tws.api.compute.nodes
-
- BaseNode() - Constructor for class edu.iu.dsc.tws.api.compute.nodes.BaseNode
-
- BaseOp - Class in edu.iu.dsc.tws.tset.ops
-
Every tset op is a Receptor.
- BaseOp() - Constructor for class edu.iu.dsc.tws.tset.ops.BaseOp
-
- BaseOp(BaseTSet) - Constructor for class edu.iu.dsc.tws.tset.ops.BaseOp
-
- BaseOp(BaseTSet, Map<String, String>) - Constructor for class edu.iu.dsc.tws.tset.ops.BaseOp
-
- BaseOperation - Class in edu.iu.dsc.tws.api.comms
-
- BaseOperation(Communicator, boolean, String) - Constructor for class edu.iu.dsc.tws.api.comms.BaseOperation
-
Create the base operation
- BaseReduceBatchFinalReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.reduce
-
- BaseReduceBatchFinalReceiver(ReduceFunction) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.reduce.BaseReduceBatchFinalReceiver
-
- BaseRichBolt - Class in org.apache.storm.topology.base
-
- BaseRichBolt() - Constructor for class org.apache.storm.topology.base.BaseRichBolt
-
- BaseRichSpout - Class in org.apache.storm.topology.base
-
- BaseRichSpout() - Constructor for class org.apache.storm.topology.base.BaseRichSpout
-
- BaseSerializer - Class in edu.iu.dsc.tws.comms.dfw.io
-
- BaseSerializer() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.BaseSerializer
-
- BaseSerializeTest - Class in edu.iu.dsc.tws.comms.dfw.io
-
- BaseSerializeTest() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.BaseSerializeTest
-
- BaseSinkFunc<T> - Class in edu.iu.dsc.tws.api.tset.fn
-
- BaseSinkFunc() - Constructor for class edu.iu.dsc.tws.api.tset.fn.BaseSinkFunc
-
- BaseSource - Class in edu.iu.dsc.tws.api.compute.nodes
-
- BaseSource() - Constructor for class edu.iu.dsc.tws.api.compute.nodes.BaseSource
-
- BaseSourceFunc<T> - Class in edu.iu.dsc.tws.api.tset.fn
-
- BaseSourceFunc() - Constructor for class edu.iu.dsc.tws.api.tset.fn.BaseSourceFunc
-
- BaseStatefulWindowedBolt<T extends State> - Class in org.apache.storm.topology.base
-
- BaseStatefulWindowedBolt() - Constructor for class org.apache.storm.topology.base.BaseStatefulWindowedBolt
-
- BaseTFunction<O,I> - Class in edu.iu.dsc.tws.api.tset.fn
-
- BaseTFunction() - Constructor for class edu.iu.dsc.tws.api.tset.fn.BaseTFunction
-
- BaseTLink<T1,T0> - Class in edu.iu.dsc.tws.tset.links
-
Base link impl for all the links
- BaseTLink(TSetEnvironment, String) - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLink
-
- BaseTLink(TSetEnvironment, String, int) - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLink
-
- BaseTLink(TSetEnvironment, String, int, int) - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLink
-
- BaseTLink() - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLink
-
- BaseTLinkWithSchema<T1,T0> - Class in edu.iu.dsc.tws.tset.links
-
- BaseTLinkWithSchema(TSetEnvironment, String, Schema) - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLinkWithSchema
-
- BaseTLinkWithSchema(TSetEnvironment, String, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLinkWithSchema
-
- BaseTLinkWithSchema(TSetEnvironment, String, int, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLinkWithSchema
-
- BaseTLinkWithSchema() - Constructor for class edu.iu.dsc.tws.tset.links.BaseTLinkWithSchema
-
- BaseTSet<T> - Class in edu.iu.dsc.tws.tset.sets
-
- BaseTSet() - Constructor for class edu.iu.dsc.tws.tset.sets.BaseTSet
-
- BaseTSet(TSetEnvironment, String) - Constructor for class edu.iu.dsc.tws.tset.sets.BaseTSet
-
- BaseTSet(TSetEnvironment, String, int) - Constructor for class edu.iu.dsc.tws.tset.sets.BaseTSet
-
- BaseTSet.StateType - Enum in edu.iu.dsc.tws.tset.sets
-
Possible Types of state in a TSet
- BaseTSetBatchWorker - Class in edu.iu.dsc.tws.examples.tset
-
We need to keep variable static as this class is serialized
- BaseTSetBatchWorker() - Constructor for class edu.iu.dsc.tws.examples.tset.BaseTSetBatchWorker
-
- BaseTSetBatchWorker.TestBaseSource - Class in edu.iu.dsc.tws.examples.tset
-
- BaseTSetWithSchema<T> - Class in edu.iu.dsc.tws.tset.sets
-
- BaseTSetWithSchema() - Constructor for class edu.iu.dsc.tws.tset.sets.BaseTSetWithSchema
-
- BaseTSetWithSchema(TSetEnvironment, String, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.BaseTSetWithSchema
-
General constructor for
TSets
- BaseTSetWithSchema(TSetEnvironment, String, int, Schema, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.BaseTSetWithSchema
-
- BaseWindow - Class in edu.iu.dsc.tws.task.window.api
-
- BaseWindow(long, long) - Constructor for class edu.iu.dsc.tws.task.window.api.BaseWindow
-
- BaseWindowCompute<T> - Class in edu.iu.dsc.tws.task.window
-
- BaseWindowCompute() - Constructor for class edu.iu.dsc.tws.task.window.BaseWindowCompute
-
- BaseWindowedBolt - Class in org.apache.storm.topology.base
-
- BaseWindowedBolt() - Constructor for class org.apache.storm.topology.base.BaseWindowedBolt
-
- BaseWindowedBolt.Count - Class in org.apache.storm.topology.base
-
Holds a count value for count based windows and sliding intervals.
- BaseWindowedBolt.Duration - Class in org.apache.storm.topology.base
-
Holds a Time duration for time based windows and sliding intervals.
- BaseWindowedSink<T> - Class in edu.iu.dsc.tws.task.window.core
-
- BaseWindowedSink() - Constructor for class edu.iu.dsc.tws.task.window.core.BaseWindowedSink
-
- BaseWindowSink<T> - Class in edu.iu.dsc.tws.task.window.api
-
- BaseWindowSink() - Constructor for class edu.iu.dsc.tws.task.window.api.BaseWindowSink
-
- BaseWindowSource - Class in edu.iu.dsc.tws.task.window
-
- BaseWindowSource() - Constructor for class edu.iu.dsc.tws.task.window.BaseWindowSource
-
- BaseWindowStrategy<T> - Class in edu.iu.dsc.tws.task.window.strategy
-
- BaseWindowStrategy(IWindow) - Constructor for class edu.iu.dsc.tws.task.window.strategy.BaseWindowStrategy
-
- BasicAuroraContainer - Class in edu.iu.dsc.tws.examples.internal.rsched
-
- BasicAuroraContainer() - Constructor for class edu.iu.dsc.tws.examples.internal.rsched.BasicAuroraContainer
-
- BasicAuroraJob - Class in edu.iu.dsc.tws.examples.internal.rsched
-
- BasicComputation - Class in edu.iu.dsc.tws.graphapi.api
-
- BasicComputation() - Constructor for class edu.iu.dsc.tws.graphapi.api.BasicComputation
-
- BasicComputation.ComputeTask - Class in edu.iu.dsc.tws.graphapi.api
-
- BasicComputation.GraphInitialization - Class in edu.iu.dsc.tws.graphapi.api
-
- BasicComputation.GraphPartiton - Class in edu.iu.dsc.tws.graphapi.api
-
- BasicComputation.ReductionFunction - Class in edu.iu.dsc.tws.graphapi.api
-
- BasicComputation.SourceTask - Class in edu.iu.dsc.tws.graphapi.api
-
- BasicGraphTests - Class in edu.iu.dsc.tws.tset.test.graph
-
- BasicGraphTests() - Constructor for class edu.iu.dsc.tws.tset.test.graph.BasicGraphTests
-
- BasicK8sWorker - Class in edu.iu.dsc.tws.examples.internal.rsched
-
- BasicK8sWorker() - Constructor for class edu.iu.dsc.tws.examples.internal.rsched.BasicK8sWorker
-
- BasicKubernetesJob - Class in edu.iu.dsc.tws.examples.internal.rsched
-
- BasicMesosContainer - Class in edu.iu.dsc.tws.examples.internal.rsched
-
- BasicMesosContainer() - Constructor for class edu.iu.dsc.tws.examples.internal.rsched.BasicMesosContainer
-
- BasicMesosJob - Class in edu.iu.dsc.tws.examples.internal.rsched
-
- BasicMesosWorker - Class in edu.iu.dsc.tws.examples.internal.rsched
-
- BasicMesosWorker() - Constructor for class edu.iu.dsc.tws.examples.internal.rsched.BasicMesosWorker
-
- BasicMpiJob - Class in edu.iu.dsc.tws.examples.internal.rsched
-
- BasicNetworkTest - Class in edu.iu.dsc.tws.examples.internal
-
- BasicNetworkTest() - Constructor for class edu.iu.dsc.tws.examples.internal.BasicNetworkTest
-
- BasicOutputCollector - Class in org.apache.storm.topology
-
- BasicOutputCollector(OutputCollector, String) - Constructor for class org.apache.storm.topology.BasicOutputCollector
-
- BATCH_EXECUTOR - Static variable in class edu.iu.dsc.tws.api.compute.executor.ExecutorContext
-
- BATCH_EXECUTOR_SHARING - Static variable in class edu.iu.dsc.tws.api.compute.executor.ExecutorContext
-
- BATCH_EXECUTOR_SHARING_SEP_COMM - Static variable in class edu.iu.dsc.tws.api.compute.executor.ExecutorContext
-
- BatchChkPntEnvironment - Class in edu.iu.dsc.tws.tset.env
-
- BatchChkPntEnvironment(WorkerEnvironment) - Constructor for class edu.iu.dsc.tws.tset.env.BatchChkPntEnvironment
-
- batchDone - Variable in class edu.iu.dsc.tws.comms.dfw.io.KeyedReceiver
-
Tracks if the partial receiver has completed processing for a given target
- BatchEnvironment - Class in edu.iu.dsc.tws.tset.env
-
- BatchEnvironment(WorkerEnvironment) - Constructor for class edu.iu.dsc.tws.tset.env.BatchEnvironment
-
- BatchEnvironment() - Constructor for class edu.iu.dsc.tws.tset.env.BatchEnvironment
-
- BatchGatherLink<T> - Class in edu.iu.dsc.tws.tset.links.batch
-
This is the Tlinks used by gather operations.
- BatchGatherLink() - Constructor for class edu.iu.dsc.tws.tset.links.batch.BatchGatherLink
-
- BatchIteratorLink<T> - Class in edu.iu.dsc.tws.tset.links.batch
-
- BatchIteratorLink() - Constructor for class edu.iu.dsc.tws.tset.links.batch.BatchIteratorLink
-
- BatchIteratorLinkWrapper<T> - Class in edu.iu.dsc.tws.tset.links.batch
-
- BatchIteratorLinkWrapper() - Constructor for class edu.iu.dsc.tws.tset.links.batch.BatchIteratorLinkWrapper
-
- BatchRowTLink - Interface in edu.iu.dsc.tws.api.tset.link.batch
-
Table based communication links.
- BatchRowTSet - Interface in edu.iu.dsc.tws.api.tset.sets.batch
-
- BatchRowTSetImpl - Class in edu.iu.dsc.tws.tset.sets.batch.row
-
- BatchRowTSetImpl(BatchEnvironment, String, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.batch.row.BatchRowTSetImpl
-
- BatchRowTSetImpl() - Constructor for class edu.iu.dsc.tws.tset.sets.batch.row.BatchRowTSetImpl
-
- BatchSharingExecutor - Class in edu.iu.dsc.tws.executor.threading
-
- BatchSharingExecutor(Config, int, TWSChannel, ExecutionPlan, IExecutionHook) - Constructor for class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor
-
- BatchSharingExecutor.BatchWorker - Class in edu.iu.dsc.tws.executor.threading
-
- BatchSharingExecutor.CommunicationWorker - Class in edu.iu.dsc.tws.executor.threading
-
- BatchSharingExecutor2 - Class in edu.iu.dsc.tws.executor.threading
-
- BatchSharingExecutor2(Config, int, TWSChannel, ExecutionPlan, IExecutionHook) - Constructor for class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor2
-
- BatchSharingExecutor2.BatchWorker - Class in edu.iu.dsc.tws.executor.threading
-
- BatchSharingExecutor2.CommunicationWorker - Class in edu.iu.dsc.tws.executor.threading
-
- BatchSingleLink<T> - Class in edu.iu.dsc.tws.tset.links.batch
-
- BatchTaskScheduler - Class in edu.iu.dsc.tws.tsched.batch.batchscheduler
-
This scheduler is capable of handling of single task graph as well as multiple task graphs.
- BatchTaskScheduler() - Constructor for class edu.iu.dsc.tws.tsched.batch.batchscheduler.BatchTaskScheduler
-
- BatchTaskSchedulerExample - Class in edu.iu.dsc.tws.examples.internal.batchscheduler
-
- BatchTaskSchedulerExample() - Constructor for class edu.iu.dsc.tws.examples.internal.batchscheduler.BatchTaskSchedulerExample
-
- BatchTaskSchedulerTest - Class in edu.iu.dsc.tws.tsched.batch.batchscheduler
-
- BatchTaskSchedulerTest() - Constructor for class edu.iu.dsc.tws.tsched.batch.batchscheduler.BatchTaskSchedulerTest
-
- batchTaskSchedulingClass(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
-
- batchTaskSchedulingMode(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
-
- BatchTLink<T1,T0> - Interface in edu.iu.dsc.tws.api.tset.link.batch
-
- BatchTLinkImpl<T1,T0> - Class in edu.iu.dsc.tws.tset.links.batch
-
- BatchTLinkImpl() - Constructor for class edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl
-
- batchTraining() - Method in class edu.iu.dsc.tws.examples.ml.svm.compute.IterativeSVMCompute
-
This method is used to do batch mode training *
- batchTraining() - Method in class edu.iu.dsc.tws.examples.ml.svm.compute.SVMCompute
-
This method is used to do batch mode training *
- BatchTransformTranslator<TransformT extends PTransform> - Interface in org.apache.beam.runners.twister2.translators
-
doc.
- BatchTSet<T> - Interface in edu.iu.dsc.tws.api.tset.sets.batch
-
Batch extension of
TSet interface.
- BatchTSetBaseDriver - Class in edu.iu.dsc.tws.tset.cdfw
-
The base driver class for TSet API when using connected dataflow
- BatchTSetBaseDriver() - Constructor for class edu.iu.dsc.tws.tset.cdfw.BatchTSetBaseDriver
-
- BatchTSetCDFWEnvironment - Class in edu.iu.dsc.tws.tset.cdfw
-
- BatchTSetCDFWEnvironment(CDFWEnv) - Constructor for class edu.iu.dsc.tws.tset.cdfw.BatchTSetCDFWEnvironment
-
- BatchTsetExample - Class in edu.iu.dsc.tws.examples.tset.batch
-
- BatchTsetExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.BatchTsetExample
-
- BatchTSetImpl<T> - Class in edu.iu.dsc.tws.tset.sets.batch
-
- BatchTSetImpl() - Constructor for class edu.iu.dsc.tws.tset.sets.batch.BatchTSetImpl
-
- BatchTupleTSet<K,V> - Interface in edu.iu.dsc.tws.api.tset.sets.batch
-
- BatchTupleTSetImpl<K,V> - Class in edu.iu.dsc.tws.tset.sets.batch
-
Attaches a key to the oncoming data.
- BatchTupleTSetImpl() - Constructor for class edu.iu.dsc.tws.tset.sets.batch.BatchTupleTSetImpl
-
- BatchWordSource - Class in edu.iu.dsc.tws.examples.batch.wordcount.comms
-
- BatchWordSource(BKeyedReduce, int, int, int) - Constructor for class edu.iu.dsc.tws.examples.batch.wordcount.comms.BatchWordSource
-
- BatchWorker(List<INodeInstance>, AtomicBoolean[]) - Constructor for class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor.BatchWorker
-
- BatchWorker(INodeInstance) - Constructor for class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor.BatchWorker
-
- BatchWorker(List<INodeInstance>, AtomicBoolean[]) - Constructor for class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor2.BatchWorker
-
- BBroadcast - Class in edu.iu.dsc.tws.comms.batch
-
- BBroadcast(Communicator, LogicalPlan, int, Set<Integer>, BulkReceiver, MessageType, int, MessageSchema, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BBroadcast
-
Construct a Streaming Reduce operation
- BBroadcast(Communicator, LogicalPlan, int, Set<Integer>, BulkReceiver, MessageType, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BBroadcast
-
- BBroadcast(Communicator, LogicalPlan, int, Set<Integer>, BulkReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BBroadcast
-
Construct a Streaming Reduce operation
- BBroadcast(Communicator, LogicalPlanBuilder, BulkReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BBroadcast
-
- BBroadcast(Communicator, LogicalPlanBuilder, BulkReceiver, MessageType, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BBroadcast
-
- BBroadcast(Communicator, LogicalPlan, int, Set<Integer>, BulkReceiver, MessageType, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BBroadcast
-
- BBroadCastCompute<T> - Class in edu.iu.dsc.tws.task.typed.batch
-
- BBroadCastCompute() - Constructor for class edu.iu.dsc.tws.task.typed.batch.BBroadCastCompute
-
- BBroadcastExample - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BBroadcastExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BBroadcastExample
-
- BBroadcastExample.BCastReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
-
- bcast(int, Object, int) - Method in class edu.iu.dsc.tws.comms.batch.BBroadcast
-
Send a message to be reduced
- bcast(int, Object, int) - Method in class edu.iu.dsc.tws.comms.stream.SBroadCast
-
Send a message to be reduced
- BcastBatchFinalReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.bcast
-
- BcastBatchFinalReceiver(SingularReceiver) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastBatchFinalReceiver
-
- BcastGatherBatchReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.allgather
-
- BcastGatherBatchReceiver(BulkReceiver) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.allgather.BcastGatherBatchReceiver
-
- BcastGatheStreamingReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.allgather
-
- BcastGatheStreamingReceiver(BulkReceiver) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.allgather.BcastGatheStreamingReceiver
-
- BCastReceiver() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BBroadcastExample.BCastReceiver
-
- BCastReceiver() - Constructor for class edu.iu.dsc.tws.examples.comms.stream.SBroadcastExample.BCastReceiver
-
- BcastReceiver() - Constructor for class edu.iu.dsc.tws.executor.comms.batch.BroadcastBatchOperation.BcastReceiver
-
- BcastReceiver() - Constructor for class edu.iu.dsc.tws.executor.comms.streaming.BroadcastStreamingOperation.BcastReceiver
-
- BcastStreamingFinalReceiver - Class in edu.iu.dsc.tws.comms.dfw.io.bcast
-
- BcastStreamingFinalReceiver(SingularReceiver) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.bcast.BcastStreamingFinalReceiver
-
- BDirect - Class in edu.iu.dsc.tws.comms.batch
-
- BDirect(Communicator, LogicalPlan, List<Integer>, List<Integer>, BulkReceiver, MessageType, int, MessageSchema, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BDirect
-
- BDirect(Communicator, LogicalPlan, List<Integer>, List<Integer>, BulkReceiver, MessageType, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BDirect
-
- BDirect(Communicator, LogicalPlan, List<Integer>, List<Integer>, BulkReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BDirect
-
Construct a Batch AllReduce operation
- BDirect(Communicator, LogicalPlanBuilder, BulkReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BDirect
-
- BDirect(Communicator, LogicalPlanBuilder, BulkReceiver, MessageType, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BDirect
-
- BDirect(Communicator, LogicalPlan, List<Integer>, List<Integer>, BulkReceiver, MessageType, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BDirect
-
- BDirectExample - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BDirectExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BDirectExample
-
- BDirectExample.DirectReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BDJoinExample - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BDJoinExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BDJoinExample
-
- BDJoinExample.JoinReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BDKeyedGatherExample - Class in edu.iu.dsc.tws.examples.comms.batch
-
todo fix verification
- BDKeyedGatherExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BDKeyedGatherExample
-
- BDKeyedGatherExample.FinalReduceReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BeamBatchTSetEnvironment - Class in org.apache.beam.runners.twister2
-
This is a shell tset environment which is used on as a central driver model to fit what beam
expects.
- BeamBatchTSetEnvironment() - Constructor for class org.apache.beam.runners.twister2.BeamBatchTSetEnvironment
-
- BeamBatchWorker - Class in org.apache.beam.runners.twister2
-
- BeamBatchWorker() - Constructor for class org.apache.beam.runners.twister2.BeamBatchWorker
-
- before() - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedMergerTest
-
- before() - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMergerTest
-
- before() - Method in class edu.iu.dsc.tws.comms.shuffle.FSMergerTest
-
- beforeClass() - Static method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedMergerTest
-
- beforeClass() - Static method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMergerTest
-
- beforeClass() - Static method in class edu.iu.dsc.tws.comms.shuffle.FSMergerTest
-
- beforeExecution() - Method in interface edu.iu.dsc.tws.api.compute.executor.IExecutionHook
-
Every IExecutor should execute this method before it begins an execution
- beforeExecution() - Method in class edu.iu.dsc.tws.task.impl.ExecutionHookImpl
-
- BenchmarkArg - Class in edu.iu.dsc.tws.examples.utils.bench
-
- BenchmarkArg() - Constructor for class edu.iu.dsc.tws.examples.utils.bench.BenchmarkArg
-
- BenchmarkConstants - Class in edu.iu.dsc.tws.examples.utils.bench
-
- BenchmarkMetadata - Class in edu.iu.dsc.tws.examples.utils.bench
-
- BenchmarkMetadata() - Constructor for class edu.iu.dsc.tws.examples.utils.bench.BenchmarkMetadata
-
- BenchmarkResultsRecorder - Class in edu.iu.dsc.tws.examples.utils.bench
-
- BenchmarkResultsRecorder(Config, boolean) - Constructor for class edu.iu.dsc.tws.examples.utils.bench.BenchmarkResultsRecorder
-
- BenchmarkUtils - Class in edu.iu.dsc.tws.examples.utils.bench
-
- BenchTaskWorker - Class in edu.iu.dsc.tws.examples.task
-
- BenchTaskWorker() - Constructor for class edu.iu.dsc.tws.examples.task.BenchTaskWorker
-
- BenchTaskWorker.SourceTask - Class in edu.iu.dsc.tws.examples.task
-
- BenchTaskWorker.SourceWindowTask - Class in edu.iu.dsc.tws.examples.task
-
- BenchTaskWorker.SourceWindowTimeStampTask - Class in edu.iu.dsc.tws.examples.task
-
- BenchWindowTaskWorker - Class in edu.iu.dsc.tws.examples.task
-
- BenchWindowTaskWorker() - Constructor for class edu.iu.dsc.tws.examples.task.BenchWindowTaskWorker
-
- BenchWindowTaskWorker.SourceWindowTask - Class in edu.iu.dsc.tws.examples.task
-
- BenchWorker - Class in edu.iu.dsc.tws.examples.comms
-
- BenchWorker() - Constructor for class edu.iu.dsc.tws.examples.comms.BenchWorker
-
- BenchWorker.MapWorker - Class in edu.iu.dsc.tws.examples.comms
-
- BGather - Class in edu.iu.dsc.tws.comms.batch
-
Batch Gather Operation
- BGather(Communicator, LogicalPlan, Set<Integer>, int, MessageType, BulkReceiver, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BGather
-
Construct a Streaming Gather operation
- BGather(Communicator, LogicalPlanBuilder, MessageType, BulkReceiver, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BGather
-
- BGather(Communicator, LogicalPlan, Set<Integer>, int, MessageType, BulkReceiver, boolean, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BGather
-
- BGather(Communicator, LogicalPlan, Set<Integer>, int, MessageType, BulkReceiver, boolean, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BGather
-
- BGatherExample - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BGatherExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BGatherExample
-
- BGatherExample.FinalReduceReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BINARY_FILED_TYPE - Static variable in class edu.iu.dsc.tws.common.table.arrow.ArrowTypes
-
- BinaryBatchModel - Class in edu.iu.dsc.tws.examples.ml.svm.util
-
This class is an extended Model which is specialized to hold the parameters
involved in the Binary Batch based training
- BinaryBatchModel() - Constructor for class edu.iu.dsc.tws.examples.ml.svm.util.BinaryBatchModel
-
- BinaryBatchModel(int, int, double[], double[]) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.util.BinaryBatchModel
-
- BinaryBatchModel(int, int, double[], double[], double[][]) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.util.BinaryBatchModel
-
- BinaryBatchModel(int, int, double[], double[], double, double[][]) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.util.BinaryBatchModel
-
- BinaryBatchModel(int, int, double[], double[], double, double[][], int) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.util.BinaryBatchModel
-
- BinaryColumn - Class in edu.iu.dsc.tws.common.table.arrow
-
- BinaryColumn(VarBinaryVector) - Constructor for class edu.iu.dsc.tws.common.table.arrow.BinaryColumn
-
- BinaryInputPartitioner - Class in edu.iu.dsc.tws.data.api.formatters
-
Input formatter class that reads binary files
- BinaryInputPartitioner(Path, int) - Constructor for class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner
-
- BinaryInputPartitioner(Path, int, Config) - Constructor for class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner
-
- BinaryInputPartitioner(Path, int, int) - Constructor for class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner
-
- BinaryInputPartitioner(Path, int, int, Config) - Constructor for class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner
-
- BinaryInputSplit - Class in edu.iu.dsc.tws.data.api.splits
-
- BinaryInputSplit(int, Path, long, long, String[]) - Constructor for class edu.iu.dsc.tws.data.api.splits.BinaryInputSplit
-
Constructs a split with host information.
- BinaryInputSplit(int, Path, int, String[]) - Constructor for class edu.iu.dsc.tws.data.api.splits.BinaryInputSplit
-
- BinaryTree - Class in edu.iu.dsc.tws.comms.routing
-
- BinaryTree(int, int, LogicalPlan, int, Set<Integer>) - Constructor for class edu.iu.dsc.tws.comms.routing.BinaryTree
-
- BinaryTreeRouter - Class in edu.iu.dsc.tws.comms.routing
-
- BinaryTreeRouter(Config, LogicalPlan, int, Set<Integer>) - Constructor for class edu.iu.dsc.tws.comms.routing.BinaryTreeRouter
-
Initialize the data structure
- BinaryTreeTest - Class in edu.iu.dsc.tws.comms.routing
-
- BinaryTreeTest() - Constructor for class edu.iu.dsc.tws.comms.routing.BinaryTreeTest
-
- bindWorkerToCPU(Config) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesContext
-
- BJoin - Class in edu.iu.dsc.tws.comms.batch
-
Batch Join operation
- BJoin(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Set<Integer>, MessageType, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, int, int, CommunicationContext.JoinType, CommunicationContext.JoinAlgorithm, MessageSchema, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BJoin
-
Construct a Batch partition operation
- BJoin(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Set<Integer>, MessageType, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, CommunicationContext.JoinType, CommunicationContext.JoinAlgorithm, MessageSchema, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BJoin
-
- BJoin(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Set<Integer>, MessageType, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, CommunicationContext.JoinType, CommunicationContext.JoinAlgorithm) - Constructor for class edu.iu.dsc.tws.comms.batch.BJoin
-
- BJoin(Communicator, LogicalPlanBuilder, MessageType, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, CommunicationContext.JoinType, CommunicationContext.JoinAlgorithm) - Constructor for class edu.iu.dsc.tws.comms.batch.BJoin
-
- BJoin(Communicator, LogicalPlanBuilder, Set<Integer>, Set<Integer>, MessageType, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, CommunicationContext.JoinType, CommunicationContext.JoinAlgorithm) - Constructor for class edu.iu.dsc.tws.comms.batch.BJoin
-
- BJoinCompute<K,L,R> - Class in edu.iu.dsc.tws.task.typed.batch
-
- BJoinCompute() - Constructor for class edu.iu.dsc.tws.task.typed.batch.BJoinCompute
-
- BJoinExample - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BJoinExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BJoinExample
-
- BJoinExample.JoinReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BJoinStudentExample - Class in edu.iu.dsc.tws.examples.comms.batch
-
This example join performs a join between two tables, 1 : | Student ID | Name | and 2 :
| Student ID | Course ID |.
- BJoinStudentExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BJoinStudentExample
-
- BJoinStudentExample.JoinReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
-
The final result receiver class, it will get an iterator object which contains the
key and value pairs of each result from the join operation
- BJoinStudentExample.MapWorker - Class in edu.iu.dsc.tws.examples.comms.batch
-
This class is responsible of generating and sending the message to the join operation,
This is essentially the source task for this join example.
- BKeyedGather - Class in edu.iu.dsc.tws.comms.batch
-
- BKeyedGather(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
-
Creates an instance of BKeyedGather without shuffling
- BKeyedGather(Communicator, LogicalPlanBuilder, MessageType, MessageType, BulkReceiver, DestinationSelector) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
-
- BKeyedGather(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
-
- BKeyedGather(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, boolean, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
-
- BKeyedGather(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
-
- BKeyedGather(Communicator, LogicalPlanBuilder, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
-
- BKeyedGather(Communicator, LogicalPlanBuilder, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, boolean, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
-
- BKeyedGather(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector, boolean, Comparator<Object>, boolean, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedGather
-
Creates an instance of BKeyedGather with key comparator
- BKeyedGatherExample - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BKeyedGatherExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BKeyedGatherExample
-
- BKeyedGatherExample.FinalReduceReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BKeyedGatherGroupedCompute<K,T> - Class in edu.iu.dsc.tws.task.typed.batch
-
- BKeyedGatherGroupedCompute() - Constructor for class edu.iu.dsc.tws.task.typed.batch.BKeyedGatherGroupedCompute
-
- BKeyedGatherUnGroupedCompute<K,T> - Class in edu.iu.dsc.tws.task.typed.batch
-
- BKeyedGatherUnGroupedCompute() - Constructor for class edu.iu.dsc.tws.task.typed.batch.BKeyedGatherUnGroupedCompute
-
- BKeyedPartition - Class in edu.iu.dsc.tws.comms.batch
-
- BKeyedPartition(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedPartition
-
- BKeyedPartition(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedPartition
-
- BKeyedPartition(Communicator, LogicalPlanBuilder, MessageType, MessageType, BulkReceiver, DestinationSelector) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedPartition
-
- BKeyedPartition(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, MessageType, BulkReceiver, DestinationSelector, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedPartition
-
- BKeyedPartitionCompute<K,T> - Class in edu.iu.dsc.tws.task.typed.batch
-
- BKeyedPartitionCompute() - Constructor for class edu.iu.dsc.tws.task.typed.batch.BKeyedPartitionCompute
-
- BKeyedPartitionExample - Class in edu.iu.dsc.tws.examples.comms.batch
-
This class is a example use of the keyed partition function
- BKeyedPartitionExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BKeyedPartitionExample
-
- BKeyedPartitionExample.PartitionReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BKeyedPartitionSinkTask() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTPartitionKeyedExample.BKeyedPartitionSinkTask
-
- BKeyedReduce - Class in edu.iu.dsc.tws.comms.batch
-
Example class for Batch keyed reduce.
- BKeyedReduce(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, ReduceFunction, BulkReceiver, MessageType, MessageType, DestinationSelector, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedReduce
-
- BKeyedReduce(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, ReduceFunction, BulkReceiver, MessageType, MessageType, DestinationSelector) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedReduce
-
- BKeyedReduce(Communicator, LogicalPlanBuilder, ReduceFunction, BulkReceiver, MessageType, MessageType, DestinationSelector) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedReduce
-
- BKeyedReduce(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, ReduceFunction, BulkReceiver, MessageType, MessageType, DestinationSelector, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BKeyedReduce
-
- BKeyedReduceCompute<K,T> - Class in edu.iu.dsc.tws.task.typed.batch
-
- BKeyedReduceCompute() - Constructor for class edu.iu.dsc.tws.task.typed.batch.BKeyedReduceCompute
-
- BKeyedReduceExample - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BKeyedReduceExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BKeyedReduceExample
-
- BKeyedReduceExample.FinalBulkReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BlockingSendException - Exception in edu.iu.dsc.tws.api.exceptions.net
-
- BlockingSendException(BlockingSendFailureReason, String, Throwable) - Constructor for exception edu.iu.dsc.tws.api.exceptions.net.BlockingSendException
-
- BlockingSendFailureReason - Enum in edu.iu.dsc.tws.api.exceptions.net
-
Failure reasons for blocking send operations
- BlockLocation - Interface in edu.iu.dsc.tws.api.data
-
A BlockLocation lists hosts, offset and length of block.
- Bolt - Class in org.apache.storm.generated
-
- Bolt() - Constructor for class org.apache.storm.generated.Bolt
-
- BoltDeclarer - Interface in org.apache.storm.topology
-
- boltExecute(List<Tuple>, List<Tuple>, List<Tuple>, Long) - Method in class org.apache.storm.topology.WindowedBoltExecutor
-
- boltExecute(Supplier<Iterator<Tuple>>, Supplier<Iterator<Tuple>>, Supplier<Iterator<Tuple>>, Long) - Method in class org.apache.storm.topology.WindowedBoltExecutor
-
- BootstrapPoint - Class in edu.iu.dsc.tws.python
-
- BootstrapPoint() - Constructor for class edu.iu.dsc.tws.python.BootstrapPoint
-
- BPartition - Class in edu.iu.dsc.tws.comms.batch
-
Streaming Partition Operation
- BPartition(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, BulkReceiver, DestinationSelector, boolean, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BPartition
-
Construct a Batch partition operation
- BPartition(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, BulkReceiver, DestinationSelector, boolean, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BPartition
-
- BPartition(Communicator, LogicalPlan, Set<Integer>, Set<Integer>, MessageType, BulkReceiver, DestinationSelector, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BPartition
-
- BPartition(Communicator, LogicalPlanBuilder, MessageType, BulkReceiver, DestinationSelector, boolean) - Constructor for class edu.iu.dsc.tws.comms.batch.BPartition
-
- BPartitionCompute<T> - Class in edu.iu.dsc.tws.task.typed.batch
-
- BPartitionCompute() - Constructor for class edu.iu.dsc.tws.task.typed.batch.BPartitionCompute
-
- BPartitionExample - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BPartitionExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BPartitionExample
-
- BPartitionExample.PartitionReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BranchingExample - Class in edu.iu.dsc.tws.examples.tset.batch
-
- BranchingExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.BranchingExample
-
- BReduce - Class in edu.iu.dsc.tws.comms.batch
-
Batch Reduce Operation
- BReduce(Communicator, LogicalPlan, Set<Integer>, int, ReduceFunction, SingularReceiver, MessageType, int, MessageSchema) - Constructor for class edu.iu.dsc.tws.comms.batch.BReduce
-
Construct a Streaming Reduce operation
- BReduce(Communicator, LogicalPlan, Set<Integer>, int, ReduceFunction, SingularReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BReduce
-
- BReduce(Communicator, LogicalPlanBuilder, ReduceFunction, SingularReceiver, MessageType) - Constructor for class edu.iu.dsc.tws.comms.batch.BReduce
-
- BReduceExample - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BReduceExample() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BReduceExample
-
- BReduceExample.FinalSingularReceiver - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BROADCAST - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
-
- BROADCAST - Static variable in class edu.iu.dsc.tws.api.compute.OperationNames
-
- broadcast(Iterator<int[]>) - Method in class edu.iu.dsc.tws.examples.task.batch.BTBroadCastExample.BroadcastSinkTask
-
- broadcast(int[]) - Method in class edu.iu.dsc.tws.examples.task.streaming.STBroadCastExample.BroadCastSinkTask
-
- broadcast(String) - Method in class edu.iu.dsc.tws.task.impl.ComputeConnection
-
Create a broadcast configuration
- broadcast(Iterator<T>) - Method in class edu.iu.dsc.tws.task.typed.batch.BBroadCastCompute
-
- broadcast(T) - Method in class edu.iu.dsc.tws.task.typed.streaming.SBroadCastCompute
-
- BroadcastBatchOperation - Class in edu.iu.dsc.tws.executor.comms.batch
-
- BroadcastBatchOperation(Config, Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Edge) - Constructor for class edu.iu.dsc.tws.executor.comms.batch.BroadcastBatchOperation
-
- BroadcastBatchOperation.BcastReceiver - Class in edu.iu.dsc.tws.executor.comms.batch
-
- BroadcastConfig - Class in edu.iu.dsc.tws.task.impl.ops
-
- BroadcastConfig(String, ComputeConnection) - Constructor for class edu.iu.dsc.tws.task.impl.ops.BroadcastConfig
-
- BroadcastExample - Class in edu.iu.dsc.tws.examples.tset.batch
-
- BroadcastExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.BroadcastExample
-
- broadcastMessage(Message) - Method in class edu.iu.dsc.tws.master.server.WorkerMonitor
-
- BroadcastSinkTask() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTBroadCastExample.BroadcastSinkTask
-
- BroadCastSinkTask() - Constructor for class edu.iu.dsc.tws.examples.task.streaming.STBroadCastExample.BroadCastSinkTask
-
- BroadcastStreamingOperation - Class in edu.iu.dsc.tws.executor.comms.streaming
-
- BroadcastStreamingOperation(Config, Communicator, LogicalPlan, Set<Integer>, Set<Integer>, Edge) - Constructor for class edu.iu.dsc.tws.executor.comms.streaming.BroadcastStreamingOperation
-
- BroadcastStreamingOperation.BcastReceiver - Class in edu.iu.dsc.tws.executor.comms.streaming
-
- broadcastToAllWorkers(Message) - Method in interface edu.iu.dsc.tws.api.driver.IDriverMessenger
-
send a protocol buffer message to all workers in the job
- broadcastToAllWorkers(Message) - Method in class edu.iu.dsc.tws.master.driver.DriverMessenger
-
send this message to all workers in the job
- BTAllGatherExample - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTAllGatherExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTAllGatherExample
-
- BTAllGatherExample.AllGatherSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTAllReduceExample - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTAllReduceExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTAllReduceExample
-
- BTAllReduceExample.AllReduceSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTAllToAll - Class in edu.iu.dsc.tws.examples.comms.batch
-
- BTAllToAll() - Constructor for class edu.iu.dsc.tws.examples.comms.batch.BTAllToAll
-
- BTBroadCastExample - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTBroadCastExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTBroadCastExample
-
- BTBroadCastExample.BroadcastSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTDirectExample - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTDirectExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTDirectExample
-
- BTDirectExample.PartitionSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTGatherExample - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTGatherExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTGatherExample
-
- BTGatherExample.GatherSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTJoinExample - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTJoinExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTJoinExample
-
- BTJoinExample.JoinSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTJoinExample.JoinSource - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTKeyedGatherExample - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTKeyedGatherExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTKeyedGatherExample
-
- BTKeyedGatherExample.KeyedGatherGroupedSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTKeyedReduceExample - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTKeyedReduceExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTKeyedReduceExample
-
- BTKeyedReduceExample.KeyedReduceSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTPartition - Class in edu.iu.dsc.tws.comms.table.ops
-
- BTPartition(Communicator, IWorkerController, Set<Integer>, Set<Integer>, LogicalPlan, DestinationSelector, List<Integer>, Schema, BulkReceiver, RootAllocator, String) - Constructor for class edu.iu.dsc.tws.comms.table.ops.BTPartition
-
- BTPartitionExample - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTPartitionExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTPartitionExample
-
- BTPartitionExample.PartitionSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTPartitionKeyedExample - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTPartitionKeyedExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTPartitionKeyedExample
-
- BTPartitionKeyedExample.BKeyedPartitionSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTReduceExample - Class in edu.iu.dsc.tws.examples.task.batch
-
- BTReduceExample() - Constructor for class edu.iu.dsc.tws.examples.task.batch.BTReduceExample
-
- BTReduceExample.ReduceSinkTask - Class in edu.iu.dsc.tws.examples.task.batch
-
- buf - Variable in class edu.iu.dsc.tws.comms.dfw.io.ByteArrayOutputStream
-
The buffer where data is stored.
- buffer - Variable in class edu.iu.dsc.tws.comms.table.channel.TRequest
-
- BUFFER_SIZE - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
-
- BufferedCollectionPartition<T> - Class in edu.iu.dsc.tws.dataset.partition
-
- BufferedCollectionPartition(long, MessageType, long, Config, String) - Constructor for class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
-
- BufferedCollectionPartition(long, Config) - Constructor for class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
-
- BufferedCollectionPartition(long, Config, String) - Constructor for class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
-
- BufferedCollectionPartition(long, MessageType, Config) - Constructor for class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
-
Creates an instance with default bugger size 10MB
- BufferedCollectionPartition(MessageType, long, Config) - Constructor for class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
-
Creates an 100% disk based instance.
- BufferedCollectionPartition(MessageType, long, Config, String) - Constructor for class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
-
Loads an disk based partition from file system.
- BufferedMemoryManager - Class in edu.iu.dsc.tws.data.memory
-
Inserts into the memory store in batches.
- BufferedMemoryManager(Path) - Constructor for class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
-
- BufferReceiveCallback - Interface in edu.iu.dsc.tws.comms.table
-
- bufferSize(Config) - Static method in class edu.iu.dsc.tws.api.comms.CommunicationContext
-
- bufs - Variable in class edu.iu.dsc.tws.comms.dfw.io.ByteArrayInputStream
-
- build() - Method in class edu.iu.dsc.tws.api.comms.messaging.MessageHeader.Builder
-
- build(Object, int) - Method in interface edu.iu.dsc.tws.api.comms.packing.MessageDeSerializer
-
Serilize a message
- build(Object, Object) - Method in interface edu.iu.dsc.tws.api.comms.packing.MessageSerializer
-
This method will be called repeatedly until the message is fully built
- build(Config, ComputeGraph, TaskSchedulePlan) - Method in interface edu.iu.dsc.tws.api.compute.executor.IExecutionPlanBuilder
-
Schedule and execution
- build() - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
-
Build the internal structures of the graph, so that it can be searched
- build() - Method in class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
-
This method is responsible for storing the directed edges between the source and target task
vertex in a map.
- build() - Method in class edu.iu.dsc.tws.api.config.Config.Builder
-
- build() - Method in class edu.iu.dsc.tws.api.Twister2Job.Twister2JobBuilder
-
- build() - Method in class edu.iu.dsc.tws.checkpointing.worker.CheckpointingWorkerEnv.Builder
-
build the checkpointing worker env
- build() - Method in class edu.iu.dsc.tws.common.table.ArrowTableBuilder
-
- build() - Method in interface edu.iu.dsc.tws.common.table.TableBuilder
-
Build the table at the end
- build(Object, Object) - Method in class edu.iu.dsc.tws.comms.dfw.io.BaseSerializer
-
- build(Object, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.DataDeserializer
-
Builds the message from the data buffers in the partialObject.
- build(Object, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.FixedSchemaDataDeserializer
-
Builds the message from the data buffers in the partialObject.
- build(Object, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.FixedSchemaKeyedDataDeSerializer
-
Builds the message from the data buffers in the partialObject.
- build(Object, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.KeyedDataDeSerializer
-
Builds the message from the data buffers in the partialObject.
- build() - Method in class edu.iu.dsc.tws.comms.utils.LogicalPlanBuilder
-
- build(Config) - Static method in class edu.iu.dsc.tws.examples.batch.cdfw.CDFJobParameters
-
This method is to build the job parameters which is based on the configuration value.
- build(Config) - Static method in class edu.iu.dsc.tws.examples.comms.JobParameters
-
- build(Config) - Static method in class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowJobParameters
-
This method is to build the job parameters which is based on the configuration value.
- build(Config) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.SVMJobParameters
-
Builds the Job Parameters relevant SVM Algorithm
- build(Config, ComputeGraph, TaskSchedulePlan) - Method in class edu.iu.dsc.tws.executor.core.ExecutionPlanBuilder
-
- build(Edge, Edge, Set<Integer>, Set<Integer>, Set<Integer>, OperationMode, Map<Integer, Integer>, Map<Integer, Integer>) - Method in class edu.iu.dsc.tws.executor.core.ParallelOperationFactory
-
- build(Edge, Set<Integer>, Set<Integer>, OperationMode, Map<Integer, Integer>, Map<Integer, Integer>) - Method in class edu.iu.dsc.tws.executor.core.ParallelOperationFactory
-
Building the parallel operation based on the batch or streaming tasks.
- build(int, List<JobMasterAPI.WorkerInfo>, TaskSchedulePlan, TaskIdGenerator) - Static method in class edu.iu.dsc.tws.executor.core.TaskPlanBuilder
-
Create a task plan based on the resource plan from resources and scheduled plan
- build(Config) - Static method in class edu.iu.dsc.tws.graphapi.api.WorkerParameter
-
This method is to build the job parameters which is based on the configuration value.
- build(Config) - Static method in class edu.iu.dsc.tws.graphapi.pagerank.PageRankWorkerParameters
-
This method is to build the job parameters which is based on the configuration value.
- build(Config) - Static method in class edu.iu.dsc.tws.graphapi.sssp.SsspParameters
-
This method is to build the job parameters which is based on the configuration value.
- build(Object, Object, Object) - Method in class edu.iu.dsc.tws.python.numpy.NumpyHolderBuilder
-
- build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.ApplyFunctions
-
- build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.ComparatorFunctions
-
- build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.ComputeFunctions
-
- build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.ComputeWithCollectorFunctions
-
- build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.FlatMapFunctions
-
- build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.MapFunctions
-
- build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.PartitionFunctions
-
This method builds a partition function
- build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.ReduceFunctions
-
- build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.SinkFunctions
-
- build(byte[]) - Method in class edu.iu.dsc.tws.python.tset.fn.TFunc
-
- build() - Method in class edu.iu.dsc.tws.task.cdfw.DataFlowGraph
-
- build(ComputeGraph...) - Method in class edu.iu.dsc.tws.task.ComputeEnvironment
-
- build() - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
-
- build() - Method in class edu.iu.dsc.tws.task.impl.ComputeGraphBuilder
-
- build() - Method in class edu.iu.dsc.tws.tsched.builder.TaskSchedulePlanBuilder
-
This method first validates the available resource settings and invoke the build container
plans method to build the container based on the task instance ram, disk, and cpu map values.
- build(GraphBuilder, Collection<? extends TBase>) - Method in interface edu.iu.dsc.tws.tset.Buildable
-
Builds the underlying node or edge
- build(TaskExecutor) - Method in class edu.iu.dsc.tws.tset.env.BuildContext
-
- build(GraphBuilder, Collection<? extends TBase>) - Method in class edu.iu.dsc.tws.tset.links.batch.JoinTLink
-
Uses a different build pattern than the usual
TLinks
- build(GraphBuilder, Collection<? extends TBase>) - Method in interface edu.iu.dsc.tws.tset.links.BuildableTLink
-
- build(GraphBuilder, Collection<? extends TBase>) - Method in interface edu.iu.dsc.tws.tset.sets.BuildableTSet
-
- build() - Method in class edu.iu.dsc.tws.tset.TBaseGraph
-
Builds the entire graph
- build(BuildableTSet) - Method in class edu.iu.dsc.tws.tset.TBaseGraph
-
Builds a subgraph of TSets from the specified TSet
- Buildable - Interface in edu.iu.dsc.tws.tset
-
Interface that provides buildable functionality for sets and links
- BuildableTLink - Interface in edu.iu.dsc.tws.tset.links
-
- BuildableTSet - Interface in edu.iu.dsc.tws.tset.sets
-
- buildAndExecute(ComputeGraphBuilder) - Method in class edu.iu.dsc.tws.task.ComputeEnvironment
-
for single task graph runs
- buildCentroidsTG(String, int, int, int, Config, String) - Static method in class edu.iu.dsc.tws.examples.batch.kmeans.KMeansComputeJob
-
- buildComputationSsspTG(int, Config) - Static method in class edu.iu.dsc.tws.graphapi.sssp.SingleSourceShortestPathWorker
-
- buildComputationTG(int, Config, BasicComputation.SourceTask, BasicComputation.ComputeTask, BasicComputation.ReductionFunction, PrimitiveMessageTypes) - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation
-
- buildComputationTG(int, Config) - Static method in class edu.iu.dsc.tws.graphapi.pagerank.PageRankWorker
-
- buildConfig(String) - Static method in class edu.iu.dsc.tws.examples.internal.jobmaster.ZKJobMasterRegistrarExample
-
construct a Config object
- BuildContext - Class in edu.iu.dsc.tws.tset.env
-
TSet build context holds references for executed tset, build sequence of that tset, compute
graph
- BuildContext(String, Set<BuildableTSet>, Set<TBase>, OperationMode) - Constructor for class edu.iu.dsc.tws.tset.env.BuildContext
-
- buildDataPointsTG(String, int, int, int, Config, String) - Static method in class edu.iu.dsc.tws.examples.batch.kmeans.KMeansComputeJob
-
- buildDataPointsTG(String, int, int, Config) - Static method in class edu.iu.dsc.tws.graphapi.pagerank.PageRankWorker
-
- buildDataPointsTG(String, int, int, String, Config) - Static method in class edu.iu.dsc.tws.graphapi.sssp.SingleSourceShortestPathWorker
-
- Builder() - Constructor for class edu.iu.dsc.tws.api.config.Config.Builder
-
- buildGraphInitialaizationTG(String, int, int, Config, BasicComputation.GraphInitialization) - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation
-
- buildGraphInitialValueTG(String, int, int, Config) - Static method in class edu.iu.dsc.tws.graphapi.pagerank.PageRankWorker
-
- buildGraphPartitionTG(String, int, int, Config, BasicComputation.GraphPartiton) - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation
-
- buildHeader(DataBuffer, int) - Method in interface edu.iu.dsc.tws.api.comms.packing.MessageDeSerializer
-
Read the header from the buffer
- buildHeader(DataBuffer, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.DataDeserializer
-
Builds the header object from the data in the data buffer
- buildHeader(DataBuffer, OutMessage, int) - Static method in class edu.iu.dsc.tws.comms.dfw.io.DFWIOUtils
-
Builds the header of the message.
- buildHeader(DataBuffer, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.KeyedDataDeSerializer
-
Builds the header object from the data in the data buffer
- buildInterGroupTree(int) - Method in class edu.iu.dsc.tws.comms.routing.BinaryTree
-
Building the tree
- buildKMeansTG(int, Config) - Static method in class edu.iu.dsc.tws.examples.batch.kmeans.KMeansComputeJob
-
- buildOne(BuildableTSet) - Method in class edu.iu.dsc.tws.tset.TBaseGraph
-
Builds only one TSet (NOT the subgraph)
- buildSsspInitialTG(String, int, int, String, Config) - Static method in class edu.iu.dsc.tws.graphapi.sssp.SingleSourceShortestPathWorker
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTAllGatherExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTAllReduceExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTBroadCastExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTDirectExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTGatherExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTJoinExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTKeyedGatherExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTKeyedReduceExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTPartitionExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTPartitionKeyedExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.batch.BTReduceExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.BenchTaskWorker
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.BenchWindowTaskWorker
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STAllGatherExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STAllReduceExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STBroadCastExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STGatherExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STKeyedGatherExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STKeyedReduceExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STPartitionExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STPartitionKeyedExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.STReduceExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowCustomExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowEventTimeExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowExample
-
- buildTaskGraph() - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowMPI
-
- buildTestConfig(String) - Static method in class edu.iu.dsc.tws.examples.internal.jobmaster.ZKJobMasterFinderExample
-
construct a test Config object
- buildTestingDataPointsTG(int, SVMJobParameters, Config, OperationMode) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.TGUtils
-
- buildTopology() - Method in class edu.iu.dsc.tws.examples.compatibility.storm.MultiSpoutTopology
-
- buildTopology() - Method in class edu.iu.dsc.tws.examples.compatibility.storm.SentenceWordCountTopology
-
- buildTopology() - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.IntervalWindowTopology
-
- buildTopology() - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.SlidingWindowTopology
-
- buildTopology() - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.TumblingWindowTopology
-
- buildTopology() - Method in class edu.iu.dsc.tws.examples.compatibility.storm.WordCountTopology
-
- buildTopology() - Method in class org.apache.storm.topology.twister2.Twister2StormWorker
-
- buildTrainingDataPointsTG(int, SVMJobParameters, Config, OperationMode) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.TGUtils
-
- buildWeightVectorTG(Config, int, SVMJobParameters, OperationMode) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.TGUtils
-
- BULK_MM_STEP_SIZE - Static variable in class edu.iu.dsc.tws.data.memory.MemoryManagerContext
-
Default step size of the Bulk Memory Manager.
- bulkCopyToBuffer(char[], ByteBuffer, int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.CharArrayPacker
-
- bulkCopyToBuffer(double[], ByteBuffer, int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.DoubleArrayPacker
-
- bulkCopyToBuffer(float[], ByteBuffer, int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.FloatArrayPacker
-
- bulkCopyToBuffer(int[], ByteBuffer, int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.IntegerArrayPacker
-
- bulkCopyToBuffer(long[], ByteBuffer, int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.LongArrayPacker
-
- bulkCopyToBuffer(A, ByteBuffer, int, int) - Method in interface edu.iu.dsc.tws.api.comms.packing.types.primitive.PrimitiveArrayPacker
-
- bulkCopyToBuffer(short[], ByteBuffer, int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ShortArrayPacker
-
- bulkReadFromBuffer(ByteBuffer, char[], int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.CharArrayPacker
-
- bulkReadFromBuffer(ByteBuffer, double[], int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.DoubleArrayPacker
-
- bulkReadFromBuffer(ByteBuffer, float[], int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.FloatArrayPacker
-
- bulkReadFromBuffer(ByteBuffer, int[], int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.IntegerArrayPacker
-
- bulkReadFromBuffer(ByteBuffer, long[], int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.LongArrayPacker
-
- bulkReadFromBuffer(ByteBuffer, A, int, int) - Method in interface edu.iu.dsc.tws.api.comms.packing.types.primitive.PrimitiveArrayPacker
-
- bulkReadFromBuffer(ByteBuffer, short[], int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.types.primitive.ShortArrayPacker
-
- BulkReceiver - Interface in edu.iu.dsc.tws.api.comms
-
Receiver for multiple values
- BulkReceiverWrapper - Class in edu.iu.dsc.tws.comms.dfw.io.join
-
- BulkReceiverWrapper(JoinBatchCombinedReceiver, JoinRelation) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.join.BulkReceiverWrapper
-
- bundleExpiredWindowIMessage(List<IMessage<T>>) - Method in class edu.iu.dsc.tws.task.window.manage.WindowManager
-
This method bundles data into a IWindowMessage for creating expired IWindowMessages
- bundleNonExpiredWindowIMessage(List<IMessage<T>>) - Method in class edu.iu.dsc.tws.task.window.manage.WindowManager
-
This method bundles data into a IWindowMessage for creating non-expired IWindowMessages
- bundleWindowMessage(List<Event<T>>) - Method in class edu.iu.dsc.tws.task.window.manage.WindowManager
-
- BYTE - Static variable in class edu.iu.dsc.tws.api.comms.messaging.types.MessageTypes
-
- BYTE_ARRAY - Static variable in class edu.iu.dsc.tws.api.comms.messaging.types.MessageTypes
-
- BYTE_TYPE - Static variable in class edu.iu.dsc.tws.data.utils.DataObjectConstants
-
- ByteArrayInputStream - Class in edu.iu.dsc.tws.comms.dfw.io
-
This is a specialized input stream targetted to reading a twister object message expanding
to multiple MPI buffers.
- ByteArrayInputStream(List<DataBuffer>, int) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.ByteArrayInputStream
-
- ByteArrayOutputStream - Class in edu.iu.dsc.tws.comms.dfw.io
-
- ByteArrayOutputStream() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.ByteArrayOutputStream
-
- ByteArrayOutputStream(int) - Constructor for class edu.iu.dsc.tws.comms.dfw.io.ByteArrayOutputStream
-
- ByteArrayPacker - Class in edu.iu.dsc.tws.api.comms.packing.types.primitive
-
- BytePacker - Class in edu.iu.dsc.tws.api.comms.packing.types.primitive
-
- ByteSelector - Class in edu.iu.dsc.tws.examples.batch.sortop
-
- ByteSelector() - Constructor for class edu.iu.dsc.tws.examples.batch.sortop.ByteSelector
-
- ByteToWindowFunction<K,V> - Class in org.apache.beam.runners.twister2.translators.functions
-
ByteToWindow function.
- ByteToWindowFunction(<any>, <any>) - Constructor for class org.apache.beam.runners.twister2.translators.functions.ByteToWindowFunction
-
- ByteUtils - Class in edu.iu.dsc.tws.common.net.tcp.request
-
Utility methods
- C - Static variable in class edu.iu.dsc.tws.data.utils.MLDataObjectConstants.SgdSvmDataObjectConstants
-
- cache() - Method in interface edu.iu.dsc.tws.api.tset.StoringData
-
Runs this TSet and caches the data to an in-memory
DataPartition and exposes the data as another TSet.
- cache() - Method in class edu.iu.dsc.tws.tset.links.batch.AllReduceTLink
-
- cache() - Method in class edu.iu.dsc.tws.tset.links.batch.BatchGatherLink
-
- cache() - Method in class edu.iu.dsc.tws.tset.links.batch.BatchIteratorLinkWrapper
-
- cache() - Method in class edu.iu.dsc.tws.tset.links.batch.BatchSingleLink
-
- cache() - Method in class edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl
-
- cache() - Method in class edu.iu.dsc.tws.tset.links.batch.KeyedBatchIteratorLinkWrapper
-
- cache() - Method in class edu.iu.dsc.tws.tset.links.batch.KeyedPipeTLink
-
- cache() - Method in class edu.iu.dsc.tws.tset.links.batch.PipeTLink
-
- cache() - Method in class edu.iu.dsc.tws.tset.links.batch.ReduceTLink
-
- cache() - Method in class edu.iu.dsc.tws.tset.links.batch.row.RowBatchTLinkImpl
-
- cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.BatchTSetImpl
-
- cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.BatchTupleTSetImpl
-
- cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.CachedTSet
-
- cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.KeyedCachedTSet
-
- cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.KeyedPersistedTSet
-
- cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.PersistedTSet
-
- cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.row.BatchRowTSetImpl
-
- cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.row.RowCachedTSet
-
- cache() - Method in class edu.iu.dsc.tws.tset.sets.batch.row.RowPersistedTSet
-
- CachedTSet<T> - Class in edu.iu.dsc.tws.tset.sets.batch
-
Cached tset
- CachedTSet(BatchEnvironment, SinkFunc<?>, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.batch.CachedTSet
-
- CacheExample - Class in edu.iu.dsc.tws.examples.tset.batch
-
- CacheExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.CacheExample
-
- CacheGatherSink<T> - Class in edu.iu.dsc.tws.tset.sinks
-
- CacheGatherSink() - Constructor for class edu.iu.dsc.tws.tset.sinks.CacheGatherSink
-
- CacheIterSink<T> - Class in edu.iu.dsc.tws.tset.sinks
-
An in-memory cached TSet
- CacheIterSink() - Constructor for class edu.iu.dsc.tws.tset.sinks.CacheIterSink
-
- CacheSingleSink<T> - Class in edu.iu.dsc.tws.tset.sinks
-
- CacheSingleSink() - Constructor for class edu.iu.dsc.tws.tset.sinks.CacheSingleSink
-
- calculateWorkerID(JobAPI.Job, String, String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.worker.K8sWorkerUtils
-
calculate the workerID from the given parameters
- calculateWorkerIDInSS(int, int, int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.worker.K8sWorkerUtils
-
calculate the workerID in the given StatefulSet
- calculation(Iterator) - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation.ComputeTask
-
- canAcceptMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetFinalReceiver
-
- canAcceptMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetPartialReceiver
-
- canAcceptMessage(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetReceiver
-
Check weather we can accept a message
- cancel() - Method in class org.apache.beam.runners.twister2.Twister2PiplineResult
-
- cancelTransfer() - Method in class edu.iu.dsc.tws.rsched.uploaders.k8s.UploaderToPod
-
- canProgress() - Method in class edu.iu.dsc.tws.comms.dfw.ControlledProgressTracker
-
- canProgress() - Method in class edu.iu.dsc.tws.comms.dfw.ProgressionTracker
-
- cast(Object) - Method in interface edu.iu.dsc.tws.api.comms.messaging.types.MessageType
-
- CDFConstants - Class in edu.iu.dsc.tws.examples.batch.cdfw
-
- CDFConstants() - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.CDFConstants
-
- CDFJobParameters - Class in edu.iu.dsc.tws.examples.batch.cdfw
-
- CDFJobParameters(int) - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.CDFJobParameters
-
- CDFWEnv - Class in edu.iu.dsc.tws.task.cdfw
-
- CDFWEnv(Config, IScaler, IDriverMessenger, List<JobMasterAPI.WorkerInfo>) - Constructor for class edu.iu.dsc.tws.task.cdfw.CDFWEnv
-
- CDFWExecutor - Class in edu.iu.dsc.tws.task.cdfw
-
- CDFWExecutor(CDFWEnv, IDriverMessenger) - Constructor for class edu.iu.dsc.tws.task.cdfw.CDFWExecutor
-
- CDFWRuntime - Class in edu.iu.dsc.tws.task.impl.cdfw
-
- CDFWRuntime(Config, int, IWorkerController) - Constructor for class edu.iu.dsc.tws.task.impl.cdfw.CDFWRuntime
-
Connected Dataflow Runtime
- CDFWScheduler - Class in edu.iu.dsc.tws.task.cdfw
-
This schedule is the base method for making decisions to run the part of the task graph which
will be improved further with the complex logic.
- CDFWScheduler(List<JobMasterAPI.WorkerInfo>) - Constructor for class edu.iu.dsc.tws.task.cdfw.CDFWScheduler
-
- CDFWWorker - Class in edu.iu.dsc.tws.task.impl.cdfw
-
This is an implementation of IWorker to support easy deployment of task graphs.
- CDFWWorker() - Constructor for class edu.iu.dsc.tws.task.impl.cdfw.CDFWWorker
-
- CenterSource(String) - Constructor for class edu.iu.dsc.tws.examples.batch.kmeans.KMeansTsetJob.CenterSource
-
- CentroidAggregator() - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.KMeansConnectedDataflowExample.CentroidAggregator
-
- CentroidAggregator() - Constructor for class edu.iu.dsc.tws.examples.batch.kmeans.KMeansComputeJob.CentroidAggregator
-
- cfg - Variable in class edu.iu.dsc.tws.connectors.kafka.KafkaSource
-
- changeJobState(String, JobState) - Method in interface edu.iu.dsc.tws.dashboard.repositories.JobRepository
-
- changeNumberOfWorkers(String, Integer) - Method in interface edu.iu.dsc.tws.dashboard.repositories.JobRepository
-
- changeState(String, StateChangeRequest<JobState>) - Method in class edu.iu.dsc.tws.dashboard.controllers.JobController
-
- changeState(String, Long, StateChangeRequest<WorkerState>) - Method in class edu.iu.dsc.tws.dashboard.controllers.WorkerController
-
- changeState(String, StateChangeRequest<JobState>) - Method in class edu.iu.dsc.tws.dashboard.services.JobService
-
- changeState(String, Long, StateChangeRequest<WorkerState>) - Method in class edu.iu.dsc.tws.dashboard.services.WorkerService
-
- changeStateOfAllWorkers(String, WorkerState, WorkerState) - Method in interface edu.iu.dsc.tws.dashboard.repositories.WorkerRepository
-
- changeStateOfAllWorkers(String, WorkerState) - Method in class edu.iu.dsc.tws.dashboard.services.WorkerService
-
- changeWorkerState(String, Long, WorkerState) - Method in interface edu.iu.dsc.tws.dashboard.repositories.WorkerRepository
-
- channel - Variable in class edu.iu.dsc.tws.api.comms.BaseOperation
-
THe underlying channel
- channel - Variable in class edu.iu.dsc.tws.executor.comms.AbstractParallelOperation
-
- channel - Variable in class edu.iu.dsc.tws.executor.threading.ThreadSharingExecutor
-
Channel
- channel - Variable in class edu.iu.dsc.tws.task.impl.cdfw.CDFWWorker
-
The channel
- CHANNEL_PENDING_SIZE - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
-
- ChannelBuffer - Interface in edu.iu.dsc.tws.comms.table.channel
-
- ChannelDataFlowOperation - Class in edu.iu.dsc.tws.comms.dfw
-
- channelHandler - Variable in class edu.iu.dsc.tws.common.net.tcp.BaseNetworkChannel
-
- ChannelHandler - Interface in edu.iu.dsc.tws.common.net.tcp
-
Listen to channel events
- ChannelListener - Interface in edu.iu.dsc.tws.api.comms.channel
-
A listener for getting notifications about completion of network events
- ChannelMessage - Class in edu.iu.dsc.tws.api.comms.messaging
-
- ChannelMessage() - Constructor for class edu.iu.dsc.tws.api.comms.messaging.ChannelMessage
-
- ChannelMessage(int, MessageType, MessageDirection, ChannelMessageReleaseCallback) - Constructor for class edu.iu.dsc.tws.api.comms.messaging.ChannelMessage
-
- ChannelMessageReleaseCallback - Interface in edu.iu.dsc.tws.api.comms.messaging
-
- ChannelReceiveCallback - Interface in edu.iu.dsc.tws.comms.table.channel
-
- ChannelReceiver - Interface in edu.iu.dsc.tws.api.comms.channel
-
Get notifications about receives and sends
- ChannelSendCallback - Interface in edu.iu.dsc.tws.comms.table.channel
-
- CHAR - Static variable in class edu.iu.dsc.tws.api.comms.messaging.types.MessageTypes
-
- CHAR_ARRAY - Static variable in class edu.iu.dsc.tws.api.comms.messaging.types.MessageTypes
-
- CharArrayPacker - Class in edu.iu.dsc.tws.api.comms.packing.types.primitive
-
- CharPacker - Class in edu.iu.dsc.tws.api.comms.packing.types.primitive
-
- checkBarrierFailure() - Method in class edu.iu.dsc.tws.master.barrier.BarrierMonitor
-
this method is called periodically by Job Master to check for the barrier failure
barriers fail for two reasons:
the barrier times out: barrier failure message should be broadcasted to all waiting workers
job becomes faulty: default barrier fails in this case only
- checkCycle(T, T) - Method in class edu.iu.dsc.tws.tset.graph.DAGMutableGraph
-
check if adding this edge to the graph creates an cycle
- checkCycle() - Method in class edu.iu.dsc.tws.tset.test.graph.BasicGraphTests
-
- checkData(int, int) - Method in class edu.iu.dsc.tws.examples.ml.svm.data.DataPartitioner
-
- checkForInstantiationError(Class<? extends FileSystem>) - Static method in class edu.iu.dsc.tws.data.utils.InstantiationUtils
-
- checkIfEmptyIsSent(int) - Method in class edu.iu.dsc.tws.comms.dfw.io.gather.keyed.DKGatherBatchFinalReceiver
-
checks if the Empty message was sent for this target and sends it if not sent and possible to
send.
- checkIfEmptyIsSent(int) - Method in class edu.iu.dsc.tws.comms.dfw.io.KeyedReceiver
-
checks if the Empty message was sent for this target and sends it if not sent and possible to
send
- checkJstZNodeWaitIfNeeded(CuratorFramework, String, String, long) - Static method in class edu.iu.dsc.tws.common.zk.JobZNodeManager
-
Job master creates job submission time znode under job znode,
as the last action to create job related znodes at ZK server
workers wait for the job master to create this znode.
- checkNotNull(T, String) - Static method in class edu.iu.dsc.tws.data.utils.PreConditions
-
- checkNotNull(String, String) - Static method in class edu.iu.dsc.tws.data.utils.PreConditions
-
- checkNotNull(T, String) - Static method in class edu.iu.dsc.tws.deeplearning.common.ParameterTool
-
- checkPodsReachable(Config) - Static method in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- checkpoint(long, CheckpointableTask, SnapshotImpl, StateStore, String, int, CheckpointingClient) - Static method in class edu.iu.dsc.tws.executor.core.TaskCheckpointUtils
-
- CHECKPOINT_COMPONENT_ID - Static variable in class org.apache.storm.spout.CheckpointSpout
-
- CHECKPOINT_FIELD_ACTION - Static variable in class org.apache.storm.spout.CheckpointSpout
-
- CHECKPOINT_FIELD_TXID - Static variable in class org.apache.storm.spout.CheckpointSpout
-
- CHECKPOINT_STREAM_ID - Static variable in class org.apache.storm.spout.CheckpointSpout
-
- CHECKPOINT_YAML - Static variable in class edu.iu.dsc.tws.api.config.Context
-
- CheckpointablePythonWorker() - Constructor for class edu.iu.dsc.tws.python.PythonWorker.CheckpointablePythonWorker
-
- CheckpointableTask - Interface in edu.iu.dsc.tws.checkpointing.task
-
- checkpointAvailable(String) - Method in interface edu.iu.dsc.tws.api.checkpointing.Snapshot
-
Weater a checkpoint available for a kye
- checkpointAvailable(String) - Method in class edu.iu.dsc.tws.checkpointing.api.SnapshotImpl
-
- checkpointCofigurationFile(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
-
- checkpointConfigurationFile(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
-
- CheckpointedSourceOp<T> - Class in edu.iu.dsc.tws.tset.ops
-
- CheckpointedSourceOp(DiskPartitionBackedSourceWrapper<T>, BaseTSet, Map<String, String>) - Constructor for class edu.iu.dsc.tws.tset.ops.CheckpointedSourceOp
-
- CheckpointedTSet<T> - Class in edu.iu.dsc.tws.tset.sets.batch
-
This is a shadow
PersistedTSet to add the checkpointing capability.
- CheckpointedTSet(BatchEnvironment, DiskPartitionBackedSource<T>, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.batch.CheckpointedTSet
-
- CHECKPOINTING_ENABLED - Static variable in class edu.iu.dsc.tws.checkpointing.util.CheckpointingContext
-
- CHECKPOINTING_RESTORE_JOB - Static variable in class edu.iu.dsc.tws.checkpointing.util.CheckpointingContext
-
- CHECKPOINTING_SOURCE_FREQUNCY - Static variable in class edu.iu.dsc.tws.checkpointing.util.CheckpointingContext
-
- CHECKPOINTING_STORE_CLASS - Static variable in class edu.iu.dsc.tws.checkpointing.util.CheckpointingContext
-
- CHECKPOINTING_STORE_FS_DIR - Static variable in class edu.iu.dsc.tws.checkpointing.stores.LocalFileStateStore
-
- CheckpointingClient - Interface in edu.iu.dsc.tws.api.checkpointing
-
todo This class was added as an temp solution to resolve a cyclic dependency issue.
- CheckpointingClientImpl - Class in edu.iu.dsc.tws.checkpointing.client
-
- CheckpointingClientImpl(RRClient, long) - Constructor for class edu.iu.dsc.tws.checkpointing.client.CheckpointingClientImpl
-
- CheckpointingContext - Class in edu.iu.dsc.tws.checkpointing.util
-
- CheckpointingExample - Class in edu.iu.dsc.tws.examples.tset.checkpointing
-
- CheckpointingExample() - Constructor for class edu.iu.dsc.tws.examples.tset.checkpointing.CheckpointingExample
-
- CheckpointingSGatherSink - Class in edu.iu.dsc.tws.checkpointing.task
-
- CheckpointingSGatherSink(String) - Constructor for class edu.iu.dsc.tws.checkpointing.task.CheckpointingSGatherSink
-
- CheckpointingTaskExample - Class in edu.iu.dsc.tws.examples.checkpointing
-
- CheckpointingTaskExample() - Constructor for class edu.iu.dsc.tws.examples.checkpointing.CheckpointingTaskExample
-
- CheckpointingTaskExample.ComputeTask - Class in edu.iu.dsc.tws.examples.checkpointing
-
- CheckpointingTaskExample.SinkTask - Class in edu.iu.dsc.tws.examples.checkpointing
-
- CheckpointingTaskExample.SourceTask - Class in edu.iu.dsc.tws.examples.checkpointing
-
- CheckpointingWorkerEnv - Class in edu.iu.dsc.tws.checkpointing.worker
-
- CheckpointingWorkerEnv.Builder - Class in edu.iu.dsc.tws.checkpointing.worker
-
- CheckpointManager - Class in edu.iu.dsc.tws.checkpointing.master
-
- CheckpointManager(RRServer, StateStore, String) - Constructor for class edu.iu.dsc.tws.checkpointing.master.CheckpointManager
-
- CheckpointSpout - Class in org.apache.storm.spout
-
Emits checkpoint tuples which is used to save the state of the
IStatefulComponent across the topology.
- CheckpointSpout() - Constructor for class org.apache.storm.spout.CheckpointSpout
-
- CheckPointState - Class in org.apache.storm.spout
-
- CheckPointState(long, CheckPointState.State) - Constructor for class org.apache.storm.spout.CheckPointState
-
- CheckPointState() - Constructor for class org.apache.storm.spout.CheckPointState
-
- CheckPointState.Action - Enum in org.apache.storm.spout
-
- CheckPointState.State - Enum in org.apache.storm.spout
-
- CheckpointStatus - Class in edu.iu.dsc.tws.checkpointing.master
-
- CheckpointStatus(String, int) - Constructor for class edu.iu.dsc.tws.checkpointing.master.CheckpointStatus
-
- CheckpointUtils - Class in edu.iu.dsc.tws.checkpointing.util
-
- checkPwdFreeSsh(Config) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesContext
-
- checkSelfCycle() - Method in class edu.iu.dsc.tws.tset.test.graph.BasicGraphTests
-
- childOfTask(Vertex, String) - Method in class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
-
- childrenOfTask(TV) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
-
This method is helpful to find out the children of the task vertex (t).
- childrenOfTask(String) - Method in class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
-
- chooseTasks(int, List<Object>) - Method in interface org.apache.storm.grouping.CustomStreamGrouping
-
This function implements a custom stream grouping.
- CINPUT_DIRECTORY - Static variable in class edu.iu.dsc.tws.data.utils.DataObjectConstants
-
- classesToLoad - Variable in class edu.iu.dsc.tws.local.util.LocalClassLoader
-
- clean() - Method in interface edu.iu.dsc.tws.api.comms.messaging.MessageReceiver
-
Clean any state associated with the receiver and go to initial state
- clean() - Method in class edu.iu.dsc.tws.comms.dfw.io.gather.DGatherBatchFinalReceiver
-
- clean() - Method in class edu.iu.dsc.tws.comms.dfw.io.partition.DPartitionBatchFinalReceiver
-
- clean() - Method in class edu.iu.dsc.tws.comms.dfw.io.partition.PartitionPartialReceiver
-
- clean() - Method in class edu.iu.dsc.tws.comms.dfw.io.SourceReceiver
-
- clean() - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetFinalReceiver
-
- clean() - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetPartialReceiver
-
- clean() - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedMerger
-
Cleanup the directories
- clean() - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMerger
-
Cleanup the directories
- clean() - Method in class edu.iu.dsc.tws.comms.shuffle.FSKeyedSortedMerger2
-
Cleanup the directories
- clean() - Method in class edu.iu.dsc.tws.comms.shuffle.FSMerger
-
Cleanup the directories
- clean - Static variable in class edu.iu.dsc.tws.comms.shuffle.MemoryMapUtils
-
- clean() - Method in interface edu.iu.dsc.tws.comms.shuffle.Shuffle
-
Clean the file system
- cleanup() - Method in interface org.apache.storm.task.IBolt
-
Called when an IBolt is going to be shutdown.
- cleanup() - Method in class org.apache.storm.topology.base.BaseBasicBolt
-
- cleanup() - Method in class org.apache.storm.topology.base.BaseRichBolt
-
- cleanup() - Method in class org.apache.storm.topology.base.BaseWindowedBolt
-
- cleanup() - Method in interface org.apache.storm.topology.IBasicBolt
-
- cleanup() - Method in interface org.apache.storm.topology.IStatefulBolt
-
- cleanup() - Method in interface org.apache.storm.topology.IWindowedBolt
-
- cleanup() - Method in class org.apache.storm.topology.WindowedBoltExecutor
-
- clear() - Method in interface edu.iu.dsc.tws.api.dataset.DataPartition
-
- clear() - Method in class edu.iu.dsc.tws.common.net.tcp.BaseNetworkChannel
-
- clear() - Method in class edu.iu.dsc.tws.comms.utils.DiskBasedList
-
- clear() - Method in class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
-
- clear() - Method in class edu.iu.dsc.tws.dataset.partition.CollectionPartition
-
- clear() - Method in class org.apache.storm.generated.GlobalStreamId
-
- clearAllJobs(Config) - Static method in class edu.iu.dsc.tws.rsched.job.Twister2Submitter
-
Clear left over resources for all checkpointed jobs that are not currently running:
The Job package for the checkpointed job stored in user home directory
Checkpointed data that are saved when jobs failed.
- clearData(String) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
-
This method can be used to clear
DataPartitions collected from previous
task graphs, which are no longer required
- clearJob(String, Config) - Static method in class edu.iu.dsc.tws.rsched.job.Twister2Submitter
-
- clearRestorePoint() - Method in class edu.iu.dsc.tws.comms.shuffle.ControlledFileReader
-
- clearRestorePoint() - Method in class edu.iu.dsc.tws.comms.shuffle.ControlledMemoryReader
-
- clearRestorePoint() - Method in interface edu.iu.dsc.tws.comms.shuffle.Restorable
-
- clearRestorePoint() - Method in class edu.iu.dsc.tws.comms.utils.SortJoinUtils.ListBasedRestorableIterator
-
- clearTarget(int) - Method in class edu.iu.dsc.tws.comms.dfw.io.TargetReceiver
-
Clear all the buffers for the target, to ready for the next
- clearTemporaryFiles(String) - Method in class edu.iu.dsc.tws.rsched.core.ResourceAllocator
-
clear temporary files
- clearWindow() - Method in interface edu.iu.dsc.tws.task.window.manage.IWindowingPolicyManager
-
- Client - Class in edu.iu.dsc.tws.common.net.tcp
-
- Client(String, int, Config, Progress, ChannelHandler) - Constructor for class edu.iu.dsc.tws.common.net.tcp.Client
-
- Client(String, int, Config, Progress, ChannelHandler, boolean) - Constructor for class edu.iu.dsc.tws.common.net.tcp.Client
-
- client - Variable in class edu.iu.dsc.tws.master.server.ZKMasterController
-
- CLIENT_ID - Static variable in class edu.iu.dsc.tws.common.net.tcp.request.RRServer
-
The client id
- clientChannel - Variable in class edu.iu.dsc.tws.common.net.tcp.request.RRServer
-
the client channel,
- clientChannels - Variable in class edu.iu.dsc.tws.common.net.tcp.TCPChannel
-
client channels with workerIDs
- ClientConnectHandler() - Constructor for class edu.iu.dsc.tws.master.worker.JMWorkerAgent.ClientConnectHandler
-
- ClientJobKillHandler - Class in edu.iu.dsc.tws.rsched.schedulers.k8s
-
Watch whether job resources are killed by Job Master
If necessary, kill the job resources from Twister2 client
- ClientJobKillHandler(String, KubernetesController) - Constructor for class edu.iu.dsc.tws.rsched.schedulers.k8s.ClientJobKillHandler
-
- cloneWithRam(double) - Method in class edu.iu.dsc.tws.api.compute.schedule.elements.Resource
-
- cloneWorkers() - Method in class edu.iu.dsc.tws.common.zk.ZKWorkerController
-
- Closable - Interface in edu.iu.dsc.tws.api.compute.modifiers
-
A task which needs to clean up resources at the end should implement this method
- close() - Method in class edu.iu.dsc.tws.api.comms.BaseOperation
-
- close() - Method in interface edu.iu.dsc.tws.api.comms.channel.TWSChannel
-
Close the channel
- close() - Method in class edu.iu.dsc.tws.api.comms.Communicator
-
Terminate the communicator
- close() - Method in interface edu.iu.dsc.tws.api.comms.DataFlowOperation
-
Close the operation
- close() - Method in interface edu.iu.dsc.tws.api.comms.messaging.MessageReceiver
-
Close the receiver
- close() - Method in interface edu.iu.dsc.tws.api.compute.executor.IExecution
-
Cleanup the execution
- close() - Method in interface edu.iu.dsc.tws.api.compute.executor.IExecutor
-
Terminate the executor
- close() - Method in interface edu.iu.dsc.tws.api.compute.executor.INodeInstance
-
Calls at the end to clean up
- close() - Method in interface edu.iu.dsc.tws.api.compute.executor.IParallelOperation
-
Close the parallel operation
- close() - Method in interface edu.iu.dsc.tws.api.compute.modifiers.Closable
-
Close method for cleaning up the resources
- close() - Method in class edu.iu.dsc.tws.api.compute.nodes.BaseNode
-
- close() - Method in class edu.iu.dsc.tws.api.data.FSDataOutputStream
-
Closes the output stream.
- close() - Method in class edu.iu.dsc.tws.api.resource.WorkerEnvironment
-
Close the worker environment
- close() - Method in interface edu.iu.dsc.tws.api.scheduler.IController
-
- close() - Method in interface edu.iu.dsc.tws.api.scheduler.ILauncher
-
Cleanup any resources
- close() - Method in interface edu.iu.dsc.tws.api.scheduler.IUploader
-
This is to for disposing or cleaning up any internal state accumulated by the uploader
- close() - Method in interface edu.iu.dsc.tws.api.tset.fn.RecordCollector
-
Closes the collector
- close() - Method in interface edu.iu.dsc.tws.api.tset.fn.SourceFunc
-
Closes the source
- close() - Method in interface edu.iu.dsc.tws.api.tset.fn.TFunction
-
- close() - Static method in class edu.iu.dsc.tws.api.util.CommonThreadPool
-
- close() - Method in class edu.iu.dsc.tws.common.logging.Twister2FileLogHandler
-
- close() - Method in class edu.iu.dsc.tws.common.zk.ZKJobMasterFinder
-
- close() - Method in class edu.iu.dsc.tws.common.zk.ZKJobMasterRegistrar
-
- close() - Method in class edu.iu.dsc.tws.common.zk.ZKWorkerController
-
close all local entities.
- close() - Method in class edu.iu.dsc.tws.comms.batch.BJoin
-
- close() - Method in class edu.iu.dsc.tws.comms.dfw.AllGather
-
- close() - Method in class edu.iu.dsc.tws.comms.dfw.AllReduce
-
- close() - Method in class edu.iu.dsc.tws.comms.dfw.ChannelDataFlowOperation
-
- close() - Method in class edu.iu.dsc.tws.comms.dfw.ControlledChannelOperation
-
- close() - Method in class edu.iu.dsc.tws.comms.dfw.io.ByteArrayInputStream
-
- close() - Method in class edu.iu.dsc.tws.comms.dfw.io.ByteArrayOutputStream
-
- close() - Method in class edu.iu.dsc.tws.comms.dfw.io.gather.DGatherBatchFinalReceiver
-
- close() - Method in class edu.iu.dsc.tws.comms.dfw.io.partition.DPartitionBatchFinalReceiver
-
- close() - Method in class edu.iu.dsc.tws.comms.dfw.MToNChain
-
- close() - Method in class edu.iu.dsc.tws.comms.dfw.MToNRing
-
- close() - Method in class edu.iu.dsc.tws.comms.dfw.MToNSimple
-
- close() - Method in class edu.iu.dsc.tws.comms.dfw.MToOneTree
-
- close() - Method in class edu.iu.dsc.tws.comms.dfw.OneToOne
-
- close() - Method in class edu.iu.dsc.tws.comms.dfw.TreeBroadcast
-
- close() - Method in class edu.iu.dsc.tws.comms.mpi.TWSMPIChannel
-
- close() - Method in class edu.iu.dsc.tws.comms.shuffle.OpenFile
-
- close() - Method in class edu.iu.dsc.tws.comms.table.ArrowAllToAll
-
- close() - Method in class edu.iu.dsc.tws.comms.table.channel.MPIChannel
-
Close the channel and clear any allocated memory by the channel
- close() - Method in class edu.iu.dsc.tws.comms.table.ops.BTPartition
-
- close() - Method in class edu.iu.dsc.tws.comms.table.ops.STPartition
-
- close() - Method in class edu.iu.dsc.tws.comms.table.SimpleAllToAll
-
- close() - Method in class edu.iu.dsc.tws.comms.tcp.TWSTCPChannel
-
- close() - Method in class edu.iu.dsc.tws.comms.ucx.TWSUCXChannel
-
- close() - Method in class edu.iu.dsc.tws.data.api.out.CSVOutputWriter
-
- close() - Method in class edu.iu.dsc.tws.data.api.out.FileOutputWriter
-
- close() - Method in class edu.iu.dsc.tws.data.api.out.TextOutputWriter
-
- close() - Method in interface edu.iu.dsc.tws.data.api.OutputWriter
-
Close the writer, flush everything
- close() - Method in class edu.iu.dsc.tws.data.api.splits.CSVInputSplit
-
Closes the input by releasing all buffers and closing the file input stream.
- close() - Method in class edu.iu.dsc.tws.data.api.splits.DelimitedInputSplit
-
Closes the input by releasing all buffers and closing the file input stream.
- close() - Method in class edu.iu.dsc.tws.data.api.splits.FileInputSplit
-
- close() - Method in class edu.iu.dsc.tws.data.arrow.Twister2ArrowFileWriter
-
- close() - Method in class edu.iu.dsc.tws.data.arrow.Twister2ArrowOutputStream
-
- close() - Method in interface edu.iu.dsc.tws.data.fs.io.InputSplit
-
Method that marks the end of the life-cycle of an input split.
- close() - Method in class edu.iu.dsc.tws.data.fs.local.LocalDataInputStream
-
- close() - Method in class edu.iu.dsc.tws.data.fs.local.LocalDataOutputStream
-
- close() - Method in class edu.iu.dsc.tws.data.hdfs.HadoopDataInputStream
-
- close() - Method in class edu.iu.dsc.tws.data.hdfs.HadoopDataOutputStream
-
- close() - Method in class edu.iu.dsc.tws.data.hdfs.HadoopFileSystem
-
- close(int, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
-
- close(int, String) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
-
Closing the key will make the BufferedMemoryManager to flush the current data into the store
and delete all the key information.
- close(int, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
-
- close(int, String) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
-
- close(int, ByteBuffer) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
-
flush and close the given key.
- close(int, String) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
-
- close(ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
-
- close(String) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
-
- close() - Method in class edu.iu.dsc.tws.dataset.partition.BufferedCollectionPartition
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BAllGatherExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BAllReduceExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BBroadcastExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BDirectExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BDJoinExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BDKeyedGatherExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BGatherExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BJoinExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BJoinStudentExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BKeyedGatherExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BKeyedPartitionExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BKeyedReduceExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BPartitionExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.batch.BReduceExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.BenchWorker
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.KeyedBenchWorker
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.stream.SAllGatherExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.stream.SAllReduceExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.stream.SBroadcastExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.stream.SDirectExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.stream.SGatherExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.stream.SPartitionExample
-
- close() - Method in class edu.iu.dsc.tws.examples.comms.stream.SReduceExample
-
- close() - Method in class edu.iu.dsc.tws.examples.ml.svm.comms.CommsWorker
-
- close() - Method in class edu.iu.dsc.tws.examples.ml.svm.comms.SVMCommsReducer
-
- close() - Method in class edu.iu.dsc.tws.executor.comms.AbstractParallelOperation
-
- close() - Method in class edu.iu.dsc.tws.executor.comms.batch.JoinBatchOperation
-
- close() - Method in class edu.iu.dsc.tws.executor.core.batch.SourceBatchInstance
-
- close() - Method in class edu.iu.dsc.tws.executor.core.batch.TaskBatchInstance
-
- close() - Method in class edu.iu.dsc.tws.executor.core.streaming.SourceStreamingInstance
-
- close() - Method in class edu.iu.dsc.tws.executor.core.streaming.TaskStreamingInstance
-
- close() - Method in class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor2
-
- close() - Method in class edu.iu.dsc.tws.executor.threading.NullExecutor
-
- close() - Method in class edu.iu.dsc.tws.executor.threading.StreamingAllSharingExecutor
-
- close() - Method in class edu.iu.dsc.tws.executor.threading.StreamingAllSharingExecutor2
-
- close() - Method in class edu.iu.dsc.tws.executor.threading.ThreadSharingExecutor
-
- close() - Method in class edu.iu.dsc.tws.master.barrier.ZKBarrierHandler
-
close all local entities.
- close() - Method in class edu.iu.dsc.tws.master.dashclient.DashboardClient
-
- close() - Method in class edu.iu.dsc.tws.master.server.ZKMasterController
-
close all local entities.
- close() - Method in class edu.iu.dsc.tws.master.worker.JMWorkerAgent
-
stop the JMWorkerAgent
- close() - Method in class edu.iu.dsc.tws.python.EntryPoint
-
- close() - Static method in class edu.iu.dsc.tws.rsched.core.WorkerRuntime
-
- close() - Method in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraLauncher
-
Close up any resources
- close() - Method in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraWorkerStarter
-
needs to close down when finished computation
- close() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
-
- close() - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesLauncher
-
Close up any resources
- close() - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.master.JobKillWatcher
-
- close() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.PodWatchUtils
-
- close() - Method in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosLauncher
-
- close() - Method in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosWorkerController
-
needs to close down when finished computation
- close() - Method in class edu.iu.dsc.tws.rsched.schedulers.nomad.NomadController
-
- close() - Method in class edu.iu.dsc.tws.rsched.schedulers.nomad.NomadLauncher
-
- close() - Method in class edu.iu.dsc.tws.rsched.schedulers.standalone.MPIController
-
- close() - Method in class edu.iu.dsc.tws.rsched.schedulers.standalone.MPILauncher
-
- close() - Method in class edu.iu.dsc.tws.rsched.uploaders.hdfs.HdfsUploader
-
- close() - Method in class edu.iu.dsc.tws.rsched.uploaders.k8s.DirectUploader
-
- close() - Method in class edu.iu.dsc.tws.rsched.uploaders.k8s.K8sUploader
-
- close() - Method in class edu.iu.dsc.tws.rsched.uploaders.k8s.UploaderToWebServers
-
- close() - Method in class edu.iu.dsc.tws.rsched.uploaders.localfs.LocalFileSystemUploader
-
- close() - Method in class edu.iu.dsc.tws.rsched.uploaders.NullUploader
-
This is to for disposing or cleaning up any internal state accumulated by
the uploader
- close() - Method in class edu.iu.dsc.tws.rsched.uploaders.s3.S3Uploader
-
- close() - Method in class edu.iu.dsc.tws.rsched.uploaders.scp.ScpUploader
-
- close() - Method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
-
close the tar stream
- close() - Method in class edu.iu.dsc.tws.task.cdfw.CDFWEnv
-
- close() - Method in class edu.iu.dsc.tws.task.ComputeEnvironment
-
Closes the task environment
- close() - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
-
- close() - Method in class edu.iu.dsc.tws.task.window.core.BaseWindowedSink
-
- close() - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
-
Close the environment
- close() - Method in class edu.iu.dsc.tws.tset.fn.FlatMapCompute
-
- close() - Method in class edu.iu.dsc.tws.tset.fn.FlatMapIterCompute
-
- close() - Method in class edu.iu.dsc.tws.tset.fn.ForEachCompute
-
- close() - Method in class edu.iu.dsc.tws.tset.fn.ForEachIterCompute
-
- close() - Method in class edu.iu.dsc.tws.tset.fn.GatherFlatMapCompute
-
- close() - Method in class edu.iu.dsc.tws.tset.fn.GatherForEachCompute
-
- close() - Method in class edu.iu.dsc.tws.tset.fn.GatherMapCompute
-
- close() - Method in class edu.iu.dsc.tws.tset.fn.impl.ArrowBasedSinkFunction
-
- close() - Method in class edu.iu.dsc.tws.tset.fn.MapCompute
-
- close() - Method in class edu.iu.dsc.tws.tset.fn.MapIterCompute
-
- close() - Method in class edu.iu.dsc.tws.tset.fn.ProcessWindowCompute
-
- close() - Method in class edu.iu.dsc.tws.tset.fn.row.RowFlatMapCompute
-
- close() - Method in class edu.iu.dsc.tws.tset.fn.row.RowForEachCompute
-
- close() - Method in class edu.iu.dsc.tws.tset.fn.row.RowMapCompute
-
- close() - Method in class edu.iu.dsc.tws.tset.ops.ComputeCollectorOp
-
- close() - Method in class edu.iu.dsc.tws.tset.ops.ComputeCollectorToTupleOp
-
- close() - Method in class edu.iu.dsc.tws.tset.ops.ComputeOp
-
- close() - Method in class edu.iu.dsc.tws.tset.ops.ComputeToTupleOp
-
- close() - Method in class edu.iu.dsc.tws.tset.ops.row.RowComupteCollectorOp
-
- close() - Method in class edu.iu.dsc.tws.tset.ops.row.RowItrComputeCollectorOp
-
- close() - Method in class edu.iu.dsc.tws.tset.ops.row.RowSinkOp
-
- close() - Method in class edu.iu.dsc.tws.tset.ops.SinkOp
-
- close() - Method in class edu.iu.dsc.tws.tset.ops.SourceOp
-
- close() - Method in class edu.iu.dsc.tws.tset.sinks.BaseDiskPersistIterSink
-
- close() - Method in class edu.iu.dsc.tws.tset.sinks.DiskPersistSingleSink
-
- close() - Method in class edu.iu.dsc.tws.tset.sinks.FileIterSink
-
- close() - Method in class edu.iu.dsc.tws.tset.sinks.FileSink
-
- close() - Method in class edu.iu.dsc.tws.tset.sinks.StreamingDiskPersistSink
-
- close() - Method in class org.apache.beam.runners.twister2.translators.functions.SideInputSinkFunction
-
- close() - Method in class org.apache.beam.runners.twister2.translators.functions.Twister2SinkFunction
-
- close() - Method in interface org.apache.storm.spout.ISpout
-
Called when an ISpout is going to be shutdown.
- close() - Method in class org.apache.storm.topology.base.BaseRichSpout
-
- closeClient() - Static method in class edu.iu.dsc.tws.common.zk.ZKUtils
-
- closeConnection(int) - Method in class edu.iu.dsc.tws.common.net.tcp.TCPChannel
-
- closeExecution() - Method in interface edu.iu.dsc.tws.api.compute.executor.IExecutor
-
Wait for the execution to complete
- closeExecution() - Method in class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor
-
- closeExecution() - Method in class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor2
-
- closeExecution() - Method in class edu.iu.dsc.tws.executor.threading.StreamingAllSharingExecutor
-
- closeExecution() - Method in class edu.iu.dsc.tws.executor.threading.StreamingAllSharingExecutor2
-
- closeExecution() - Method in class edu.iu.dsc.tws.executor.threading.StreamingSharingExecutor
-
- closeWorker() - Static method in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosDockerWorker
-
last method to call to close the worker
- closeWorker() - Static method in class edu.iu.dsc.tws.rsched.schedulers.mesos.mpi.MesosMPIWorkerStarter
-
last method to call to close the worker
- closeWorker() - Method in class edu.iu.dsc.tws.rsched.schedulers.nomad.NomadWorkerStarter
-
last method to call to close the worker
- CLUSTER - Static variable in class edu.iu.dsc.tws.api.config.Context
-
- Cluster - Class in edu.iu.dsc.tws.dashboard.data_models
-
- Cluster() - Constructor for class edu.iu.dsc.tws.dashboard.data_models.Cluster
-
- CLUSTER_CONF - Static variable in class edu.iu.dsc.tws.api.config.Context
-
- CLUSTER_HOME - Static variable in class edu.iu.dsc.tws.api.config.Context
-
- CLUSTER_TYPE - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- ClusterController - Class in edu.iu.dsc.tws.dashboard.controllers
-
- ClusterController(ClusterService, NodeService) - Constructor for class edu.iu.dsc.tws.dashboard.controllers.ClusterController
-
- ClusterRepository - Interface in edu.iu.dsc.tws.dashboard.repositories
-
- ClusterService - Class in edu.iu.dsc.tws.dashboard.services
-
- ClusterService() - Constructor for class edu.iu.dsc.tws.dashboard.services.ClusterService
-
- clusterType(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
-
- collect(String, IMessage) - Method in interface edu.iu.dsc.tws.api.compute.OutputCollection
-
Collects a message on the given edge
- collect(T) - Method in interface edu.iu.dsc.tws.api.tset.fn.RecordCollector
-
Collects the record
- collect(String, IMessage) - Method in class edu.iu.dsc.tws.executor.core.DefaultOutputCollection
-
- collectData(Config, ExecutionPlan, Map<String, DataObject>) - Static method in class edu.iu.dsc.tws.task.impl.TaskExecutor
-
This method collects all the output from the provided
ExecutionPlan.
- CollectionPartition<T> - Class in edu.iu.dsc.tws.dataset.partition
-
- CollectionPartition(int) - Constructor for class edu.iu.dsc.tws.dataset.partition.CollectionPartition
-
- CollectionPartition() - Constructor for class edu.iu.dsc.tws.dataset.partition.CollectionPartition
-
- CollectionSource<T> - Class in edu.iu.dsc.tws.tset.sources
-
- CollectionSource(Collection<T>) - Constructor for class edu.iu.dsc.tws.tset.sources.CollectionSource
-
- collectiveEvents - Variable in class edu.iu.dsc.tws.task.window.core.BaseWindowedSink
-
- collectiveOutput - Variable in class edu.iu.dsc.tws.task.window.core.BaseWindowedSink
-
- Collector - Interface in edu.iu.dsc.tws.api.compute.modifiers
-
Special task for collecting the output from tasks
- COLUMN_AVERAGE_TIME - Static variable in class edu.iu.dsc.tws.examples.utils.bench.BenchmarkConstants
-
- COLUMN_TOTAL_TIME - Static variable in class edu.iu.dsc.tws.examples.utils.bench.BenchmarkConstants
-
- com.twitter.bazel.checkstyle - package com.twitter.bazel.checkstyle
-
- combineLabelAndData(double[], double) - Static method in class edu.iu.dsc.tws.examples.ml.svm.util.DataUtils
-
This method combines the label and features in the data point
This can be use to submit a single message in the stream
- commandAsAString(String[]) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.mpi.MPIMasterStarter
-
- commentPrefix - Variable in class edu.iu.dsc.tws.data.fs.local.LocalCSVReader
-
- commit(int, int) - Method in interface edu.iu.dsc.tws.api.comms.DestinationSelector
-
Say that we have used the obtained destination
- commit(int, int) - Method in interface edu.iu.dsc.tws.api.compute.TaskPartitioner
-
Indicate that we are using this partition
- commit(int, int) - Method in interface edu.iu.dsc.tws.api.tset.fn.PartitionFunc
-
Commit the partition
- commit(int, int) - Method in class edu.iu.dsc.tws.comms.selectors.HashingSelector
-
- commit(int, int) - Method in class edu.iu.dsc.tws.comms.selectors.LoadBalanceSelector
-
- commit(int, int) - Method in class edu.iu.dsc.tws.comms.selectors.SimpleKeyBasedSelector
-
- commit(int, int) - Method in class edu.iu.dsc.tws.examples.batch.sortop.ByteSelector
-
- commit(int, int) - Method in class edu.iu.dsc.tws.examples.batch.terasort.TaskPartitionerForRandom
-
- commit(int, int) - Method in class edu.iu.dsc.tws.examples.utils.partitioners.DeterministicTaskPartitioner
-
- commit(int, int) - Method in class edu.iu.dsc.tws.executor.comms.DefaultDestinationSelector
-
- commit() - Method in class edu.iu.dsc.tws.tset.env.BatchChkPntEnvironment
-
Commits the snapshot
- commit(int, int) - Method in class edu.iu.dsc.tws.tset.fn.HashingPartitioner
-
- commit(int, int) - Method in class edu.iu.dsc.tws.tset.fn.LoadBalancePartitioner
-
- commit(int, int) - Method in class edu.iu.dsc.tws.tset.fn.OneToOnePartitioner
-
- commit() - Method in class org.apache.storm.state.InMemoryKeyValueState
-
- commit(long) - Method in class org.apache.storm.state.InMemoryKeyValueState
-
- commit(long) - Method in interface org.apache.storm.state.State
-
Commit a previously prepared transaction.
- commit() - Method in interface org.apache.storm.state.State
-
Persist the current state.
- commitArrowData() - Method in interface edu.iu.dsc.tws.data.arrow.ITwister2ArrowFileWriter
-
- commitArrowData() - Method in class edu.iu.dsc.tws.data.arrow.Twister2ArrowFileWriter
-
- commitSnapshot() - Method in class edu.iu.dsc.tws.checkpointing.worker.CheckpointingWorkerEnv
-
- commitState(StateStore, String, int, SnapshotImpl, CheckpointingClient, MessageHandler) - Static method in class edu.iu.dsc.tws.checkpointing.util.CheckpointUtils
-
- commonConfDir(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
-
- CommonThreadPool - Class in edu.iu.dsc.tws.api.util
-
- COMMS_RUNNER - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
-
- commsType - Variable in class edu.iu.dsc.tws.examples.ml.svm.comms.CommsWorker
-
- CommsWorker - Class in edu.iu.dsc.tws.examples.ml.svm.comms
-
- CommsWorker() - Constructor for class edu.iu.dsc.tws.examples.ml.svm.comms.CommsWorker
-
- CommsWorker.DataStreamer - Class in edu.iu.dsc.tws.examples.ml.svm.comms
-
- CommunicationContext - Class in edu.iu.dsc.tws.api.comms
-
- CommunicationContext() - Constructor for class edu.iu.dsc.tws.api.comms.CommunicationContext
-
- CommunicationContext.JoinAlgorithm - Enum in edu.iu.dsc.tws.api.comms
-
- CommunicationContext.JoinType - Enum in edu.iu.dsc.tws.api.comms
-
- CommunicationWorker(BlockingQueue<INodeInstance>) - Constructor for class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor.CommunicationWorker
-
- CommunicationWorker(BlockingQueue<INodeInstance>) - Constructor for class edu.iu.dsc.tws.executor.threading.BatchSharingExecutor2.CommunicationWorker
-
- CommunicationWorker(BlockingQueue<INodeInstance>) - Constructor for class edu.iu.dsc.tws.executor.threading.StreamingAllSharingExecutor.CommunicationWorker
-
- CommunicationWorker(BlockingQueue<INodeInstance>) - Constructor for class edu.iu.dsc.tws.executor.threading.StreamingAllSharingExecutor2.CommunicationWorker
-
- Communicator - Class in edu.iu.dsc.tws.api.comms
-
Communicator that keeps the information about.
- Communicator(Config, TWSChannel) - Constructor for class edu.iu.dsc.tws.api.comms.Communicator
-
- Communicator(Config, TWSChannel, List<String>) - Constructor for class edu.iu.dsc.tws.api.comms.Communicator
-
- Communicator(Config, TWSChannel, String) - Constructor for class edu.iu.dsc.tws.api.comms.Communicator
-
- Communicator(Config, TWSChannel, EdgeGenerator, TaskIdGenerator, List<String>) - Constructor for class edu.iu.dsc.tws.api.comms.Communicator
-
- communicator - Variable in class edu.iu.dsc.tws.task.impl.cdfw.CDFWWorker
-
Communicator
- compactWindow() - Method in class edu.iu.dsc.tws.task.window.manage.WindowManager
-
- compactWindow() - Method in class org.apache.storm.windowing.StatefulWindowManager
-
- compactWindow() - Method in class org.apache.storm.windowing.WindowManager
-
expires events that fall out of the window every EXPIRE_EVENTS_THRESHOLD so that the window does not grow too big.
- comparator() - Method in class edu.iu.dsc.tws.python.tset.fn.TSetFunctions
-
- ComparatorFunctions - Class in edu.iu.dsc.tws.python.tset.fn
-
- ComparatorFunctions() - Constructor for class edu.iu.dsc.tws.python.tset.fn.ComparatorFunctions
-
- ComparatorFunctions.ComparatorImpl - Class in edu.iu.dsc.tws.python.tset.fn
-
- compare(String, String) - Method in class edu.iu.dsc.tws.api.compute.graph.ComputeGraph.StringComparator
-
- compare(Tuple, Tuple) - Method in class edu.iu.dsc.tws.comms.utils.KeyComparatorWrapper
-
- compare(byte[], byte[]) - Method in class edu.iu.dsc.tws.examples.batch.terasort.TeraSort.ByteArrayComparator
-
- compare(byte[], byte[]) - Method in class edu.iu.dsc.tws.examples.tset.tutorial.terasort.TSetTeraSort.ByteArrayComparator
-
- compare(int[], int[]) - Method in class edu.iu.dsc.tws.examples.verification.comparators.IntArrayComparator
-
- compare(Integer, Integer) - Method in class edu.iu.dsc.tws.examples.verification.comparators.IntComparator
-
- compare(Iterator<int[]>, Iterator<int[]>) - Method in class edu.iu.dsc.tws.examples.verification.comparators.IntIteratorComparator
-
- compare(Iterator<V>, Iterator<V>) - Method in class edu.iu.dsc.tws.examples.verification.comparators.IteratorComparator
-
- compare(List<int[]>, List<int[]>) - Method in class edu.iu.dsc.tws.examples.verification.comparators.ListOfIntArraysComparator
-
- compare(Tuple<K, V>, Tuple<K, V>) - Method in class edu.iu.dsc.tws.examples.verification.comparators.TupleComparator
-
- compare(D, D) - Method in interface edu.iu.dsc.tws.examples.verification.ResultsComparator
-
- compare(Object, Object) - Method in class edu.iu.dsc.tws.python.tset.fn.ComparatorFunctions.ComparatorImpl
-
- compareTo(TaskInstancePlan) - Method in class edu.iu.dsc.tws.api.compute.schedule.elements.TaskInstancePlan
-
- compareTo(WorkerSchedulePlan) - Method in class edu.iu.dsc.tws.api.compute.schedule.elements.WorkerSchedulePlan
-
- compareTo(ControlledReader) - Method in class edu.iu.dsc.tws.comms.shuffle.ControlledFileReader
-
- compareTo(ControlledReader<Tuple>) - Method in class edu.iu.dsc.tws.comms.shuffle.ControlledMemoryReader
-
- compareTo(HeapNode<K, V>) - Method in class edu.iu.dsc.tws.comms.utils.HeapNode
-
- compareTo(BlockLocation) - Method in class edu.iu.dsc.tws.data.fs.local.LocalBlockLocation
-
- compareTo(BlockLocation) - Method in class edu.iu.dsc.tws.data.hdfs.HadoopBlockLocation
-
- compareTo(DataTransferTimeCalculator) - Method in class edu.iu.dsc.tws.tsched.utils.DataTransferTimeCalculator
-
- compareTo(RequiredRam) - Method in class edu.iu.dsc.tws.tsched.utils.RequiredRam
-
- complete - Variable in class edu.iu.dsc.tws.api.comms.messaging.ChannelMessage
-
Keep whether we have all the buffers added
- complete() - Method in interface edu.iu.dsc.tws.api.scheduler.IUploader
-
if uploader is threaded,
this method will wait for the threaded uploading to finish
- complete - Variable in class edu.iu.dsc.tws.comms.dfw.InMessage
-
Keep whether we have all the buffers added
- complete() - Method in class edu.iu.dsc.tws.rsched.uploaders.k8s.DirectUploader
-
DirectUploader should run until the job completes
it should upload the job package in case of failures and job scaling up new workers
- complete() - Method in class edu.iu.dsc.tws.rsched.uploaders.k8s.K8sUploader
-
- complete() - Method in class edu.iu.dsc.tws.rsched.uploaders.k8s.UploaderToWebServers
-
- complete() - Method in class edu.iu.dsc.tws.rsched.uploaders.s3.S3Uploader
-
- CompleteArrowInputPartitioner<OT> - Class in edu.iu.dsc.tws.data.api.formatters
-
- CompleteArrowInputPartitioner(Path, Config) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CompleteArrowInputPartitioner
-
- CompleteArrowInputPartitioner(Path, Config, int) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CompleteArrowInputPartitioner
-
- CompleteCSVInputPartitioner<OT> - Class in edu.iu.dsc.tws.data.api.formatters
-
- CompleteCSVInputPartitioner(Path, Config) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CompleteCSVInputPartitioner
-
- CompleteCSVInputPartitioner(Path, Config, int) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CompleteCSVInputPartitioner
-
- completed(int) - Method in interface edu.iu.dsc.tws.api.resource.IWorkerStatusListener
-
- completed() - Method in class edu.iu.dsc.tws.common.zk.WorkerWithState
-
if the worker state is COMPLETED
- completed(int) - Method in class edu.iu.dsc.tws.master.server.WorkerMonitor
-
called when a worker COMPLETED the job
- CompleteFileInputPartitioner<OT> - Class in edu.iu.dsc.tws.data.api.formatters
-
Base class for File input formats for specific file types the methods
- CompleteFileInputPartitioner(Path) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CompleteFileInputPartitioner
-
- CompleteFileInputPartitioner(Path, Config) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CompleteFileInputPartitioner
-
- ComponentConfigurationDeclarer<T extends ComponentConfigurationDeclarer> - Interface in org.apache.storm.topology
-
- computation() - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation
-
- computation() - Method in class edu.iu.dsc.tws.graphapi.impl.TestForPagerank
-
- computation() - Method in class edu.iu.dsc.tws.graphapi.impl.TestForSSSP
-
- compute(I, RecordCollector<O>) - Method in interface edu.iu.dsc.tws.api.tset.fn.ComputeCollectorFunc
-
- compute(I) - Method in interface edu.iu.dsc.tws.api.tset.fn.ComputeFunc
-
- compute(ComputeCollectorFunc<Row, Iterator<Row>>) - Method in interface edu.iu.dsc.tws.api.tset.link.batch.BatchRowTLink
-
- compute(ComputeFunc<O, T1>) - Method in interface edu.iu.dsc.tws.api.tset.link.batch.BatchTLink
-
- compute(ComputeCollectorFunc<O, T1>) - Method in interface edu.iu.dsc.tws.api.tset.link.batch.BatchTLink
-
- compute(ComputeFunc<O, T1>) - Method in interface edu.iu.dsc.tws.api.tset.link.streaming.StreamingTLink
-
- compute(ComputeCollectorFunc<O, T1>) - Method in interface edu.iu.dsc.tws.api.tset.link.streaming.StreamingTLink
-
- compute(ComputeFunc<O, T1>) - Method in interface edu.iu.dsc.tws.api.tset.link.TLink
-
- compute(ComputeCollectorFunc<O, T1>) - Method in interface edu.iu.dsc.tws.api.tset.link.TLink
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BAllGatherExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BAllReduceExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BBroadcastExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BDirectExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BDJoinExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BDKeyedGatherExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BGatherExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BJoinExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BJoinStudentExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BKeyedGatherExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BKeyedPartitionExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BKeyedReduceExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BPartitionExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.batch.BReduceExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.BenchWorker
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.KeyedBenchWorker
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SAllGatherExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SAllReduceExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SBroadcastExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SDirectExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SGatherExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SKeyedGatherExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SKeyedPartitionExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SKeyedReduceExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SPartitionExample
-
- compute(WorkerEnvironment) - Method in class edu.iu.dsc.tws.examples.comms.stream.SReduceExample
-
- compute() - Method in class edu.iu.dsc.tws.examples.ml.svm.streamer.IterativeDataStream
-
- compute() - Method in class edu.iu.dsc.tws.examples.ml.svm.streamer.IterativePredictionDataStreamer
-
- compute(Object) - Method in class edu.iu.dsc.tws.python.tset.fn.ComputeFunctions.ComputeFuncImpl
-
- compute(Object, RecordCollector) - Method in class edu.iu.dsc.tws.python.tset.fn.ComputeWithCollectorFunctions.ComputeFuncImpl
-
- compute() - Method in class edu.iu.dsc.tws.python.tset.fn.TSetFunctions
-
- compute(I, RecordCollector<O>) - Method in class edu.iu.dsc.tws.tset.fn.FlatMapCompute
-
- compute(Iterator<I>, RecordCollector<O>) - Method in class edu.iu.dsc.tws.tset.fn.FlatMapIterCompute
-
- compute(T) - Method in class edu.iu.dsc.tws.tset.fn.ForEachCompute
-
- compute(Iterator<T>) - Method in class edu.iu.dsc.tws.tset.fn.ForEachIterCompute
-
- compute(Iterator<Tuple<Integer, I>>, RecordCollector<O>) - Method in class edu.iu.dsc.tws.tset.fn.GatherFlatMapCompute
-
- compute(Iterator<Tuple<Integer, T>>) - Method in class edu.iu.dsc.tws.tset.fn.GatherForEachCompute
-
- compute(Iterator<Tuple<Integer, I>>, RecordCollector<O>) - Method in class edu.iu.dsc.tws.tset.fn.GatherMapCompute
-
- compute(I) - Method in class edu.iu.dsc.tws.tset.fn.MapCompute
-
- compute(Iterator<I>, RecordCollector<O>) - Method in class edu.iu.dsc.tws.tset.fn.MapIterCompute
-
- compute(Iterator<I>) - Method in class edu.iu.dsc.tws.tset.fn.ProcessWindowCompute
-
- compute(Iterator<Row>, RecordCollector<Row>) - Method in class edu.iu.dsc.tws.tset.fn.row.RowFlatMapCompute
-
- compute(Iterator<Row>, RecordCollector<Row>) - Method in class edu.iu.dsc.tws.tset.fn.row.RowForEachCompute
-
- compute(Iterator<Row>, RecordCollector<Row>) - Method in class edu.iu.dsc.tws.tset.fn.row.RowMapCompute
-
- compute(String, ComputeFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl
-
- compute(String, ComputeCollectorFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl
-
- compute(ComputeFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl
-
- compute(ComputeCollectorFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.batch.BatchTLinkImpl
-
- compute(String, ComputeCollectorFunc<Row, Iterator<Row>>) - Method in class edu.iu.dsc.tws.tset.links.batch.row.RowBatchTLinkImpl
-
- compute(ComputeCollectorFunc<Row, Iterator<Row>>) - Method in class edu.iu.dsc.tws.tset.links.batch.row.RowBatchTLinkImpl
-
- compute(String, ComputeCollectorFunc<Row, Iterator<Row>>) - Method in class edu.iu.dsc.tws.tset.links.batch.row.RowPartitionTLink
-
- compute(String, ComputeFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.streaming.StreamingTLinkImpl
-
- compute(String, ComputeCollectorFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.streaming.StreamingTLinkImpl
-
- compute(ComputeFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.streaming.StreamingTLinkImpl
-
- compute(ComputeCollectorFunc<P, T1>) - Method in class edu.iu.dsc.tws.tset.links.streaming.StreamingTLinkImpl
-
- compute(Iterator<<any>>, RecordCollector<<any>>) - Method in class org.apache.beam.runners.twister2.translators.functions.AssignWindowsFunction
-
- compute(Iterator<<any>>, RecordCollector<RawUnionValue>) - Method in class org.apache.beam.runners.twister2.translators.functions.DoFnFunction
-
- compute(Iterator<RawUnionValue>, RecordCollector<<any>>) - Method in class org.apache.beam.runners.twister2.translators.functions.OutputTagFilter
-
- ComputeCollectExample - Class in edu.iu.dsc.tws.examples.tset.batch
-
- ComputeCollectExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.ComputeCollectExample
-
- computeCollector() - Method in class edu.iu.dsc.tws.python.tset.fn.TSetFunctions
-
- ComputeCollectorFunc<O,I> - Interface in edu.iu.dsc.tws.api.tset.fn
-
Computes an output of type O based on an input of type I and the output would be passed on to
a
RecordCollector object.
- ComputeCollectorOp<O,I> - Class in edu.iu.dsc.tws.tset.ops
-
Performs the compute function on the value received for the imessage and write it to edges
- ComputeCollectorOp() - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeCollectorOp
-
- ComputeCollectorOp(ComputeCollectorFunc<O, I>, BaseTSet, Map<String, String>) - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeCollectorOp
-
- ComputeCollectorToTupleOp<K,O,I> - Class in edu.iu.dsc.tws.tset.ops
-
- ComputeCollectorToTupleOp() - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeCollectorToTupleOp
-
- ComputeCollectorToTupleOp(ComputeCollectorFunc<Tuple<K, O>, I>, BaseTSet, Map<String, String>) - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeCollectorToTupleOp
-
- computeConnection - Variable in class edu.iu.dsc.tws.examples.task.BenchTaskWorker
-
- computeConnection - Variable in class edu.iu.dsc.tws.examples.task.BenchWindowTaskWorker
-
- ComputeConnection - Class in edu.iu.dsc.tws.task.impl
-
Represents a compute connection.
- computeConnection - Variable in class edu.iu.dsc.tws.task.impl.ops.AbstractOpsConfig
-
- ComputeConnectionUtils - Class in edu.iu.dsc.tws.task.impl
-
- ComputeEnvironment - Class in edu.iu.dsc.tws.task
-
Task environment.
- computeEnvironment - Variable in class edu.iu.dsc.tws.task.impl.TaskWorker
-
- ComputeExample - Class in edu.iu.dsc.tws.examples.tset.batch
-
- ComputeExample() - Constructor for class edu.iu.dsc.tws.examples.tset.batch.ComputeExample
-
- computeFold() - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowEventTimeExample.FoldFunctionImpl
-
- computeFold() - Method in class edu.iu.dsc.tws.examples.task.streaming.windowing.STWindowExample.FoldFunctionImpl
-
- computeFold() - Method in interface edu.iu.dsc.tws.task.window.function.FoldWindowedFunction
-
- ComputeFunc<O,I> - Interface in edu.iu.dsc.tws.api.tset.fn
-
Computes an output of type O based on an input of type I
- ComputeFunctions - Class in edu.iu.dsc.tws.python.tset.fn
-
- ComputeFunctions() - Constructor for class edu.iu.dsc.tws.python.tset.fn.ComputeFunctions
-
- ComputeFunctions.ComputeFuncImpl - Class in edu.iu.dsc.tws.python.tset.fn
-
- ComputeGraph - Class in edu.iu.dsc.tws.api.compute.graph
-
This class extends the base data flow task graph which is mainly responsible for building the
task graph for the task vertex and the task edge.
- ComputeGraph() - Constructor for class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
-
- ComputeGraph(OperationMode) - Constructor for class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
-
- ComputeGraph(OperationMode, String) - Constructor for class edu.iu.dsc.tws.api.compute.graph.ComputeGraph
-
- computeGraph - Variable in class edu.iu.dsc.tws.examples.task.BenchTaskWorker
-
- computeGraph - Variable in class edu.iu.dsc.tws.examples.task.BenchWindowTaskWorker
-
- ComputeGraph.StringComparator - Class in edu.iu.dsc.tws.api.compute.graph
-
- computeGraphBuilder - Variable in class edu.iu.dsc.tws.examples.task.BenchTaskWorker
-
- computeGraphBuilder - Variable in class edu.iu.dsc.tws.examples.task.BenchWindowTaskWorker
-
- ComputeGraphBuilder - Class in edu.iu.dsc.tws.task.impl
-
This is the entry point for creating a task graph by the user.
- ComputeOp<O,I> - Class in edu.iu.dsc.tws.tset.ops
-
Performs the compute function on the value received for the imessage and write it to edges
- ComputeOp() - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeOp
-
- ComputeOp(ComputeFunc<O, I>, BaseTSet, Map<String, String>) - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeOp
-
- ComputeResource - Class in edu.iu.dsc.tws.dashboard.data_models
-
- ComputeResource() - Constructor for class edu.iu.dsc.tws.dashboard.data_models.ComputeResource
-
- ComputeResource - Class in edu.iu.dsc.tws.master.dashclient.models
-
The ComputeResource to send with json to Dashboard from JobMaster
- ComputeResource() - Constructor for class edu.iu.dsc.tws.master.dashclient.models.ComputeResource
-
- ComputeResource(JobAPI.ComputeResource) - Constructor for class edu.iu.dsc.tws.master.dashclient.models.ComputeResource
-
- ComputeResource - Class in edu.iu.dsc.tws.python.config
-
- ComputeResource(double, int, int) - Constructor for class edu.iu.dsc.tws.python.config.ComputeResource
-
- ComputeResourceId - Class in edu.iu.dsc.tws.dashboard.data_models.composite_ids
-
- ComputeResourceId() - Constructor for class edu.iu.dsc.tws.dashboard.data_models.composite_ids.ComputeResourceId
-
- ComputeResourceRepository - Interface in edu.iu.dsc.tws.dashboard.repositories
-
- ComputeResourceService - Class in edu.iu.dsc.tws.dashboard.services
-
- ComputeResourceService() - Constructor for class edu.iu.dsc.tws.dashboard.services.ComputeResourceService
-
- computeResourcesToPrint(JobAPI.Job) - Static method in class edu.iu.dsc.tws.rsched.utils.JobUtils
-
- ComputeResourceUtils - Class in edu.iu.dsc.tws.proto.utils
-
- ComputeTask() - Constructor for class edu.iu.dsc.tws.examples.checkpointing.CheckpointingTaskExample.ComputeTask
-
- ComputeTask() - Constructor for class edu.iu.dsc.tws.graphapi.api.BasicComputation.ComputeTask
-
- ComputeToTupleOp<K,O,I> - Class in edu.iu.dsc.tws.tset.ops
-
- ComputeToTupleOp() - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeToTupleOp
-
- ComputeToTupleOp(ComputeFunc<Tuple<K, O>, I>, BaseTSet, Map<String, String>) - Constructor for class edu.iu.dsc.tws.tset.ops.ComputeToTupleOp
-
- ComputeTSet<O,I> - Class in edu.iu.dsc.tws.tset.sets.batch
-
- ComputeTSet() - Constructor for class edu.iu.dsc.tws.tset.sets.batch.ComputeTSet
-
- ComputeTSet(BatchEnvironment, ComputeFunc<O, I>, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.batch.ComputeTSet
-
- ComputeTSet(BatchEnvironment, ComputeCollectorFunc<O, I>, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.batch.ComputeTSet
-
- ComputeTSet(BatchEnvironment, String, ComputeFunc<O, I>, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.batch.ComputeTSet
-
- ComputeTSet(BatchEnvironment, String, ComputeCollectorFunc<O, I>, int, Schema) - Constructor for class edu.iu.dsc.tws.tset.sets.batch.ComputeTSet
-
- ComputeWithCollectorFunctions - Class in edu.iu.dsc.tws.python.tset.fn
-
- ComputeWithCollectorFunctions() - Constructor for class edu.iu.dsc.tws.python.tset.fn.ComputeWithCollectorFunctions
-
- ComputeWithCollectorFunctions.ComputeFuncImpl - Class in edu.iu.dsc.tws.python.tset.fn
-
- conf(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
-
- config - Variable in class edu.iu.dsc.tws.api.compute.nodes.BaseNode
-
- Config - Class in edu.iu.dsc.tws.api.config
-
Config is an Immutable Map of <String, Object> The get/set API that uses Key objects
should be favored over Strings.
- Config(Config.Builder) - Constructor for class edu.iu.dsc.tws.api.config.Config
-
- config - Variable in class edu.iu.dsc.tws.data.api.formatters.CompleteArrowInputPartitioner
-
Config file required for Hdfs connection
- config - Variable in class edu.iu.dsc.tws.data.api.formatters.CompleteCSVInputPartitioner
-
Config file required for Hdfs connection
- config - Variable in class edu.iu.dsc.tws.data.api.formatters.CompleteFileInputPartitioner
-
Config file required for Hdfs connection
- config - Variable in class edu.iu.dsc.tws.data.api.formatters.CSVInputPartitioner
-
- config - Variable in class edu.iu.dsc.tws.data.api.formatters.FileInputPartitioner
-
- config - Variable in class edu.iu.dsc.tws.data.api.formatters.FixedInputPartitioner
-
- config - Variable in class edu.iu.dsc.tws.executor.comms.AbstractParallelOperation
-
- config - Variable in class edu.iu.dsc.tws.executor.core.streaming.TaskStreamingInstance
-
The configuration
- config - Variable in class edu.iu.dsc.tws.executor.threading.ThreadSharingExecutor
-
The configuration
- config - Variable in class edu.iu.dsc.tws.master.server.ZKMasterController
-
- config - Variable in class edu.iu.dsc.tws.rsched.schedulers.standalone.MPICommand
-
- config - Variable in class edu.iu.dsc.tws.task.impl.cdfw.CDFWWorker
-
Configuration
- config - Variable in class edu.iu.dsc.tws.task.impl.TaskWorker
-
Configuration
- Config - Class in org.apache.storm
-
Topology configs are specified as a plain old map.
- Config() - Constructor for class org.apache.storm.Config
-
- Config.Builder - Class in edu.iu.dsc.tws.api.config
-
- CONFIG_DIR - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- CONFIG_FILE - Static variable in class edu.iu.dsc.tws.data.utils.DataObjectConstants
-
- CONFIG_USE_SORT_JOIN_CACHE - Static variable in class edu.iu.dsc.tws.comms.utils.SortJoinUtils
-
- CONFIG_WAIT_TIME - Static variable in class edu.iu.dsc.tws.checkpointing.client.CheckpointingClientImpl
-
- ConfigEntry - Class in edu.iu.dsc.tws.api.config
-
- ConfigEntry(String, String, ConfigEntry.Type, String) - Constructor for class edu.iu.dsc.tws.api.config.ConfigEntry
-
- ConfigEntry(String) - Constructor for class edu.iu.dsc.tws.api.config.ConfigEntry
-
- ConfigEntry(String, ConfigEntry.Type) - Constructor for class edu.iu.dsc.tws.api.config.ConfigEntry
-
- ConfigEntry(String, String) - Constructor for class edu.iu.dsc.tws.api.config.ConfigEntry
-
- ConfigEntry(String, String, String) - Constructor for class edu.iu.dsc.tws.api.config.ConfigEntry
-
- ConfigEntry.Type - Enum in edu.iu.dsc.tws.api.config
-
- ConfigLoader - Class in edu.iu.dsc.tws.common.config
-
- ConfigReader - Class in edu.iu.dsc.tws.common.config
-
Loads config file in Yaml file format.
- ConfigSerializer - Class in edu.iu.dsc.tws.common.config
-
- configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner
-
- configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteArrowInputPartitioner
-
- configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteCSVInputPartitioner
-
- configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteFileInputPartitioner
-
- configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.CSVInputPartitioner
-
- configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.FileInputPartitioner
-
- configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.FixedInputPartitioner
-
- configure(Config) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalCompleteArrowInputPartitioner
-
- configure(Config) - Method in interface edu.iu.dsc.tws.data.api.InputPartitioner
-
Configures this input format.
- configure(Config) - Method in class edu.iu.dsc.tws.data.api.out.FileOutputWriter
-
- configure(Config) - Method in interface edu.iu.dsc.tws.data.api.OutputWriter
-
Configure the output writer
- configure(Config) - Method in class edu.iu.dsc.tws.data.api.splits.BinaryInputSplit
-
Configures this input format by reading the path to the file from the configuration and setting
the record length
- configure(Config) - Method in class edu.iu.dsc.tws.data.api.splits.CSVInputSplit
-
Configures this input format by reading the path to the file from the
configuration and the string that
defines the record delimiter.
- configure(Config) - Method in class edu.iu.dsc.tws.data.api.splits.DelimitedInputSplit
-
Configures this input format by reading the path to the file from the
configuration and the string that
defines the record delimiter.
- configure(Config) - Method in class edu.iu.dsc.tws.data.api.splits.FileInputSplit
-
- configure(Config) - Method in class edu.iu.dsc.tws.data.api.splits.GenericCSVInputSplit
-
- configure(Config) - Method in class edu.iu.dsc.tws.data.api.splits.TextInputSplit
-
- configure(Config) - Method in interface edu.iu.dsc.tws.data.fs.io.InputSplit
-
Configure the split with parameters
- configureInterpreter(JepConfig) - Method in class edu.iu.dsc.tws.python.processors.TSharedInterpreter
-
- connect() - Method in class edu.iu.dsc.tws.common.net.tcp.Client
-
- connect() - Method in class edu.iu.dsc.tws.common.net.tcp.request.RRClient
-
- connect() - Static method in class edu.iu.dsc.tws.deeplearning.pytorch.PytorchSampleJob
-
- connect(String, String, String, String) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
-
- connect(String, String, String, String, IFunction) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
-
- connect(String, String, String, String, MessageType, MessageType) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
-
- connect(String, String, String, String, IFunction, MessageType, MessageType) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
-
- connect(String, String, String, String, IFunction, MessageType, MessageType, TaskPartitioner) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
-
- connect(String, String, String, String, MessageType) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
-
- connect(String, String, Edge) - Method in class edu.iu.dsc.tws.task.graph.GraphBuilder
-
- connect() - Method in class edu.iu.dsc.tws.task.impl.ops.AbstractOpsConfig
-
- connect() - Method in class edu.iu.dsc.tws.task.impl.ops.JoinConfig
-
- connectedChannels - Variable in class edu.iu.dsc.tws.common.net.tcp.request.RRServer
-
We keep track of connected channels here to make sure we close them
- connectedChildTask(TV, TE) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
-
This method is used to calculate the connected child tasks between the task vertex(t) and the
task edge (TE)
- connectEdge(ComputeConnection, String, Edge) - Static method in class edu.iu.dsc.tws.task.impl.ComputeConnectionUtils
-
- connectedParentTask(TV, TE) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
-
This method returns the connected parent tasks between the task vertex(t) and the task edge(TE)
- ConnectedSink - Class in edu.iu.dsc.tws.task.cdfw.task
-
- ConnectedSink() - Constructor for class edu.iu.dsc.tws.task.cdfw.task.ConnectedSink
-
- ConnectedSink(String) - Constructor for class edu.iu.dsc.tws.task.cdfw.task.ConnectedSink
-
- ConnectedSource - Class in edu.iu.dsc.tws.task.cdfw.task
-
Connected source for the connected dataflow example
- ConnectedSource() - Constructor for class edu.iu.dsc.tws.task.cdfw.task.ConnectedSource
-
- ConnectedSource(String) - Constructor for class edu.iu.dsc.tws.task.cdfw.task.ConnectedSource
-
- ConnectedSource(String, String) - Constructor for class edu.iu.dsc.tws.task.cdfw.task.ConnectedSource
-
- ConnectHandler - Interface in edu.iu.dsc.tws.api.net.request
-
Handle a connection
- connectHandler - Variable in class edu.iu.dsc.tws.common.net.tcp.request.RRServer
-
Connection handler
- connectToServer(String) - Static method in class edu.iu.dsc.tws.common.zk.ZKUtils
-
connect to ZooKeeper server
- connectToServer(String, int) - Static method in class edu.iu.dsc.tws.common.zk.ZKUtils
-
connect to ZooKeeper server
- connectTSets(TBase, TBase) - Method in class edu.iu.dsc.tws.tset.TBaseGraph
-
connect two tsets
- Constants - Class in edu.iu.dsc.tws.examples.comms
-
- Constants - Class in edu.iu.dsc.tws.examples.ml.svm.constant
-
- Constants.SimpleGraphConfig - Class in edu.iu.dsc.tws.examples.ml.svm.constant
-
- ConstraintTaskExample - Class in edu.iu.dsc.tws.examples.internal.batchscheduler
-
- ConstraintTaskExample() - Constructor for class edu.iu.dsc.tws.examples.internal.batchscheduler.ConstraintTaskExample
-
- constructAffinity(V1PodSpec) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
-
- constructContainer() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.master.JobMasterRequestObject
-
construct a container
- constructContainer(ComputeResource, int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
-
construct a container
- constructDataStr(HashMap<String, VertexStatus>, IMessage) - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation.GraphInitialization
-
- constructDataStr(IMessage) - Method in class edu.iu.dsc.tws.graphapi.api.BasicComputation.GraphPartiton
-
- ConstructDataStr - Class in edu.iu.dsc.tws.graphapi.api
-
- ConstructDataStr(String, int, int) - Constructor for class edu.iu.dsc.tws.graphapi.api.ConstructDataStr
-
- constructEnvironmentVariables(int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.master.JobMasterRequestObject
-
set environment variables for containers
- constructEnvironmentVariables(String, int, int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
-
set environment variables for containers
- constructEnvVariables(Config, JobAPI.Job) - Static method in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraLauncher
-
put relevant config parameters to a HashMap to be used as environment variables
when submitting jobs
- constructEventPath(String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKEventsManager
-
construct the next event path
increase the eventCounter by one
- constructJobMasterPath(Config, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKJobMasterRegistrar
-
construct job master path
- constructPodTemplate() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.master.JobMasterRequestObject
-
construct pod template
- constructPodTemplate(ComputeResource) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
-
construct pod template
- ConsumerBolt() - Constructor for class edu.iu.dsc.tws.examples.compatibility.storm.WordCountTopology.ConsumerBolt
-
- Container - Class in edu.iu.dsc.tws.tsched.builder
-
This class is for the logical representation of container and it has getter and setter
property to retrieve and set the task instances allocated to the container.
- Container(int, Resource, int) - Constructor for class edu.iu.dsc.tws.tsched.builder.Container
-
- CONTAINER_NAME_PREFIX - Static variable in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesConstants
-
- CONTAINER_PER_WORKER - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
-
- containerCpuPadding(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
-
- containerDiskPadding(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
-
- containerId(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
-
- ContainerIdScorer - Class in edu.iu.dsc.tws.tsched.builder
-
This class is to sort the container in an ascending order.
- ContainerIdScorer() - Constructor for class edu.iu.dsc.tws.tsched.builder.ContainerIdScorer
-
- containerInstanceBandwidth(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
-
- containerInstanceCpu(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
-
- containerInstanceDisk(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
-
- containerInstanceLatency(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
-
- containerInstanceNetwork(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
-
- containerInstanceRam(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
-
- containerPaddingPercentage(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
-
- containerPerWorker(Config) - Static method in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
-
- containerRamPadding(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
-
- contains(String) - Method in interface edu.iu.dsc.tws.api.checkpointing.StateStore
-
Check weather the specified key is in the store
- contains(String) - Method in class edu.iu.dsc.tws.checkpointing.stores.HDFSFileStateStore
-
- contains(String) - Method in class edu.iu.dsc.tws.checkpointing.stores.LocalFileStateStore
-
- contains(Object) - Method in class edu.iu.dsc.tws.comms.utils.DiskBasedList
-
- contains(String[], Protos.Offer) - Method in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosScheduler
-
- contains(<any>) - Method in class org.apache.beam.runners.twister2.utils.Twister2SideInputReader
-
- contains(String) - Method in class org.apache.storm.tuple.Fields
-
Checks if this contains the specified name of the field
- contains(String) - Method in interface org.apache.storm.tuple.Tuple
-
Returns true if this tuple contains the specified name of the field.
- contains(String) - Method in class org.apache.storm.tuple.Twister2Tuple
-
- containsAll(Collection) - Method in class edu.iu.dsc.tws.comms.utils.DiskBasedList
-
- containsJobInStore(String, StateStore) - Static method in class edu.iu.dsc.tws.checkpointing.util.CheckpointUtils
-
- containsKey(int, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
-
- containsKey(int, String) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
-
- containsKey(int, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
-
- containsKey(int, String) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
-
- containsKey(int, ByteBuffer) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
-
checks if the given key is in the memory manager
- containsKey(int, String) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
-
checks if the given key is in the memory manager
- containsKey(ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
-
- containsKey(String) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
-
- containsTaskEdge(TE) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
-
This method is used to identify the duplicate task edge for the same two tasks in the graph.
- containsTaskEdge(TV, TV) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
-
This method is to validate that whether the source and target task vertex has task edge.
- containsTaskEdge(TV, TV, TE) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
-
- containsTaskEdge(TV, TV) - Method in interface edu.iu.dsc.tws.api.compute.graph.ITaskGraph
-
This method returns true if the task edge persists in the graph between the source task vertex TV and target task
vertex TV.
- containsTaskEdge(TE) - Method in interface edu.iu.dsc.tws.api.compute.graph.ITaskGraph
-
This method returns true if the task edge persists in the graph.
- containsTaskVertex(TV) - Method in class edu.iu.dsc.tws.api.compute.graph.BaseDataflowTaskGraph
-
This method is to validate whether the task graph vertices has the task vertex(TV)
- containsTaskVertex(TV) - Method in interface edu.iu.dsc.tws.api.compute.graph.ITaskGraph
-
This method returns true if the task vertex exists in the graph.
- context - Variable in class edu.iu.dsc.tws.api.compute.nodes.BaseNode
-
- Context - Class in edu.iu.dsc.tws.api.config
-
- Context() - Constructor for class edu.iu.dsc.tws.api.config.Context
-
- context - Variable in class edu.iu.dsc.tws.connectors.kafka.KafkaSource
-
- contextLoads() - Method in class edu.iu.dsc.tws.dashboard.DashboardApplicationTests
-
- ControlledChannelOperation - Class in edu.iu.dsc.tws.comms.dfw
-
- ControlledFileReader - Class in edu.iu.dsc.tws.comms.shuffle
-
- ControlledFileReader(ControlledFileReaderFlags, String, MessageType, MessageType, Comparator) - Constructor for class edu.iu.dsc.tws.comms.shuffle.ControlledFileReader
-
- ControlledFileReaderFlags - Class in edu.iu.dsc.tws.comms.shuffle
-
Memory mappable limit can be increased in linux with following command.
- ControlledFileReaderFlags(long, Comparator) - Constructor for class edu.iu.dsc.tws.comms.shuffle.ControlledFileReaderFlags
-
- ControlledFileReaderFlags(long, long, Comparator) - Constructor for class edu.iu.dsc.tws.comms.shuffle.ControlledFileReaderFlags
-
This constructor can be used to configure an instance with an arbitrary amount of
mem maps.
- ControlledMemoryReader - Class in edu.iu.dsc.tws.comms.shuffle
-
Wrapper for tuples in memory.
- ControlledMemoryReader(List<Tuple>, Comparator) - Constructor for class edu.iu.dsc.tws.comms.shuffle.ControlledMemoryReader
-
- ControlledProgressTracker - Class in edu.iu.dsc.tws.comms.dfw
-
- ControlledProgressTracker(List<IntArrayList>) - Constructor for class edu.iu.dsc.tws.comms.dfw.ControlledProgressTracker
-
- ControlledReader<T> - Interface in edu.iu.dsc.tws.comms.shuffle
-
A interface for reading a a continous data set stored in eighther memory or file system
- ControllerContext - Class in edu.iu.dsc.tws.api.resource
-
- convertStringToIP(String) - Static method in class edu.iu.dsc.tws.master.worker.JMWorkerController
-
convert the given string to ip address object
- convertToK8sFormat(String, int) - Static method in class edu.iu.dsc.tws.api.util.JobIDUtils
-
we perform the following actions:
shorten the length of the job name if needed
replace underscore and dot characters with dashes
convert all letters to lower case characters
delete non-alphanumeric characters excluding dots and dashes
replace the first char with "a", if it is not a letter in between a-z
replace the last char with "z", if it is dash
- copy() - Method in class edu.iu.dsc.tws.checkpointing.api.SnapshotImpl
-
- COPY_SYSTEM_PACKAGE - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- copyDirectory(String, String) - Static method in class edu.iu.dsc.tws.rsched.utils.FileUtils
-
- copyDirectoryToDirectory(String, String) - Static method in class edu.iu.dsc.tws.rsched.utils.FileUtils
-
- copyFileToDirectory(String, String) - Static method in class edu.iu.dsc.tws.rsched.utils.FileUtils
-
- copyFromLocalDirectory(String, String) - Method in class edu.iu.dsc.tws.rsched.uploaders.scp.ScpController
-
- copyFromLocalFile(String, String) - Method in class edu.iu.dsc.tws.rsched.uploaders.hdfs.HdfsController
-
- copyFromLocalFile(String, String) - Method in class edu.iu.dsc.tws.rsched.uploaders.scp.ScpController
-
- copyPartToByteArray(int, byte[], int, int) - Method in class edu.iu.dsc.tws.api.comms.packing.DataBuffer
-
Copies a part of the ByteBuffer to the given byte array
- copySystemPackage(Config) - Static method in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- CORE_PACKAGE_ENV - Static variable in class edu.iu.dsc.tws.rsched.schedulers.nomad.NomadContext
-
- CORE_PACKAGE_FILENAME - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- CORE_PACKAGE_FILENAME_DEFAULT - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- CORE_PACKAGE_URL - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- CORE_YAML - Static variable in class edu.iu.dsc.tws.api.config.Context
-
- corePackageFileName(Config) - Static method in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- corePackageUrl(Config) - Static method in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- corsConfigurer() - Method in class edu.iu.dsc.tws.dashboard.DashboardSpringConfig
-
- COUNT - Static variable in class edu.iu.dsc.tws.common.logging.Twister2FileLogHandler
-
- count - Variable in class edu.iu.dsc.tws.comms.dfw.io.ByteArrayOutputStream
-
The number of valid bytes in the buffer.
- COUNT - Static variable in class edu.iu.dsc.tws.examples.tset.batch.BatchTsetExample
-
- count - Variable in class edu.iu.dsc.tws.graphapi.api.BasicComputation.SourceTask
-
- Count(long) - Constructor for class edu.iu.dsc.tws.task.window.config.WindowConfig.Count
-
- Count(int) - Constructor for class org.apache.storm.topology.base.BaseWindowedBolt.Count
-
- CountEvictionPolicy<T> - Class in edu.iu.dsc.tws.task.window.policy.eviction.count
-
- CountEvictionPolicy(long) - Constructor for class edu.iu.dsc.tws.task.window.policy.eviction.count.CountEvictionPolicy
-
- CountEvictionPolicy<T> - Class in org.apache.storm.windowing
-
An eviction policy that tracks event counts and can evict based on a threshold count.
- CountEvictionPolicy(int) - Constructor for class org.apache.storm.windowing.CountEvictionPolicy
-
- CountTriggerPolicy<T> - Class in org.apache.storm.windowing
-
- CountTriggerPolicy(int, TriggerHandler, EvictionPolicy<T, ?>) - Constructor for class org.apache.storm.windowing.CountTriggerPolicy
-
- countWindow(long) - Method in class edu.iu.dsc.tws.tset.links.streaming.StreamingTLinkImpl
-
- countWindow(long, long) - Method in class edu.iu.dsc.tws.tset.links.streaming.StreamingTLinkImpl
-
- CountWindowPolicy<T> - Class in edu.iu.dsc.tws.task.window.policy.trigger.count
-
- CountWindowPolicy(long, IManager, IEvictionPolicy<T>) - Constructor for class edu.iu.dsc.tws.task.window.policy.trigger.count.CountWindowPolicy
-
- CountWords() - Constructor for class org.apache.beam.runners.twister2.examples.WordCount.CountWords
-
- countWorkersUpToSS(JobAPI.Job, int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.worker.K8sWorkerUtils
-
calculate the number of workers in the earlier statefulsets
- CppCheckstyle - Class in com.twitter.bazel.checkstyle
-
Verifies that the c, cpp and header source styles conform to the google styles in cpplint.
- CPUS_PER_CONTAINER - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
-
- CPUS_PER_NODE - Static variable in class edu.iu.dsc.tws.data.utils.WorkerConstants
-
- cpusPerContainer(Config) - Static method in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
-
- create(Path) - Method in class edu.iu.dsc.tws.api.data.FileSystem
-
Create a file system with the OVERWRITE
- create(Path, FileSystem.WriteMode) - Method in class edu.iu.dsc.tws.api.data.FileSystem
-
Create a file system with the specific write mdoe
- create(Gson, <any>) - Method in class edu.iu.dsc.tws.common.util.RuntimeTypeAdapterFactory
-
doc.
- create(Path) - Method in class edu.iu.dsc.tws.data.fs.local.LocalFileSystem
-
- create(Path, FileSystem.WriteMode) - Method in class edu.iu.dsc.tws.data.fs.local.LocalFileSystem
-
- create(Path) - Method in class edu.iu.dsc.tws.data.hdfs.HadoopFileSystem
-
- create(Path, FileSystem.WriteMode) - Method in class edu.iu.dsc.tws.data.hdfs.HadoopFileSystem
-
- createArrowSource(String, String, int, String) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
-
- createArrowSource(String, int) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
-
- createArrowSource(String, int) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
-
- createArrowSource(String, String, int, String) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
-
- createArrowSource(String, int) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
-
- createAuroraWorker() - Static method in class edu.iu.dsc.tws.rsched.schedulers.aurora.AuroraWorkerStarter
-
create a AuroraWorkerStarter object by getting values from system property
- createBarrierDir(CuratorFramework, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
-
create parent directory for barrier
- createBuffer(int) - Method in interface edu.iu.dsc.tws.api.comms.channel.TWSChannel
-
Create a buffer
- createBuffer(int) - Method in class edu.iu.dsc.tws.comms.mpi.TWSMPIChannel
-
- createBuffer(int) - Method in class edu.iu.dsc.tws.comms.tcp.TWSTCPChannel
-
- createBuffer(int) - Method in class edu.iu.dsc.tws.comms.ucx.TWSUCXChannel
-
- createCluster(Cluster) - Method in class edu.iu.dsc.tws.dashboard.controllers.ClusterController
-
- createCluster(Cluster) - Method in class edu.iu.dsc.tws.dashboard.services.ClusterService
-
- createCM(KubernetesController, JobAPI.Job) - Static method in class edu.iu.dsc.tws.examples.internal.rsched.K8sControllerExample
-
- createCMWatcher(KubernetesController, String) - Static method in class edu.iu.dsc.tws.examples.internal.rsched.K8sControllerExample
-
- createComputeResource(String, ComputeResource) - Method in class edu.iu.dsc.tws.dashboard.controllers.JobController
-
- createComputeResource(int, double, int, double) - Static method in class edu.iu.dsc.tws.proto.utils.ComputeResourceUtils
-
- createComputeResource(Number, Number, Number) - Method in class edu.iu.dsc.tws.python.BootstrapPoint
-
- createComputerResourceId(String, Integer) - Method in class edu.iu.dsc.tws.dashboard.services.ComputeResourceService
-
- createConfigMap(V1ConfigMap) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
-
create the given ConfigMap on Kubernetes master
- createConfigMap(JobAPI.Job) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
-
create a ConfigMap object
It will have start counts for workers
- createContainerName(int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
-
create container name with the given containerIndex
each container in a pod will have a unique name with this index
- createCopyCommand(String, String, String, String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
-
create file copy command to a pod
- createCoreV1Api() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
-
create CoreV1Api that does not time out
- createCSVSource(String, int, int, String) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
-
- createCSVSource(String, int, int, String) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
-
- createCSVSource(String, int, int, String) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
-
- createData(int, MessageType) - Static method in class edu.iu.dsc.tws.comms.dfw.io.DataSerializerTest
-
- createDataObject(int, MessageType) - Method in class edu.iu.dsc.tws.comms.dfw.io.BaseSerializeTest
-
- createDataQueue(int, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.BaseSerializeTest
-
- createDefaultBarrierDir(CuratorFramework, String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
-
create parent directory for default barrier
- createDirectory(String) - Static method in class edu.iu.dsc.tws.rsched.utils.FileUtils
-
- createEphemDir(CuratorFramework, String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKEphemStateManager
-
create parent directory for ephemeral worker znodes
- createEventsZNode(CuratorFramework, String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKEventsManager
-
Create job znode for persistent states
Assumes that there is no znode exists in the ZooKeeper
This method should be called by the submitting client
- createExecution(ComputeGraph, ExecutionPlan) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
-
Execute a plan and a graph.
- createExecution(ComputeGraph) - Method in class edu.iu.dsc.tws.task.impl.TaskExecutor
-
Execute a plan and a graph.
- createHadoopSource(Configuration, Class<F>, int) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
-
- createHadoopSource(Configuration, Class<F>, int, MapFunc<I, Tuple<K, V>>) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
-
- createHDFSFileSystem() - Method in class edu.iu.dsc.tws.data.utils.HdfsUtils
-
This method create and return the file system respective to the configuration file.
- createHeadlessServiceObject(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
-
- createHostFile(ArrayList<String>, int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.mpi.MPIMasterStarter
-
create hostfile for mpirun command
first line in the file is the ip of this pod
other lines are unordered
each line has one ip
- createInitBarrierDir(CuratorFramework, String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
-
create parent directory for init barrier
- createInput(Config, TaskContext, InputPartitioner<T, O>) - Method in class edu.iu.dsc.tws.executor.core.ExecutionRuntime
-
- createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner
-
Computes the input splits for the file.
- createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteArrowInputPartitioner
-
It creates the split for the complete file.
- createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteCSVInputPartitioner
-
It creates the split for the complete file.
- createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteFileInputPartitioner
-
It creates the split for the complete file.
- createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.CSVInputPartitioner
-
- createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.FileInputPartitioner
-
Computes the input splits for the file.
- createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.FixedInputPartitioner
-
This method create the input splits which is based on the number of lines in the input and the
parallelism value.
- createInputSplits(int) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalCompleteArrowInputPartitioner
-
- createInputSplits(int) - Method in interface edu.iu.dsc.tws.data.api.InputPartitioner
-
Create the input splits
- createJMWorkerAgent(Config, WorkerInfo, String, int, int, int) - Static method in class edu.iu.dsc.tws.master.worker.JMWorkerAgent
-
create the singleton JMWorkerAgent
if it is already created, return the previous one.
- createJob(Job) - Method in class edu.iu.dsc.tws.dashboard.controllers.JobController
-
- createJob(Job) - Method in class edu.iu.dsc.tws.dashboard.services.JobService
-
- createJob(String, String, JobAPI.Job) - Method in class edu.iu.dsc.tws.rsched.schedulers.standalone.MPIController
-
Create a slurm job.
- createJobDescriptionFileName(String) - Static method in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- createJobEndTimeZNode(CuratorFramework, String, String) - Static method in class edu.iu.dsc.tws.common.zk.JobZNodeManager
-
Create job end time znode
- createJobLabels(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
-
all twister2 resources have these two labels
One is to distinguish twister2 resources from others
the other is to distinguish job resources from others
- createJobMasterHeadlessServiceObject() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.master.JobMasterRequestObject
-
create headless service for job master
- createJobMasterPersState(CuratorFramework, String, String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKPersStateManager
-
create job master persistent state at ZooKeeper server
this method must be called if isJobMasterRestarting returns false
- createJobMasterPodName(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
-
create pod name for the job master
there will be one pod for the job master
we add a suffix to statefulset name
- createJobMasterServiceName(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
-
create service name for the job master
- createJobMasterServiceObject() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.master.JobMasterRequestObject
-
create regular service for job master
- createJobMasterStatefulSetName(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
-
create StatefulSet name for the given job name
add a suffix to job name
- createJobPackageFileName(String) - Static method in class edu.iu.dsc.tws.rsched.utils.JobUtils
-
- createJobServiceObject() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
-
- createJobZNode(CuratorFramework, String, JobAPI.Job) - Static method in class edu.iu.dsc.tws.common.zk.JobZNodeManager
-
Create job znode
Assumes that there is no znode exists in the ZooKeeper
Add job object as its body
- createJstZNode(CuratorFramework, String, String, long) - Static method in class edu.iu.dsc.tws.common.zk.JobZNodeManager
-
Create job submission time znode
- createKeyedData(int, MessageType, MessageType) - Method in class edu.iu.dsc.tws.comms.dfw.io.BaseSerializeTest
-
- createKeyedData(int, MessageType, int, MessageType) - Method in class edu.iu.dsc.tws.comms.dfw.io.BaseSerializeTest
-
- createKeyedHadoopSource(Configuration, Class<F>, int, MapFunc<Tuple<K2, V2>, Tuple<K, V>>) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
-
- createKeyedSource(byte[], int) - Method in class edu.iu.dsc.tws.python.Twister2Environment
-
- createKeyedSource(SourceFunc<Tuple<K, V>>, int) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
-
- createKeyedSource(String, SourceFunc<Tuple<K, V>>, int) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
-
- createKeyedSource(SourceFunc<Tuple<K, V>>, int) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
-
- createKeyedSource(String, SourceFunc<Tuple<K, V>>, int) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
-
- createKeyedSource(SourceFunc<Tuple<K, V>>, int) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
-
- createKeyedSource(String, SourceFunc<Tuple<K, V>>, int) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
-
Same as above, but a source tset name can be provided at the instantiation
- createKeyObject(MessageType, int) - Method in class edu.iu.dsc.tws.comms.dfw.io.BaseSerializeTest
-
- createKeyObject(MessageType) - Method in class edu.iu.dsc.tws.comms.dfw.io.BaseSerializeTest
-
- createNode(Node) - Method in class edu.iu.dsc.tws.dashboard.controllers.NodeController
-
- createNode(Node) - Method in class edu.iu.dsc.tws.dashboard.services.NodeService
-
- createNode(NodeId) - Method in class edu.iu.dsc.tws.dashboard.services.NodeService
-
- createNodeId(Node) - Method in class edu.iu.dsc.tws.dashboard.services.NodeService
-
- createNodeInfo(String, String, String) - Static method in class edu.iu.dsc.tws.proto.utils.NodeInfoUtils
-
do not set if any one of the parameters are null
- createNodePortServiceObject() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
-
create service for NodePort
- createOption(String, boolean, String, boolean) - Static method in class edu.iu.dsc.tws.examples.Utils
-
- createOrGetCluster(String) - Method in class edu.iu.dsc.tws.dashboard.services.ClusterService
-
This util method creates a cluster for a given data center name.
- createOutput(int, FSDataOutputStream) - Method in class edu.iu.dsc.tws.data.api.out.CSVOutputWriter
-
- createOutput() - Method in class edu.iu.dsc.tws.data.api.out.CSVOutputWriter
-
- createOutput(int, FSDataOutputStream) - Method in class edu.iu.dsc.tws.data.api.out.FileOutputWriter
-
Create a suitable output
- createOutput(int, FSDataOutputStream) - Method in class edu.iu.dsc.tws.data.api.out.TextOutputWriter
-
- createOutput() - Method in class edu.iu.dsc.tws.data.api.out.TextOutputWriter
-
- createPersistentEphemeralZnode(String, byte[]) - Static method in class edu.iu.dsc.tws.common.zk.ZKUtils
-
create a PersistentNode object in the given path
it is ephemeral and persistent
it will be deleted after the worker leaves or fails
it will be persistent for occasional network problems
- createPersistentJobDirName(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosController
-
- createPersistentJobDirName(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.nomad.NomadController
-
- createPersistentVolume(V1PersistentVolume) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
-
create the given service on Kubernetes master
- createPersistentVolume(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
-
- createPersistentVolumeClaim(V1PersistentVolumeClaim) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
-
create the given PersistentVolumeClaim on Kubernetes master
- createPersistentVolumeClaimObject(int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
-
- createPersistentVolumeName(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
-
create storage claim name name from job name
- createPersistentVolumeObject(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
-
we initially used this method to create PersistentVolumes
we no longer use this method
it is just here in case we may need it for some reason at one point
- createPersistentZnode(String, byte[]) - Static method in class edu.iu.dsc.tws.common.zk.ZKUtils
-
create a PersistentNode object in the given path
it needs to be deleted explicitly, not ephemeral
it will be persistent for occasional network problems
- createPersStateDir(CuratorFramework, String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKPersStateManager
-
Create job znode for persistent states
Assumes that there is no znode exists in the ZooKeeper
This method should be called by the submitting client
- createPropertiesFile(String) - Method in class edu.iu.dsc.tws.deeplearning.common.ParameterTool
-
Create a properties file with all the known parameters (call after the last get*() call).
- createPropertiesFile(String, boolean) - Method in class edu.iu.dsc.tws.deeplearning.common.ParameterTool
-
Create a properties file with all the known parameters (call after the last get*() call).
- createReduceTaskPlan(Config, int, List<JobMasterAPI.WorkerInfo>, int) - Static method in class edu.iu.dsc.tws.examples.Utils
-
Let assume we have 2 tasks per container and one additional for first container,
which will be the destination
- createRestartJobMasterKey() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
-
create the key for job master restart count to be used in ConfigMap
- createRestartWorkerKey(int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
-
create the key for worker restart count to be used in ConfigMap
- createRestorePoint() - Method in class edu.iu.dsc.tws.comms.shuffle.ControlledFileReader
-
- createRestorePoint() - Method in class edu.iu.dsc.tws.comms.shuffle.ControlledMemoryReader
-
- createRestorePoint() - Method in interface edu.iu.dsc.tws.comms.shuffle.Restorable
-
- createRestorePoint() - Method in class edu.iu.dsc.tws.comms.utils.SortJoinUtils.ListBasedRestorableIterator
-
- createRowSource(String, SourceFunc<Row>, int) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
-
- createSecretVolume(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
-
- createService(V1Service) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
-
create the given service on Kubernetes master
- createServiceName(String) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
-
create service name for workers
- createSource(byte[], int) - Method in class edu.iu.dsc.tws.python.Twister2Environment
-
- createSource(SourceFunc<T>, int) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
-
- createSource(String, SourceFunc<T>, int) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
-
- createSource(SourceFunc<T>, int) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
-
- createSource(String, SourceFunc<T>, int) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
-
- createSource(SourceFunc<T>, int) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
-
- createSource(String, SourceFunc<T>, int) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
-
Same as above, but a source tset name can be provided at the instantiation
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.BinaryInputPartitioner
-
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteArrowInputPartitioner
-
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteCSVInputPartitioner
-
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.CompleteFileInputPartitioner
-
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.CSVInputPartitioner
-
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.FileInputPartitioner
-
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.FixedInputPartitioner
-
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalBinaryInputPartitioner
-
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalCompleteArrowInputPartitioner
-
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalCompleteCSVInputPartitioner
-
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalCompleteTextInputPartitioner
-
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalCSVInputPartitioner
-
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalFixedInputPartitioner
-
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.LocalTextInputPartitioner
-
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.data.api.formatters.SharedTextInputPartitioner
-
- createSplit(int, Path, long, long, String[]) - Method in class edu.iu.dsc.tws.examples.ml.svm.integration.test.LocalTextInputPartitioner1
-
- createStageLogicalPlan(WorkerEnvironment, List<Integer>) - Static method in class edu.iu.dsc.tws.examples.Utils
-
Create task plan according to stages
- createStatefulSet(V1StatefulSet) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
-
create the given StatefulSet on Kubernetes master
- createStatefulSetForWorkers(ComputeResource) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
-
create StatefulSet object for a job
- createStatefulSetObject() - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.master.JobMasterRequestObject
-
create StatefulSet object for a job
- createTarGzipPacker(String, Config) - Static method in class edu.iu.dsc.tws.rsched.utils.TarGzipPacker
-
create TarGzipPacker object
- createTarPackage(String, String, String, boolean, boolean) - Static method in class edu.iu.dsc.tws.rsched.utils.ProcessUtils
-
- createTaskPlan(int, int, int) - Static method in class edu.iu.dsc.tws.comms.routing.RoutingTestUtils
-
- createTextSource(String, int, int, String) - Method in class edu.iu.dsc.tws.tset.env.BatchEnvironment
-
- createTextSource(String, int, int, String) - Method in class edu.iu.dsc.tws.tset.env.StreamingEnvironment
-
- createTextSource(String, int, int, String) - Method in class edu.iu.dsc.tws.tset.env.TSetEnvironment
-
- createTopology() - Method in class org.apache.storm.topology.TopologyBuilder
-
- createVolatileVolume(double) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.RequestObjectBuilder
-
- createWordCountPlan(Config, int, List<JobMasterAPI.WorkerInfo>, int) - Static method in class edu.iu.dsc.tws.examples.utils.WordCountUtils
-
Let assume we have 2 tasks per container and one additional for first container,
which will be the destination
- createWorker(WorkerCreateRequest) - Method in class edu.iu.dsc.tws.dashboard.controllers.WorkerController
-
- createWorker(WorkerCreateRequest) - Method in class edu.iu.dsc.tws.dashboard.services.WorkerService
-
- createWorkerInfo(int, String, int) - Static method in class edu.iu.dsc.tws.proto.utils.WorkerInfoUtils
-
- createWorkerInfo(int, String, int, NodeInfo) - Static method in class edu.iu.dsc.tws.proto.utils.WorkerInfoUtils
-
- createWorkerInfo(int, String, int, NodeInfo, JobAPI.ComputeResource) - Static method in class edu.iu.dsc.tws.proto.utils.WorkerInfoUtils
-
- createWorkerInfo(int, String, int, NodeInfo, JobAPI.ComputeResource, Map<String, Integer>) - Static method in class edu.iu.dsc.tws.proto.utils.WorkerInfoUtils
-
- createWorkerInfoMap(Intracomm) - Method in class edu.iu.dsc.tws.rsched.schedulers.standalone.MPIWorkerStarter
-
create a AllocatedResources
- createWorkerPersState(CuratorFramework, String, String, WorkerInfo) - Static method in class edu.iu.dsc.tws.common.zk.ZKPersStateManager
-
Initialize worker persistent state at ZooKeeper server
This method must be called after making sure that
there is no pers state znode for this worker at zk
- createWorkerPlan(List<JobMasterAPI.WorkerInfo>) - Static method in class edu.iu.dsc.tws.examples.internal.task.TaskUtils
-
- createWorkersStatefulSetName(String, int) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesUtils
-
create StatefulSet name for workers
add the given index a suffix to the job name
- createWorkerZNode(CuratorFramework, String, long) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
-
create a worker znode at the barrier directory
- createWorkerZnode(CuratorFramework, String, String, int) - Static method in class edu.iu.dsc.tws.common.zk.ZKEphemStateManager
-
- createWorkerZNodeAtDefault(CuratorFramework, String, String, int, long) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
-
create a worker znode at the default barrier directory
- createWorkerZNodeAtInit(CuratorFramework, String, String, int, long) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
-
create a worker znode at the init barrier directory
- CROSS_VALIDATION_DATA - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
-
- CROSS_VALIDATION_DATA_DIR - Static variable in class edu.iu.dsc.tws.data.utils.MLDataObjectConstants
-
- CSIZE - Static variable in class edu.iu.dsc.tws.data.utils.DataObjectConstants
-
- CSVBasedSourceFunction - Class in edu.iu.dsc.tws.tset.fn.impl
-
- CSVBasedSourceFunction(String, int, int, String) - Constructor for class edu.iu.dsc.tws.tset.fn.impl.CSVBasedSourceFunction
-
- CSVInputFormatTest - Class in edu.iu.dsc.tws.examples.batch.kmeans
-
- CSVInputFormatTest() - Constructor for class edu.iu.dsc.tws.examples.batch.kmeans.CSVInputFormatTest
-
- CSVInputFormatTest.TestSink - Class in edu.iu.dsc.tws.examples.batch.kmeans
-
- CSVInputFormatTest.TestSource - Class in edu.iu.dsc.tws.examples.batch.kmeans
-
This is the test source class
- CSVInputPartitioner<OT> - Class in edu.iu.dsc.tws.data.api.formatters
-
- CSVInputPartitioner(Path, Config) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CSVInputPartitioner
-
- CSVInputPartitioner(Path, Config, int) - Constructor for class edu.iu.dsc.tws.data.api.formatters.CSVInputPartitioner
-
- CSVInputSplit - Class in edu.iu.dsc.tws.data.api.splits
-
This class is primarily responsible for reading the split of a CSV file.
- CSVInputSplit(int, Path, long, long, String[]) - Constructor for class edu.iu.dsc.tws.data.api.splits.CSVInputSplit
-
Constructs a split with host information.
- CSVOutputWriter - Class in edu.iu.dsc.tws.data.api.out
-
- CSVOutputWriter(FileSystem.WriteMode, Path) - Constructor for class edu.iu.dsc.tws.data.api.out.CSVOutputWriter
-
- CSVOutputWriter(FileSystem.WriteMode, Path, Config) - Constructor for class edu.iu.dsc.tws.data.api.out.CSVOutputWriter
-
- CSVOutputWriter(FileSystem.WriteMode, Path, String, String, String, Config, String) - Constructor for class edu.iu.dsc.tws.data.api.out.CSVOutputWriter
-
- CSVTSetSourceExample - Class in edu.iu.dsc.tws.examples.batch.csv
-
- CSVTSetSourceExample() - Constructor for class edu.iu.dsc.tws.examples.batch.csv.CSVTSetSourceExample
-
- CUR_DIR - Static variable in class edu.iu.dsc.tws.api.data.Path
-
The current directory
- curlPackage(String, String, boolean, boolean) - Static method in class edu.iu.dsc.tws.rsched.utils.ProcessUtils
-
- currentBufferIndex - Variable in class edu.iu.dsc.tws.comms.dfw.io.ByteArrayInputStream
-
- currentCount - Variable in class edu.iu.dsc.tws.task.window.policy.eviction.count.CountEvictionPolicy
-
- currentCount - Variable in class org.apache.storm.windowing.CountEvictionPolicy
-
- currentCount - Variable in class org.apache.storm.windowing.WatermarkCountEvictionPolicy
-
- currentReader - Variable in class edu.iu.dsc.tws.tset.sources.HadoopSource
-
The current record reader
- currentSize() - Method in class edu.iu.dsc.tws.common.table.arrow.BinaryColumn
-
- currentSize() - Method in class edu.iu.dsc.tws.common.table.arrow.Float4Column
-
- currentSize() - Method in class edu.iu.dsc.tws.common.table.arrow.Float8Column
-
- currentSize() - Method in class edu.iu.dsc.tws.common.table.arrow.Int4Column
-
- currentSize() - Method in class edu.iu.dsc.tws.common.table.arrow.Int8Column
-
- currentSize() - Method in class edu.iu.dsc.tws.common.table.arrow.StringColumn
-
- currentSize() - Method in class edu.iu.dsc.tws.common.table.arrow.UInt2Column
-
- currentSize() - Method in interface edu.iu.dsc.tws.common.table.ArrowColumn
-
- currentSize() - Method in class edu.iu.dsc.tws.common.table.ArrowTableBuilder
-
- currentSize() - Method in interface edu.iu.dsc.tws.common.table.TableBuilder
-
Get the current size of the table
- customGrouping(String, CustomStreamGrouping) - Method in interface org.apache.storm.topology.InputDeclarer
-
- customGrouping(String, String, CustomStreamGrouping) - Method in interface org.apache.storm.topology.InputDeclarer
-
- customGrouping(String, CustomStreamGrouping) - Method in class org.apache.storm.topology.twister2.Twister2BoltDeclarer
-
- customGrouping(String, String, CustomStreamGrouping) - Method in class org.apache.storm.topology.twister2.Twister2BoltDeclarer
-
- CustomStreamGrouping - Interface in org.apache.storm.grouping
-
- DAGMutableGraph<T extends TBase> - Class in edu.iu.dsc.tws.tset.graph
-
DAG graph implementation
- DAGMutableGraph() - Constructor for class edu.iu.dsc.tws.tset.graph.DAGMutableGraph
-
- DASHBOARD_HOST - Static variable in class edu.iu.dsc.tws.master.JobMasterContext
-
- DashboardApplication - Class in edu.iu.dsc.tws.dashboard
-
- DashboardApplicationTests - Class in edu.iu.dsc.tws.dashboard
-
- DashboardApplicationTests() - Constructor for class edu.iu.dsc.tws.dashboard.DashboardApplicationTests
-
- DashboardClient - Class in edu.iu.dsc.tws.master.dashclient
-
This client is used to send messages to Dashboard by JobMaster
- DashboardClient(String, String, int) - Constructor for class edu.iu.dsc.tws.master.dashclient.DashboardClient
-
- DashboardClientExample - Class in edu.iu.dsc.tws.examples.internal.jobmaster
-
- dashboardHost(Config) - Static method in class edu.iu.dsc.tws.master.JobMasterContext
-
- DashboardSpringConfig - Class in edu.iu.dsc.tws.dashboard
-
- DashboardSpringConfig() - Constructor for class edu.iu.dsc.tws.dashboard.DashboardSpringConfig
-
- data - Variable in class edu.iu.dsc.tws.comms.utils.HeapNode
-
- data - Variable in class edu.iu.dsc.tws.deeplearning.common.ParameterTool
-
- DATA_BUFF_INIT_CAP - Static variable in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManagerContext
-
- DATA_EDGE - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
-
- DATA_INPUT - Static variable in class edu.iu.dsc.tws.data.utils.DataObjectConstants
-
- DATA_OBJECT_COMPUTE - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
-
- DATA_OBJECT_COMPUTE_TESTING - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
-
- DATA_OBJECT_SINK - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
-
- DATA_OBJECT_SINK_TESTING - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
-
- DATA_OBJECT_SOURCE - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
-
- DATA_OBJECT_SOURCE_TESTING - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
-
- DATA_YAML - Static variable in class edu.iu.dsc.tws.api.config.Context
-
- DataBuffer - Class in edu.iu.dsc.tws.api.comms.packing
-
Keep track of a byte buffer with capacity and size
- DataBuffer(ByteBuffer) - Constructor for class edu.iu.dsc.tws.api.comms.packing.DataBuffer
-
Create a buffer
- DATACENTER_LABEL_KEY - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- datacenterLabelKeyForK8s(Config) - Static method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesContext
-
- DATACENTERS_LIST - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- dataConfigurationFile(Config) - Static method in class edu.iu.dsc.tws.api.config.Context
-
- DataConstants - Class in edu.iu.dsc.tws.api.data
-
Class that holds common config constants and there default values
- DataContext - Class in edu.iu.dsc.tws.data.utils
-
- DataContext() - Constructor for class edu.iu.dsc.tws.data.utils.DataContext
-
- DataDeserializer - Class in edu.iu.dsc.tws.comms.dfw.io
-
- DataDeserializer() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.DataDeserializer
-
- dataDirectory - Static variable in class edu.iu.dsc.tws.graphapi.api.BasicComputation
-
- DataFileReader - Class in edu.iu.dsc.tws.data.utils
-
This class acts as an interface for reading the input datapoints and centroid values from
the local file system or from the distributed file system (HDFS).
- DataFileReader(Config, String) - Constructor for class edu.iu.dsc.tws.data.utils.DataFileReader
-
- DataFileReplicatedReadSource - Class in edu.iu.dsc.tws.task.dataobjects
-
This class partition the datapoints using the LocalCompleteTextInputPartitioner to partition
the complete file as a one partition.
- DataFileReplicatedReadSource(String, String) - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataFileReplicatedReadSource
-
- DataFileReplicatedReadSource(String, String, int) - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataFileReplicatedReadSource
-
- DataFileReplicatedReadSource() - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataFileReplicatedReadSource
-
- DataFileSink<T> - Class in edu.iu.dsc.tws.task.dataobjects
-
This class receives the message from the DataFileSource and writes the output into the DataObject
- DataFileSink() - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataFileSink
-
- DataFileSplittedReadSource<T> - Class in edu.iu.dsc.tws.task.dataobjects
-
This class is responsible for partition the datapoints which is based on the task parallelism
value.
- DataFileSplittedReadSource(String) - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataFileSplittedReadSource
-
- DataflowAddNodeExperiment - Class in edu.iu.dsc.tws.examples.internal.dataflowexperiment
-
- DataflowAddNodeExperiment() - Constructor for class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowAddNodeExperiment
-
- DataflowAddNodeExperiment.Aggregator - Class in edu.iu.dsc.tws.examples.internal.dataflowexperiment
-
- DataflowAddNodeExperiment.Aggregator1 - Class in edu.iu.dsc.tws.examples.internal.dataflowexperiment
-
- DataFlowGraph - Class in edu.iu.dsc.tws.task.cdfw
-
- DataFlowJobConfig - Class in edu.iu.dsc.tws.task.cdfw
-
- DataFlowJobConfig() - Constructor for class edu.iu.dsc.tws.task.cdfw.DataFlowJobConfig
-
- DataflowJobParameters - Class in edu.iu.dsc.tws.examples.internal.dataflowexperiment
-
- DataflowJobParameters() - Constructor for class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowJobParameters
-
- DataflowNodeExperiment - Class in edu.iu.dsc.tws.examples.internal.dataflowexperiment
-
- DataflowNodeExperiment() - Constructor for class edu.iu.dsc.tws.examples.internal.dataflowexperiment.DataflowNodeExperiment
-
- DataflowNodeExperiment.Aggregator - Class in edu.iu.dsc.tws.examples.internal.dataflowexperiment
-
- DataflowNodeExperiment.Aggregator1 - Class in edu.iu.dsc.tws.examples.internal.dataflowexperiment
-
- DataFlowOperation - Interface in edu.iu.dsc.tws.api.comms
-
The communication operation interface.
- dataFlowOperation - Variable in class edu.iu.dsc.tws.comms.dfw.io.KeyedReceiver
-
The dataflow operation that is related to the class instance.
- DataGenerator - Class in edu.iu.dsc.tws.examples.comms
-
- DataGenerator - Class in edu.iu.dsc.tws.examples.internal.batchscheduler
-
- DataGenerator(Config, int) - Constructor for class edu.iu.dsc.tws.examples.internal.batchscheduler.DataGenerator
-
- DataGenerator(Config) - Constructor for class edu.iu.dsc.tws.examples.internal.batchscheduler.DataGenerator
-
- DataGenerator - Class in edu.iu.dsc.tws.examples.utils
-
Generate a data set
- DataGenerator - Class in edu.iu.dsc.tws.tsched.utils
-
- DataGenerator(Config, int) - Constructor for class edu.iu.dsc.tws.tsched.utils.DataGenerator
-
- DataGenerator(Config) - Constructor for class edu.iu.dsc.tws.tsched.utils.DataGenerator
-
- DataGeneratorSink - Class in edu.iu.dsc.tws.examples.batch.cdfw
-
- DataGeneratorSink() - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.DataGeneratorSink
-
- DataGeneratorSource - Class in edu.iu.dsc.tws.examples.batch.cdfw
-
- DataGeneratorSource() - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.DataGeneratorSource
-
- DataGeneratorSource(String, int, int, int, String, String) - Constructor for class edu.iu.dsc.tws.examples.batch.cdfw.DataGeneratorSource
-
- DataInitializationSinkTask - Class in edu.iu.dsc.tws.graphapi.api
-
- DataInitializationSinkTask(String) - Constructor for class edu.iu.dsc.tws.graphapi.api.DataInitializationSinkTask
-
- dataList - Variable in class edu.iu.dsc.tws.dataset.partition.CollectionPartition
-
- DataLoadingTask - Class in edu.iu.dsc.tws.examples.ml.svm.tset
-
- DataLoadingTask(BinaryBatchModel) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.tset.DataLoadingTask
-
- DataLoadingTask(BinaryBatchModel, SVMJobParameters) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.tset.DataLoadingTask
-
- DataLoadingTask(BinaryBatchModel, SVMJobParameters, String) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.tset.DataLoadingTask
-
- dataLoadingTime - Variable in class edu.iu.dsc.tws.examples.ml.svm.sgd.SgdSvm
-
- DataLocalityBatchTaskScheduler - Class in edu.iu.dsc.tws.tsched.batch.datalocalityaware
-
The data locality batch task scheduler generate the task schedule plan based on the distance
calculated between the worker node and the data nodes where the input data resides.
- DataLocalityBatchTaskScheduler() - Constructor for class edu.iu.dsc.tws.tsched.batch.datalocalityaware.DataLocalityBatchTaskScheduler
-
- DataLocalityBatchTaskSchedulerTest - Class in edu.iu.dsc.tws.tsched.batch.datalocality
-
- DataLocalityBatchTaskSchedulerTest() - Constructor for class edu.iu.dsc.tws.tsched.batch.datalocality.DataLocalityBatchTaskSchedulerTest
-
- DataLocalityStreamingTaskScheduler - Class in edu.iu.dsc.tws.tsched.streaming.datalocalityaware
-
The data locality streaming task scheduler generate the task schedule plan based on the distance
calculated between the worker node and the data nodes where the input data resides.
- DataLocalityStreamingTaskScheduler() - Constructor for class edu.iu.dsc.tws.tsched.streaming.datalocalityaware.DataLocalityStreamingTaskScheduler
-
- DataLocalityTaskSchedulerTest - Class in edu.iu.dsc.tws.tsched.streaming.datalocality
-
- DataLocalityTaskSchedulerTest() - Constructor for class edu.iu.dsc.tws.tsched.streaming.datalocality.DataLocalityTaskSchedulerTest
-
- DataMessageType - Enum in edu.iu.dsc.tws.data.memory.utils
-
- datanodeInstanceBandwidth(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
-
- datanodeInstanceLatency(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
-
- DataNodeLocatorUtils - Class in edu.iu.dsc.tws.data.utils
-
This class is to find out the location of the datanodes corresponding to the input file names.
- DataNodeLocatorUtils(Config) - Constructor for class edu.iu.dsc.tws.data.utils.DataNodeLocatorUtils
-
- DataObject<T> - Interface in edu.iu.dsc.tws.api.dataset
-
Distributed data set
- DataObjectCompute - Class in edu.iu.dsc.tws.graphapi.pagerank
-
- DataObjectCompute(String, int, int) - Constructor for class edu.iu.dsc.tws.graphapi.pagerank.DataObjectCompute
-
- DataObjectCompute(String, int) - Constructor for class edu.iu.dsc.tws.graphapi.pagerank.DataObjectCompute
-
- DataObjectConstants - Class in edu.iu.dsc.tws.data.utils
-
The input parameters required to create, partition, and read the input data points.
- DataObjectConstants() - Constructor for class edu.iu.dsc.tws.data.utils.DataObjectConstants
-
- DataObjectCSVSource - Class in edu.iu.dsc.tws.task.dataobjects
-
- DataObjectCSVSource() - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataObjectCSVSource
-
- DataObjectCSVSource(String, String) - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataObjectCSVSource
-
- DataObjectImpl<T> - Class in edu.iu.dsc.tws.dataset
-
- DataObjectImpl(Config) - Constructor for class edu.iu.dsc.tws.dataset.DataObjectImpl
-
- DataObjectImpl(String, Config) - Constructor for class edu.iu.dsc.tws.dataset.DataObjectImpl
-
- DataObjectSink - Class in edu.iu.dsc.tws.graphapi.pagerank
-
- DataObjectSink(String) - Constructor for class edu.iu.dsc.tws.graphapi.pagerank.DataObjectSink
-
- DataObjectSink<T> - Class in edu.iu.dsc.tws.task.dataobjects
-
This class receives the message from the DataObjectSource and writes the output into the
DataObject.
- DataObjectSink() - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataObjectSink
-
- DataObjectSource<T> - Class in edu.iu.dsc.tws.task.dataobjects
-
This class is responsible for partition the datapoints which is based on the task parallelism
value.
- DataObjectSource() - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataObjectSource
-
- DataObjectSource(String, String) - Constructor for class edu.iu.dsc.tws.task.dataobjects.DataObjectSource
-
- DataPacker<D,W> - Interface in edu.iu.dsc.tws.api.comms.packing
-
The data packer interface.
- DataPackerProxy - Class in edu.iu.dsc.tws.comms.dfw.io
-
- DataParallelJob - Class in edu.iu.dsc.tws.examples.task.dataparallel
-
- DataParallelTask - Class in edu.iu.dsc.tws.examples.task.dataparallel
-
- DataParallelTask() - Constructor for class edu.iu.dsc.tws.examples.task.dataparallel.DataParallelTask
-
- DataParallelWorker - Class in edu.iu.dsc.tws.examples.task.dataparallel
-
This example demonstrates the use of a data parallel job.
- DataParallelWorker() - Constructor for class edu.iu.dsc.tws.examples.task.dataparallel.DataParallelWorker
-
- DataPartition<T> - Interface in edu.iu.dsc.tws.api.dataset
-
Partition of a distributed set
- DataPartitionConsumer<T> - Interface in edu.iu.dsc.tws.api.dataset
-
The partition consumer
- DataPartitioner - Class in edu.iu.dsc.tws.examples.ml.svm.data
-
This class can provide a config like a map where taskindex is paired with the number of
data points per partition.
- DataPartitioner() - Constructor for class edu.iu.dsc.tws.examples.ml.svm.data.DataPartitioner
-
- DataPartitioner(int, int) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.data.DataPartitioner
-
- DataPartitionSourceFunc<T> - Class in edu.iu.dsc.tws.tset.sources
-
- DataPartitionSourceFunc(String) - Constructor for class edu.iu.dsc.tws.tset.sources.DataPartitionSourceFunc
-
- DataPartitionType - Enum in edu.iu.dsc.tws.examples.ml.svm.config
-
- DataSerializer - Class in edu.iu.dsc.tws.comms.dfw.io
-
Builds the message and copies it into data buffers.The structure of the message depends on the
type of message that is sent, for example if it is a keyed message or not.
- DataSerializer() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.DataSerializer
-
- DataSerializerTest - Class in edu.iu.dsc.tws.comms.dfw.io
-
- DataSerializerTest() - Constructor for class edu.iu.dsc.tws.comms.dfw.io.DataSerializerTest
-
- dataSets - Variable in class org.apache.beam.runners.twister2.Twister2TranslationContext
-
- DataSink<T> - Class in edu.iu.dsc.tws.dataset
-
A data sink
- DataSink(Config, DataObjectImpl<T>) - Constructor for class edu.iu.dsc.tws.dataset.DataSink
-
- DataSink(Config, OutputWriter<T>) - Constructor for class edu.iu.dsc.tws.dataset.DataSink
-
- DataSink() - Constructor for class edu.iu.dsc.tws.examples.compatibility.storm.bench.StormBenchmark.DataSink
-
- DataSinkTask - Class in edu.iu.dsc.tws.graphapi.api
-
- DataSinkTask(String) - Constructor for class edu.iu.dsc.tws.graphapi.api.DataSinkTask
-
- DataSource<T,O extends InputSplit<T>> - Class in edu.iu.dsc.tws.dataset
-
A distributed data source
- DataSource(Config, InputPartitioner<T, O>, int) - Constructor for class edu.iu.dsc.tws.dataset.DataSource
-
- DataStatus - Enum in edu.iu.dsc.tws.common.net.tcp
-
- DataStreamer(int) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.comms.CommsWorker.DataStreamer
-
- DataStreamer - Class in edu.iu.dsc.tws.examples.ml.svm.streamer
-
- DataStreamer(OperationMode) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.streamer.DataStreamer
-
Deprecated.
- DataStreamer(int, OperationMode) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.streamer.DataStreamer
-
Deprecated.
- DataStreamer(OperationMode, boolean, BinaryBatchModel) - Constructor for class edu.iu.dsc.tws.examples.ml.svm.streamer.DataStreamer
-
Deprecated.
- DATASTREAMER_SOURCE - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
-
- DataTransferTimeCalculator - Class in edu.iu.dsc.tws.tsched.utils
-
This class has getters and setters property to set the data transfer time for the nodes.
- DataTransferTimeCalculator(String, double, String) - Constructor for class edu.iu.dsc.tws.tsched.utils.DataTransferTimeCalculator
-
- DataTransferTimeCalculator(String, double) - Constructor for class edu.iu.dsc.tws.tsched.utils.DataTransferTimeCalculator
-
- DataUtils - Class in edu.iu.dsc.tws.examples.ml.svm.util
-
- days(long) - Static method in class edu.iu.dsc.tws.common.pojo.Time
-
Set Time with length and days
- days() - Method in class edu.iu.dsc.tws.common.pojo.TimeTest
-
- days(long) - Static method in class edu.iu.dsc.tws.task.window.config.WindowConfig.Duration
-
- days(int) - Static method in class org.apache.storm.topology.base.BaseWindowedBolt.Duration
-
- DB_NAME - Static variable in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManagerContext
-
Name of the databse
- deactivate() - Method in interface org.apache.storm.spout.ISpout
-
Called when a spout has been deactivated.
- deactivate() - Method in class org.apache.storm.topology.base.BaseRichSpout
-
- DEBUG - Static variable in class edu.iu.dsc.tws.api.config.SchedulerContext
-
- declare(String...) - Static method in class edu.iu.dsc.tws.api.compute.modifiers.IONames
-
- declare(Collection<String>) - Static method in class edu.iu.dsc.tws.api.compute.modifiers.IONames
-
- declare(Fields) - Method in interface org.apache.storm.topology.OutputFieldsDeclarer
-
Uses default stream id.
- declare(boolean, Fields) - Method in interface org.apache.storm.topology.OutputFieldsDeclarer
-
- declare(Fields) - Method in class org.apache.storm.topology.twister2.EdgeFieldMap
-
- declare(boolean, Fields) - Method in class org.apache.storm.topology.twister2.EdgeFieldMap
-
- declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.MultiSpoutTopology.ExclamationBolt
-
- declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.MultiSpoutTopology.TestWordSpout
-
- declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.SentenceWordCountTopology.FastRandomSentenceSpout
-
- declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.SentenceWordCountTopology.SplitSentence
-
- declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.SentenceWordCountTopology.WordCount
-
- declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.IntervalWindowTopology.IntervalWindowBolt
-
- declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.IntervalWindowTopology.TestWordSpout
-
- declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.SlidingWindowTopology.SlidingWindowBolt
-
- declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.SlidingWindowTopology.TestWordSpout
-
- declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.TumblingWindowTopology.TestWordSpout
-
- declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.windowing.TumblingWindowTopology.TumblingWindowBolt
-
- declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.WordCountTopology.ConsumerBolt
-
- declareOutputFields(OutputFieldsDeclarer) - Method in class edu.iu.dsc.tws.examples.compatibility.storm.WordCountTopology.WordSpout
-
- declareOutputFields(OutputFieldsDeclarer) - Method in class org.apache.storm.spout.CheckpointSpout
-
- declareOutputFields(OutputFieldsDeclarer) - Method in class org.apache.storm.topology.base.BaseWindowedBolt
-
- declareOutputFields(OutputFieldsDeclarer) - Method in interface org.apache.storm.topology.IComponent
-
Declare the output schema for all the streams of this topology.
- declareOutputFields(OutputFieldsDeclarer) - Method in class org.apache.storm.topology.WindowedBoltExecutor
-
- declareStream(String, Fields) - Method in interface org.apache.storm.topology.OutputFieldsDeclarer
-
- declareStream(String, boolean, Fields) - Method in interface org.apache.storm.topology.OutputFieldsDeclarer
-
- declareStream(String, Fields) - Method in class org.apache.storm.topology.twister2.EdgeFieldMap
-
- declareStream(String, boolean, Fields) - Method in class org.apache.storm.topology.twister2.EdgeFieldMap
-
- decode(byte[]) - Static method in class edu.iu.dsc.tws.common.zk.JobWithState
-
- decode(byte[]) - Static method in class edu.iu.dsc.tws.common.zk.WorkerWithState
-
- decodeJobEvent(byte[]) - Static method in class edu.iu.dsc.tws.common.zk.ZKEventsManager
-
- decodeNodeInfo(String) - Static method in class edu.iu.dsc.tws.proto.utils.NodeInfoUtils
-
decode the given String that is encoded with encodeNodeInfo method
each field is separated by a comma
- decodeNodeInfoList(String) - Static method in class edu.iu.dsc.tws.proto.utils.NodeInfoUtils
-
decode the given String that is encoded with the method encodeNodeInfoList
each NodeInfoUtils object is separated by others with a semi colon
- decodeWorkerZnodeBody(byte[]) - Static method in class edu.iu.dsc.tws.common.zk.ZKEphemStateManager
-
- decorate(Kryo) - Method in interface org.apache.storm.serialization.IKryoDecorator
-
- decreaseMemoryLoad(int) - Method in class edu.iu.dsc.tws.comms.shuffle.ControlledFileReaderFlags
-
- decreaseWorkers(int) - Method in class edu.iu.dsc.tws.task.cdfw.CDFWEnv
-
- DedicatedComStreamingExecutor - Class in edu.iu.dsc.tws.executor.threading.ft
-
This is a dedicated communication thread based streaming executor that halts execution in case
of an error.
- DedicatedComStreamingExecutor(Config, int, TWSChannel, ExecutionPlan, IExecutionHook) - Constructor for class edu.iu.dsc.tws.executor.threading.ft.DedicatedComStreamingExecutor
-
- DedidatedBatchExecutor - Class in edu.iu.dsc.tws.executor.threading.ft
-
- DedidatedBatchExecutor(Config, int, TWSChannel, ExecutionPlan, IExecutionHook) - Constructor for class edu.iu.dsc.tws.executor.threading.ft.DedidatedBatchExecutor
-
- DEFAULT_APPEND_BUFFER_SIZE - Static variable in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManagerContext
-
- DEFAULT_BYTEORDER - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
-
- DEFAULT_CHARSET - Static variable in class edu.iu.dsc.tws.data.memory.MemoryManagerContext
-
Charset used in the memory manager
- DEFAULT_CONTAINER_PER_WORKER - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
-
- DEFAULT_CPU_AMOUNT - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
-
- DEFAULT_DESIRED_NODE - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
-
- DEFAULT_DESTINATION - Static variable in class edu.iu.dsc.tws.api.comms.CommunicationContext
-
- DEFAULT_DISK_SIZE - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
-
- DEFAULT_EDGE - Static variable in class edu.iu.dsc.tws.task.impl.TaskConfigurations
-
- DEFAULT_FIELD_DELIMITER - Static variable in class edu.iu.dsc.tws.data.api.splits.CSVInputSplit
-
- DEFAULT_FILESYSTEM_SCHEME - Static variable in class edu.iu.dsc.tws.api.data.DataConstants
-
The default filesystem to be used, if no other scheme is specified in the
user-provided URI (= local filesystem)
- DEFAULT_FOLDER_PATH - Static variable in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManagerContext
-
File path to store the LMDB database
- DEFAULT_FORMAT - Static variable in class edu.iu.dsc.tws.common.logging.LoggingContext
-
- DEFAULT_FORMAT - Static variable in class edu.iu.dsc.tws.common.logging.LoggingHelper
-
- DEFAULT_HDFS_FILESYSTEM_SCHEME - Static variable in class edu.iu.dsc.tws.api.data.DataConstants
-
- DEFAULT_LINE_DELIMITER - Static variable in class edu.iu.dsc.tws.data.api.splits.CSVInputSplit
-
- DEFAULT_MAX_LAG - Static variable in class edu.iu.dsc.tws.task.window.core.BaseWindowedSink
-
- DEFAULT_NUMBER_OF_CONTAINERS - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
-
- DEFAULT_PARALLELISM - Static variable in class edu.iu.dsc.tws.task.impl.TaskConfigurations
-
- DEFAULT_RAM_SIZE - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
-
- DEFAULT_RECORD_LENGTH - Static variable in class edu.iu.dsc.tws.data.api.splits.BinaryInputSplit
-
The default value of the record length
- DEFAULT_REF - Static variable in interface edu.iu.dsc.tws.api.dataset.DataPartition
-
- DEFAULT_TAB_DELIMITER - Static variable in class edu.iu.dsc.tws.data.api.splits.CSVInputSplit
-
- DEFAULT_UNDEFINED - Static variable in class edu.iu.dsc.tws.deeplearning.common.ParameterTool
-
- DEFAULT_USE_DOCKER_CONTAINER - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
-
- DEFAULT_WATERMARK_INTERVAL - Static variable in class edu.iu.dsc.tws.task.window.core.BaseWindowedSink
-
- DEFAULT_WORKER_PORT - Static variable in class edu.iu.dsc.tws.rsched.schedulers.mesos.MesosContext
-
- DEFAULT_WRITE_BUFFER_MAP_SIZE - Static variable in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManagerContext
-
- defaultBarrierDir(String, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKUtils
-
construct default barrier directory path for the job
- defaultData - Variable in class edu.iu.dsc.tws.deeplearning.common.ParameterTool
-
- DefaultDestinationSelector - Class in edu.iu.dsc.tws.executor.comms
-
- DefaultDestinationSelector(TaskPartitioner, Map<Integer, Integer>, Map<Integer, Integer>) - Constructor for class edu.iu.dsc.tws.executor.comms.DefaultDestinationSelector
-
- DefaultDriver - Class in edu.iu.dsc.tws.api.driver
-
- DefaultDriver() - Constructor for class edu.iu.dsc.tws.api.driver.DefaultDriver
-
- DefaultEdge<I,V> - Class in edu.iu.dsc.tws.graphapi.vertex
-
- DefaultEdge() - Constructor for class edu.iu.dsc.tws.graphapi.vertex.DefaultEdge
-
- DefaultEvictionContext - Class in edu.iu.dsc.tws.task.window.api
-
- DefaultEvictionContext(Long) - Constructor for class edu.iu.dsc.tws.task.window.api.DefaultEvictionContext
-
- DefaultEvictionContext(Long, Long) - Constructor for class edu.iu.dsc.tws.task.window.api.DefaultEvictionContext
-
- DefaultEvictionContext(Long, Long, Long) - Constructor for class edu.iu.dsc.tws.task.window.api.DefaultEvictionContext
-
- DefaultEvictionContext(Long, Long, Long, Long) - Constructor for class edu.iu.dsc.tws.task.window.api.DefaultEvictionContext
-
- DefaultEvictionContext - Class in org.apache.storm.windowing
-
- DefaultEvictionContext(Long) - Constructor for class org.apache.storm.windowing.DefaultEvictionContext
-
- DefaultEvictionContext(Long, Long) - Constructor for class org.apache.storm.windowing.DefaultEvictionContext
-
- DefaultEvictionContext(Long, Long, Long) - Constructor for class org.apache.storm.windowing.DefaultEvictionContext
-
- DefaultEvictionContext(Long, Long, Long, Long) - Constructor for class org.apache.storm.windowing.DefaultEvictionContext
-
- DefaultOutputCollection - Class in edu.iu.dsc.tws.executor.core
-
- DefaultOutputCollection(BlockingQueue<IMessage>) - Constructor for class edu.iu.dsc.tws.executor.core.DefaultOutputCollection
-
- defaults - Static variable in class edu.iu.dsc.tws.api.config.Context
-
- defaultTaskInstancesPerContainer(Config) - Static method in class edu.iu.dsc.tws.tsched.spi.common.TaskSchedulerContext
-
- DefaultVertex<I,V,E> - Class in edu.iu.dsc.tws.graphapi.vertex
-
- DefaultVertex() - Constructor for class edu.iu.dsc.tws.graphapi.vertex.DefaultVertex
-
- defineFlag(String, int, boolean) - Static method in class edu.iu.dsc.tws.examples.utils.bench.Timing
-
This method will allocate initial capacity required for array list
- delete(Path, boolean) - Method in class edu.iu.dsc.tws.api.data.FileSystem
-
- delete(String, Integer) - Method in class edu.iu.dsc.tws.dashboard.services.ComputeResourceService
-
- delete(Path, boolean) - Method in class edu.iu.dsc.tws.data.fs.local.LocalFileSystem
-
- delete(Path, boolean) - Method in class edu.iu.dsc.tws.data.hdfs.HadoopFileSystem
-
- delete(int, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
-
- delete(int, String) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
-
- delete(int, ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
-
- delete(int, String) - Method in class edu.iu.dsc.tws.data.memory.lmdb.LMDBMemoryManager
-
- delete(int, ByteBuffer) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
-
delete the given key from the store
- delete(int, String) - Method in interface edu.iu.dsc.tws.data.memory.MemoryManager
-
delete the given key from the store
- delete(ByteBuffer) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
-
- delete(String) - Method in class edu.iu.dsc.tws.data.memory.OperationMemoryManager
-
- delete(String) - Method in class edu.iu.dsc.tws.rsched.uploaders.hdfs.HdfsController
-
- delete(String) - Method in class edu.iu.dsc.tws.rsched.uploaders.scp.ScpController
-
- delete(K) - Method in class org.apache.storm.state.InMemoryKeyValueState
-
- delete(K) - Method in interface org.apache.storm.state.KeyValueState
-
Deletes the value mapped to the key, if there is any
- DELETE_OPTIONS_PROPAGATION_POLICY - Static variable in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesConstants
-
- DELETE_TAG - Static variable in class edu.iu.dsc.tws.common.zk.ZKEphemStateManager
-
- deleteByJob_JobIDAndIndex(String, Integer) - Method in interface edu.iu.dsc.tws.dashboard.repositories.ComputeResourceRepository
-
- deleteComputeResource(String, Integer) - Method in class edu.iu.dsc.tws.dashboard.controllers.JobController
-
- deleteConfigMap(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
-
delete the given ConfigMap from Kubernetes master
- deleteDir(String) - Static method in class edu.iu.dsc.tws.rsched.utils.FileUtils
-
- deleteFile(String) - Static method in class edu.iu.dsc.tws.rsched.utils.FileUtils
-
- deleteFromBMM(int, String) - Method in class edu.iu.dsc.tws.data.memory.BufferedMemoryManager
-
- deleteJobMasterZNode() - Method in class edu.iu.dsc.tws.common.zk.ZKJobMasterRegistrar
-
this method can be used to delete the znode from a previous session
if you don't want to wait the ZooKeeper to delete the ephemeral znode
if ZKJobMasterRegistrar is not closed properly in the previous session,
it takes around 30 seconds for ZooKeeper to delete the ephemeral JobMaster node
- deleteJobPackage(List<String>, String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
-
delete job package file from uploader web server pods
currently it does not delete job package file from multiple uploader pods
so, It is not in use
- deleteJobZNode(CuratorFramework, String, String) - Static method in class edu.iu.dsc.tws.common.zk.JobZNodeManager
-
delete job znode from zk server
- deletePersistentVolume(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
-
- deletePersistentVolumeClaim(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
-
- deleteService(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
-
delete the given service from Kubernetes master
- deleteStatefulSet(String) - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.KubernetesController
-
delete the given StatefulSet from Kubernetes master
- deleteUndeletedResources() - Method in class edu.iu.dsc.tws.rsched.schedulers.k8s.ClientJobKillHandler
-
- deleteWorkerZNode(CuratorFramework, String) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
-
delete the worker znode at a barrier directory
- deleteWorkerZNodeFromDefault(CuratorFramework, String, String, int) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
-
delete the worker znode at the default barrier directory
- deleteWorkerZNodeFromInit(CuratorFramework, String, String, int) - Static method in class edu.iu.dsc.tws.common.zk.ZKBarrierManager
-
delete the worker znode at the init barrier directory
- DelimitedInputSplit<OT> - Class in edu.iu.dsc.tws.data.api.splits
-
- DelimitedInputSplit(int, Path, long, long, String[]) - Constructor for class edu.iu.dsc.tws.data.api.splits.DelimitedInputSplit
-
Constructs a split with host information.
- DELIMITER - Static variable in class edu.iu.dsc.tws.examples.ml.svm.constant.Constants.SimpleGraphConfig
-
- deserialize(byte[]) - Method in class edu.iu.dsc.tws.api.util.KryoSerializer
-
- deserialize(InputStream) - Method in class edu.iu.dsc.tws.api.util.KryoSerializer
-
- deserialize(byte[]) - Static method in class edu.iu.dsc.tws.executor.util.Utils
-
- deserialize(ByteBuffer) - Method in interface org.apache.storm.spout.MultiScheme
-
- deserialize(ByteBuffer) - Method in interface org.apache.storm.spout.Scheme
-
- deserialize(byte[]) - Static method in class org.apache.storm.utils.Utils
-
- deserializeDouble(ByteBuffer) - Static method in class edu.iu.dsc.tws.data.utils.MemoryDeserializer
-
- deserializeInteger(ByteBuffer) - Static method in class edu.iu.dsc.tws.data.utils.MemoryDeserializer
-