edu.iu.dsc.tws.examples.ml.svm.util

Class DataUtils

java.lang.Object

edu.iu.dsc.tws.examples.ml.svm.util.DataUtils

public final class DataUtils
extends java.lang.Object

Method Summary

Modifier and Type	Method and Description
static double[]	arrayFromString(java.lang.String s)
static double[]	arrayFromString(java.lang.String s, java.lang.String delemiter)
static double[]	arrayFromString(java.lang.String s, java.lang.String delemiter, boolean trim)
static double[]	average(double[] a, int processes)
static double[]	combineLabelAndData(double[] x, double y) This method combines the label and features in the data point This can be use to submit a single message in the stream
static BinaryBatchModel	generateBinaryModel(double[][] xy, int iterations, double alpha) Deprecated. method
static double[][]	generateDummyDataPoints(int samples, int features) This method provides a dummy data set for batch based computations User can say the number of samples and feature size and this function generates a data set with labels included per data sample
static double[][]	getDataObjectToDoubleArray(DataObject<java.lang.Object> dataPointsObject1)
static double[][]	getDataPointsFromDataObject(java.lang.Object object) This method is used to convert the input data obtained from a different SourceTask
static double[][]	getWeightVectorFromDataObject(java.lang.Object object) This method is used to convert the input data obtained from a different SourceTask
static double[]	seedDoubleArray(int features) This method populates the array with a Gaussian Distribution
static BinaryBatchModel	updateModelData(BinaryBatchModel binaryBatchModel, double[][] xy) This method updates an existing BinaryBatchModel with the data points

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

seedDoubleArray

public static double[] seedDoubleArray(int features)

This method populates the array with a Gaussian Distribution

Parameters:

features - : number of features in a data point

combineLabelAndData

public static double[] combineLabelAndData(double[] x,
                                           double y)

This method combines the label and features in the data point This can be use to submit a single message in the stream

Parameters:

x - data points with d features

y - label

Returns:

[y, x_i, ...x_d]

generateDummyDataPoints

public static double[][] generateDummyDataPoints(int samples,
                                                 int features)

This method provides a dummy data set for batch based computations User can say the number of samples and feature size and this function generates a data set with labels included per data sample

Parameters:

samples - number of data points = N

features - number of features in a data point = D

Returns:

data.length = N, data[0].length = D + 1, i.e: data[i][0]== label, data[i][1:D+1]== {x}

generateBinaryModel

@Deprecated
public static BinaryBatchModel generateBinaryModel(double[][] xy,
                                                               int iterations,
                                                               double alpha)

Deprecated. method

This method is deprecated and use the updateModelData method to update the model with data points

Parameters:

xy - data points with {y_i, x_i_1, .... x_i_d}

iterations - number of iterations

alpha - learning rate

Returns:

returns the BinaryBatchModel

updateModelData

public static BinaryBatchModel updateModelData(BinaryBatchModel binaryBatchModel,
                                               double[][] xy)

This method updates an existing BinaryBatchModel with the data points

Parameters:

binaryBatchModel - Binary Batch Model

xy - data points with {y_i, x_i_1, .... x_i_d}

Returns:

returns the updated model

getDataPointsFromDataObject

public static double[][] getDataPointsFromDataObject(java.lang.Object object)

This method is used to convert the input data obtained from a different SourceTask

getWeightVectorFromDataObject

public static double[][] getWeightVectorFromDataObject(java.lang.Object object)

This method is used to convert the input data obtained from a different SourceTask

getDataObjectToDoubleArray

public static double[][] getDataObjectToDoubleArray(DataObject<java.lang.Object> dataPointsObject1)

arrayFromString

public static double[] arrayFromString(java.lang.String s)

arrayFromString

public static double[] arrayFromString(java.lang.String s,
                                       java.lang.String delemiter)

arrayFromString

public static double[] arrayFromString(java.lang.String s,
                                       java.lang.String delemiter,
                                       boolean trim)

average

public static double[] average(double[] a,
                               int processes)