| Modifier and Type | Method and Description | 
|---|---|
| static org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock> | MLContextConversionUtil. frameObjectToBinaryBlocks(FrameObject frameObject,
                         SparkExecutionContext sparkExecutionContext)Convert a  FrameObjectto aJavaPairRDD<Long, FrameBlock>. | 
| static org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> | MLContextConversionUtil. frameObjectToDataFrame(FrameObject frameObject,
                      SparkExecutionContext sparkExecutionContext)Convert a  FrameObjectto aDataFrame. | 
| static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> | MLContextConversionUtil. matrixObjectToBinaryBlocks(MatrixObject matrixObject,
                          SparkExecutionContext sparkExecutionContext)Convert a  MatrixObjectto aJavaPairRDD<MatrixIndexes, MatrixBlock>. | 
| static org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> | MLContextConversionUtil. matrixObjectToDataFrame(MatrixObject matrixObject,
                       SparkExecutionContext sparkExecutionContext,
                       boolean isVectorDF)Convert a  MatrixObjectto aDataFrame. | 
| Constructor and Description | 
|---|
| Frame(FrameObject frameObject,
     SparkExecutionContext sparkExecutionContext) | 
| Matrix(MatrixObject matrixObject,
      SparkExecutionContext sparkExecutionContext) | 
| Modifier and Type | Method and Description | 
|---|---|
| static org.apache.spark.api.java.JavaPairRDD<Integer,scala.Tuple2<MatrixBlock,MatrixBlock>> | ParamservUtils. doPartitionOnSpark(SparkExecutionContext sec,
                  MatrixObject features,
                  MatrixObject labels,
                  Statement.PSScheme scheme,
                  int workerNum) | 
| Constructor and Description | 
|---|
| DataPartitionerSparkMapper(Statement.PSScheme scheme,
                          int workersNum,
                          SparkExecutionContext sec,
                          int numEntries) | 
| Modifier and Type | Method and Description | 
|---|---|
| void | UnaryFrameSPInstruction. detectSchema(SparkExecutionContext sec) | 
| Modifier and Type | Method and Description | 
|---|---|
| static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> | RDDSortUtils. sortDataByValMemSort(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val,
                    org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data,
                    boolean asc,
                    long rlen,
                    long clen,
                    int blen,
                    SparkExecutionContext sec,
                    ReorgOperator r_op)This function collects and sorts value column in memory and then broadcasts it. | 
Copyright © 2021 The Apache Software Foundation. All rights reserved.