Uses of Class
org.apache.sysds.runtime.matrix.data.MatrixBlock
-
-
Uses of MatrixBlock in org.apache.sysds.api.jmlc
Methods in org.apache.sysds.api.jmlc that return MatrixBlock Modifier and Type Method Description MatrixBlockConnection. convertToMatrix(InputStream input, int rows, int cols)Converts an input stream of a string matrix in text format into a matrix block.MatrixBlockConnection. convertToMatrix(InputStream input, int rows, int cols, String format)Converts an input stream of a string matrix in csv or text format into a matrix block.MatrixBlockConnection. convertToMatrix(InputStream input, String meta)Converts an input stream of a string matrix in csv or textcell format into a matrix block.MatrixBlockConnection. convertToMatrix(String input, int rows, int cols)Converts an input string representation of a matrix in textcell format into a matrix block.MatrixBlockConnection. convertToMatrix(String input, String meta)Converts an input string representation of a matrix in csv or textcell format into a matrix block.MatrixBlockResultVariables. getMatrixBlock(String varname)Obtain the matrix represented by the given output variable.Methods in org.apache.sysds.api.jmlc with parameters of type MatrixBlock Modifier and Type Method Description voidPreparedScript. setMatrix(String varname, MatrixBlock matrix, boolean reuse)Binds a matrix object to a registered input variable. -
Uses of MatrixBlock in org.apache.sysds.api.mlcontext
Methods in org.apache.sysds.api.mlcontext that return MatrixBlock Modifier and Type Method Description static MatrixBlockMLContextConversionUtil. binaryBlocksToMatrixBlock(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> binaryBlocks, MatrixMetadata matrixMetadata)Convert aJavaPairRDD<MatrixIndexes, MatrixBlock>to aMatrixBlockMatrixBlockMatrix. toMatrixBlock()Obtain the matrix as aMatrixBlockMethods in org.apache.sysds.api.mlcontext that return types with arguments of type MatrixBlock Modifier and Type Method Description static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>MLContextConversionUtil. dataFrameToMatrixBinaryBlocks(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame)Convert aDataFrameto aJavaPairRDD<MatrixIndexes, MatrixBlock>binary-block matrix.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>MLContextConversionUtil. dataFrameToMatrixBinaryBlocks(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame, MatrixMetadata matrixMetadata)Convert aDataFrameto aJavaPairRDD<MatrixIndexes, MatrixBlock>binary-block matrix.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>MLContextConversionUtil. matrixObjectToBinaryBlocks(MatrixObject matrixObject, SparkExecutionContext sparkExecutionContext)Convert aMatrixObjectto aJavaPairRDD<MatrixIndexes, MatrixBlock>.org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>Matrix. toBinaryBlocks()Obtain the matrix as aJavaPairRDD<MatrixIndexes, MatrixBlock>Methods in org.apache.sysds.api.mlcontext with parameters of type MatrixBlock Modifier and Type Method Description static MatrixObjectMLContextConversionUtil. matrixBlockToMatrixObject(String variableName, MatrixBlock matrixBlock, MatrixMetadata matrixMetadata)Convert aMatrixBlockto aMatrixObject.Method parameters in org.apache.sysds.api.mlcontext with type arguments of type MatrixBlock Modifier and Type Method Description static MatrixBlockMLContextConversionUtil. binaryBlocksToMatrixBlock(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> binaryBlocks, MatrixMetadata matrixMetadata)Convert aJavaPairRDD<MatrixIndexes, MatrixBlock>to aMatrixBlockstatic MatrixObjectMLContextConversionUtil. binaryBlocksToMatrixObject(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> binaryBlocks)Convert aJavaPairRDD<MatrixIndexes, MatrixBlock>to aMatrixObject.static MatrixObjectMLContextConversionUtil. binaryBlocksToMatrixObject(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> binaryBlocks, MatrixMetadata matrixMetadata)Convert aJavaPairRDD<MatrixIndexes, MatrixBlock>to aMatrixObject.Constructor parameters in org.apache.sysds.api.mlcontext with type arguments of type MatrixBlock Constructor Description Matrix(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> binaryBlocks, MatrixMetadata matrixMetadata)Create a Matrix, specifying the SystemDS binary-block matrix and its metadata. -
Uses of MatrixBlock in org.apache.sysds.hops.estim
Methods in org.apache.sysds.hops.estim that return MatrixBlock Modifier and Type Method Description MatrixBlockMMNode. getData()MatrixBlockEstimatorDensityMap.DensityMap. getMap()Methods in org.apache.sysds.hops.estim with parameters of type MatrixBlock Modifier and Type Method Description voidEstimatorLayeredGraph.LayeredGraph. buildNext(MatrixBlock mb)static EstimatorBitsetMM.BitsetMatrixEstimatorBitsetMM. createBitset(MatrixBlock in)doubleEstimatorBasicAvg. estim(MatrixBlock m, SparsityEstimator.OpCode op)doubleEstimatorBasicAvg. estim(MatrixBlock m1, MatrixBlock m2)doubleEstimatorBasicAvg. estim(MatrixBlock m1, MatrixBlock m2, SparsityEstimator.OpCode op)doubleEstimatorBasicWorst. estim(MatrixBlock m, SparsityEstimator.OpCode op)doubleEstimatorBasicWorst. estim(MatrixBlock m1, MatrixBlock m2)doubleEstimatorBasicWorst. estim(MatrixBlock m1, MatrixBlock m2, SparsityEstimator.OpCode op)doubleEstimatorBitsetMM. estim(MatrixBlock m, SparsityEstimator.OpCode op)doubleEstimatorBitsetMM. estim(MatrixBlock m1, MatrixBlock m2)doubleEstimatorBitsetMM. estim(MatrixBlock m1, MatrixBlock m2, SparsityEstimator.OpCode op)doubleEstimatorDensityMap. estim(MatrixBlock m, SparsityEstimator.OpCode op)doubleEstimatorDensityMap. estim(MatrixBlock m1, MatrixBlock m2)doubleEstimatorDensityMap. estim(MatrixBlock m1, MatrixBlock m2, SparsityEstimator.OpCode op)doubleEstimatorLayeredGraph. estim(MatrixBlock m, SparsityEstimator.OpCode op)doubleEstimatorLayeredGraph. estim(MatrixBlock m1, MatrixBlock m2)doubleEstimatorLayeredGraph. estim(MatrixBlock m1, MatrixBlock m2, SparsityEstimator.OpCode op)doubleEstimatorMatrixHistogram. estim(MatrixBlock m1, SparsityEstimator.OpCode op)doubleEstimatorMatrixHistogram. estim(MatrixBlock m1, MatrixBlock m2)doubleEstimatorMatrixHistogram. estim(MatrixBlock m1, MatrixBlock m2, SparsityEstimator.OpCode op)doubleEstimatorSample. estim(MatrixBlock m, SparsityEstimator.OpCode op)doubleEstimatorSample. estim(MatrixBlock m1, MatrixBlock m2)doubleEstimatorSample. estim(MatrixBlock m1, MatrixBlock m2, SparsityEstimator.OpCode op)doubleEstimatorSampleRa. estim(MatrixBlock m, SparsityEstimator.OpCode op)doubleEstimatorSampleRa. estim(MatrixBlock m1, MatrixBlock m2)doubleEstimatorSampleRa. estim(MatrixBlock m1, MatrixBlock m2, SparsityEstimator.OpCode op)abstract doubleSparsityEstimator. estim(MatrixBlock m, SparsityEstimator.OpCode op)Estimates the output sparsity for a given unary operation.abstract doubleSparsityEstimator. estim(MatrixBlock m1, MatrixBlock m2)Estimates the output sparsity for a single matrix multiplication.abstract doubleSparsityEstimator. estim(MatrixBlock m1, MatrixBlock m2, SparsityEstimator.OpCode op)Estimates the output sparsity for a given binary operation.static longEstimationUtils. getSelfProductOutputNnz(MatrixBlock m1)This utility function computes the exact output nnz of a self matrix product without need to materialize the output.static longEstimationUtils. getSparseProductOutputNnz(MatrixBlock m1, MatrixBlock m2)voidEstimatorMatrixHistogram.MatrixHistogram. setData(MatrixBlock mb)Constructors in org.apache.sysds.hops.estim with parameters of type MatrixBlock Constructor Description BitsetMatrix1(MatrixBlock in)BitsetMatrix2(MatrixBlock in)DensityMap(MatrixBlock in, int b)DensityMap(MatrixBlock map, int rlenOrig, int clenOrig, int b, boolean scaled)MatrixHistogram(MatrixBlock in, boolean useExcepts)MMNode(MatrixBlock in)Constructor parameters in org.apache.sysds.hops.estim with type arguments of type MatrixBlock Constructor Description LayeredGraph(List<MatrixBlock> chain, int r) -
Uses of MatrixBlock in org.apache.sysds.hops.rewrite
Methods in org.apache.sysds.hops.rewrite with parameters of type MatrixBlock Modifier and Type Method Description static voidHopRewriteUtils. copyLineNumbers(MatrixBlock mb, Hop tread)static DataOpHopRewriteUtils. createTransientRead(String name, MatrixBlock mb) -
Uses of MatrixBlock in org.apache.sysds.runtime.codegen
Fields in org.apache.sysds.runtime.codegen declared as MatrixBlock Modifier and Type Field Description MatrixBlockSpoofOperator.SideInput. mdatConstructors in org.apache.sysds.runtime.codegen with parameters of type MatrixBlock Constructor Description SideInput(DenseBlock ddata, MatrixBlock mdata, int clength) -
Uses of MatrixBlock in org.apache.sysds.runtime.compress
Subclasses of MatrixBlock in org.apache.sysds.runtime.compress Modifier and Type Class Description classCompressedMatrixBlockMethods in org.apache.sysds.runtime.compress that return MatrixBlock Modifier and Type Method Description MatrixBlockCompressedMatrixBlock. aggregateBinaryOperations(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, AggregateBinaryOperator op)MatrixBlockCompressedMatrixBlock. aggregateBinaryOperations(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, AggregateBinaryOperator op, boolean transposeLeft, boolean transposeRight)MatrixBlockCompressedMatrixBlock. aggregateTernaryOperations(MatrixBlock m1, MatrixBlock m2, MatrixBlock m3, MatrixBlock ret, AggregateTernaryOperator op, boolean inCP)MatrixBlockCompressedMatrixBlock. aggregateUnaryOperations(AggregateUnaryOperator op, MatrixValue result, int blen, MatrixIndexes indexesIn, boolean inCP)MatrixBlockCompressedMatrixBlock. append(MatrixBlock[] that, MatrixBlock ret, boolean cbind)MatrixBlockCompressedMatrixBlock. binaryOperations(BinaryOperator op, MatrixValue thatValue, MatrixValue result)MatrixBlockCompressedMatrixBlock. binaryOperationsInPlace(BinaryOperator op, MatrixValue thatValue)MatrixBlockCompressedMatrixBlock. binaryOperationsLeft(BinaryOperator op, MatrixValue thatValue, MatrixValue result)MatrixBlockCompressedMatrixBlock. chainMatrixMultOperations(MatrixBlock v, MatrixBlock w, MatrixBlock out, MapMultChain.ChainType ctype, int k)MatrixBlockCompressedMatrixBlock. colSum()MatrixBlockCompressedMatrixBlock. copyShallow(MatrixBlock that)MatrixBlockCompressedMatrixBlock. ctableSeqOperations(MatrixValue thatMatrix, double thatScalar, MatrixBlock resultBlock, boolean updateClen)MatrixBlockCompressedMatrixBlock. decompress()Decompress block into a MatrixBlockMatrixBlockCompressedMatrixBlock. decompress(int k)Decompress block into a MatrixBlockMatrixBlockCompressedMatrixBlock. extractTriangular(MatrixBlock ret, boolean lower, boolean diag, boolean values)MatrixBlockCompressedMatrixBlock. getCachedDecompressed()Get the cached decompressed matrix (if it exists otherwise null).MatrixBlockCompressedMatrixBlock. getUncompressed()MatrixBlockCompressedMatrixBlock. getUncompressed(String operation)MatrixBlockCompressedMatrixBlock. getUncompressed(String operation, int k)static MatrixBlockCompressedMatrixBlock. getUncompressed(MatrixValue mVal)static MatrixBlockCompressedMatrixBlock. getUncompressed(MatrixValue mVal, String message)MatrixBlockCompressedMatrixBlock. groupedAggOperations(MatrixValue tgt, MatrixValue wghts, MatrixValue ret, int ngroups, Operator op, int k)MatrixBlockCompressedMatrixBlock. leftIndexingOperations(ScalarObject scalar, int rl, int cl, MatrixBlock ret, MatrixObject.UpdateType update)MatrixBlockCompressedMatrixBlock. leftIndexingOperations(MatrixBlock rhsMatrix, int rl, int ru, int cl, int cu, MatrixBlock ret, MatrixObject.UpdateType update)MatrixBlockCompressedMatrixBlock. pickValues(MatrixValue quantiles, MatrixValue ret)MatrixBlockCompressedMatrixBlock. quaternaryOperations(QuaternaryOperator qop, MatrixBlock um, MatrixBlock vm, MatrixBlock wm, MatrixBlock out, int k)MatrixBlockCompressedMatrixBlock. randOperationsInPlace(RandomMatrixGenerator rgen, org.apache.commons.math3.random.Well1024a bigrand, long bSeed)MatrixBlockCompressedMatrixBlock. randOperationsInPlace(RandomMatrixGenerator rgen, org.apache.commons.math3.random.Well1024a bigrand, long bSeed, int k)MatrixBlockCompressedMatrixBlock. removeEmptyOperations(MatrixBlock ret, boolean rows, boolean emptyReturn, MatrixBlock select)MatrixBlockCompressedMatrixBlock. reorgOperations(ReorgOperator op, MatrixValue ret, int startRow, int startColumn, int length)MatrixBlockCompressedMatrixBlock. replaceOperations(MatrixValue result, double pattern, double replacement)MatrixBlockCompressedMatrixBlock. rexpandOperations(MatrixBlock ret, double max, boolean rows, boolean cast, boolean ignore, int k)MatrixBlockCompressedMatrixBlock. scalarOperations(ScalarOperator sop, MatrixValue result)MatrixBlockCompressedMatrixBlock. seqOperationsInPlace(double from, double to, double incr)MatrixBlockCompressedMatrixBlock. slice(int rl, int ru, int cl, int cu, boolean deep, CacheBlock ret)MatrixBlockCompressedMatrixBlock. sortOperations(MatrixValue weights, MatrixBlock result)MatrixBlockCompressedMatrixBlock. ternaryOperations(TernaryOperator op, MatrixBlock m2, MatrixBlock m3, MatrixBlock ret)MatrixBlockCompressedMatrixBlock. transposeSelfMatrixMultOperations(MatrixBlock out, MMTSJ.MMTSJType tstype, int k)MatrixBlockCompressedMatrixBlock. uaggouterchainOperations(MatrixBlock mbLeft, MatrixBlock mbRight, MatrixBlock mbOut, BinaryOperator bOp, AggregateUnaryOperator uaggOp)MatrixBlockCompressedMatrixBlock. unaryOperations(UnaryOperator op, MatrixValue result)MatrixBlockCompressedMatrixBlock. zeroOutOperations(MatrixValue result, IndexRange range, boolean complementary)Methods in org.apache.sysds.runtime.compress that return types with arguments of type MatrixBlock Modifier and Type Method Description Future<MatrixBlock>CompressedMatrixBlock. allocateBlockAsync()static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb)Default sequential compression with no parallelizationstatic org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, CompressionSettingsBuilder compSettings)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, CompressionSettingsBuilder compSettings, ACostEstimate costEstimator)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, CompressionSettingsBuilder compSettings, CostEstimatorBuilder csb)The main method for compressing the input matrix.static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, CompressionSettingsBuilder compSettings, WTreeRoot root)The main method for compressing the input matrix.static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, ACostEstimate costEstimator)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, CostEstimatorBuilder csb)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, InstructionTypeCounter ins)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, WTreeRoot root)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, CompressionSettingsBuilder customSettings)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, ACostEstimate costEstimator)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, CostEstimatorBuilder csb)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, InstructionTypeCounter ins)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, WTreeRoot root)SoftReference<MatrixBlock>CompressedMatrixBlock. getSoftReferenceToDecompressed()Methods in org.apache.sysds.runtime.compress with parameters of type MatrixBlock Modifier and Type Method Description MatrixBlockCompressedMatrixBlock. aggregateBinaryOperations(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, AggregateBinaryOperator op)MatrixBlockCompressedMatrixBlock. aggregateBinaryOperations(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, AggregateBinaryOperator op, boolean transposeLeft, boolean transposeRight)MatrixBlockCompressedMatrixBlock. aggregateTernaryOperations(MatrixBlock m1, MatrixBlock m2, MatrixBlock m3, MatrixBlock ret, AggregateTernaryOperator op, boolean inCP)MatrixBlockCompressedMatrixBlock. append(MatrixBlock[] that, MatrixBlock ret, boolean cbind)voidCompressedMatrixBlock. appendRowToSparse(SparseBlock dest, MatrixBlock src, int i, int rowoffset, int coloffset, boolean deep)MatrixBlockCompressedMatrixBlock. chainMatrixMultOperations(MatrixBlock v, MatrixBlock w, MatrixBlock out, MapMultChain.ChainType ctype, int k)CM_COV_ObjectCompressedMatrixBlock. cmOperations(CMOperator op, MatrixBlock weights)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb)Default sequential compression with no parallelizationstatic org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, CompressionSettingsBuilder compSettings)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, CompressionSettingsBuilder compSettings, ACostEstimate costEstimator)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, CompressionSettingsBuilder compSettings, CostEstimatorBuilder csb)The main method for compressing the input matrix.static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, CompressionSettingsBuilder compSettings, WTreeRoot root)The main method for compressing the input matrix.static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, ACostEstimate costEstimator)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, CostEstimatorBuilder csb)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, InstructionTypeCounter ins)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, int k, WTreeRoot root)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, CompressionSettingsBuilder customSettings)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, ACostEstimate costEstimator)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, CostEstimatorBuilder csb)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, InstructionTypeCounter ins)static org.apache.commons.lang3.tuple.Pair<MatrixBlock,CompressionStatistics>CompressedMatrixBlockFactory. compress(MatrixBlock mb, WTreeRoot root)voidCompressedMatrixBlock. copy(int rl, int ru, int cl, int cu, MatrixBlock src, boolean awareDestNZ)MatrixBlockCompressedMatrixBlock. copyShallow(MatrixBlock that)CM_COV_ObjectCompressedMatrixBlock. covOperations(COVOperator op, MatrixBlock that)CM_COV_ObjectCompressedMatrixBlock. covOperations(COVOperator op, MatrixBlock that, MatrixBlock weights)voidCompressedMatrixBlock. ctableOperations(Operator op, double scalar, double scalar2, CTableMap resultMap, MatrixBlock resultBlock)voidCompressedMatrixBlock. ctableOperations(Operator op, double scalar, MatrixValue that, CTableMap resultMap, MatrixBlock resultBlock)voidCompressedMatrixBlock. ctableOperations(Operator op, MatrixIndexes ix1, double scalar, boolean left, int brlen, CTableMap resultMap, MatrixBlock resultBlock)voidCompressedMatrixBlock. ctableOperations(Operator op, MatrixValue that, double scalar, boolean ignoreZeros, CTableMap resultMap, MatrixBlock resultBlock)voidCompressedMatrixBlock. ctableOperations(Operator op, MatrixValue that, MatrixValue that2, CTableMap resultMap, MatrixBlock resultBlock)MatrixBlockCompressedMatrixBlock. ctableSeqOperations(MatrixValue thatMatrix, double thatScalar, MatrixBlock resultBlock, boolean updateClen)MatrixBlockCompressedMatrixBlock. extractTriangular(MatrixBlock ret, boolean lower, boolean diag, boolean values)static CompressedMatrixBlockCompressedMatrixBlockFactory. genUncompressedCompressedMatrixBlock(MatrixBlock mb)Generate a CompressedMatrixBlock Object that contains a single uncompressed matrix block column group.MatrixBlockCompressedMatrixBlock. leftIndexingOperations(ScalarObject scalar, int rl, int cl, MatrixBlock ret, MatrixObject.UpdateType update)MatrixBlockCompressedMatrixBlock. leftIndexingOperations(MatrixBlock rhsMatrix, int rl, int ru, int cl, int cu, MatrixBlock ret, MatrixObject.UpdateType update)voidCompressedMatrixBlock. merge(MatrixBlock that, boolean appendOnly, boolean par, boolean deep)voidCompressedMatrixBlock. putInto(MatrixBlock target, int rowOffset, int colOffset, boolean sparseCopyShallow)MatrixBlockCompressedMatrixBlock. quaternaryOperations(QuaternaryOperator qop, MatrixBlock um, MatrixBlock vm, MatrixBlock wm, MatrixBlock out, int k)MatrixBlockCompressedMatrixBlock. removeEmptyOperations(MatrixBlock ret, boolean rows, boolean emptyReturn, MatrixBlock select)MatrixBlockCompressedMatrixBlock. rexpandOperations(MatrixBlock ret, double max, boolean rows, boolean cast, boolean ignore, int k)MatrixBlockCompressedMatrixBlock. sortOperations(MatrixValue weights, MatrixBlock result)MatrixBlockCompressedMatrixBlock. ternaryOperations(TernaryOperator op, MatrixBlock m2, MatrixBlock m3, MatrixBlock ret)MatrixBlockCompressedMatrixBlock. transposeSelfMatrixMultOperations(MatrixBlock out, MMTSJ.MMTSJType tstype, int k)MatrixBlockCompressedMatrixBlock. uaggouterchainOperations(MatrixBlock mbLeft, MatrixBlock mbRight, MatrixBlock mbOut, BinaryOperator bOp, AggregateUnaryOperator uaggOp) -
Uses of MatrixBlock in org.apache.sysds.runtime.compress.bitmap
Methods in org.apache.sysds.runtime.compress.bitmap with parameters of type MatrixBlock Modifier and Type Method Description static ABitmapBitmapEncoder. extractBitmap(int[] colIndices, MatrixBlock rawBlock, boolean transposed, int estimatedNumberOfUniques, boolean sortedEntries)Generate uncompressed bitmaps for a set of columns in an uncompressed matrix block. -
Uses of MatrixBlock in org.apache.sysds.runtime.compress.colgroup
Methods in org.apache.sysds.runtime.compress.colgroup that return MatrixBlock Modifier and Type Method Description MatrixBlockColGroupUncompressed. getData()Access for superclassMethods in org.apache.sysds.runtime.compress.colgroup with parameters of type MatrixBlock Modifier and Type Method Description static List<AColGroup>ColGroupFactory. compressColGroups(MatrixBlock in, CompressedSizeInfo csi, CompressionSettings cs, int k)The actual compression method, that handles the logic of compressing multiple columns together.static List<AColGroup>ColGroupFactory. compressColGroups(MatrixBlock in, CompressedSizeInfo csi, CompressionSettings cs, ACostEstimate ce, int k)static AColGroupColGroupUncompressed. create(int[] colIndexes, MatrixBlock rawBlock, boolean transposed)Main constructor for Uncompressed ColGroup.abstract voidAColGroup. leftMultByAColGroup(AColGroup lhs, MatrixBlock result)Left side matrix multiplication with a column group that is transposed.voidAMorphingMMColGroup. leftMultByAColGroup(AColGroup lhs, MatrixBlock result)voidAPreAgg. leftMultByAColGroup(AColGroup lhs, MatrixBlock result)voidColGroupConst. leftMultByAColGroup(AColGroup lhs, MatrixBlock result)voidColGroupEmpty. leftMultByAColGroup(AColGroup lhs, MatrixBlock c)voidColGroupOLE. leftMultByAColGroup(AColGroup lhs, MatrixBlock result)voidColGroupRLE. leftMultByAColGroup(AColGroup lhs, MatrixBlock result)voidColGroupUncompressed. leftMultByAColGroup(AColGroup lhs, MatrixBlock result)voidColGroupUncompressed. leftMultByMatrix(MatrixBlock matrix, MatrixBlock result, int rl, int ru)abstract voidAColGroup. leftMultByMatrixNoPreAgg(MatrixBlock matrix, MatrixBlock result, int rl, int ru, int cl, int cu)Left multiply with this column group.voidAMorphingMMColGroup. leftMultByMatrixNoPreAgg(MatrixBlock matrix, MatrixBlock result, int rl, int ru, int cl, int cu)voidASDCZero. leftMultByMatrixNoPreAgg(MatrixBlock matrix, MatrixBlock result, int rl, int ru, int cl, int cu)voidColGroupConst. leftMultByMatrixNoPreAgg(MatrixBlock matrix, MatrixBlock result, int rl, int ru, int cl, int cu)voidColGroupDDC. leftMultByMatrixNoPreAgg(MatrixBlock matrix, MatrixBlock result, int rl, int ru, int cl, int cu)voidColGroupDDCFOR. leftMultByMatrixNoPreAgg(MatrixBlock matrix, MatrixBlock result, int rl, int ru, int cl, int cu)voidColGroupEmpty. leftMultByMatrixNoPreAgg(MatrixBlock matrix, MatrixBlock result, int rl, int ru, int cl, int cu)voidColGroupOLE. leftMultByMatrixNoPreAgg(MatrixBlock matrix, MatrixBlock result, int rl, int ru, int cl, int cu)voidColGroupRLE. leftMultByMatrixNoPreAgg(MatrixBlock matrix, MatrixBlock result, int rl, int ru, int cl, int cu)voidColGroupUncompressed. leftMultByMatrixNoPreAgg(MatrixBlock matrix, MatrixBlock result, int rl, int ru, int cl, int cu)voidAPreAgg. mmWithDictionary(MatrixBlock preAgg, MatrixBlock tmpRes, MatrixBlock ret, int k, int rl, int ru)voidAPreAgg. preAggregate(MatrixBlock m, double[] preAgg, int rl, int ru)Pre aggregate a matrix block into a pre aggregate target (first step of left matrix multiplication)abstract voidAPreAgg. preAggregateDense(MatrixBlock m, double[] preAgg, int rl, int ru, int cl, int cu)Pre aggregate a dense matrix block into a pre aggregate target (first step of left matrix multiplication)voidColGroupDDC. preAggregateDense(MatrixBlock m, double[] preAgg, int rl, int ru, int cl, int cu)voidColGroupSDCSingleZeros. preAggregateDense(MatrixBlock m, double[] preAgg, int rl, int ru, int cl, int cu)voidColGroupSDCZeros. preAggregateDense(MatrixBlock m, double[] preAgg, int rl, int ru, int cl, int cu)abstract AColGroupAColGroup. rightMultByMatrix(MatrixBlock right)Right matrix multiplication with this column group.AColGroupAColGroupValue. rightMultByMatrix(MatrixBlock right)AColGroupColGroupConst. rightMultByMatrix(MatrixBlock right)AColGroupColGroupEmpty. rightMultByMatrix(MatrixBlock right)AColGroupColGroupUncompressed. rightMultByMatrix(MatrixBlock right)abstract voidAColGroup. tsmm(MatrixBlock ret, int nRows)Do a transposed self matrix multiplication on the left side t(x) %*% x.voidAColGroupCompressed. tsmm(MatrixBlock ret, int nRows)voidColGroupUncompressed. tsmm(MatrixBlock ret, int nRows)abstract voidAColGroup. tsmmAColGroup(AColGroup other, MatrixBlock result)Matrix multiply with this other column group, but: 1.voidAMorphingMMColGroup. tsmmAColGroup(AColGroup other, MatrixBlock result)voidAPreAgg. tsmmAColGroup(AColGroup other, MatrixBlock result)voidColGroupConst. tsmmAColGroup(AColGroup other, MatrixBlock result)voidColGroupEmpty. tsmmAColGroup(AColGroup other, MatrixBlock result)voidColGroupOLE. tsmmAColGroup(AColGroup other, MatrixBlock result)voidColGroupRLE. tsmmAColGroup(AColGroup other, MatrixBlock result)voidColGroupUncompressed. tsmmAColGroup(AColGroup lhs, MatrixBlock result)Constructors in org.apache.sysds.runtime.compress.colgroup with parameters of type MatrixBlock Constructor Description ColGroupUncompressed(MatrixBlock data)Constructor for allocating a single uncompressed column group. -
Uses of MatrixBlock in org.apache.sysds.runtime.compress.colgroup.dictionary
Methods in org.apache.sysds.runtime.compress.colgroup.dictionary that return MatrixBlock Modifier and Type Method Description MatrixBlockMatrixBlockDictionary. getMatrixBlock()Methods in org.apache.sysds.runtime.compress.colgroup.dictionary with parameters of type MatrixBlock Modifier and Type Method Description static voidDictLibMatrixMult. MMDicts(ADictionary left, ADictionary right, int[] rowsLeft, int[] colsRight, MatrixBlock result)Matrix Multiply the two dictionaries, note that the left side is considered transposed but not allocated transposed making the multiplication a: t(left) %*% rightstatic voidDictLibMatrixMult. MMDictsWithScaling(ADictionary left, ADictionary right, int[] leftRows, int[] rightColumns, MatrixBlock result, int[] counts)Matrix multiply with scaling (left side transposed)static voidDictLibMatrixMult. TSMMDictionaryWithScaling(ADictionary dict, int[] counts, int[] rows, int[] cols, MatrixBlock ret)Perform the full tsmm with the dictionary (allocating into the entire output matrix.)static voidDictLibMatrixMult. TSMMToUpperTriangle(ADictionary left, ADictionary right, int[] rowsLeft, int[] colsRight, MatrixBlock result)Does two matrix multiplications in one go but only add to the upper triangle.static voidDictLibMatrixMult. TSMMToUpperTriangleScaling(ADictionary left, ADictionary right, int[] rowsLeft, int[] colsRight, int[] scale, MatrixBlock result)Does two matrix multiplications in one go but only add to the upper triangle with scaling.Constructors in org.apache.sysds.runtime.compress.colgroup.dictionary with parameters of type MatrixBlock Constructor Description MatrixBlockDictionary(MatrixBlock data, int nCol) -
Uses of MatrixBlock in org.apache.sysds.runtime.compress.colgroup.mapping
Methods in org.apache.sysds.runtime.compress.colgroup.mapping with parameters of type MatrixBlock Modifier and Type Method Description voidAMapToData. preAggregateDense(MatrixBlock m, double[] preAV, int rl, int ru, int cl, int cu)Pre aggregate a dense matrix m into pre, subject to only including a row segment and column segment.voidAMapToData. preAggregateDense(MatrixBlock m, double[] preAV, int rl, int ru, int cl, int cu, AOffset indexes)PreAggregate a Dense Matrix at index offsets. -
Uses of MatrixBlock in org.apache.sysds.runtime.compress.colgroup.offset
Methods in org.apache.sysds.runtime.compress.colgroup.offset with parameters of type MatrixBlock Modifier and Type Method Description voidAOffset. preAggregateDenseMap(MatrixBlock m, double[] preAV, int rl, int ru, int cl, int cu, int nVal, AMapToData data) -
Uses of MatrixBlock in org.apache.sysds.runtime.compress.cost
Methods in org.apache.sysds.runtime.compress.cost with parameters of type MatrixBlock Modifier and Type Method Description abstract doubleACostEstimate. getCost(MatrixBlock mb)Get the cost of a matrix block.doubleComputationCostEstimator. getCost(MatrixBlock mb)doubleDistinctCostEstimator. getCost(MatrixBlock mb)doubleHybridCostEstimator. getCost(MatrixBlock mb)doubleMemoryCostEstimator. getCost(MatrixBlock mb) -
Uses of MatrixBlock in org.apache.sysds.runtime.compress.estim
Methods in org.apache.sysds.runtime.compress.estim with parameters of type MatrixBlock Modifier and Type Method Description static CompressedSizeEstimatorCompressedSizeEstimatorFactory. createEstimator(MatrixBlock data, CompressionSettings cs, int k)Create an estimator for the input data with the given settings and parallelization degree.static CompressedSizeEstimatorCompressedSizeEstimatorFactory. createEstimator(MatrixBlock data, CompressionSettings cs, int sampleSize, int k)Create an estimator for the input data with the given settings and parallelization degree.Constructors in org.apache.sysds.runtime.compress.estim with parameters of type MatrixBlock Constructor Description CompressedSizeEstimatorExact(MatrixBlock data, CompressionSettings compSettings)CompressedSizeEstimatorSample(MatrixBlock data, CompressionSettings cs, int sampleSize, int k)CompressedSizeEstimatorSample, samples from the input data and estimates the size of the compressed matrix. -
Uses of MatrixBlock in org.apache.sysds.runtime.compress.estim.encoding
Methods in org.apache.sysds.runtime.compress.estim.encoding with parameters of type MatrixBlock Modifier and Type Method Description static IEncodeIEncode. createFromMatrixBlock(MatrixBlock m, boolean transposed, int rowCol)static IEncodeIEncode. createFromMatrixBlock(MatrixBlock m, boolean transposed, int[] rowCols)static IEncodeIEncode. createFromMatrixBlockDelta(MatrixBlock m, boolean transposed, int[] rowCols)static IEncodeIEncode. createFromMatrixBlockDelta(MatrixBlock m, boolean transposed, int[] rowCols, int nVals) -
Uses of MatrixBlock in org.apache.sysds.runtime.compress.lib
Methods in org.apache.sysds.runtime.compress.lib that return MatrixBlock Modifier and Type Method Description static MatrixBlockCLALibCompAgg. aggregateUnary(CompressedMatrixBlock inputMatrix, MatrixBlock result, AggregateUnaryOperator op, int blen, MatrixIndexes indexesIn, boolean inCP)static MatrixBlockCLALibAppend. append(MatrixBlock left, MatrixBlock right, int k)static MatrixBlockCLALibBinaryCellOp. binaryOperationsLeft(BinaryOperator op, CompressedMatrixBlock m1, MatrixBlock that, MatrixBlock result)static MatrixBlockCLALibBinaryCellOp. binaryOperationsRight(BinaryOperator op, CompressedMatrixBlock m1, MatrixBlock that, MatrixBlock result)static MatrixBlockCLALibDecompress. decompress(CompressedMatrixBlock cmb, int k)static MatrixBlockCLALibLeftMultBy. leftMultByMatrix(CompressedMatrixBlock right, MatrixBlock left, MatrixBlock ret, int k)Left multiplication with two CompressedMatrixBlock following the equation: ret = left %*% rightstatic MatrixBlockCLALibLeftMultBy. leftMultByMatrixTransposed(CompressedMatrixBlock right, CompressedMatrixBlock left, MatrixBlock ret, int k)Left multiplication with two CompressedMatrixBlock following the equation: ret = t(left) %*% rightstatic MatrixBlockCLALibLeftMultBy. leftMultByMatrixTransposed(CompressedMatrixBlock right, MatrixBlock left, MatrixBlock ret, int k)Left multiplication with a CompressedMatrixBlock on the right following the equation: ret = t(left) %*% rightstatic MatrixBlockCLALibMatrixMult. matrixMult(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, int k)static MatrixBlockCLALibMatrixMult. matrixMultiply(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, int k, boolean transposeLeft, boolean transposeRight)static MatrixBlockCLALibMMChain. mmChain(CompressedMatrixBlock x, MatrixBlock v, MatrixBlock w, MatrixBlock out, MapMultChain.ChainType ctype, int k)static MatrixBlockCLALibRexpand. rexpand(CompressedMatrixBlock in, MatrixBlock ret, double max, boolean rows, boolean cast, boolean ignore, int k)static MatrixBlockCLALibRightMultBy. rightMultByMatrix(CompressedMatrixBlock m1, MatrixBlock m2, MatrixBlock ret, int k)static MatrixBlockCLALibRightMultBy. rightMultByMatrix(CompressedMatrixBlock m1, MatrixBlock m2, MatrixBlock ret, int k, boolean allowOverlap)static MatrixBlockCLALibScalar. scalarOperations(ScalarOperator sop, CompressedMatrixBlock m1, MatrixValue result)static MatrixBlockCLALibSlice. slice(CompressedMatrixBlock cmb, int rl, int ru, int cl, int cu, boolean deep)static MatrixBlockCLALibUnary. unaryOperations(CompressedMatrixBlock m, UnaryOperator op, MatrixValue result)Methods in org.apache.sysds.runtime.compress.lib with parameters of type MatrixBlock Modifier and Type Method Description static MatrixBlockCLALibCompAgg. aggregateUnary(CompressedMatrixBlock inputMatrix, MatrixBlock result, AggregateUnaryOperator op, int blen, MatrixIndexes indexesIn, boolean inCP)static MatrixBlockCLALibAppend. append(MatrixBlock left, MatrixBlock right, int k)static MatrixBlockCLALibBinaryCellOp. binaryOperationsLeft(BinaryOperator op, CompressedMatrixBlock m1, MatrixBlock that, MatrixBlock result)static MatrixBlockCLALibBinaryCellOp. binaryOperationsRight(BinaryOperator op, CompressedMatrixBlock m1, MatrixBlock that, MatrixBlock result)static voidCLALibDecompress. decompressTo(CompressedMatrixBlock cmb, MatrixBlock ret, int rowOffset, int colOffset, int k)static MatrixBlockCLALibLeftMultBy. leftMultByMatrix(CompressedMatrixBlock right, MatrixBlock left, MatrixBlock ret, int k)Left multiplication with two CompressedMatrixBlock following the equation: ret = left %*% rightstatic MatrixBlockCLALibLeftMultBy. leftMultByMatrixTransposed(CompressedMatrixBlock right, CompressedMatrixBlock left, MatrixBlock ret, int k)Left multiplication with two CompressedMatrixBlock following the equation: ret = t(left) %*% rightstatic MatrixBlockCLALibLeftMultBy. leftMultByMatrixTransposed(CompressedMatrixBlock right, MatrixBlock left, MatrixBlock ret, int k)Left multiplication with a CompressedMatrixBlock on the right following the equation: ret = t(left) %*% rightstatic voidCLALibTSMM. leftMultByTransposeSelf(CompressedMatrixBlock cmb, MatrixBlock ret, int k)Self left Matrix multiplication (tsmm) t(x) %*% xstatic MatrixBlockCLALibMatrixMult. matrixMult(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, int k)static MatrixBlockCLALibMatrixMult. matrixMultiply(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, int k, boolean transposeLeft, boolean transposeRight)static MatrixBlockCLALibMMChain. mmChain(CompressedMatrixBlock x, MatrixBlock v, MatrixBlock w, MatrixBlock out, MapMultChain.ChainType ctype, int k)static MatrixBlockCLALibRexpand. rexpand(CompressedMatrixBlock in, MatrixBlock ret, double max, boolean rows, boolean cast, boolean ignore, int k)static MatrixBlockCLALibRightMultBy. rightMultByMatrix(CompressedMatrixBlock m1, MatrixBlock m2, MatrixBlock ret, int k)static MatrixBlockCLALibRightMultBy. rightMultByMatrix(CompressedMatrixBlock m1, MatrixBlock m2, MatrixBlock ret, int k, boolean allowOverlap) -
Uses of MatrixBlock in org.apache.sysds.runtime.compress.readers
Methods in org.apache.sysds.runtime.compress.readers with parameters of type MatrixBlock Modifier and Type Method Description static ReaderColumnSelectionReaderColumnSelection. createReader(MatrixBlock rawBlock, int[] colIndices, boolean transposed)static ReaderColumnSelectionReaderColumnSelection. createReader(MatrixBlock rawBlock, int[] colIndices, boolean transposed, int rl, int ru) -
Uses of MatrixBlock in org.apache.sysds.runtime.compress.utils
Methods in org.apache.sysds.runtime.compress.utils that return MatrixBlock Modifier and Type Method Description static MatrixBlockUtil. extractValues(double[] v, int[] colIndexes)static MatrixBlockUtil. matrixBlockFromDenseArray(double[] values, int nCol) -
Uses of MatrixBlock in org.apache.sysds.runtime.controlprogram.caching
Methods in org.apache.sysds.runtime.controlprogram.caching that return MatrixBlock Modifier and Type Method Description MatrixBlockMatrixObject. readMatrixPartition(IndexRange pred)NOTE: for reading matrix partitions, we could cache (in its real sense) the read block with soft references (no need for eviction, as partitioning only applied for read-only matrices).Methods in org.apache.sysds.runtime.controlprogram.caching with parameters of type MatrixBlock Modifier and Type Method Description voidMatrixObject. setInMemoryPartition(MatrixBlock block)Constructors in org.apache.sysds.runtime.controlprogram.caching with parameters of type MatrixBlock Constructor Description MatrixObject(Types.ValueType vt, String file, MetaData mtd, MatrixBlock data)Constructor that takes the value type, HDFS filename and associated metadata and a MatrixBlock used for creation after serialization -
Uses of MatrixBlock in org.apache.sysds.runtime.controlprogram.context
Methods in org.apache.sysds.runtime.controlprogram.context that return MatrixBlock Modifier and Type Method Description MatrixBlockExecutionContext. getMatrixInput(String varName)Pins a matrix variable into memory and returns the internal matrix block.MatrixBlockExecutionContext. getMatrixInput(CPOperand input)static MatrixBlockSparkExecutionContext. toMatrixBlock(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> rdd, int rlen, int clen, int blen, long nnz)Utility method for creating a single matrix block out of a binary block RDD.static MatrixBlockSparkExecutionContext. toMatrixBlock(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixCell> rdd, int rlen, int clen, long nnz)Utility method for creating a single matrix block out of a binary cell RDD.static MatrixBlockSparkExecutionContext. toMatrixBlock(RDDObject rdd, int rlen, int clen, int blen, long nnz)This method is a generic abstraction for calls from the buffer pool.static MatrixBlockSparkExecutionContext. toMatrixBlock(RDDObject rdd, int rlen, int clen, long nnz)Methods in org.apache.sysds.runtime.controlprogram.context that return types with arguments of type MatrixBlock Modifier and Type Method Description org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>SparkExecutionContext. getBinaryMatrixBlockRDDHandleForVariable(String varname)Spark instructions should call this for all matrix inputs except broadcast variables.org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>SparkExecutionContext. getBinaryMatrixBlockRDDHandleForVariable(String varname, int numParts, boolean inclEmpty)PartitionedBroadcast<MatrixBlock>SparkExecutionContext. getBroadcastForMatrixObject(MatrixObject mo)PartitionedBroadcast<MatrixBlock>SparkExecutionContext. getBroadcastForVariable(String varname)List<MatrixBlock>ExecutionContext. getMatrixInputs(CPOperand[] inputs)List<MatrixBlock>ExecutionContext. getMatrixInputs(CPOperand[] inputs, boolean includeList)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>SparkExecutionContext. toMatrixJavaPairRDD(org.apache.spark.api.java.JavaSparkContext sc, MatrixBlock src, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>SparkExecutionContext. toMatrixJavaPairRDD(org.apache.spark.api.java.JavaSparkContext sc, MatrixBlock src, int blen, int numParts, boolean inclEmpty)static PartitionedBlock<MatrixBlock>SparkExecutionContext. toPartitionedMatrixBlock(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> rdd, int rlen, int clen, int blen, long nnz)Methods in org.apache.sysds.runtime.controlprogram.context with parameters of type MatrixBlock Modifier and Type Method Description static MatrixObjectExecutionContext. createMatrixObject(MatrixBlock mb)voidExecutionContext. setMatrixOutput(String varName, MatrixBlock outputData)voidExecutionContext. setMatrixOutput(String varName, MatrixBlock outputData, MatrixObject.UpdateType flag)voidExecutionContext. setMatrixOutputAndLineage(String varName, MatrixBlock outputData, LineageItem li)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>SparkExecutionContext. toMatrixJavaPairRDD(org.apache.spark.api.java.JavaSparkContext sc, MatrixBlock src, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>SparkExecutionContext. toMatrixJavaPairRDD(org.apache.spark.api.java.JavaSparkContext sc, MatrixBlock src, int blen, int numParts, boolean inclEmpty)Method parameters in org.apache.sysds.runtime.controlprogram.context with type arguments of type MatrixBlock Modifier and Type Method Description static MatrixBlockSparkExecutionContext. toMatrixBlock(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> rdd, int rlen, int clen, int blen, long nnz)Utility method for creating a single matrix block out of a binary block RDD.static PartitionedBlock<MatrixBlock>SparkExecutionContext. toPartitionedMatrixBlock(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> rdd, int rlen, int clen, int blen, long nnz) -
Uses of MatrixBlock in org.apache.sysds.runtime.controlprogram.federated
Methods in org.apache.sysds.runtime.controlprogram.federated that return MatrixBlock Modifier and Type Method Description static MatrixBlockFederationUtils. aggAdd(Future<FederatedResponse>[] ffr)static MatrixBlockFederationUtils. aggMatrix(AggregateUnaryOperator aop, Future<FederatedResponse>[] ffr, Future<FederatedResponse>[] meanFfr, FederationMap map)static MatrixBlockFederationUtils. aggMatrix(AggregateUnaryOperator aop, Future<FederatedResponse>[] ffr, FederationMap map)static MatrixBlockFederationUtils. aggMean(Future<FederatedResponse>[] ffr, FederationMap map)static MatrixBlockFederationUtils. aggMinMax(Future<FederatedResponse>[] ffr, boolean isMin, boolean isScalar, Optional<FTypes.FType> fedType)static MatrixBlockFederationUtils. aggMinMaxIndex(Future<FederatedResponse>[] ffr, boolean isMin, FederationMap map)static MatrixBlockFederationUtils. aggProd(Future<FederatedResponse>[] ffr, FederationMap fedMap, AggregateUnaryOperator aop)static MatrixBlockFederationUtils. aggregateResponses(List<org.apache.commons.lang3.tuple.Pair<FederatedRange,Future<FederatedResponse>>> readResponses)Aggregate partially aggregated data from federated workers by adding values with the same index in different federated locations.static MatrixBlockFederationUtils. aggVar(Future<FederatedResponse>[] ffr, Future<FederatedResponse>[] meanFfr, FederationMap map, boolean isRowAggregate, boolean isScalar)static MatrixBlockFederationUtils. bind(Future<FederatedResponse>[] ffr, boolean cbind)static MatrixBlockFederationUtils. bindResponses(List<org.apache.commons.lang3.tuple.Pair<FederatedRange,Future<FederatedResponse>>> readResponses, long[] dims)Bind data from federated workers based on non-overlapping federated ranges.static MatrixBlock[]FederationUtils. getResults(Future<FederatedResponse>[] ffr) -
Uses of MatrixBlock in org.apache.sysds.runtime.controlprogram.paramserv
Methods in org.apache.sysds.runtime.controlprogram.paramserv that return MatrixBlock Modifier and Type Method Description static MatrixBlockParamservUtils. cbindMatrix(MatrixBlock left, MatrixBlock right)static MatrixBlockParamservUtils. generatePermutation(int numEntries, long seed)Generate the permutationstatic MatrixBlockParamservUtils. generateReplicationMatrix(int nsamples, int nrows, long seed)Generates a matrix which when left multiplied with the input matrix will replicate n data rowsstatic MatrixBlockParamservUtils. generateSubsampleMatrix(int nsamples, int nrows, long seed)Generates a matrix which when left multiplied with the input matrix will subsamplestatic MatrixBlockParamservUtils. sliceMatrixBlock(MatrixBlock mb, long rl, long rh)Slice the matrix block and return a matrix block (used in spark)Methods in org.apache.sysds.runtime.controlprogram.paramserv that return types with arguments of type MatrixBlock Modifier and Type Method Description static org.apache.spark.api.java.JavaPairRDD<Long,scala.Tuple2<MatrixBlock,MatrixBlock>>SparkParamservUtils. assembleTrainingData(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> featuresRDD, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> labelsRDD)Assemble the matrix of features and labels according to the rowIDstatic org.apache.spark.api.java.JavaPairRDD<Long,scala.Tuple2<MatrixBlock,MatrixBlock>>SparkParamservUtils. assembleTrainingData(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> featuresRDD, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> labelsRDD)Assemble the matrix of features and labels according to the rowIDstatic org.apache.spark.api.java.JavaPairRDD<Integer,scala.Tuple2<MatrixBlock,MatrixBlock>>SparkParamservUtils. doPartitionOnSpark(SparkExecutionContext sec, MatrixObject features, MatrixObject labels, Statement.PSScheme scheme, int workerNum)static org.apache.spark.api.java.JavaPairRDD<Integer,scala.Tuple2<MatrixBlock,MatrixBlock>>SparkParamservUtils. doPartitionOnSpark(SparkExecutionContext sec, MatrixObject features, MatrixObject labels, Statement.PSScheme scheme, int workerNum)Methods in org.apache.sysds.runtime.controlprogram.paramserv with parameters of type MatrixBlock Modifier and Type Method Description static MatrixBlockParamservUtils. cbindMatrix(MatrixBlock left, MatrixBlock right)static MatrixObjectParamservUtils. newMatrixObject(MatrixBlock mb)static MatrixObjectParamservUtils. newMatrixObject(MatrixBlock mb, boolean cleanup)static MatrixBlockParamservUtils. sliceMatrixBlock(MatrixBlock mb, long rl, long rh)Slice the matrix block and return a matrix block (used in spark)Method parameters in org.apache.sysds.runtime.controlprogram.paramserv with type arguments of type MatrixBlock Modifier and Type Method Description static org.apache.spark.api.java.JavaPairRDD<Long,scala.Tuple2<MatrixBlock,MatrixBlock>>SparkParamservUtils. assembleTrainingData(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> featuresRDD, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> labelsRDD)Assemble the matrix of features and labels according to the rowIDvoidSparkPSWorker. call(scala.Tuple2<Integer,scala.Tuple2<MatrixBlock,MatrixBlock>> input)voidSparkPSWorker. call(scala.Tuple2<Integer,scala.Tuple2<MatrixBlock,MatrixBlock>> input) -
Uses of MatrixBlock in org.apache.sysds.runtime.controlprogram.paramserv.dp
Methods in org.apache.sysds.runtime.controlprogram.paramserv.dp that return MatrixBlock Modifier and Type Method Description static MatrixBlockDRRLocalScheme. removeEmpty(MatrixBlock mb, int k, int workerId)Methods in org.apache.sysds.runtime.controlprogram.paramserv.dp that return types with arguments of type MatrixBlock Modifier and Type Method Description scala.Tuple2<Integer,scala.Tuple2<MatrixBlock,MatrixBlock>>DataPartitionerSparkAggregator. call(scala.Tuple2<Integer,LinkedList<scala.Tuple2<Long,scala.Tuple2<MatrixBlock,MatrixBlock>>>> input)Row-wise combine the matrixscala.Tuple2<Integer,scala.Tuple2<MatrixBlock,MatrixBlock>>DataPartitionerSparkAggregator. call(scala.Tuple2<Integer,LinkedList<scala.Tuple2<Long,scala.Tuple2<MatrixBlock,MatrixBlock>>>> input)Row-wise combine the matrixIterator<scala.Tuple2<Integer,scala.Tuple2<Long,scala.Tuple2<MatrixBlock,MatrixBlock>>>>DataPartitionerSparkMapper. call(scala.Tuple2<Long,scala.Tuple2<MatrixBlock,MatrixBlock>> input)Do data partitioningIterator<scala.Tuple2<Integer,scala.Tuple2<Long,scala.Tuple2<MatrixBlock,MatrixBlock>>>>DataPartitionerSparkMapper. call(scala.Tuple2<Long,scala.Tuple2<MatrixBlock,MatrixBlock>> input)Do data partitioningstatic List<MatrixBlock>DCLocalScheme. partition(int k, MatrixBlock mb)static List<MatrixBlock>ORLocalScheme. partition(int k, MatrixBlock mb, List<MatrixBlock> permutations)Methods in org.apache.sysds.runtime.controlprogram.paramserv.dp with parameters of type MatrixBlock Modifier and Type Method Description abstract DataPartitionLocalScheme.ResultDataPartitionLocalScheme. doPartitioning(int workersNum, MatrixBlock features, MatrixBlock labels)abstract org.apache.sysds.runtime.controlprogram.paramserv.dp.DataPartitionSparkScheme.ResultDataPartitionSparkScheme. doPartitioning(int numWorkers, int rblkID, MatrixBlock features, MatrixBlock labels)DataPartitionLocalScheme.ResultDCLocalScheme. doPartitioning(int workersNum, MatrixBlock features, MatrixBlock labels)org.apache.sysds.runtime.controlprogram.paramserv.dp.DataPartitionSparkScheme.ResultDCSparkScheme. doPartitioning(int numWorkers, int rblkID, MatrixBlock features, MatrixBlock labels)DataPartitionLocalScheme.ResultDRLocalScheme. doPartitioning(int workersNum, MatrixBlock features, MatrixBlock labels)DataPartitionLocalScheme.ResultDRRLocalScheme. doPartitioning(int workersNum, MatrixBlock features, MatrixBlock labels)org.apache.sysds.runtime.controlprogram.paramserv.dp.DataPartitionSparkScheme.ResultDRRSparkScheme. doPartitioning(int numWorkers, int rblkID, MatrixBlock features, MatrixBlock labels)org.apache.sysds.runtime.controlprogram.paramserv.dp.DataPartitionSparkScheme.ResultDRSparkScheme. doPartitioning(int numWorkers, int rblkID, MatrixBlock features, MatrixBlock labels)DataPartitionLocalScheme.ResultLocalDataPartitioner. doPartitioning(int workersNum, MatrixBlock features, MatrixBlock labels)DataPartitionLocalScheme.ResultORLocalScheme. doPartitioning(int workersNum, MatrixBlock features, MatrixBlock labels)org.apache.sysds.runtime.controlprogram.paramserv.dp.DataPartitionSparkScheme.ResultORSparkScheme. doPartitioning(int numWorkers, int rblkID, MatrixBlock features, MatrixBlock labels)org.apache.sysds.runtime.controlprogram.paramserv.dp.DataPartitionSparkScheme.ResultSparkDataPartitioner. doPartitioning(int numWorkers, MatrixBlock features, MatrixBlock labels, long rowID)static List<MatrixBlock>DCLocalScheme. partition(int k, MatrixBlock mb)static List<MatrixBlock>ORLocalScheme. partition(int k, MatrixBlock mb, List<MatrixBlock> permutations)static MatrixBlockDRRLocalScheme. removeEmpty(MatrixBlock mb, int k, int workerId)Method parameters in org.apache.sysds.runtime.controlprogram.paramserv.dp with type arguments of type MatrixBlock Modifier and Type Method Description scala.Tuple2<Integer,scala.Tuple2<MatrixBlock,MatrixBlock>>DataPartitionerSparkAggregator. call(scala.Tuple2<Integer,LinkedList<scala.Tuple2<Long,scala.Tuple2<MatrixBlock,MatrixBlock>>>> input)Row-wise combine the matrixscala.Tuple2<Integer,scala.Tuple2<MatrixBlock,MatrixBlock>>DataPartitionerSparkAggregator. call(scala.Tuple2<Integer,LinkedList<scala.Tuple2<Long,scala.Tuple2<MatrixBlock,MatrixBlock>>>> input)Row-wise combine the matrixIterator<scala.Tuple2<Integer,scala.Tuple2<Long,scala.Tuple2<MatrixBlock,MatrixBlock>>>>DataPartitionerSparkMapper. call(scala.Tuple2<Long,scala.Tuple2<MatrixBlock,MatrixBlock>> input)Do data partitioningIterator<scala.Tuple2<Integer,scala.Tuple2<Long,scala.Tuple2<MatrixBlock,MatrixBlock>>>>DataPartitionerSparkMapper. call(scala.Tuple2<Long,scala.Tuple2<MatrixBlock,MatrixBlock>> input)Do data partitioningstatic List<MatrixBlock>ORLocalScheme. partition(int k, MatrixBlock mb, List<MatrixBlock> permutations) -
Uses of MatrixBlock in org.apache.sysds.runtime.controlprogram.parfor
Methods in org.apache.sysds.runtime.controlprogram.parfor that return MatrixBlock Modifier and Type Method Description static MatrixBlockDataPartitioner. createReuseMatrixBlock(ParForProgramBlock.PDataPartitionFormat dpf, int rows, int cols)Methods in org.apache.sysds.runtime.controlprogram.parfor that return types with arguments of type MatrixBlock Modifier and Type Method Description scala.Tuple2<MatrixIndexes,MatrixBlock>ResultMergeRemoteSparkWCompare. call(scala.Tuple2<MatrixIndexes,scala.Tuple2<Iterable<MatrixBlock>,MatrixBlock>> arg)Method parameters in org.apache.sysds.runtime.controlprogram.parfor with type arguments of type MatrixBlock Modifier and Type Method Description Iterator<scala.Tuple2<Long,org.apache.hadoop.io.Writable>>DataPartitionerRemoteSparkMapper. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)scala.Tuple2<MatrixIndexes,MatrixBlock>ResultMergeRemoteSparkWCompare. call(scala.Tuple2<MatrixIndexes,scala.Tuple2<Iterable<MatrixBlock>,MatrixBlock>> arg)scala.Tuple2<MatrixIndexes,MatrixBlock>ResultMergeRemoteSparkWCompare. call(scala.Tuple2<MatrixIndexes,scala.Tuple2<Iterable<MatrixBlock>,MatrixBlock>> arg) -
Uses of MatrixBlock in org.apache.sysds.runtime.controlprogram.parfor.util
Fields in org.apache.sysds.runtime.controlprogram.parfor.util declared as MatrixBlock Modifier and Type Field Description MatrixBlockPairWritableBlock. blockMethods in org.apache.sysds.runtime.controlprogram.parfor.util that return MatrixBlock Modifier and Type Method Description static MatrixBlockStagingFileUtils. readCellList2BlockFromLocal(String fname, int blen)static MatrixBlockStagingFileUtils. readCellList2BlockFromLocal(String fname, int blen, boolean sparse)Constructors in org.apache.sysds.runtime.controlprogram.parfor.util with parameters of type MatrixBlock Constructor Description PairWritableBlock(MatrixIndexes ix, MatrixBlock mb) -
Uses of MatrixBlock in org.apache.sysds.runtime.data
Methods in org.apache.sysds.runtime.data with parameters of type MatrixBlock Modifier and Type Method Description voidBasicTensorBlock. set(MatrixBlock other)voidTensorBlock. set(MatrixBlock other) -
Uses of MatrixBlock in org.apache.sysds.runtime.functionobjects
Methods in org.apache.sysds.runtime.functionobjects with parameters of type MatrixBlock Modifier and Type Method Description voidCTable. execute(double v1, double v2, double w, boolean ignoreZeros, CTableMap resultMap, MatrixBlock resultBlock)voidCTable. execute(double v1, double v2, double w, boolean ignoreZeros, MatrixBlock ctableResult)voidCTable. execute(MatrixBlock in1, MatrixBlock in2, MatrixBlock w, CTableMap resultMap, int k)Callable<Object>CTable. getPartialCTableTask(MatrixBlock in1, MatrixBlock in2, MatrixBlock w, int startInd, int blockSize, ArrayList<CTableMap> pmaps) -
Uses of MatrixBlock in org.apache.sysds.runtime.instructions.fed
Methods in org.apache.sysds.runtime.instructions.fed that return MatrixBlock Modifier and Type Method Description <T> MatrixBlockQuantilePickFEDInstruction. getEquiHeightBins(ExecutionContext ec, int colID, double[] quantiles) -
Uses of MatrixBlock in org.apache.sysds.runtime.instructions.gpu.context
Methods in org.apache.sysds.runtime.instructions.gpu.context that return MatrixBlock Modifier and Type Method Description MatrixBlockGPUObject. evictFromDeviceToHostMB(String instName, boolean eagerDelete) -
Uses of MatrixBlock in org.apache.sysds.runtime.instructions.spark
Methods in org.apache.sysds.runtime.instructions.spark that return MatrixBlock Modifier and Type Method Description MatrixBlockAggregateUnarySPInstruction.RDDUAggFunction2. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)MatrixBlockBinUaggChainSPInstruction.RDDBinUaggChainFunction. call(MatrixBlock arg0)MatrixBlockCompressionSPInstruction.CompressionFunction. call(MatrixBlock arg0)MatrixBlockCompressionSPInstruction.CompressionWorkloadFunction. call(MatrixBlock arg0)MatrixBlock[]CtableSPInstruction.MapJoinSignature1. call(MatrixBlock v1)MatrixBlock[]CtableSPInstruction.MapJoinSignature2. call(scala.Tuple2<MatrixBlock,MatrixBlock> v1)MatrixBlock[]CtableSPInstruction.MapJoinSignature3. call(scala.Tuple2<scala.Tuple2<MatrixBlock,MatrixBlock>,MatrixBlock> v1)MatrixBlockDeCompressionSPInstruction.DeCompressionFunction. call(MatrixBlock arg0)MatrixBlockParameterizedBuiltinSPInstruction.RDDMapGroupedAggFunction2. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)MatrixBlockParameterizedBuiltinSPInstruction.RDDReplaceFunction. call(MatrixBlock arg0)static MatrixBlockMatrixIndexingSPInstruction. inmemoryIndexing(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in1, DataCharacteristics mcIn, DataCharacteristics mcOut, IndexRange ixrange)Methods in org.apache.sysds.runtime.instructions.spark that return types with arguments of type MatrixBlock Modifier and Type Method Description scala.Tuple2<MatrixIndexes,MatrixBlock>AppendGAlignedSPInstruction.ShiftColumnIndex. call(scala.Tuple2<MatrixIndexes,MatrixBlock> kv)scala.Tuple2<MatrixIndexes,MatrixBlock>AppendGSPInstruction.MergeWithShiftedBlocks. call(scala.Tuple2<MatrixIndexes,scala.Tuple2<Iterable<MatrixBlock>,Iterable<MatrixBlock>>> kv)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>AppendGSPInstruction.ShiftMatrix. call(scala.Tuple2<MatrixIndexes,MatrixBlock> kv)scala.Tuple2<MatrixIndexes,MatrixBlock>BuiltinNarySPInstruction.PadBlocksFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>ParameterizedBuiltinSPInstruction.RDDMapGroupedAggFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>ParameterizedBuiltinSPInstruction.RDDRemoveEmptyFunction. call(scala.Tuple2<MatrixIndexes,scala.Tuple2<MatrixBlock,MatrixBlock>> arg0)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>ParameterizedBuiltinSPInstruction.RDDRemoveEmptyFunctionInMem. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>ParameterizedBuiltinSPInstruction.RDDRExpandFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)scala.Tuple2<MatrixIndexes,MatrixBlock>ParameterizedBuiltinSPInstruction.RDDTransformDecodeExpandFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> in)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>SpoofSPInstruction.ReplicateRightFactorFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)Methods in org.apache.sysds.runtime.instructions.spark with parameters of type MatrixBlock Modifier and Type Method Description MatrixBlockBinUaggChainSPInstruction.RDDBinUaggChainFunction. call(MatrixBlock arg0)MatrixBlockCompressionSPInstruction.CompressionFunction. call(MatrixBlock arg0)MatrixBlockCompressionSPInstruction.CompressionWorkloadFunction. call(MatrixBlock arg0)LongCompressionSPInstruction.SizeFunction. call(MatrixBlock arg0)MatrixBlock[]CtableSPInstruction.MapJoinSignature1. call(MatrixBlock v1)MatrixBlockDeCompressionSPInstruction.DeCompressionFunction. call(MatrixBlock arg0)MatrixBlockParameterizedBuiltinSPInstruction.RDDReplaceFunction. call(MatrixBlock arg0)Method parameters in org.apache.sysds.runtime.instructions.spark with type arguments of type MatrixBlock Modifier and Type Method Description MatrixBlockAggregateUnarySPInstruction.RDDUAggFunction2. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)scala.Tuple2<MatrixIndexes,MatrixBlock>AppendGAlignedSPInstruction.ShiftColumnIndex. call(scala.Tuple2<MatrixIndexes,MatrixBlock> kv)scala.Tuple2<MatrixIndexes,MatrixBlock>AppendGSPInstruction.MergeWithShiftedBlocks. call(scala.Tuple2<MatrixIndexes,scala.Tuple2<Iterable<MatrixBlock>,Iterable<MatrixBlock>>> kv)scala.Tuple2<MatrixIndexes,MatrixBlock>AppendGSPInstruction.MergeWithShiftedBlocks. call(scala.Tuple2<MatrixIndexes,scala.Tuple2<Iterable<MatrixBlock>,Iterable<MatrixBlock>>> kv)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>AppendGSPInstruction.ShiftMatrix. call(scala.Tuple2<MatrixIndexes,MatrixBlock> kv)scala.Tuple2<MatrixIndexes,MatrixBlock>BuiltinNarySPInstruction.PadBlocksFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)MatrixBlock[]CtableSPInstruction.MapJoinSignature2. call(scala.Tuple2<MatrixBlock,MatrixBlock> v1)MatrixBlock[]CtableSPInstruction.MapJoinSignature2. call(scala.Tuple2<MatrixBlock,MatrixBlock> v1)MatrixBlock[]CtableSPInstruction.MapJoinSignature3. call(scala.Tuple2<scala.Tuple2<MatrixBlock,MatrixBlock>,MatrixBlock> v1)MatrixBlock[]CtableSPInstruction.MapJoinSignature3. call(scala.Tuple2<scala.Tuple2<MatrixBlock,MatrixBlock>,MatrixBlock> v1)MatrixBlock[]CtableSPInstruction.MapJoinSignature3. call(scala.Tuple2<scala.Tuple2<MatrixBlock,MatrixBlock>,MatrixBlock> v1)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>ParameterizedBuiltinSPInstruction.RDDMapGroupedAggFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)MatrixBlockParameterizedBuiltinSPInstruction.RDDMapGroupedAggFunction2. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>ParameterizedBuiltinSPInstruction.RDDRemoveEmptyFunction. call(scala.Tuple2<MatrixIndexes,scala.Tuple2<MatrixBlock,MatrixBlock>> arg0)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>ParameterizedBuiltinSPInstruction.RDDRemoveEmptyFunction. call(scala.Tuple2<MatrixIndexes,scala.Tuple2<MatrixBlock,MatrixBlock>> arg0)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>ParameterizedBuiltinSPInstruction.RDDRemoveEmptyFunctionInMem. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>ParameterizedBuiltinSPInstruction.RDDRExpandFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)scala.Tuple2<MatrixIndexes,MatrixBlock>ParameterizedBuiltinSPInstruction.RDDTransformDecodeExpandFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> in)scala.Tuple2<Long,FrameBlock>ParameterizedBuiltinSPInstruction.RDDTransformDecodeFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> in)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>SpoofSPInstruction.ReplicateRightFactorFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)static MatrixBlockMatrixIndexingSPInstruction. inmemoryIndexing(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in1, DataCharacteristics mcIn, DataCharacteristics mcOut, IndexRange ixrange)Constructor parameters in org.apache.sysds.runtime.instructions.spark with type arguments of type MatrixBlock Constructor Description RDDMapGroupedAggFunction(PartitionedBroadcast<MatrixBlock> pbm, Operator op, int ngroups, int blen)RDDMapGroupedAggFunction2(PartitionedBroadcast<MatrixBlock> pbm, Operator op, int ngroups)RDDRemoveEmptyFunctionInMem(boolean rmRows, long len, long blen, PartitionedBroadcast<MatrixBlock> off) -
Uses of MatrixBlock in org.apache.sysds.runtime.instructions.spark.data
Methods in org.apache.sysds.runtime.instructions.spark.data that return MatrixBlock Modifier and Type Method Description MatrixBlockCorrMatrixBlock. getCorrection()MatrixBlockCorrMatrixBlock. getValue()MatrixBlockRowMatrixBlock. getValue()Methods in org.apache.sysds.runtime.instructions.spark.data with parameters of type MatrixBlock Modifier and Type Method Description CorrMatrixBlockCorrMatrixBlock. set(MatrixBlock value, MatrixBlock corr)Constructors in org.apache.sysds.runtime.instructions.spark.data with parameters of type MatrixBlock Constructor Description CorrMatrixBlock(MatrixBlock value)CorrMatrixBlock(MatrixBlock value, MatrixBlock corr)RowMatrixBlock(int len, int row, MatrixBlock value) -
Uses of MatrixBlock in org.apache.sysds.runtime.instructions.spark.functions
Methods in org.apache.sysds.runtime.instructions.spark.functions that return MatrixBlock Modifier and Type Method Description MatrixBlockAggregateDropCorrectionFunction. call(MatrixBlock arg0)MatrixBlockComputeBinaryBlockNnzFunction. call(MatrixBlock arg0)MatrixBlockCopyMatrixBlockFunction. call(MatrixBlock arg0)MatrixBlockCreateSparseBlockFunction. call(MatrixBlock arg0)MatrixBlock[]MapInputSignature. call(MatrixBlock v1)MatrixBlock[]MapJoinSignature. call(scala.Tuple2<MatrixBlock[],MatrixBlock> v1)MatrixBlockMatrixMatrixBinaryOpFunction. call(scala.Tuple2<MatrixBlock,MatrixBlock> arg0)MatrixBlockMatrixScalarUnaryFunction. call(MatrixBlock arg0)Methods in org.apache.sysds.runtime.instructions.spark.functions that return types with arguments of type MatrixBlock Modifier and Type Method Description LazyIterableIterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>CopyMatrixBlockPairFunction. call(Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> arg0)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>ExtractBlockForBinaryReblock. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)scala.Tuple2<MatrixIndexes,MatrixBlock>GetMIMBFromRow. call(org.apache.spark.sql.Row row)LazyIterableIterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>MatrixVectorBinaryOpPartitionFunction. call(Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> arg0)scala.Tuple2<MatrixIndexes,MatrixBlock>ReorgMapFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>ReplicateBlockFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>ReplicateVectorFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)Methods in org.apache.sysds.runtime.instructions.spark.functions with parameters of type MatrixBlock Modifier and Type Method Description MatrixBlockAggregateDropCorrectionFunction. call(MatrixBlock arg0)MatrixBlockComputeBinaryBlockNnzFunction. call(MatrixBlock arg0)MatrixBlockCopyMatrixBlockFunction. call(MatrixBlock arg0)MatrixBlockCreateSparseBlockFunction. call(MatrixBlock arg0)BooleanFilterNonEmptyBlocksFunction2. call(MatrixBlock arg0)MatrixBlock[]MapInputSignature. call(MatrixBlock v1)MatrixBlockMatrixScalarUnaryFunction. call(MatrixBlock arg0)Method parameters in org.apache.sysds.runtime.instructions.spark.functions with type arguments of type MatrixBlock Modifier and Type Method Description Iterator<String>ConvertMatrixBlockToIJVLines. call(scala.Tuple2<MatrixIndexes,MatrixBlock> kv)LazyIterableIterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>CopyMatrixBlockPairFunction. call(Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> arg0)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>ExtractBlockForBinaryReblock. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)Iterator<scala.Tuple2<MatrixIndexes,WeightedCell>>ExtractGroup.ExtractGroupBroadcast. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg)Iterator<scala.Tuple2<MatrixIndexes,WeightedCell>>ExtractGroup.ExtractGroupJoin. call(scala.Tuple2<MatrixIndexes,scala.Tuple2<MatrixBlock,MatrixBlock>> arg)Iterator<scala.Tuple2<MatrixIndexes,WeightedCell>>ExtractGroup.ExtractGroupJoin. call(scala.Tuple2<MatrixIndexes,scala.Tuple2<MatrixBlock,MatrixBlock>> arg)Iterator<scala.Tuple2<MatrixIndexes,WeightedCell>>ExtractGroupNWeights. call(scala.Tuple2<MatrixIndexes,scala.Tuple2<scala.Tuple2<MatrixBlock,MatrixBlock>,MatrixBlock>> arg)Iterator<scala.Tuple2<MatrixIndexes,WeightedCell>>ExtractGroupNWeights. call(scala.Tuple2<MatrixIndexes,scala.Tuple2<scala.Tuple2<MatrixBlock,MatrixBlock>,MatrixBlock>> arg)Iterator<scala.Tuple2<MatrixIndexes,WeightedCell>>ExtractGroupNWeights. call(scala.Tuple2<MatrixIndexes,scala.Tuple2<scala.Tuple2<MatrixBlock,MatrixBlock>,MatrixBlock>> arg)BooleanFilterDiagMatrixBlocksFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)BooleanFilterNonEmptyBlocksFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)BooleanIsBlockInList. call(scala.Tuple2<MatrixIndexes,MatrixBlock> kv)BooleanIsBlockInRange. call(scala.Tuple2<MatrixIndexes,MatrixBlock> kv)MatrixBlock[]MapJoinSignature. call(scala.Tuple2<MatrixBlock[],MatrixBlock> v1)MatrixBlockMatrixMatrixBinaryOpFunction. call(scala.Tuple2<MatrixBlock,MatrixBlock> arg0)MatrixBlockMatrixMatrixBinaryOpFunction. call(scala.Tuple2<MatrixBlock,MatrixBlock> arg0)LazyIterableIterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>MatrixVectorBinaryOpPartitionFunction. call(Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> arg0)org.apache.sysds.runtime.instructions.spark.functions.OuterVectorBinaryOpFunction.OuterVectorBinaryOpIteratorOuterVectorBinaryOpFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)Iterator<Long>RecomputeNnzFunction. call(Iterator<MatrixBlock> iter)scala.Tuple2<MatrixIndexes,MatrixBlock>ReorgMapFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>ReplicateBlockFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>ReplicateVectorFunction. call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0)Constructor parameters in org.apache.sysds.runtime.instructions.spark.functions with type arguments of type MatrixBlock Constructor Description ExtractGroupBroadcast(PartitionedBroadcast<MatrixBlock> pbm, long blen, long ngroups, Operator op)MatrixVectorBinaryOpPartitionFunction(BinaryOperator op, PartitionedBroadcast<MatrixBlock> binput, BinaryM.VectorType vtype)OuterVectorBinaryOpFunction(BinaryOperator op, PartitionedBroadcast<MatrixBlock> binput) -
Uses of MatrixBlock in org.apache.sysds.runtime.instructions.spark.utils
Methods in org.apache.sysds.runtime.instructions.spark.utils that return MatrixBlock Modifier and Type Method Description static MatrixBlockRDDAggregateUtils. aggStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, AggregateOperator aop)Single block aggregation over pair rdds with corrections for numerical stability.static MatrixBlockRDDAggregateUtils. aggStable(org.apache.spark.api.java.JavaRDD<MatrixBlock> in, AggregateOperator aop)Single block aggregation over rdds with corrections for numerical stability.static MatrixBlockRDDAggregateUtils. sumStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in)static MatrixBlockRDDAggregateUtils. sumStable(org.apache.spark.api.java.JavaRDD<MatrixBlock> in)Methods in org.apache.sysds.runtime.instructions.spark.utils that return types with arguments of type MatrixBlock Modifier and Type Method Description static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. aggByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, AggregateOperator aop)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. aggByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, AggregateOperator aop, boolean deepCopyCombiner)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. aggByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, AggregateOperator aop, int numPartitions, boolean deepCopyCombiner)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtils. binaryBlockToBinaryBlock(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, DataCharacteristics mcIn, DataCharacteristics mcOut)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>FrameRDDConverterUtils. binaryBlockToMatrixBlock(org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock> input, DataCharacteristics mcIn, DataCharacteristics mcOut)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtils. binaryCellToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixCell> input, DataCharacteristics mcOut, boolean outputEmptyBlocks)Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>>RDDConverterUtils.BinaryCellToBinaryBlockFunction. call(Iterator<scala.Tuple2<MatrixIndexes,MatrixCell>> arg0)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtilsExt. coordinateMatrixToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.mllib.linalg.distributed.CoordinateMatrix input, DataCharacteristics mcIn, boolean outputEmptyBlocks)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtilsExt. coordinateMatrixToBinaryBlock(org.apache.spark.SparkContext sc, org.apache.spark.mllib.linalg.distributed.CoordinateMatrix input, DataCharacteristics mcIn, boolean outputEmptyBlocks)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>SparkUtils. copyBinaryBlockMatrix(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in)Creates a partitioning-preserving deep copy of the input matrix RDD, where the indexes and values are copied.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>SparkUtils. copyBinaryBlockMatrix(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, boolean deep)Creates a partitioning-preserving copy of the input matrix RDD.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtils. csvToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> input, DataCharacteristics mc, boolean hasHeader, String delim, boolean fill, double fillValue, Set<String> naStrings)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtils. csvToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaRDD<String> input, DataCharacteristics mcOut, boolean hasHeader, String delim, boolean fill, double fillValue, Set<String> naStrings)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtils. dataFrameToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> df, DataCharacteristics mc, boolean containsID, boolean isVector)static List<scala.Tuple2<MatrixIndexes,MatrixBlock>>SparkUtils. fromIndexedMatrixBlock(List<IndexedMatrixValue> in)static scala.Tuple2<MatrixIndexes,MatrixBlock>SparkUtils. fromIndexedMatrixBlock(IndexedMatrixValue in)static List<Pair<MatrixIndexes,MatrixBlock>>SparkUtils. fromIndexedMatrixBlockToPair(List<IndexedMatrixValue> in)static Pair<MatrixIndexes,MatrixBlock>SparkUtils. fromIndexedMatrixBlockToPair(IndexedMatrixValue in)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>SparkUtils. getEmptyBlockRDD(org.apache.spark.api.java.JavaSparkContext sc, DataCharacteristics mc)Creates an RDD of empty blocks according to the given matrix characteristics.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtils. libsvmToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> input, DataCharacteristics mc, String delim, String indexDelim)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. mergeByKey(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in)Merges disjoint data of all blocks per key.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. mergeByKey(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, boolean deepCopyCombiner)Merges disjoint data of all blocks per key.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. mergeByKey(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, int numPartitions, boolean deepCopyCombiner)Merges disjoint data of all blocks per key.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. mergeRowsByKey(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,RowMatrixBlock> in)Merges disjoint data of all blocks per key.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, long rlen, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in2, long rlen, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortByVals(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, long rlen, long clen, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortDataByIx(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> ixmap, long rlen, long clen, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortDataByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data, boolean asc, long rlen, long clen, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortDataByValMemSort(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data, boolean asc, long rlen, long clen, int blen, SparkExecutionContext sec, ReorgOperator r_op)This function collects and sorts value column in memory and then broadcasts it.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortDataByVals(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data, boolean asc, long rlen, long clen, long clen2, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortIndexesByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val, boolean asc, long rlen, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortIndexesByVals(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, boolean asc, long rlen, long clen, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. sumByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. sumByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, boolean deepCopyCombiner)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. sumByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, int numPartitions, boolean deepCopyCombiner)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtils. textCellToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> input, DataCharacteristics mcOut, boolean outputEmptyBlocks, FileFormatPropertiesMM mmProps)Methods in org.apache.sysds.runtime.instructions.spark.utils with parameters of type MatrixBlock Modifier and Type Method Description static voidRDDConverterUtilsExt. copyRowBlocks(MatrixBlock mb, int rowIndex, MatrixBlock ret, int numRowsPerBlock, int rlen, int clen)static voidRDDConverterUtilsExt. copyRowBlocks(MatrixBlock mb, int rowIndex, MatrixBlock ret, long numRowsPerBlock, long rlen, long clen)static voidRDDConverterUtilsExt. copyRowBlocks(MatrixBlock mb, long rowIndex, MatrixBlock ret, int numRowsPerBlock, int rlen, int clen)static voidRDDConverterUtilsExt. copyRowBlocks(MatrixBlock mb, long rowIndex, MatrixBlock ret, long numRowsPerBlock, long rlen, long clen)static voidRDDConverterUtilsExt. postProcessAfterCopying(MatrixBlock ret)static IndexedMatrixValueSparkUtils. toIndexedMatrixBlock(MatrixIndexes ix, MatrixBlock mb)Method parameters in org.apache.sysds.runtime.instructions.spark.utils with type arguments of type MatrixBlock Modifier and Type Method Description static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. aggByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, AggregateOperator aop)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. aggByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, AggregateOperator aop, boolean deepCopyCombiner)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. aggByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, AggregateOperator aop, int numPartitions, boolean deepCopyCombiner)static MatrixBlockRDDAggregateUtils. aggStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, AggregateOperator aop)Single block aggregation over pair rdds with corrections for numerical stability.static MatrixBlockRDDAggregateUtils. aggStable(org.apache.spark.api.java.JavaRDD<MatrixBlock> in, AggregateOperator aop)Single block aggregation over rdds with corrections for numerical stability.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDConverterUtils. binaryBlockToBinaryBlock(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, DataCharacteristics mcIn, DataCharacteristics mcOut)static org.apache.spark.api.java.JavaRDD<String>RDDConverterUtils. binaryBlockToCsv(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, DataCharacteristics mcIn, FileFormatPropertiesCSV props, boolean strict)static org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>RDDConverterUtils. binaryBlockToDataFrame(org.apache.spark.sql.SparkSession sparkSession, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, DataCharacteristics mc, boolean toVector)static org.apache.spark.sql.Dataset<org.apache.spark.sql.Row>RDDConverterUtils. binaryBlockToDataFrame(org.apache.spark.sql.SQLContext sqlContext, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, DataCharacteristics mc, boolean toVector)Deprecated.static org.apache.spark.api.java.JavaRDD<org.apache.spark.ml.feature.LabeledPoint>RDDConverterUtils. binaryBlockToLabeledPoints(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in)Converter from binary block rdd to rdd of labeled points.static org.apache.spark.api.java.JavaRDD<String>RDDConverterUtils. binaryBlockToLibsvm(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, DataCharacteristics mcIn, FileFormatPropertiesLIBSVM props, boolean strict)static org.apache.spark.api.java.JavaRDD<String>RDDConverterUtils. binaryBlockToTextCell(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, DataCharacteristics mc)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>SparkUtils. copyBinaryBlockMatrix(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in)Creates a partitioning-preserving deep copy of the input matrix RDD, where the indexes and values are copied.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>SparkUtils. copyBinaryBlockMatrix(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, boolean deep)Creates a partitioning-preserving copy of the input matrix RDD.static longSparkUtils. getNonZeros(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> input)static org.apache.spark.api.java.JavaPairRDD<org.apache.hadoop.io.LongWritable,FrameBlock>FrameRDDConverterUtils. matrixBlockToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> input, DataCharacteristics mcIn)static org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock>FrameRDDConverterUtils. matrixBlockToBinaryBlockLongIndex(org.apache.spark.api.java.JavaSparkContext sc, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> input, DataCharacteristics dcIn)static doubleRDDAggregateUtils. max(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. mergeByKey(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in)Merges disjoint data of all blocks per key.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. mergeByKey(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, boolean deepCopyCombiner)Merges disjoint data of all blocks per key.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. mergeByKey(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, int numPartitions, boolean deepCopyCombiner)Merges disjoint data of all blocks per key.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, long rlen, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in2, long rlen, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortByVals(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, long rlen, long clen, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortDataByIx(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> ixmap, long rlen, long clen, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortDataByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data, boolean asc, long rlen, long clen, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortDataByValMemSort(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data, boolean asc, long rlen, long clen, int blen, SparkExecutionContext sec, ReorgOperator r_op)This function collects and sorts value column in memory and then broadcasts it.static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortDataByVals(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val, org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data, boolean asc, long rlen, long clen, long clen2, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortIndexesByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val, boolean asc, long rlen, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDSortUtils. sortIndexesByVals(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, boolean asc, long rlen, long clen, int blen)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. sumByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. sumByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, boolean deepCopyCombiner)static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock>RDDAggregateUtils. sumByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in, int numPartitions, boolean deepCopyCombiner)static MatrixBlockRDDAggregateUtils. sumStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in)static MatrixBlockRDDAggregateUtils. sumStable(org.apache.spark.api.java.JavaRDD<MatrixBlock> in)static IndexedMatrixValueSparkUtils. toIndexedMatrixBlock(scala.Tuple2<MatrixIndexes,MatrixBlock> in) -
Uses of MatrixBlock in org.apache.sysds.runtime.io
Methods in org.apache.sysds.runtime.io that return MatrixBlock Modifier and Type Method Description static MatrixBlockReaderHDF5. computeHDF5Size(List<org.apache.hadoop.fs.Path> files, org.apache.hadoop.fs.FileSystem fs, String datasetName)static MatrixBlock[]MatrixWriter. createMatrixBlocksForReuse(long rlen, long clen, int blen, boolean sparse, long nonZeros)MatrixBlockBinaryBlockSerialization.MatrixBlockDeserializer. deserialize(MatrixBlock mb)static MatrixBlockMatrixWriter. getMatrixBlockForReuse(MatrixBlock[] blocks, int rows, int cols, int blen)abstract MatrixBlockMatrixReader. readMatrixFromHDFS(String fname, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderBinaryBlock. readMatrixFromHDFS(String fname, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderBinaryBlockParallel. readMatrixFromHDFS(String fname, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderHDF5. readMatrixFromHDFS(String fname, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderHDF5Parallel. readMatrixFromHDFS(String fname, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderTextCell. readMatrixFromHDFS(String fname, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderTextCSV. readMatrixFromHDFS(String fname, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderTextCSVParallel. readMatrixFromHDFS(String fname, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderTextLIBSVM. readMatrixFromHDFS(String fname, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderTextLIBSVMParallel. readMatrixFromHDFS(String fname, long rlen, long clen, int blen, long estnnz)abstract MatrixBlockMatrixReader. readMatrixFromInputStream(InputStream is, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderBinaryBlock. readMatrixFromInputStream(InputStream is, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderHDF5. readMatrixFromInputStream(InputStream is, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderHDF5Parallel. readMatrixFromInputStream(InputStream is, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderTextCell. readMatrixFromInputStream(InputStream is, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderTextCSV. readMatrixFromInputStream(InputStream is, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderTextCSVParallel. readMatrixFromInputStream(InputStream is, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderTextLIBSVM. readMatrixFromInputStream(InputStream is, long rlen, long clen, int blen, long estnnz)MatrixBlockReaderTextLIBSVMParallel. readMatrixFromInputStream(InputStream is, long rlen, long clen, int blen, long estnnz)Methods in org.apache.sysds.runtime.io that return types with arguments of type MatrixBlock Modifier and Type Method Description org.apache.hadoop.io.serializer.Deserializer<MatrixBlock>BinaryBlockSerialization. getDeserializer(Class arg0)org.apache.hadoop.io.serializer.Serializer<MatrixBlock>BinaryBlockSerialization. getSerializer(Class arg0)Methods in org.apache.sysds.runtime.io with parameters of type MatrixBlock Modifier and Type Method Description MatrixBlockBinaryBlockSerialization.MatrixBlockDeserializer. deserialize(MatrixBlock mb)voidReaderTextCellParallel.CellBuffer. flushCellBufferToMatrixBlock(MatrixBlock dest)static MatrixBlockMatrixWriter. getMatrixBlockForReuse(MatrixBlock[] blocks, int rows, int cols, int blen)static longReaderHDF5. readMatrixFromHDF5(BufferedInputStream bis, String datasetName, MatrixBlock dest, int row, long rlen, long clen, int blen)voidBinaryBlockSerialization.MatrixBlockSerializer. serialize(MatrixBlock mb)voidWriterHDF5Parallel. writeHDF5MatrixToHDFS(org.apache.hadoop.fs.Path path, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.fs.FileSystem fs, MatrixBlock src)voidMatrixWriter. writeMatrixToHDFS(MatrixBlock src, String fname, long rlen, long clen, int blen, long nnz)abstract voidMatrixWriter. writeMatrixToHDFS(MatrixBlock src, String fname, long rlen, long clen, int blen, long nnz, boolean diag)voidWriterBinaryBlock. writeMatrixToHDFS(MatrixBlock src, String fname, long rlen, long clen, int blen, long nnz, boolean diag)voidWriterHDF5. writeMatrixToHDFS(MatrixBlock src, String fname, long rlen, long clen, int blen, long nnz, boolean diag)voidWriterMatrixMarket. writeMatrixToHDFS(MatrixBlock src, String fname, long rlen, long clen, int blen, long nnz, boolean diag)voidWriterTextCell. writeMatrixToHDFS(MatrixBlock src, String fname, long rlen, long clen, int blen, long nnz, boolean diag)voidWriterTextCSV. writeMatrixToHDFS(MatrixBlock src, String fname, long rlen, long clen, int blen, long nnz, boolean diag)voidWriterTextLIBSVM. writeMatrixToHDFS(MatrixBlock src, String fname, long rlen, long clen, int blen, long nnz, boolean diag)Constructors in org.apache.sysds.runtime.io with parameters of type MatrixBlock Constructor Description ReadTask(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.TextInputFormat informat, org.apache.hadoop.mapred.JobConf job, MatrixBlock dest, long rlen, long clen, boolean mm, FileFormatPropertiesMM mmProps) -
Uses of MatrixBlock in org.apache.sysds.runtime.iogen
Methods in org.apache.sysds.runtime.iogen that return MatrixBlock Modifier and Type Method Description MatrixBlockSampleProperties. getSampleMatrix()MatrixBlockMatrixGenerateReader. readMatrixFromHDFS(String fname, long rlen, long clen, int blen, long estnnz)MatrixBlockMatrixGenerateReader. readMatrixFromInputStream(InputStream is, long rlen, long clen, int blen, long estnnz)Methods in org.apache.sysds.runtime.iogen with parameters of type MatrixBlock Modifier and Type Method Description voidSampleProperties. setSampleMatrix(MatrixBlock sampleMatrix)Constructors in org.apache.sysds.runtime.iogen with parameters of type MatrixBlock Constructor Description GenerateReaderMatrix(String sampleRaw, MatrixBlock sampleMatrix)MatrixReaderMapping(String raw, MatrixBlock matrix)SampleProperties(String sampleRaw, MatrixBlock sampleMatrix) -
Uses of MatrixBlock in org.apache.sysds.runtime.lineage
Methods in org.apache.sysds.runtime.lineage that return MatrixBlock Modifier and Type Method Description static MatrixBlockLineageCache. getMatrix(LineageItem key)MatrixBlockLineageCacheEntry. getMBValue()Methods in org.apache.sysds.runtime.lineage with parameters of type MatrixBlock Modifier and Type Method Description voidLineageCacheEntry. setValue(MatrixBlock val)voidLineageCacheEntry. setValue(MatrixBlock val, long computetime)Constructors in org.apache.sysds.runtime.lineage with parameters of type MatrixBlock Constructor Description LineageCacheEntry(LineageItem key, Types.DataType dt, MatrixBlock Mval, ScalarObject Sval, long computetime) -
Uses of MatrixBlock in org.apache.sysds.runtime.matrix.data
Fields in org.apache.sysds.runtime.matrix.data declared as MatrixBlock Modifier and Type Field Description MatrixBlockDnnParameters. biasMatrixBlockDnnParameters. input1MatrixBlockDnnParameters. input2MatrixBlockDnnParameters. outputMethods in org.apache.sysds.runtime.matrix.data that return MatrixBlock Modifier and Type Method Description MatrixBlockMatrixBlock. aggregateBinaryOperations(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, AggregateBinaryOperator op)MatrixBlockMatrixBlock. aggregateBinaryOperations(MatrixBlock m1, MatrixBlock m2, AggregateBinaryOperator op)static MatrixBlockLibMatrixAgg. aggregateTernary(MatrixBlock in1, MatrixBlock in2, MatrixBlock in3, MatrixBlock ret, AggregateTernaryOperator op)static MatrixBlockLibMatrixAgg. aggregateTernary(MatrixBlock in1, MatrixBlock in2, MatrixBlock in3, MatrixBlock ret, AggregateTernaryOperator op, int k)MatrixBlockMatrixBlock. aggregateTernaryOperations(MatrixBlock m1, MatrixBlock m2, MatrixBlock m3, MatrixBlock ret, AggregateTernaryOperator op, boolean inCP)MatrixBlockMatrixBlock. aggregateUnaryOperations(AggregateUnaryOperator op, MatrixValue result, int blen, MatrixIndexes indexesIn)MatrixBlockMatrixBlock. aggregateUnaryOperations(AggregateUnaryOperator op, MatrixValue result, int blen, MatrixIndexes indexesIn, boolean inCP)MatrixBlockMatrixBlock. allocateBlock()MatrixBlockMatrixBlock. allocateDenseBlock()MatrixBlockMatrixBlock. append(MatrixBlock[] that, MatrixBlock result, boolean cbind)MatrixBlockMatrixBlock. append(MatrixBlock that, MatrixBlock ret)MatrixBlockMatrixBlock. append(MatrixBlock that, MatrixBlock ret, boolean cbind)MatrixBlockMatrixBlock. binaryOperations(BinaryOperator op, MatrixValue thatValue)MatrixBlockMatrixBlock. binaryOperations(BinaryOperator op, MatrixValue thatValue, MatrixValue result)MatrixBlockMatrixBlock. binaryOperationsInPlace(BinaryOperator op, MatrixValue thatValue)static MatrixBlockLibMatrixBincell. bincellOpInPlace(MatrixBlock m1ret, MatrixBlock m2, BinaryOperator op)NOTE: operations in place always require m1 and m2 to be of equal dimensions defaults to right side operations, updating the m1 matrix with like: m1ret op m2static MatrixBlockLibMatrixBincell. bincellOpInPlaceLeft(MatrixBlock m1ret, MatrixBlock m2, BinaryOperator op)Left side operations, updating the m1 matrix like: m2 op m1retstatic MatrixBlockLibMatrixBincell. bincellOpInPlaceRight(MatrixBlock m1ret, MatrixBlock m2, BinaryOperator op)Right side operations, updating the m1 matrix like: m1ret op m2MatrixBlockMatrixBlock. chainMatrixMultOperations(MatrixBlock v, MatrixBlock w, MatrixBlock out, MapMultChain.ChainType ctype)MatrixBlockMatrixBlock. chainMatrixMultOperations(MatrixBlock v, MatrixBlock w, MatrixBlock out, MapMultChain.ChainType ctype, int k)MatrixBlockMatrixBlock. colMax()Wrapper method for reduceall-colMin of a matrix.MatrixBlockMatrixBlock. colMin()Wrapper method for reduceall-colMin of a matrix.MatrixBlockMatrixBlock. colSum()Wrapper method for single threaded reduceall-colSum of a matrix.MatrixBlockMatrixBlock. copyShallow(MatrixBlock that)static MatrixBlockLibMatrixCountDistinct. countDistinctValuesFromSketch(CorrMatrixBlock arg0, CountDistinctOperator op)MatrixBlockMatrixBlock. ctableSeqOperations(MatrixValue thatMatrix, double thatScalar, MatrixBlock resultBlock)D = ctable(seq,A,w) this <- seq; thatMatrix <- A; thatScalar <- w; result <- D (i1,j1,v1) from input1 (this) (i1,j1,v2) from input2 (that) (w) from scalar_input3 (scalarThat2)MatrixBlockMatrixBlock. ctableSeqOperations(MatrixValue thatMatrix, double thatScalar, MatrixBlock ret, boolean updateClen)static MatrixBlockLibMatrixAgg. cumaggregateUnaryMatrix(MatrixBlock in, MatrixBlock out, UnaryOperator uop)static MatrixBlockLibMatrixAgg. cumaggregateUnaryMatrix(MatrixBlock in, MatrixBlock out, UnaryOperator uop, double[] agg)static MatrixBlockLibMatrixAgg. cumaggregateUnaryMatrix(MatrixBlock in, MatrixBlock out, UnaryOperator uop, int k)static MatrixBlockLibMatrixReorg. diag(MatrixBlock in, MatrixBlock out)static MatrixBlockLibMatrixMult. emptyMatrixMult(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret)MatrixBlockMatrixBlock. extractTriangular(MatrixBlock ret, boolean lower, boolean diag, boolean values)MatrixBlockMatrixBlock. groupedAggOperations(MatrixValue tgt, MatrixValue wghts, MatrixValue ret, int ngroups, Operator op)Invocation from CP instructions.MatrixBlockMatrixBlock. groupedAggOperations(MatrixValue tgt, MatrixValue wghts, MatrixValue ret, int ngroups, Operator op, int k)MatrixBlockMatrixBlock. leftIndexingOperations(ScalarObject scalar, int rl, int cl, MatrixBlock ret, MatrixObject.UpdateType update)Explicitly allow left indexing for scalars.MatrixBlockMatrixBlock. leftIndexingOperations(MatrixBlock rhsMatrix, int rl, int ru, int cl, int cu, MatrixBlock ret, MatrixObject.UpdateType update)MatrixBlockMatrixBlock. leftIndexingOperations(MatrixBlock rhsMatrix, IndexRange ixrange, MatrixBlock ret, MatrixObject.UpdateType update)static MatrixBlockOperationsOnMatrixValues. matMult(MatrixBlock value1, MatrixBlock value2, MatrixBlock valueOut, AggregateBinaryOperator op)static MatrixBlockOperationsOnMatrixValues. matMult(MatrixBlock value1, MatrixBlock value2, AggregateBinaryOperator op)static MatrixBlockOperationsOnMatrixValues. matMult(MatrixIndexes indexes1, MatrixBlock value1, MatrixIndexes indexes2, MatrixBlock value2, MatrixIndexes indexesOut, MatrixBlock valueOut, AggregateBinaryOperator op)static MatrixBlockLibCommonsMath. matrixMatrixOperations(MatrixBlock in1, MatrixBlock in2, String opcode)static MatrixBlockLibMatrixMult. matrixMult(MatrixBlock m1, MatrixBlock m2)Performs a matrix multiplication All variants use a IKJ access pattern, and internally use dense output.static MatrixBlockLibMatrixMult. matrixMult(MatrixBlock m1, MatrixBlock m2, int k)Performs a matrix multiplication All variants use a IKJ access pattern, and internally use dense output.static MatrixBlockLibMatrixMult. matrixMult(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret)Performs a matrix multiplication and stores the result in the output matrix.static MatrixBlockLibMatrixMult. matrixMult(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, boolean fixedRet)This method allows one to disabling exam sparsity.static MatrixBlockLibMatrixMult. matrixMult(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, boolean fixedRet, int k)Performs a matrix multiplication and stores the result in the output matrix.static MatrixBlockLibMatrixMult. matrixMult(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, int k)Performs a multi-threaded matrix multiplication and stores the result in the output matrix.static MatrixBlockLibMatrixNative. matrixMult(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, int k)Performs matrix multiplication using native library if BLAS is available or else falls back to Java BLAS.static MatrixBlock[]LibCommonsMath. multiReturnOperations(MatrixBlock in, String opcode)static MatrixBlock[]LibCommonsMath. multiReturnOperations(MatrixBlock in, String opcode, int threads, int num_iterations, double tol)static MatrixBlock[]LibCommonsMath. multiReturnOperations(MatrixBlock in, String opcode, int threads, long seed)static MatrixBlockMatrixBlock. naryOperations(Operator op, MatrixBlock[] matrices, ScalarObject[] scalars, MatrixBlock ret)MatrixBlockMatrixBlock. pickValues(MatrixValue quantiles, MatrixValue ret)MatrixBlockMatrixBlock. prepareAggregateUnaryOutput(AggregateUnaryOperator op, MatrixValue result, int blen)static MatrixBlockLibMatrixMult. prepMatrixMultTransposeSelfInput(MatrixBlock m1, boolean leftTranspose, boolean par)MatrixBlockMatrixBlock. quaternaryOperations(QuaternaryOperator qop, MatrixBlock um, MatrixBlock vm, MatrixBlock wm, MatrixBlock out)MatrixBlockMatrixBlock. quaternaryOperations(QuaternaryOperator qop, MatrixBlock U, MatrixBlock V, MatrixBlock wm, MatrixBlock out, int k)static MatrixBlockMatrixBlock. randOperations(int rows, int cols, double sparsity, double min, double max, String pdf, long seed)Function to generate the random matrix with specified dimensions (block sizes are not specified).static MatrixBlockMatrixBlock. randOperations(int rows, int cols, double sparsity, double min, double max, String pdf, long seed, int k)Function to generate the random matrix with specified dimensions (block sizes are not specified).static MatrixBlockMatrixBlock. randOperations(RandomMatrixGenerator rgen, long seed)Function to generate the random matrix with specified dimensions and block dimensions.static MatrixBlockMatrixBlock. randOperations(RandomMatrixGenerator rgen, long seed, int k)Function to generate the random matrix with specified dimensions and block dimensions.MatrixBlockMatrixBlock. randOperationsInPlace(RandomMatrixGenerator rgen, org.apache.commons.math3.random.Well1024a bigrand, long bSeed)Function to generate a matrix of random numbers.MatrixBlockMatrixBlock. randOperationsInPlace(RandomMatrixGenerator rgen, org.apache.commons.math3.random.Well1024a bigrand, long bSeed, int k)Function to generate a matrix of random numbers.MatrixBlockMatrixBlock. removeEmptyOperations(MatrixBlock ret, boolean rows, boolean emptyReturn)MatrixBlockMatrixBlock. removeEmptyOperations(MatrixBlock ret, boolean rows, boolean emptyReturn, MatrixBlock select)static MatrixBlockLibMatrixReorg. reorg(MatrixBlock in, MatrixBlock out, ReorgOperator op)static MatrixBlockLibMatrixReorg. reorgInPlace(MatrixBlock in, ReorgOperator op)MatrixBlockMatrixBlock. reorgOperations(ReorgOperator op, MatrixValue ret, int startRow, int startColumn, int length)MatrixBlockMatrixBlock. replaceOperations(MatrixValue result, double pattern, double replacement)static MatrixBlockLibMatrixReorg. reshape(MatrixBlock in, MatrixBlock out, int rows, int cols, boolean rowwise)CP reshape operation (single input, single output matrix) NOTE: In contrast to R, the rowwise parameter specifies both the read and write order, with row-wise being the default, while R uses always a column-wise read, rowwise specifying the write order and column-wise being the default.static MatrixBlockLibMatrixReorg. rev(MatrixBlock in, MatrixBlock out)static MatrixBlockLibMatrixReorg. rexpand(MatrixBlock in, MatrixBlock ret, double max, boolean rows, boolean cast, boolean ignore, int k)CP rexpand operation (single input, single output), the classic example of this operation is one hot encoding of a column to multiple columns.static MatrixBlockLibMatrixReorg. rexpand(MatrixBlock in, MatrixBlock ret, int max, boolean rows, boolean cast, boolean ignore, int k)CP rexpand operation (single input, single output), the classic example of this operation is one hot encoding of a column to multiple columns.MatrixBlockMatrixBlock. rexpandOperations(MatrixBlock ret, double max, boolean rows, boolean cast, boolean ignore, int k)static MatrixBlockLibMatrixReorg. rmempty(MatrixBlock in, MatrixBlock ret, boolean rows, boolean emptyReturn, MatrixBlock select)CP rmempty operation (single input, single output matrix)MatrixBlockMatrixBlock. rowSum()Wrapper method for single threaded reduceall-rowSum of a matrix.MatrixBlockMatrixBlock. rowSum(int k)Wrapper method for multi threaded reduceall-rowSum of a matrix.static MatrixBlockMatrixBlock. sampleOperations(long range, int size, boolean replace, long seed)MatrixBlockMatrixBlock. scalarOperations(ScalarOperator op, MatrixValue result)static MatrixBlockMatrixBlock. seqOperations(double from, double to, double incr)Method to generate a sequence according to the given parameters.MatrixBlockMatrixBlock. seqOperationsInPlace(double from, double to, double incr)MatrixBlockMatrixBlock. slice(int rl, int ru)Slice out a row blockMatrixBlockMatrixBlock. slice(int rl, int ru, boolean deep)MatrixBlockMatrixBlock. slice(int rl, int ru, int cl, int cu)MatrixBlockMatrixBlock. slice(int rl, int ru, int cl, int cu, boolean deep)Slice out a row blockMatrixBlockMatrixBlock. slice(int rl, int ru, int cl, int cu, boolean deep, CacheBlock ret)Method to perform rightIndex operation for a given lower and upper bounds in row and column dimensions.MatrixBlockMatrixBlock. slice(int rl, int ru, int cl, int cu, CacheBlock ret)MatrixBlockMatrixBlock. slice(IndexRange ixrange, MatrixBlock ret)static MatrixBlockLibMatrixReorg. sort(MatrixBlock in, MatrixBlock out, int[] by, boolean desc, boolean ixret)static MatrixBlockLibMatrixReorg. sort(MatrixBlock in, MatrixBlock out, int[] by, boolean desc, boolean ixret, int k)MatrixBlockMatrixBlock. sortOperations()MatrixBlockMatrixBlock. sortOperations(MatrixValue weights)MatrixBlockMatrixBlock. sortOperations(MatrixValue weights, MatrixBlock result)MatrixBlockMatrixBlock. sortOperations(MatrixValue weights, MatrixBlock result, int k)MatrixBlockMatrixBlock. ternaryOperations(TernaryOperator op, MatrixBlock m2, MatrixBlock m3, MatrixBlock ret)MatrixBlockCTableMap. toMatrixBlock(int rlen, int clen)static MatrixBlockLibMatrixReorg. transpose(MatrixBlock in)static MatrixBlockLibMatrixReorg. transpose(MatrixBlock in, int k)static MatrixBlockLibMatrixReorg. transpose(MatrixBlock in, MatrixBlock out)static MatrixBlockLibMatrixReorg. transpose(MatrixBlock in, MatrixBlock out, int k)static MatrixBlockLibMatrixReorg. transpose(MatrixBlock in, MatrixBlock out, int k, boolean allowCSR)static MatrixBlockLibMatrixReorg. transposeInPlace(MatrixBlock in, int k)MatrixBlockMatrixBlock. transposeSelfMatrixMultOperations(MatrixBlock out, MMTSJ.MMTSJType tstype)MatrixBlockMatrixBlock. transposeSelfMatrixMultOperations(MatrixBlock out, MMTSJ.MMTSJType tstype, int k)MatrixBlockMatrixBlock. uaggouterchainOperations(MatrixBlock mbLeft, MatrixBlock mbRight, MatrixBlock mbOut, BinaryOperator bOp, AggregateUnaryOperator uaggOp)static MatrixBlockLibCommonsMath. unaryOperations(MatrixBlock inj, String opcode)MatrixBlockMatrixBlock. unaryOperations(UnaryOperator op, MatrixValue result)MatrixBlockMatrixBlock. zeroOutOperations(MatrixValue result, IndexRange range, boolean complementary)Methods in org.apache.sysds.runtime.matrix.data that return types with arguments of type MatrixBlock Modifier and Type Method Description Future<MatrixBlock>MatrixBlock. allocateBlockAsync()Methods in org.apache.sysds.runtime.matrix.data with parameters of type MatrixBlock Modifier and Type Method Description static voidLibMatrixAgg. aggregateBinaryMatrix(MatrixBlock in, MatrixBlock aggVal, MatrixBlock aggCorr, boolean deep)Core incremental matrix aggregate (ak+) as used in mapmult, tsmm, cpmm, etc.static voidLibMatrixAgg. aggregateBinaryMatrix(MatrixBlock in, MatrixBlock aggVal, AggregateOperator aop)Core incremental matrix aggregate (ak+) as used for uack+ and acrk+.MatrixBlockMatrixBlock. aggregateBinaryOperations(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, AggregateBinaryOperator op)MatrixBlockMatrixBlock. aggregateBinaryOperations(MatrixBlock m1, MatrixBlock m2, AggregateBinaryOperator op)static CM_COV_ObjectLibMatrixAgg. aggregateCmCov(MatrixBlock in1, MatrixBlock in2, MatrixBlock in3, ValueFunction fn)Single threaded Covariance and Central Moment operations CM = Central Moment COV = Covariancestatic CM_COV_ObjectLibMatrixAgg. aggregateCmCov(MatrixBlock in1, MatrixBlock in2, MatrixBlock in3, ValueFunction fn, int k)Multi threaded Covariance and Central Moment operations CM = Central Moment COV = Covariancestatic voidLibMatrixOuterAgg. aggregateMatrix(MatrixBlock in1Val, MatrixBlock outVal, double[] bv, int[] bvi, BinaryOperator bOp, AggregateUnaryOperator uaggOp)static MatrixBlockLibMatrixAgg. aggregateTernary(MatrixBlock in1, MatrixBlock in2, MatrixBlock in3, MatrixBlock ret, AggregateTernaryOperator op)static MatrixBlockLibMatrixAgg. aggregateTernary(MatrixBlock in1, MatrixBlock in2, MatrixBlock in3, MatrixBlock ret, AggregateTernaryOperator op, int k)MatrixBlockMatrixBlock. aggregateTernaryOperations(MatrixBlock m1, MatrixBlock m2, MatrixBlock m3, MatrixBlock ret, AggregateTernaryOperator op, boolean inCP)static voidLibMatrixAgg. aggregateUnaryMatrix(MatrixBlock in, MatrixBlock out, AggregateUnaryOperator uaop)static voidLibMatrixAgg. aggregateUnaryMatrix(MatrixBlock in, MatrixBlock out, AggregateUnaryOperator uaop, int k)MatrixBlockMatrixBlock. append(MatrixBlock[] that, MatrixBlock result, boolean cbind)MatrixBlockMatrixBlock. append(MatrixBlock that, MatrixBlock ret)MatrixBlockMatrixBlock. append(MatrixBlock that, MatrixBlock ret, boolean cbind)voidMatrixBlock. appendRowToSparse(SparseBlock dest, MatrixBlock src, int i, int rowoffset, int coloffset, boolean deep)voidMatrixBlock. appendToSparse(MatrixBlock that, int rowoffset, int coloffset)static voidLibMatrixDNN. batchNorm2D(MatrixBlock image, MatrixBlock scale, MatrixBlock bias, MatrixBlock runningMean, MatrixBlock runningVar, String phase, double epsilon, double mu, MatrixBlock ret, MatrixBlock retRunningMean, MatrixBlock retRunningVar, MatrixBlock resultSaveMean, MatrixBlock resultSaveInvVariance)static voidLibMatrixDNN. batchNorm2DBackward(MatrixBlock image, MatrixBlock dout, MatrixBlock scale, double epsilon, MatrixBlock resultSaveMean, MatrixBlock resultSaveInvVariance, MatrixBlock dX, MatrixBlock dScale, MatrixBlock dBias)static voidLibMatrixDNN. biasAdd(MatrixBlock input, MatrixBlock bias, MatrixBlock outputBlock, int numThreads)Performs the operation corresponding to the DML script: ones = matrix(1, rows=1, cols=Hout*Wout) output = input + matrix(bias %*% ones, rows=1, cols=F*Hout*Wout) This operation is often followed by conv2d and hence we have introduced bias_add(input, bias) built-in functionstatic voidLibMatrixDNN. biasMultiply(MatrixBlock input, MatrixBlock bias, MatrixBlock outputBlock, int numThreads)Performs the operation corresponding to the DML script: ones = matrix(1, rows=1, cols=Hout*Wout) output = input * matrix(bias %*% ones, rows=1, cols=F*Hout*Wout) This operation is often followed by conv2d and hence we have introduced bias_multiply(input, bias) built-in functionstatic voidLibMatrixBincell. bincellOp(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, BinaryOperator op)matrix-matrix binary operations, MM, MVstatic voidLibMatrixBincell. bincellOp(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, BinaryOperator op, int k)static voidLibMatrixBincell. bincellOp(MatrixBlock m1, MatrixBlock ret, ScalarOperator op)matrix-scalar, scalar-matrix binary operations.static voidLibMatrixBincell. bincellOp(MatrixBlock m1, MatrixBlock ret, ScalarOperator op, int k)static MatrixBlockLibMatrixBincell. bincellOpInPlace(MatrixBlock m1ret, MatrixBlock m2, BinaryOperator op)NOTE: operations in place always require m1 and m2 to be of equal dimensions defaults to right side operations, updating the m1 matrix with like: m1ret op m2static MatrixBlockLibMatrixBincell. bincellOpInPlaceLeft(MatrixBlock m1ret, MatrixBlock m2, BinaryOperator op)Left side operations, updating the m1 matrix like: m2 op m1retstatic MatrixBlockLibMatrixBincell. bincellOpInPlaceRight(MatrixBlock m1ret, MatrixBlock m2, BinaryOperator op)Right side operations, updating the m1 matrix like: m1ret op m2MatrixBlockMatrixBlock. chainMatrixMultOperations(MatrixBlock v, MatrixBlock w, MatrixBlock out, MapMultChain.ChainType ctype)MatrixBlockMatrixBlock. chainMatrixMultOperations(MatrixBlock v, MatrixBlock w, MatrixBlock out, MapMultChain.ChainType ctype, int k)static voidLibMatrixDNN. channelSums(MatrixBlock input, MatrixBlock outputBlock, int C, int HW)Perform channel sum operationstatic voidMatrixBlock. checkCMOperations(MatrixBlock mb, CMOperator op)voidMatrixBlock. checkDimensionsForAppend(MatrixBlock[] in, boolean cbind)static voidLibMatrixReorg. checkRexpand(MatrixBlock in, boolean ignore)Quick check if the input is valid for rexpand, this check does not guarantee that the input is valid for rexpandCM_COV_ObjectMatrixBlock. cmOperations(CMOperator op, MatrixBlock weights)static voidLibMatrixDNNIm2Col. col2imOverSingleImage(int outputN, MatrixBlock input, DnnParameters params)static voidLibMatrixDNN. conv2d(MatrixBlock input, MatrixBlock filter, MatrixBlock outputBlock, DnnParameters params)This method performs convolution (i.e.static voidLibMatrixNative. conv2d(MatrixBlock input, MatrixBlock filter, MatrixBlock outputBlock, DnnParameters params)This method performs convolution (i.e.static voidLibMatrixDNN. conv2dBackwardData(MatrixBlock filter, MatrixBlock dout, MatrixBlock outputBlock, DnnParameters params)This method computes the backpropogation errors for previous layer of convolution operationstatic voidLibMatrixNative. conv2dBackwardData(MatrixBlock filter, MatrixBlock dout, MatrixBlock outputBlock, DnnParameters params)This method computes the backpropagation errors for previous layer of convolution operationstatic voidLibMatrixDNN. conv2dBackwardFilter(MatrixBlock input, MatrixBlock dout, MatrixBlock outputBlock, DnnParameters params)This method computes the backpropogation errors for filter of convolution operationstatic voidLibMatrixNative. conv2dBackwardFilter(MatrixBlock input, MatrixBlock dout, MatrixBlock outputBlock, DnnParameters params)This method computes the backpropogation errors for filter of convolution operationvoidBinaryBlockToTextCellConverter. convert(MatrixIndexes k1, MatrixBlock v1)Before calling convert, please make sure to setBlockSize(blen, blen);voidMatrixBlock. copy(int rl, int ru, int cl, int cu, MatrixBlock src, boolean awareDestNZ)In-place copy of matrix src into the index range of the existing current matrix.MatrixBlockMatrixBlock. copyShallow(MatrixBlock that)static longLibMatrixMult. copyUpperToLowerTriangle(MatrixBlock ret)Used for all version of TSMM where the result is known to be symmetric.static int[]LibMatrixReorg. countNNZColumns(MatrixBlock in, int k, ExecutorService pool)static List<Future<int[]>>LibMatrixReorg. countNNZColumnsFuture(MatrixBlock in, int k, ExecutorService pool)static int[]LibMatrixReorg. countNnzPerColumn(MatrixBlock in)static int[]LibMatrixReorg. countNnzPerColumn(MatrixBlock in, int rl, int ru)CM_COV_ObjectMatrixBlock. covOperations(COVOperator op, MatrixBlock that)CM_COV_ObjectMatrixBlock. covOperations(COVOperator op, MatrixBlock that, MatrixBlock weights)static CorrMatrixBlockLibMatrixCountDistinct. createSketch(MatrixBlock blkIn, CountDistinctOperator op)voidCM_N_COVCell. ctableOperations(Operator op, double scalarThat, double scalarThat2, CTableMap resultMap, MatrixBlock resultBlock)voidCM_N_COVCell. ctableOperations(Operator op, double scalarThat, MatrixValue that2, CTableMap resultMap, MatrixBlock resultBlock)voidCM_N_COVCell. ctableOperations(Operator op, MatrixIndexes ix1, double scalarThat, boolean left, int blen, CTableMap resultMap, MatrixBlock resultBlock)voidCM_N_COVCell. ctableOperations(Operator op, MatrixValue that, double scalarThat2, boolean ignoreZeros, CTableMap resultMap, MatrixBlock resultBlock)voidCM_N_COVCell. ctableOperations(Operator op, MatrixValue that, MatrixValue that2, CTableMap resultMap, MatrixBlock resultBlock)voidMatrixBlock. ctableOperations(Operator op, double scalarThat, double scalarThat2, CTableMap resultMap, MatrixBlock resultBlock)D = ctable(A,v2,w) this <- A; scalar_that <- v2; scalar_that2 <- w; result <- D (i1,j1,v1) from input1 (this) (v2) from sclar_input2 (scalarThat) (w) from scalar_input3 (scalarThat2)voidMatrixBlock. ctableOperations(Operator op, double scalarThat, MatrixValue that2Val, CTableMap resultMap, MatrixBlock resultBlock)D = ctable(A,v2,W) this <- A; scalarThat <- v2; that2 <- W; result <- D (i1,j1,v1) from input1 (this) (v2) from sclar_input2 (scalarThat) (i3,j3,w) from input3 (that2)voidMatrixBlock. ctableOperations(Operator op, MatrixIndexes ix1, double scalarThat, boolean left, int blen, CTableMap resultMap, MatrixBlock resultBlock)Specific ctable case of ctable(seq(...),X), where X is the only matrix input.voidMatrixBlock. ctableOperations(Operator op, MatrixValue thatVal, double scalarThat2, boolean ignoreZeros, CTableMap resultMap, MatrixBlock resultBlock)D = ctable(A,B,w) this <- A; that <- B; scalar_that2 <- w; result <- D (i1,j1,v1) from input1 (this) (i1,j1,v2) from input2 (that) (w) from scalar_input3 (scalarThat2) NOTE: This method supports both vectors and matrices.voidMatrixBlock. ctableOperations(Operator op, MatrixValue thatVal, MatrixValue that2Val, CTableMap resultMap, MatrixBlock resultBlock)voidMatrixCell. ctableOperations(Operator op, double scalarThat, double scalarThat2, CTableMap resultMap, MatrixBlock resultBlock)voidMatrixCell. ctableOperations(Operator op, double scalarThat, MatrixValue that2, CTableMap resultMap, MatrixBlock resultBlock)voidMatrixCell. ctableOperations(Operator op, MatrixIndexes ix1, double scalarThat, boolean left, int blen, CTableMap resultMap, MatrixBlock resultBlock)voidMatrixCell. ctableOperations(Operator op, MatrixValue that, double scalarThat2, boolean ignoreZeros, CTableMap ctableResult, MatrixBlock ctableResultBlock)voidMatrixCell. ctableOperations(Operator op, MatrixValue that, MatrixValue that2, CTableMap resultMap, MatrixBlock resultBlock)abstract voidMatrixValue. ctableOperations(Operator op, double scalar_that, double scalar_that2, CTableMap resultMap, MatrixBlock resultBlock)abstract voidMatrixValue. ctableOperations(Operator op, double scalarThat, MatrixValue that2, CTableMap ctableResult, MatrixBlock ctableResultBlock)abstract voidMatrixValue. ctableOperations(Operator op, MatrixIndexes ix1, double scalar_that, boolean left, int blen, CTableMap resultMap, MatrixBlock resultBlock)abstract voidMatrixValue. ctableOperations(Operator op, MatrixValue that, double scalar_that2, boolean ignoreZeros, CTableMap resultMap, MatrixBlock resultBlock)abstract voidMatrixValue. ctableOperations(Operator op, MatrixValue that, MatrixValue that2, CTableMap resultMap, MatrixBlock resultBlock)MatrixBlockMatrixBlock. ctableSeqOperations(MatrixValue thatMatrix, double thatScalar, MatrixBlock resultBlock)D = ctable(seq,A,w) this <- seq; thatMatrix <- A; thatScalar <- w; result <- D (i1,j1,v1) from input1 (this) (i1,j1,v2) from input2 (that) (w) from scalar_input3 (scalarThat2)MatrixBlockMatrixBlock. ctableSeqOperations(MatrixValue thatMatrix, double thatScalar, MatrixBlock ret, boolean updateClen)static MatrixBlockLibMatrixAgg. cumaggregateUnaryMatrix(MatrixBlock in, MatrixBlock out, UnaryOperator uop)static MatrixBlockLibMatrixAgg. cumaggregateUnaryMatrix(MatrixBlock in, MatrixBlock out, UnaryOperator uop, double[] agg)static MatrixBlockLibMatrixAgg. cumaggregateUnaryMatrix(MatrixBlock in, MatrixBlock out, UnaryOperator uop, int k)static MatrixBlockLibMatrixReorg. diag(MatrixBlock in, MatrixBlock out)static MatrixBlockLibMatrixMult. emptyMatrixMult(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret)static intLibMatrixCountDistinct. estimateDistinctValues(MatrixBlock in, CountDistinctOperator op)Public method to count the number of distinct values inside a matrix.MatrixBlockMatrixBlock. extractTriangular(MatrixBlock ret, boolean lower, boolean diag, boolean values)static voidLibMatrixDatagen. generateRandomMatrix(MatrixBlock out, RandomMatrixGenerator rgen, org.apache.commons.math3.random.Well1024a bigrand, long bSeed)Function to generate a matrix of random numbers.static voidLibMatrixDatagen. generateRandomMatrix(MatrixBlock out, RandomMatrixGenerator rgen, org.apache.commons.math3.random.Well1024a bigrand, long bSeed, int k)Function to generate a matrix of random numbers.static voidLibMatrixDatagen. generateSample(MatrixBlock out, long range, int size, boolean replace, long seed)Generates a sample of sizesizefrom a range of values [1,range].static voidLibMatrixDatagen. generateSequence(MatrixBlock out, double from, double to, double incr)Method to generate a sequence according to the given parameters.static LibMatrixBincell.BinaryAccessTypeLibMatrixBincell. getBinaryAccessType(MatrixBlock m1, MatrixBlock m2)static LibMatrixBincell.BinaryAccessTypeLibMatrixBincell. getBinaryAccessTypeExtended(MatrixBlock m1, MatrixBlock m2)static LibMatrixDNNRotate180.Rotate180WorkerLibMatrixDNNRotate180.Rotate180Worker. getWorker(MatrixBlock in, MatrixBlock out, DnnParameters params, boolean zeroOutSparseOutput, boolean trans)static voidLibMatrixAgg. groupedAggregate(MatrixBlock groups, MatrixBlock target, MatrixBlock weights, MatrixBlock result, int numGroups, Operator op)static voidLibMatrixAgg. groupedAggregate(MatrixBlock groups, MatrixBlock target, MatrixBlock weights, MatrixBlock result, int numGroups, Operator op, int k)static voidLibMatrixDNNIm2Col. im2col(MatrixBlock in, MatrixBlock out, int r, int C, int R, int S, int H, int W, int P, int Q, int stride_h, int stride_w, int pad_h, int pad_w, boolean trans)static voidLibMatrixDNNIm2Col. im2col(MatrixBlock in, MatrixBlock out, int r, DnnParameters params, boolean trans)static voidLibMatrixDNNIm2Col. im2colSparse(MatrixBlock in, MatrixBlock out, int r, int C, int R, int S, int H, int W, int P, int Q, int stride_h, int stride_w, int pad_h, int pad_w, boolean trans)FrameBlockFrameBlock. invalidByLength(MatrixBlock feaLen)This method validates the frame data against an attribute length constrain if data value in any cell is greater than the specified threshold of that attribute the output frame will store a null on that cell position, thus removing the length-violating values.static booleanLibMatrixBincell. isAllDense(MatrixBlock... mb)static booleanLibMatrixMult. isSparseOutputMatrixMult(MatrixBlock m1, MatrixBlock m2)static booleanLibMatrixBincell. isSparseSafeDivide(BinaryOperator op, MatrixBlock rhs)static booleanLibMatrixMult. isUltraSparseMatrixMult(MatrixBlock m1, MatrixBlock m2, boolean m1Perm)static voidLibMatrixBincell. isValidDimensionsBinary(MatrixBlock m1, MatrixBlock m2)static voidLibMatrixBincell. isValidDimensionsBinaryExtended(MatrixBlock m1, MatrixBlock m2)MatrixBlockMatrixBlock. leftIndexingOperations(ScalarObject scalar, int rl, int cl, MatrixBlock ret, MatrixObject.UpdateType update)Explicitly allow left indexing for scalars.MatrixBlockMatrixBlock. leftIndexingOperations(MatrixBlock rhsMatrix, int rl, int ru, int cl, int cu, MatrixBlock ret, MatrixObject.UpdateType update)MatrixBlockMatrixBlock. leftIndexingOperations(MatrixBlock rhsMatrix, IndexRange ixrange, MatrixBlock ret, MatrixObject.UpdateType update)static MatrixBlockOperationsOnMatrixValues. matMult(MatrixBlock value1, MatrixBlock value2, MatrixBlock valueOut, AggregateBinaryOperator op)static MatrixBlockOperationsOnMatrixValues. matMult(MatrixBlock value1, MatrixBlock value2, AggregateBinaryOperator op)static MatrixBlockOperationsOnMatrixValues. matMult(MatrixIndexes indexes1, MatrixBlock value1, MatrixIndexes indexes2, MatrixBlock value2, MatrixIndexes indexesOut, MatrixBlock valueOut, AggregateBinaryOperator op)static MatrixBlockLibCommonsMath. matrixMatrixOperations(MatrixBlock in1, MatrixBlock in2, String opcode)static MatrixBlockLibMatrixMult. matrixMult(MatrixBlock m1, MatrixBlock m2)Performs a matrix multiplication All variants use a IKJ access pattern, and internally use dense output.static MatrixBlockLibMatrixMult. matrixMult(MatrixBlock m1, MatrixBlock m2, int k)Performs a matrix multiplication All variants use a IKJ access pattern, and internally use dense output.static MatrixBlockLibMatrixMult. matrixMult(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret)Performs a matrix multiplication and stores the result in the output matrix.static MatrixBlockLibMatrixMult. matrixMult(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, boolean fixedRet)This method allows one to disabling exam sparsity.static MatrixBlockLibMatrixMult. matrixMult(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, boolean fixedRet, int k)Performs a matrix multiplication and stores the result in the output matrix.static MatrixBlockLibMatrixMult. matrixMult(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, int k)Performs a multi-threaded matrix multiplication and stores the result in the output matrix.static MatrixBlockLibMatrixNative. matrixMult(MatrixBlock m1, MatrixBlock m2, MatrixBlock ret, int k)Performs matrix multiplication using native library if BLAS is available or else falls back to Java BLAS.static voidLibMatrixMult. matrixMultChain(MatrixBlock mX, MatrixBlock mV, MatrixBlock mW, MatrixBlock ret, MapMultChain.ChainType ct)Performs a matrix multiplication chain operation of type t(X)%*%(X%*%v) or t(X)%*%(w*(X%*%v)).static voidLibMatrixMult. matrixMultChain(MatrixBlock mX, MatrixBlock mV, MatrixBlock mW, MatrixBlock ret, MapMultChain.ChainType ct, int k)Performs a parallel matrix multiplication chain operation of type t(X)%*%(X%*%v) or t(X)%*%(w*(X%*%v)).static voidLibMatrixMult. matrixMultPermute(MatrixBlock pm1, MatrixBlock m2, MatrixBlock ret1, MatrixBlock ret2)static voidLibMatrixMult. matrixMultPermute(MatrixBlock pm1, MatrixBlock m2, MatrixBlock ret1, MatrixBlock ret2, int k)static voidLibMatrixMult. matrixMultTransposeSelf(MatrixBlock m1, MatrixBlock ret, boolean leftTranspose)static voidLibMatrixMult. matrixMultTransposeSelf(MatrixBlock m1, MatrixBlock ret, boolean leftTranspose, boolean copyToLowerTriangle)static voidLibMatrixMult. matrixMultTransposeSelf(MatrixBlock m1, MatrixBlock ret, boolean leftTranspose, int k)TSMM with optional transposed left side or not (Transposed self matrix multiplication)static voidLibMatrixMult. matrixMultWCeMM(MatrixBlock mW, MatrixBlock mU, MatrixBlock mV, double eps, MatrixBlock ret, WeightedCrossEntropy.WCeMMType wt)static voidLibMatrixMult. matrixMultWCeMM(MatrixBlock mW, MatrixBlock mU, MatrixBlock mV, double eps, MatrixBlock ret, WeightedCrossEntropy.WCeMMType wt, int k)static voidLibMatrixMult. matrixMultWDivMM(MatrixBlock mW, MatrixBlock mU, MatrixBlock mV, MatrixBlock mX, MatrixBlock ret, WeightedDivMM.WDivMMType wt)NOTE: This operation has limited NaN support, which is acceptable because all our sparse-safe operations have only limited NaN support.static voidLibMatrixMult. matrixMultWDivMM(MatrixBlock mW, MatrixBlock mU, MatrixBlock mV, MatrixBlock mX, MatrixBlock ret, WeightedDivMM.WDivMMType wt, int k)NOTE: This operation has limited NaN support, which is acceptable because all our sparse-safe operations have only limited NaN support.static voidLibMatrixMult. matrixMultWSigmoid(MatrixBlock mW, MatrixBlock mU, MatrixBlock mV, MatrixBlock ret, WeightedSigmoid.WSigmoidType wt)static voidLibMatrixMult. matrixMultWSigmoid(MatrixBlock mW, MatrixBlock mU, MatrixBlock mV, MatrixBlock ret, WeightedSigmoid.WSigmoidType wt, int k)static voidLibMatrixMult. matrixMultWSLoss(MatrixBlock mX, MatrixBlock mU, MatrixBlock mV, MatrixBlock mW, MatrixBlock ret, WeightedSquaredLoss.WeightsType wt)static voidLibMatrixMult. matrixMultWSLoss(MatrixBlock mX, MatrixBlock mU, MatrixBlock mV, MatrixBlock mW, MatrixBlock ret, WeightedSquaredLoss.WeightsType wt, int k)static voidLibMatrixMult. matrixMultWuMM(MatrixBlock mW, MatrixBlock mU, MatrixBlock mV, MatrixBlock ret, WeightedUnaryMM.WUMMType wt, ValueFunction fn)static voidLibMatrixMult. matrixMultWuMM(MatrixBlock mW, MatrixBlock mU, MatrixBlock mV, MatrixBlock ret, WeightedUnaryMM.WUMMType wt, ValueFunction fn, int k)voidMatrixBlock. merge(MatrixBlock that, boolean appendOnly)Merge disjoint: merges all non-zero values of the given input into the current matrix block.voidMatrixBlock. merge(MatrixBlock that, boolean appendOnly, boolean par)voidMatrixBlock. merge(MatrixBlock that, boolean appendOnly, boolean par, boolean deep)static MatrixBlock[]LibCommonsMath. multiReturnOperations(MatrixBlock in, String opcode)static MatrixBlock[]LibCommonsMath. multiReturnOperations(MatrixBlock in, String opcode, int threads, int num_iterations, double tol)static MatrixBlock[]LibCommonsMath. multiReturnOperations(MatrixBlock in, String opcode, int threads, long seed)static MatrixBlockMatrixBlock. naryOperations(Operator op, MatrixBlock[] matrices, ScalarObject[] scalars, MatrixBlock ret)static voidOperationsOnMatrixValues. performCtable(MatrixIndexes indexesIn1, MatrixValue valueIn1, double scalarIn2, boolean left, int blen, CTableMap resultMap, MatrixBlock resultBlock, Operator op)static voidOperationsOnMatrixValues. performCtable(MatrixIndexes indexesIn1, MatrixValue valueIn1, double scalarIn2, double scalarIn3, CTableMap resultMap, MatrixBlock resultBlock, Operator op)static voidOperationsOnMatrixValues. performCtable(MatrixIndexes indexesIn1, MatrixValue valueIn1, double scalarIn2, MatrixIndexes indexesIn3, MatrixValue valueIn3, CTableMap resultMap, MatrixBlock resultBlock, Operator op)static voidOperationsOnMatrixValues. performCtable(MatrixIndexes indexesIn1, MatrixValue valueIn1, MatrixIndexes indexesIn2, MatrixValue valueIn2, double scalarIn3, CTableMap resultMap, MatrixBlock resultBlock, Operator op)static voidOperationsOnMatrixValues. performCtable(MatrixIndexes indexesIn1, MatrixValue valueIn1, MatrixIndexes indexesIn2, MatrixValue valueIn2, MatrixIndexes indexesIn3, MatrixValue valueIn3, CTableMap resultMap, MatrixBlock resultBlock, Operator op)static voidOperationsOnMatrixValues. performMapGroupedAggregate(Operator op, IndexedMatrixValue inTarget, MatrixBlock groups, int ngroups, int blen, ArrayList<IndexedMatrixValue> outlist)static ListOperationsOnMatrixValues. performSlice(IndexRange ixrange, int blen, int iix, int jix, MatrixBlock in)static voidLibMatrixDNN. pooling(MatrixBlock input, MatrixBlock output, DnnParameters params, LibMatrixDNN.PoolingType poolType)static voidLibMatrixDNN. poolingBackward(MatrixBlock input, MatrixBlock dout, MatrixBlock outputBlock, DnnParameters params, boolean performReluBackward, LibMatrixDNN.PoolingType poolType)This method computes the backpropogation errors for previous layer of pooling operationstatic voidLibMatrixDNNIm2Col. preallocateSparseOutput(MatrixBlock in, MatrixBlock out)static MatrixBlockLibMatrixMult. prepMatrixMultTransposeSelfInput(MatrixBlock m1, boolean leftTranspose, boolean par)voidMatrixBlock. putInto(MatrixBlock target, int rowOffset, int colOffset, boolean sparseCopyShallow)Method for copying this matrix into a target matrix.MatrixBlockMatrixBlock. quaternaryOperations(QuaternaryOperator qop, MatrixBlock um, MatrixBlock vm, MatrixBlock wm, MatrixBlock out)MatrixBlockMatrixBlock. quaternaryOperations(QuaternaryOperator qop, MatrixBlock U, MatrixBlock V, MatrixBlock wm, MatrixBlock out, int k)static voidLibMatrixAgg. recomputeIndexes(MatrixBlock out, AggregateUnaryOperator op, int blen, MatrixIndexes ix)Recompute outputs (e.g., maxindex or minindex) according to block indexes from MR.static voidLibMatrixDNN. reluBackward(MatrixBlock input, MatrixBlock dout, MatrixBlock outputBlock, int numThreads)This method computes the backpropagation errors for previous layer of relu operationFrameBlockFrameBlock. removeEmptyOperations(boolean rows, boolean emptyReturn, MatrixBlock select)MatrixBlockMatrixBlock. removeEmptyOperations(MatrixBlock ret, boolean rows, boolean emptyReturn)MatrixBlockMatrixBlock. removeEmptyOperations(MatrixBlock ret, boolean rows, boolean emptyReturn, MatrixBlock select)static MatrixBlockLibMatrixReorg. reorg(MatrixBlock in, MatrixBlock out, ReorgOperator op)static MatrixBlockLibMatrixReorg. reorgInPlace(MatrixBlock in, ReorgOperator op)static voidLibMatrixOuterAgg. resetOutputMatrix(MatrixIndexes in1Ix, MatrixBlock in1Val, MatrixIndexes outIx, MatrixBlock outVal, AggregateUnaryOperator uaggOp)ReSet output matrixstatic MatrixBlockLibMatrixReorg. reshape(MatrixBlock in, MatrixBlock out, int rows, int cols, boolean rowwise)CP reshape operation (single input, single output matrix) NOTE: In contrast to R, the rowwise parameter specifies both the read and write order, with row-wise being the default, while R uses always a column-wise read, rowwise specifying the write order and column-wise being the default.static MatrixBlockLibMatrixReorg. rev(MatrixBlock in, MatrixBlock out)static MatrixBlockLibMatrixReorg. rexpand(MatrixBlock in, MatrixBlock ret, double max, boolean rows, boolean cast, boolean ignore, int k)CP rexpand operation (single input, single output), the classic example of this operation is one hot encoding of a column to multiple columns.static MatrixBlockLibMatrixReorg. rexpand(MatrixBlock in, MatrixBlock ret, int max, boolean rows, boolean cast, boolean ignore, int k)CP rexpand operation (single input, single output), the classic example of this operation is one hot encoding of a column to multiple columns.MatrixBlockMatrixBlock. rexpandOperations(MatrixBlock ret, double max, boolean rows, boolean cast, boolean ignore, int k)static MatrixBlockLibMatrixReorg. rmempty(MatrixBlock in, MatrixBlock ret, boolean rows, boolean emptyReturn, MatrixBlock select)CP rmempty operation (single input, single output matrix)static booleanLibMatrixAgg. satisfiesMultiThreadingConstraints(MatrixBlock in, int k)static booleanLibMatrixAgg. satisfiesMultiThreadingConstraints(MatrixBlock in, MatrixBlock out, AggregateUnaryOperator uaop, int k)static booleanLibMatrixMult. satisfiesMultiThreadingConstraints(MatrixBlock m1, boolean checkMem, boolean checkFLOPs, long FPfactor, int k)static booleanLibMatrixMult. satisfiesMultiThreadingConstraints(MatrixBlock m1, int k)static booleanLibMatrixMult. satisfiesMultiThreadingConstraints(MatrixBlock m1, MatrixBlock m2, boolean checkMem, boolean checkFLOPs, long FPfactor, int k)MatrixBlockMatrixBlock. slice(IndexRange ixrange, MatrixBlock ret)static MatrixBlockLibMatrixReorg. sort(MatrixBlock in, MatrixBlock out, int[] by, boolean desc, boolean ixret)static MatrixBlockLibMatrixReorg. sort(MatrixBlock in, MatrixBlock out, int[] by, boolean desc, boolean ixret, int k)MatrixBlockMatrixBlock. sortOperations(MatrixValue weights, MatrixBlock result)MatrixBlockMatrixBlock. sortOperations(MatrixValue weights, MatrixBlock result, int k)static voidLibMatrixTercell. tercellOp(MatrixBlock m1, MatrixBlock m2, MatrixBlock m3, MatrixBlock ret, TernaryOperator op)MatrixBlockMatrixBlock. ternaryOperations(TernaryOperator op, MatrixBlock m2, MatrixBlock m3, MatrixBlock ret)static MatrixBlockLibMatrixReorg. transpose(MatrixBlock in)static MatrixBlockLibMatrixReorg. transpose(MatrixBlock in, int k)static MatrixBlockLibMatrixReorg. transpose(MatrixBlock in, MatrixBlock out)static MatrixBlockLibMatrixReorg. transpose(MatrixBlock in, MatrixBlock out, int k)static MatrixBlockLibMatrixReorg. transpose(MatrixBlock in, MatrixBlock out, int k, boolean allowCSR)static MatrixBlockLibMatrixReorg. transposeInPlace(MatrixBlock in, int k)MatrixBlockMatrixBlock. transposeSelfMatrixMultOperations(MatrixBlock out, MMTSJ.MMTSJType tstype)MatrixBlockMatrixBlock. transposeSelfMatrixMultOperations(MatrixBlock out, MMTSJ.MMTSJType tstype, int k)static voidLibMatrixNative. tsmm(MatrixBlock m1, MatrixBlock ret, boolean leftTrans, int k)MatrixBlockMatrixBlock. uaggouterchainOperations(MatrixBlock mbLeft, MatrixBlock mbRight, MatrixBlock mbOut, BinaryOperator bOp, AggregateUnaryOperator uaggOp)static MatrixBlockLibCommonsMath. unaryOperations(MatrixBlock inj, String opcode)Constructors in org.apache.sysds.runtime.matrix.data with parameters of type MatrixBlock Constructor Description MatrixBlock(MatrixBlock that)MatrixBlock(MatrixBlock that, boolean sp)MatrixBlock(MatrixBlock that, SparseBlock.Type stype, boolean deep) -
Uses of MatrixBlock in org.apache.sysds.runtime.matrix.data.sketch
Methods in org.apache.sysds.runtime.matrix.data.sketch that return MatrixBlock Modifier and Type Method Description MatrixBlockMatrixSketch. getMatrixValue(CorrMatrixBlock blkIn)Obtain matrix distinct count value from estimation Used for estimating distinct in rows or columns.Methods in org.apache.sysds.runtime.matrix.data.sketch with parameters of type MatrixBlock Modifier and Type Method Description CorrMatrixBlockMatrixSketch. create(MatrixBlock blkIn)Create a initial sketch of a given block.TMatrixSketch. getScalarValue(MatrixBlock blkIn)Get scalar distinct count from a input matrix block. -
Uses of MatrixBlock in org.apache.sysds.runtime.matrix.data.sketch.countdistinctapprox
Methods in org.apache.sysds.runtime.matrix.data.sketch.countdistinctapprox that return MatrixBlock Modifier and Type Method Description MatrixBlockKMVSketch. getMatrixValue(CorrMatrixBlock arg0)Methods in org.apache.sysds.runtime.matrix.data.sketch.countdistinctapprox with parameters of type MatrixBlock Modifier and Type Method Description CorrMatrixBlockKMVSketch. create(MatrixBlock blkIn)IntegerKMVSketch. getScalarValue(MatrixBlock in) -
Uses of MatrixBlock in org.apache.sysds.runtime.privacy.propagation
Methods in org.apache.sysds.runtime.privacy.propagation with parameters of type MatrixBlock Modifier and Type Method Description voidAppendPropagator. setFields(MatrixBlock input1, PrivacyConstraint privacyConstraint1, MatrixBlock input2, PrivacyConstraint privacyConstraint2)voidMatrixMultiplicationPropagator. setFields(MatrixBlock input1, PrivacyConstraint privacyConstraint1, MatrixBlock input2, PrivacyConstraint privacyConstraint2)Sets all fields of propagator. -
Uses of MatrixBlock in org.apache.sysds.runtime.transform.decode
Methods in org.apache.sysds.runtime.transform.decode with parameters of type MatrixBlock Modifier and Type Method Description abstract FrameBlockDecoder. decode(MatrixBlock in, FrameBlock out)Block decode API converting a matrix block into a frame block.FrameBlockDecoderComposite. decode(MatrixBlock in, FrameBlock out)FrameBlockDecoderDummycode. decode(MatrixBlock in, FrameBlock out)FrameBlockDecoderPassThrough. decode(MatrixBlock in, FrameBlock out)FrameBlockDecoderRecode. decode(MatrixBlock in, FrameBlock out) -
Uses of MatrixBlock in org.apache.sysds.runtime.transform.encode
Methods in org.apache.sysds.runtime.transform.encode that return MatrixBlock Modifier and Type Method Description MatrixBlockColumnEncoder. apply(CacheBlock in, MatrixBlock out, int outputCol)Apply Functions are only used in Single Threaded or Multi-Threaded Dense context.MatrixBlockColumnEncoder. apply(CacheBlock in, MatrixBlock out, int outputCol, int rowStart, int blk)MatrixBlockColumnEncoderComposite. apply(CacheBlock in, MatrixBlock out, int outputCol, int rowStart, int blk)MatrixBlockEncoder. apply(CacheBlock in, MatrixBlock out, int outputCol)Apply the generated metadata to the FrameBlock and saved the result in out.MatrixBlockEncoderMVImpute. apply(FrameBlock in, MatrixBlock out)MatrixBlockEncoderOmit. apply(FrameBlock in, MatrixBlock out)abstract MatrixBlockLegacyEncoder. apply(FrameBlock in, MatrixBlock out)Encode input data blockwise according to existing transform meta data (transform apply).MatrixBlockMultiColumnEncoder. apply(CacheBlock in)MatrixBlockMultiColumnEncoder. apply(CacheBlock in, int k)MatrixBlockMultiColumnEncoder. apply(CacheBlock in, MatrixBlock out, int outputCol)MatrixBlockMultiColumnEncoder. apply(CacheBlock in, MatrixBlock out, int outputCol, int k)MatrixBlockEncoderMVImpute. encode(FrameBlock in, MatrixBlock out)MatrixBlockEncoderOmit. encode(FrameBlock in, MatrixBlock out)abstract MatrixBlockLegacyEncoder. encode(FrameBlock in, MatrixBlock out)Block encode: build and apply (transform encode).MatrixBlockMultiColumnEncoder. encode(CacheBlock in)MatrixBlockMultiColumnEncoder. encode(CacheBlock in, int k)MatrixBlockColumnEncoder. getColMapping(FrameBlock meta)Obtain the column mapping of encoded frames based on the passed meta data frame.MatrixBlockLegacyEncoder. getColMapping(FrameBlock meta, MatrixBlock out)Obtain the column mapping of encoded frames based on the passed meta data frame.MatrixBlockMultiColumnEncoder. getColMapping(FrameBlock meta)Obtain the column mapping of encoded frames based on the passed meta data frame.Methods in org.apache.sysds.runtime.transform.encode with parameters of type MatrixBlock Modifier and Type Method Description MatrixBlockColumnEncoder. apply(CacheBlock in, MatrixBlock out, int outputCol)Apply Functions are only used in Single Threaded or Multi-Threaded Dense context.MatrixBlockColumnEncoder. apply(CacheBlock in, MatrixBlock out, int outputCol, int rowStart, int blk)MatrixBlockColumnEncoderComposite. apply(CacheBlock in, MatrixBlock out, int outputCol, int rowStart, int blk)MatrixBlockEncoder. apply(CacheBlock in, MatrixBlock out, int outputCol)Apply the generated metadata to the FrameBlock and saved the result in out.MatrixBlockEncoderMVImpute. apply(FrameBlock in, MatrixBlock out)MatrixBlockEncoderOmit. apply(FrameBlock in, MatrixBlock out)abstract MatrixBlockLegacyEncoder. apply(FrameBlock in, MatrixBlock out)Encode input data blockwise according to existing transform meta data (transform apply).MatrixBlockMultiColumnEncoder. apply(CacheBlock in, MatrixBlock out, int outputCol)MatrixBlockMultiColumnEncoder. apply(CacheBlock in, MatrixBlock out, int outputCol, int k)voidColumnEncoderUDF. applyDense(CacheBlock in, MatrixBlock out, int outputCol, int rowStart, int blk)MatrixBlockEncoderMVImpute. encode(FrameBlock in, MatrixBlock out)MatrixBlockEncoderOmit. encode(FrameBlock in, MatrixBlock out)abstract MatrixBlockLegacyEncoder. encode(FrameBlock in, MatrixBlock out)Block encode: build and apply (transform encode).List<DependencyTask<?>>ColumnEncoder. getApplyTasks(CacheBlock in, MatrixBlock out, int outputCol)List<DependencyTask<?>>ColumnEncoderComposite. getApplyTasks(CacheBlock in, MatrixBlock out, int outputCol)MatrixBlockLegacyEncoder. getColMapping(FrameBlock meta, MatrixBlock out)Obtain the column mapping of encoded frames based on the passed meta data frame.Constructors in org.apache.sysds.runtime.transform.encode with parameters of type MatrixBlock Constructor Description FeatureHashSparseApplyTask(ColumnEncoderFeatureHash encoder, CacheBlock input, MatrixBlock out, int outputCol)FeatureHashSparseApplyTask(ColumnEncoderFeatureHash encoder, CacheBlock input, MatrixBlock out, int outputCol, int startRow, int blk) -
Uses of MatrixBlock in org.apache.sysds.runtime.util
Methods in org.apache.sysds.runtime.util that return MatrixBlock Modifier and Type Method Description static MatrixBlockPy4jConverterUtils. allocateDenseOrSparse(int rlen, int clen, boolean isSparse)static MatrixBlockPy4jConverterUtils. allocateDenseOrSparse(long rlen, long clen, boolean isSparse)static MatrixBlockPy4jConverterUtils. convertPy4JArrayToMB(byte[] data, int rlen, int clen)static MatrixBlockPy4jConverterUtils. convertPy4JArrayToMB(byte[] data, int rlen, int clen, boolean isSparse, Types.ValueType valueType)static MatrixBlockPy4jConverterUtils. convertPy4JArrayToMB(byte[] data, int rlen, int clen, Types.ValueType valueType)static MatrixBlockPy4jConverterUtils. convertSciPyCOOToMB(byte[] data, byte[] row, byte[] col, int rlen, int clen, int nnz)static MatrixBlockDataConverter. convertToMatrixBlock(double[][] data)Creates a dense Matrix Block and copies the given double matrix into it.static MatrixBlockDataConverter. convertToMatrixBlock(double[] data, boolean columnVector)Creates a dense Matrix Block and copies the given double vector into it.static MatrixBlockDataConverter. convertToMatrixBlock(int[][] data)Converts an Integer matrix to an MatrixBlockstatic MatrixBlockDataConverter. convertToMatrixBlock(HashMap<MatrixIndexes,Double> map)static MatrixBlockDataConverter. convertToMatrixBlock(HashMap<MatrixIndexes,Double> map, int rlen, int clen)NOTE: this method also ensures the specified matrix dimensionsstatic MatrixBlockDataConverter. convertToMatrixBlock(org.apache.commons.math3.linear.RealMatrix rm)static MatrixBlockDataConverter. convertToMatrixBlock(CTableMap map)static MatrixBlockDataConverter. convertToMatrixBlock(CTableMap map, int rlen, int clen)NOTE: this method also ensures the specified matrix dimensionsstatic MatrixBlockDataConverter. convertToMatrixBlock(FrameBlock frame)Converts a frame block with arbitrary schema into a matrix block.static MatrixBlock[]DataConverter. convertToMatrixBlockPartitions(MatrixBlock mb, boolean colwise)static MatrixBlockLocalFileUtils. readMatrixBlockFromLocal(String fname)Reads a matrix block from local file system.static MatrixBlockLocalFileUtils. readMatrixBlockFromLocal(String fname, MatrixBlock reuse)Reads a matrix block from local file system.static MatrixBlockLocalFileUtils. readMatrixBlockFromStream(InputStream is)Reads a matrix block from an input stream, using a fused buffered reader with special support for matrix blocks.static MatrixBlockDataConverter. readMatrixFromHDFS(String dir, Types.FileFormat fmt, long rlen, long clen, int blen)static MatrixBlockDataConverter. readMatrixFromHDFS(String dir, Types.FileFormat fmt, long rlen, long clen, int blen, boolean localFS)static MatrixBlockDataConverter. readMatrixFromHDFS(String dir, Types.FileFormat fmt, long rlen, long clen, int blen, long expectedNnz)static MatrixBlockDataConverter. readMatrixFromHDFS(String dir, Types.FileFormat fmt, long rlen, long clen, int blen, long expectedNnz, boolean localFS)static MatrixBlockDataConverter. readMatrixFromHDFS(String dir, Types.FileFormat fmt, long rlen, long clen, int blen, long expectedNnz, FileFormatProperties formatProperties)static MatrixBlockDataConverter. readMatrixFromHDFS(ReadProperties prop)Core method for reading matrices in format textcell, matrixmarket, binarycell, or binaryblock from HDFS into main memory.Methods in org.apache.sysds.runtime.util that return types with arguments of type MatrixBlock Modifier and Type Method Description org.apache.hadoop.mapred.RecordReader<MatrixIndexes,MatrixBlock>BinaryBlockInputFormat. getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter)Methods in org.apache.sysds.runtime.util with parameters of type MatrixBlock Modifier and Type Method Description static byte[]Py4jConverterUtils. convertMBtoPy4JDenseArr(MatrixBlock mb)static org.apache.commons.math3.linear.Array2DRowRealMatrixDataConverter. convertToArray2DRowRealMatrix(MatrixBlock mb)Helper method that converts SystemDS matrix variable (varname) into a Array2DRowRealMatrix format, which is useful in invoking Apache CommonsMath.static org.apache.commons.math3.linear.BlockRealMatrixDataConverter. convertToBlockRealMatrix(MatrixBlock mb)static boolean[]DataConverter. convertToBooleanVector(MatrixBlock mb)static DenseBlockDataConverter. convertToDenseBlock(MatrixBlock mb)static DenseBlockDataConverter. convertToDenseBlock(MatrixBlock mb, boolean deep)static List<Double>DataConverter. convertToDoubleList(MatrixBlock mb)static double[][]DataConverter. convertToDoubleMatrix(MatrixBlock mb)Creates a two-dimensional double matrix of the input matrix block.static double[]DataConverter. convertToDoubleVector(MatrixBlock mb)static double[]DataConverter. convertToDoubleVector(MatrixBlock mb, boolean deep)static double[]DataConverter. convertToDoubleVector(MatrixBlock mb, boolean deep, boolean allowNull)static FrameBlockDataConverter. convertToFrameBlock(MatrixBlock mb)Converts a matrix block into a frame block of value type double.static FrameBlockDataConverter. convertToFrameBlock(MatrixBlock mb, Types.ValueType vt)Converts a matrix block into a frame block of a given value type.static FrameBlockDataConverter. convertToFrameBlock(MatrixBlock mb, Types.ValueType[] schema)static int[]DataConverter. convertToIntVector(MatrixBlock mb)static long[]DataConverter. convertToLongVector(MatrixBlock mb)static MatrixBlock[]DataConverter. convertToMatrixBlockPartitions(MatrixBlock mb, boolean colwise)static TensorBlockDataConverter. convertToTensorBlock(MatrixBlock mb, Types.ValueType vt, boolean toBasicTensor)static int[]DataConverter. convertVectorToIndexList(MatrixBlock mb)static voidDataConverter. copyToDoubleVector(MatrixBlock mb, double[] dest, int destPos)static voidDnnUtils. fillBias(MatrixBlock bias, double[] outputArray, int src_rl, int src_ru, int N, int K, int PQ)static booleanSortUtils. isSorted(MatrixBlock in)booleanBinaryBlockRecordReader. next(MatrixIndexes key, MatrixBlock value)static MatrixBlockLocalFileUtils. readMatrixBlockFromLocal(String fname, MatrixBlock reuse)Reads a matrix block from local file system.static StringDataConverter. toString(MatrixBlock mb)static StringDataConverter. toString(MatrixBlock mb, boolean sparse, String separator, String lineseparator, int rowsToPrint, int colsToPrint, int decimal)Returns a string representation of a matrixstatic voidLocalFileUtils. writeMatrixBlockToLocal(String fname, MatrixBlock mb)Writes a matrix block to local file system.static voidDataConverter. writeMatrixToHDFS(MatrixBlock mat, String dir, Types.FileFormat fmt, DataCharacteristics dc)static voidDataConverter. writeMatrixToHDFS(MatrixBlock mat, String dir, Types.FileFormat fmt, DataCharacteristics dc, int replication, FileFormatProperties formatProperties)static voidDataConverter. writeMatrixToHDFS(MatrixBlock mat, String dir, Types.FileFormat fmt, DataCharacteristics dc, int replication, FileFormatProperties formatProperties, boolean diag)
-