Uses of Class
org.apache.sysds.runtime.data.TensorBlock
-
-
Uses of TensorBlock in org.apache.sysds.runtime.controlprogram.context
Methods in org.apache.sysds.runtime.controlprogram.context that return TensorBlock Modifier and Type Method Description TensorBlockExecutionContext. getTensorInput(String varName)Pins a matrix variable into memory and returns the internal matrix block.static TensorBlockSparkExecutionContext. toTensorBlock(org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock> rdd, DataCharacteristics dc)Methods in org.apache.sysds.runtime.controlprogram.context that return types with arguments of type TensorBlock Modifier and Type Method Description org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock>SparkExecutionContext. getBinaryTensorBlockRDDHandleForVariable(String varname)Spark instructions should call this for all tensor inputs except broadcast variables.org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock>SparkExecutionContext. getBinaryTensorBlockRDDHandleForVariable(String varname, int numParts, boolean inclEmpty)PartitionedBroadcast<TensorBlock>SparkExecutionContext. getBroadcastForTensorObject(TensorObject to)PartitionedBroadcast<TensorBlock>SparkExecutionContext. getBroadcastForTensorVariable(String varname)static org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock>SparkExecutionContext. toTensorJavaPairRDD(org.apache.spark.api.java.JavaSparkContext sc, TensorBlock src, int blen)static org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock>SparkExecutionContext. toTensorJavaPairRDD(org.apache.spark.api.java.JavaSparkContext sc, TensorBlock src, int blen, int numParts, boolean inclEmpty)Methods in org.apache.sysds.runtime.controlprogram.context with parameters of type TensorBlock Modifier and Type Method Description voidExecutionContext. setTensorOutput(String varName, TensorBlock outputData)static org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock>SparkExecutionContext. toTensorJavaPairRDD(org.apache.spark.api.java.JavaSparkContext sc, TensorBlock src, int blen)static org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock>SparkExecutionContext. toTensorJavaPairRDD(org.apache.spark.api.java.JavaSparkContext sc, TensorBlock src, int blen, int numParts, boolean inclEmpty)Method parameters in org.apache.sysds.runtime.controlprogram.context with type arguments of type TensorBlock Modifier and Type Method Description static TensorBlockSparkExecutionContext. toTensorBlock(org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock> rdd, DataCharacteristics dc) -
Uses of TensorBlock in org.apache.sysds.runtime.data
Methods in org.apache.sysds.runtime.data that return TensorBlock Modifier and Type Method Description TensorBlockTensorBlock. allocateBlock()If data is not yet allocated, allocate.TensorBlockTensorBlock. binaryOperations(BinaryOperator op, TensorBlock thatValue, TensorBlock result)TensorBlockTensorBlock. copy(int[] lower, int[] upper, TensorBlock src)Copy a part of anotherTensorBlockTensorBlockTensorBlock. copy(TensorBlock src)TensorBlockTensorBlock. copyExact(int[] lower, int[] upper, TensorBlock src)Copy a part of anotherTensorBlock.TensorBlockIndexedTensorBlock. getValue()TensorBlockTensorBlock. slice(int[] offsets, TensorBlock outBlock)Slice the current block and write into the outBlock.Methods in org.apache.sysds.runtime.data with parameters of type TensorBlock Modifier and Type Method Description TensorBlockTensorBlock. binaryOperations(BinaryOperator op, TensorBlock thatValue, TensorBlock result)static voidLibTensorBincell. bincellOp(TensorBlock m1, TensorBlock m2, TensorBlock ret, BinaryOperator op)tensor-tensor binary operationsTensorBlockTensorBlock. copy(int[] lower, int[] upper, TensorBlock src)Copy a part of anotherTensorBlockTensorBlockTensorBlock. copy(TensorBlock src)TensorBlockTensorBlock. copyExact(int[] lower, int[] upper, TensorBlock src)Copy a part of anotherTensorBlock.static booleanLibTensorBincell. isValidDimensionsBinary(TensorBlock m1, TensorBlock m2)voidIndexedTensorBlock. set(TensorIndexes indexes2, TensorBlock block2)TensorBlockTensorBlock. slice(int[] offsets, TensorBlock outBlock)Slice the current block and write into the outBlock.Constructors in org.apache.sysds.runtime.data with parameters of type TensorBlock Constructor Description IndexedTensorBlock(TensorIndexes ind, TensorBlock b)TensorBlock(TensorBlock that)Copy constructor -
Uses of TensorBlock in org.apache.sysds.runtime.instructions.spark
Methods in org.apache.sysds.runtime.instructions.spark that return TensorBlock Modifier and Type Method Description TensorBlockAggregateUnarySPInstruction.RDDUTensorAggFunction2. call(scala.Tuple2<TensorIndexes,TensorBlock> arg0)Method parameters in org.apache.sysds.runtime.instructions.spark with type arguments of type TensorBlock Modifier and Type Method Description TensorBlockAggregateUnarySPInstruction.RDDUTensorAggFunction2. call(scala.Tuple2<TensorIndexes,TensorBlock> arg0) -
Uses of TensorBlock in org.apache.sysds.runtime.instructions.spark.functions
Methods in org.apache.sysds.runtime.instructions.spark.functions that return TensorBlock Modifier and Type Method Description TensorBlockTensorTensorBinaryOpFunction. call(scala.Tuple2<TensorBlock,TensorBlock> arg0)Methods in org.apache.sysds.runtime.instructions.spark.functions that return types with arguments of type TensorBlock Modifier and Type Method Description Iterator<scala.Tuple2<TensorIndexes,TensorBlock>>ReblockTensorFunction. call(scala.Tuple2<TensorIndexes,TensorBlock> arg0)Iterator<scala.Tuple2<TensorIndexes,TensorBlock>>ReplicateTensorFunction. call(scala.Tuple2<TensorIndexes,TensorBlock> arg0)LazyIterableIterator<scala.Tuple2<TensorIndexes,TensorBlock>>TensorTensorBinaryOpPartitionFunction. call(Iterator<scala.Tuple2<TensorIndexes,TensorBlock>> arg0)Method parameters in org.apache.sysds.runtime.instructions.spark.functions with type arguments of type TensorBlock Modifier and Type Method Description Iterator<scala.Tuple2<TensorIndexes,TensorBlock>>ReblockTensorFunction. call(scala.Tuple2<TensorIndexes,TensorBlock> arg0)Iterator<scala.Tuple2<TensorIndexes,TensorBlock>>ReplicateTensorFunction. call(scala.Tuple2<TensorIndexes,TensorBlock> arg0)TensorBlockTensorTensorBinaryOpFunction. call(scala.Tuple2<TensorBlock,TensorBlock> arg0)TensorBlockTensorTensorBinaryOpFunction. call(scala.Tuple2<TensorBlock,TensorBlock> arg0)LazyIterableIterator<scala.Tuple2<TensorIndexes,TensorBlock>>TensorTensorBinaryOpPartitionFunction. call(Iterator<scala.Tuple2<TensorIndexes,TensorBlock>> arg0)Constructor parameters in org.apache.sysds.runtime.instructions.spark.functions with type arguments of type TensorBlock Constructor Description TensorTensorBinaryOpPartitionFunction(BinaryOperator op, PartitionedBroadcast<TensorBlock> binput, boolean[] replicateDim) -
Uses of TensorBlock in org.apache.sysds.runtime.instructions.spark.utils
Methods in org.apache.sysds.runtime.instructions.spark.utils that return TensorBlock Modifier and Type Method Description static TensorBlockRDDAggregateUtils. aggStableTensor(org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock> in, AggregateOperator aop)Single block aggregation over pair rdds with corrections for numerical stability.static TensorBlockRDDAggregateUtils. aggStableTensor(org.apache.spark.api.java.JavaRDD<TensorBlock> in, AggregateOperator aop)Single block aggregation over rdds with corrections for numerical stability.Methods in org.apache.sysds.runtime.instructions.spark.utils with parameters of type TensorBlock Modifier and Type Method Description static IndexedTensorBlockSparkUtils. toIndexedTensorBlock(TensorIndexes ix, TensorBlock mb)Method parameters in org.apache.sysds.runtime.instructions.spark.utils with type arguments of type TensorBlock Modifier and Type Method Description static TensorBlockRDDAggregateUtils. aggStableTensor(org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock> in, AggregateOperator aop)Single block aggregation over pair rdds with corrections for numerical stability.static TensorBlockRDDAggregateUtils. aggStableTensor(org.apache.spark.api.java.JavaRDD<TensorBlock> in, AggregateOperator aop)Single block aggregation over rdds with corrections for numerical stability.static IndexedTensorBlockSparkUtils. toIndexedTensorBlock(scala.Tuple2<TensorIndexes,TensorBlock> in) -
Uses of TensorBlock in org.apache.sysds.runtime.io
Methods in org.apache.sysds.runtime.io that return TensorBlock Modifier and Type Method Description abstract TensorBlockTensorReader. readTensorFromHDFS(String fname, long[] dims, int blen, Types.ValueType[] schema)TensorBlockTensorReaderBinaryBlock. readTensorFromHDFS(String fname, long[] dims, int blen, Types.ValueType[] schema)TensorBlockTensorReaderTextCell. readTensorFromHDFS(String fname, long[] dims, int blen, Types.ValueType[] schema)Methods in org.apache.sysds.runtime.io with parameters of type TensorBlock Modifier and Type Method Description abstract voidTensorWriter. writeTensorToHDFS(TensorBlock src, String fname, int blen)voidTensorWriterBinaryBlock. writeTensorToHDFS(TensorBlock src, String fname, int blen)voidTensorWriterTextCell. writeTensorToHDFS(TensorBlock src, String fname, int blen)Constructors in org.apache.sysds.runtime.io with parameters of type TensorBlock Constructor Description WriteFileTask(org.apache.hadoop.fs.Path path, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.fs.FileSystem fs, TensorBlock src, long rl, long ru, int blen) -
Uses of TensorBlock in org.apache.sysds.runtime.util
Methods in org.apache.sysds.runtime.util that return TensorBlock Modifier and Type Method Description static TensorBlockDataConverter. convertToTensorBlock(MatrixBlock mb, Types.ValueType vt, boolean toBasicTensor)static TensorBlockDataConverter. readTensorFromHDFS(String dir, Types.FileFormat fmt, long[] dims, int blen, Types.ValueType[] schema)Methods in org.apache.sysds.runtime.util with parameters of type TensorBlock Modifier and Type Method Description static StringDataConverter. toString(TensorBlock tb)static StringDataConverter. toString(TensorBlock tb, boolean sparse, String separator, String lineseparator, String leftBorder, String rightBorder, int rowsToPrint, int colsToPrint, int decimal)Returns a string representation of a tensorstatic voidDataConverter. writeTensorToHDFS(TensorBlock tensor, String dir, Types.FileFormat fmt, DataCharacteristics dc)
-