Package org.apache.sysds.runtime.util
Class InputStreamInputFormat
- java.lang.Object
-
- org.apache.sysds.runtime.util.InputStreamInputFormat
-
- All Implemented Interfaces:
org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>
public class InputStreamInputFormat extends Object implements org.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>
Custom input format and record reader to redirect common implementation of csv read over record readers (which are required for the parallel readers) to an input stream.
-
-
Constructor Summary
Constructors Constructor Description InputStreamInputFormat(InputStream is)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter)org.apache.hadoop.mapred.InputSplit[]getSplits(org.apache.hadoop.mapred.JobConf job, int numSplits)
-
-
-
Constructor Detail
-
InputStreamInputFormat
public InputStreamInputFormat(InputStream is)
-
-
Method Detail
-
getSplits
public org.apache.hadoop.mapred.InputSplit[] getSplits(org.apache.hadoop.mapred.JobConf job, int numSplits) throws IOException- Specified by:
getSplitsin interfaceorg.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>- Throws:
IOException
-
getRecordReader
public org.apache.hadoop.mapred.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter) throws IOException- Specified by:
getRecordReaderin interfaceorg.apache.hadoop.mapred.InputFormat<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>- Throws:
IOException
-
-