Class EncoderMVImpute
- java.lang.Object
-
- org.apache.sysds.runtime.transform.encode.LegacyEncoder
-
- org.apache.sysds.runtime.transform.encode.EncoderMVImpute
-
- All Implemented Interfaces:
Externalizable,Serializable
public class EncoderMVImpute extends LegacyEncoder
- See Also:
- Serialized Form
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static classEncoderMVImpute.MVMethod
-
Constructor Summary
Constructors Constructor Description EncoderMVImpute()EncoderMVImpute(int[] colList, EncoderMVImpute.MVMethod[] mvMethodList, String[] replacementList, KahanObject[] meanList, long[] countList, List<Integer> rcList, int clen)EncoderMVImpute(org.apache.wink.json4j.JSONObject parsedSpec, String[] colnames, int clen, int minCol, int maxCol)
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description MatrixBlockapply(FrameBlock in, MatrixBlock out)Encode input data blockwise according to existing transform meta data (transform apply).voidbuild(FrameBlock in)Build the transform meta data for the given block input.MatrixBlockencode(FrameBlock in, MatrixBlock out)Block encode: build and apply (transform encode).HashMap<String,Long>getHistogram(int colID)Exposes the internal histogram after build.KahanObject[]getMeans()FrameBlockgetMetaData(FrameBlock out)Construct a frame block out of the transform meta data.EncoderMVImpute.MVMethodgetMethod(int colID)longgetNonMVCount(int colID)StringgetReplacement(int colID)String[]getReplacements()voidinitMetaData(FrameBlock meta)Sets up the required meta data for a subsequent call to apply.voidinitRecodeIDList(List<Integer> rcList)voidmergeAt(LegacyEncoder other, int row, int col)Merges another encoder, of a compatible type, in after a certain position.voidreadExternal(ObjectInput in)Redirects the default java serialization via externalizable to our default hadoop writable serialization for efficient broadcast/rdd deserialization.LegacyEncodersubRangeEncoder(IndexRange ixRange)Returns a new Encoder that only handles a sub range of columns.voidwriteExternal(ObjectOutput out)Redirects the default java serialization via externalizable to our default hadoop writable serialization for efficient broadcast/rdd serialization.-
Methods inherited from class org.apache.sysds.runtime.transform.encode.LegacyEncoder
buildPartial, getColList, getColMapping, initColList, initColList, isApplicable, isApplicable, prepareBuildPartial, setColList, shiftCols, updateIndexRanges
-
-
-
-
Constructor Detail
-
EncoderMVImpute
public EncoderMVImpute(org.apache.wink.json4j.JSONObject parsedSpec, String[] colnames, int clen, int minCol, int maxCol) throws org.apache.wink.json4j.JSONException- Throws:
org.apache.wink.json4j.JSONException
-
EncoderMVImpute
public EncoderMVImpute()
-
EncoderMVImpute
public EncoderMVImpute(int[] colList, EncoderMVImpute.MVMethod[] mvMethodList, String[] replacementList, KahanObject[] meanList, long[] countList, List<Integer> rcList, int clen)
-
-
Method Detail
-
getReplacements
public String[] getReplacements()
-
getMeans
public KahanObject[] getMeans()
-
getMethod
public EncoderMVImpute.MVMethod getMethod(int colID)
-
getNonMVCount
public long getNonMVCount(int colID)
-
getReplacement
public String getReplacement(int colID)
-
encode
public MatrixBlock encode(FrameBlock in, MatrixBlock out)
Description copied from class:LegacyEncoderBlock encode: build and apply (transform encode).- Specified by:
encodein classLegacyEncoder- Parameters:
in- input frame blockout- output matrix block- Returns:
- output matrix block
-
build
public void build(FrameBlock in)
Description copied from class:LegacyEncoderBuild the transform meta data for the given block input. This call modifies and keeps meta data as encoder state.- Specified by:
buildin classLegacyEncoder- Parameters:
in- input frame block
-
apply
public MatrixBlock apply(FrameBlock in, MatrixBlock out)
Description copied from class:LegacyEncoderEncode input data blockwise according to existing transform meta data (transform apply).- Specified by:
applyin classLegacyEncoder- Parameters:
in- input frame blockout- output matrix block- Returns:
- output matrix block
-
subRangeEncoder
public LegacyEncoder subRangeEncoder(IndexRange ixRange)
Description copied from class:LegacyEncoderReturns a new Encoder that only handles a sub range of columns.- Overrides:
subRangeEncoderin classLegacyEncoder- Parameters:
ixRange- the range (1-based, begin inclusive, end exclusive)- Returns:
- an encoder of the same type, just for the sub-range
-
mergeAt
public void mergeAt(LegacyEncoder other, int row, int col)
Description copied from class:LegacyEncoderMerges another encoder, of a compatible type, in after a certain position. Resizes as necessary.Encodersare compatible with themselves andEncoderCompositeis compatible with every otherEncoder.- Overrides:
mergeAtin classLegacyEncoder- Parameters:
other- the encoder that should be merged inrow- the row where it should be placed (1-based)col- the col where it should be placed (1-based)
-
getMetaData
public FrameBlock getMetaData(FrameBlock out)
Description copied from class:LegacyEncoderConstruct a frame block out of the transform meta data.- Specified by:
getMetaDatain classLegacyEncoder- Parameters:
out- output frame block- Returns:
- output frame block?
-
initMetaData
public void initMetaData(FrameBlock meta)
Description copied from class:LegacyEncoderSets up the required meta data for a subsequent call to apply.- Specified by:
initMetaDatain classLegacyEncoder- Parameters:
meta- frame block
-
getHistogram
public HashMap<String,Long> getHistogram(int colID)
Exposes the internal histogram after build.- Parameters:
colID- column ID- Returns:
- histogram (map of string keys and long values)
-
writeExternal
public void writeExternal(ObjectOutput out) throws IOException
Description copied from class:LegacyEncoderRedirects the default java serialization via externalizable to our default hadoop writable serialization for efficient broadcast/rdd serialization.- Specified by:
writeExternalin interfaceExternalizable- Overrides:
writeExternalin classLegacyEncoder- Parameters:
out- object output- Throws:
IOException- if IOException occurs
-
readExternal
public void readExternal(ObjectInput in) throws IOException
Description copied from class:LegacyEncoderRedirects the default java serialization via externalizable to our default hadoop writable serialization for efficient broadcast/rdd deserialization.- Specified by:
readExternalin interfaceExternalizable- Overrides:
readExternalin classLegacyEncoder- Parameters:
in- object input- Throws:
IOException- if IOException occur
-
-