@InterfaceAudience.Public @InterfaceStability.Stable public class LazyOutputFormat<K,V> extends FilterOutputFormat<K,V>
baseOut| Constructor and Description |
|---|
LazyOutputFormat() |
| Modifier and Type | Method and Description |
|---|---|
void |
checkOutputSpecs(FileSystem ignored,
JobConf job)
Check for validity of the output-specification for the job.
|
RecordWriter<K,V> |
getRecordWriter(FileSystem ignored,
JobConf job,
String name,
Progressable progress)
Get the
RecordWriter for the given job. |
static void |
setOutputFormatClass(JobConf job,
Class<? extends OutputFormat> theClass)
Set the underlying output format for LazyOutputFormat.
|
public static void setOutputFormatClass(JobConf job, Class<? extends OutputFormat> theClass)
job - the JobConf to modifytheClass - the underlying classpublic RecordWriter<K,V> getRecordWriter(FileSystem ignored, JobConf job, String name, Progressable progress) throws IOException
OutputFormatRecordWriter for the given job.getRecordWriter in interface OutputFormat<K,V>getRecordWriter in class FilterOutputFormat<K,V>job - configuration for the job whose output is being written.name - the unique name for this part of the output.progress - mechanism for reporting progress while writing to file.RecordWriter to write the output for the job.IOExceptionpublic void checkOutputSpecs(FileSystem ignored, JobConf job) throws IOException
OutputFormatThis is to validate the output specification for the job when it is a job is submitted. Typically checks that it does not already exist, throwing an exception when it already exists, so that output is not overwritten.
Implementations which write to filesystems which support delegation tokens usually collect the tokens for the destination path(s) and attach them to the job configuration.checkOutputSpecs in interface OutputFormat<K,V>checkOutputSpecs in class FilterOutputFormat<K,V>job - job configuration.IOException - when output should not be attemptedCopyright © 2023 Apache Software Foundation. All rights reserved.