com.asakusafw.runtime.stage.output

Class TemporaryOutputFormat<T>

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<org.apache.hadoop.io.NullWritable,T>

com.asakusafw.runtime.stage.output.TemporaryOutputFormat<T>

Type Parameters:

T - target type

public final class TemporaryOutputFormat<T>
extends org.apache.hadoop.mapreduce.OutputFormat<org.apache.hadoop.io.NullWritable,T>

A temporary output format.

Since:

0.2.5

Version:

0.8.0

Field Summary

Fields

Modifier and Type	Field and Description
static String	DEFAULT_FILE_NAME The default output name prefix.
static String	KEY_FILE_NAME The Hadoop property key of output name prefix.

Constructor Summary

Constructors

Constructor and Description
TemporaryOutputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
<V> org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.NullWritable,V>	createRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context, String name, Class<V> dataType) Creates a new RecordWriter to output temporary data.
org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter	getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
static org.apache.hadoop.fs.Path	getOutputPath(org.apache.hadoop.mapreduce.JobContext context) Returns the output path.
org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.NullWritable,T>	getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
static void	setOutputPath(org.apache.hadoop.mapreduce.JobContext context, org.apache.hadoop.fs.Path path) Configures output path.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

KEY_FILE_NAME

public static final String KEY_FILE_NAME

The Hadoop property key of output name prefix.

Since:

0.8.0

See Also:

Constant Field Values

DEFAULT_FILE_NAME

public static final String DEFAULT_FILE_NAME

The default output name prefix.

See Also:

Constant Field Values

Constructor Detail

TemporaryOutputFormat

public TemporaryOutputFormat()

Method Detail

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
                      throws IOException,
                             InterruptedException

Specified by:

checkOutputSpecs in class org.apache.hadoop.mapreduce.OutputFormat<org.apache.hadoop.io.NullWritable,T>

Throws:

IOException

InterruptedException

getRecordWriter

public org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.NullWritable,T> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                              throws IOException,
                                                                                                     InterruptedException

Specified by:

getRecordWriter in class org.apache.hadoop.mapreduce.OutputFormat<org.apache.hadoop.io.NullWritable,T>

Throws:

IOException

InterruptedException

createRecordWriter

public <V> org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.NullWritable,V> createRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context,
                                                                                                            String name,
                                                                                                            Class<V> dataType)
                                                                                                     throws IOException,
                                                                                                            InterruptedException

Creates a new RecordWriter to output temporary data.

Type Parameters:

V - value type

Parameters:

context - current context

name - output name

dataType - value type

Returns:

the created writer

Throws:

IOException - if failed to create a new RecordWriter

InterruptedException - if interrupted

IllegalArgumentException - if some parameters were null

getOutputCommitter

public org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                              throws IOException

Specified by:

getOutputCommitter in class org.apache.hadoop.mapreduce.OutputFormat<org.apache.hadoop.io.NullWritable,T>

Throws:

IOException

getOutputPath

public static org.apache.hadoop.fs.Path getOutputPath(org.apache.hadoop.mapreduce.JobContext context)

Returns the output path.

Parameters:

context - current context

Returns:

the path

Throws:

IllegalArgumentException - if some parameters were null

See Also:

setOutputPath(JobContext, Path)

setOutputPath

public static void setOutputPath(org.apache.hadoop.mapreduce.JobContext context,
                                 org.apache.hadoop.fs.Path path)

Configures output path.

Parameters:

context - current context

path - target output path

Throws:

IllegalArgumentException - if some parameters were null