com.asakusafw.runtime.stage.output

Class BridgeOutputFormat

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<Object,Object>

com.asakusafw.runtime.stage.output.BridgeOutputFormat

public final class BridgeOutputFormat
extends org.apache.hadoop.mapreduce.OutputFormat<Object,Object>

A bridge implementation for Hadoop OutputFormat.

Since:

0.2.5

Version:

0.9.0

Constructor Summary

Constructors

Constructor and Description
BridgeOutputFormat()

Method Summary

Modifier and Type	Method and Description
void	checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
static OutputTransactionContext	createContext(org.apache.hadoop.mapreduce.JobContext context, String datasourceId) Creates output context from Hadoop context.
static OutputAttemptContext	createContext(org.apache.hadoop.mapreduce.TaskAttemptContext context, String datasourceId) Creates output context from Hadoop context.
org.apache.hadoop.mapreduce.OutputCommitter	getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
org.apache.hadoop.mapreduce.RecordWriter<Object,Object>	getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
static boolean	hasOutput(org.apache.hadoop.mapreduce.JobContext context) Returns whether this stage has an output corresponding this format.
static void	set(org.apache.hadoop.mapreduce.JobContext context, List<StageOutput> outputList) Sets current output information into the current context.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BridgeOutputFormat

public BridgeOutputFormat()

Method Detail

hasOutput

public static boolean hasOutput(org.apache.hadoop.mapreduce.JobContext context)

Returns whether this stage has an output corresponding this format.

Parameters:

context - current context

Returns:

true if such output exists, otherwise false

Throws:

IllegalArgumentException - if some parameters were null

set

public static void set(org.apache.hadoop.mapreduce.JobContext context,
                       List<StageOutput> outputList)

Sets current output information into the current context.

Parameters:

context - current context

outputList - output information to be set

Throws:

IllegalArgumentException - if some parameters were null

createContext

public static OutputTransactionContext createContext(org.apache.hadoop.mapreduce.JobContext context,
                                                     String datasourceId)

Creates output context from Hadoop context.

Parameters:

context - current context in Hadoop

datasourceId - datasource ID

Returns:

the created context

Throws:

IllegalArgumentException - if some parameters were null

createContext

public static OutputAttemptContext createContext(org.apache.hadoop.mapreduce.TaskAttemptContext context,
                                                 String datasourceId)

Creates output context from Hadoop context.

Parameters:

context - current context in Hadoop

datasourceId - datasource ID

Returns:

the created context

Throws:

IllegalArgumentException - if some parameters were null

checkOutputSpecs

public void checkOutputSpecs(org.apache.hadoop.mapreduce.JobContext context)
                      throws IOException,
                             InterruptedException

Specified by:

checkOutputSpecs in class org.apache.hadoop.mapreduce.OutputFormat<Object,Object>

Throws:

IOException

InterruptedException

getRecordWriter

public org.apache.hadoop.mapreduce.RecordWriter<Object,Object> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                        throws IOException,
                                                                               InterruptedException

Specified by:

getRecordWriter in class org.apache.hadoop.mapreduce.OutputFormat<Object,Object>

Throws:

IOException

InterruptedException

getOutputCommitter

public org.apache.hadoop.mapreduce.OutputCommitter getOutputCommitter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                               throws IOException,
                                                                      InterruptedException

Specified by:

getOutputCommitter in class org.apache.hadoop.mapreduce.OutputFormat<Object,Object>

Throws:

IOException

InterruptedException