com.asakusafw.runtime.stage.directio

Class AbstractNoReduceDirectOutputMapper<T>

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<KEYIN,VALUEIN,KEYOUT,VALUEOUT>

com.asakusafw.runtime.flow.MapperWithRuntimeResource<Object,T,Object,Object>

com.asakusafw.runtime.stage.directio.AbstractNoReduceDirectOutputMapper<T>

Type Parameters:

T - target data type

public abstract class AbstractNoReduceDirectOutputMapper<T>
extends MapperWithRuntimeResource<Object,T,Object,Object>

Mapper which directly creates file for direct output.

Since:

0.4.0

Version:

0.8.1

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

Constructor Summary

Constructors

Constructor and Description
AbstractNoReduceDirectOutputMapper(Class<? extends T> dataType, String rawBasePath, String rawResourcePath, Class<? extends DataFormat<? super T>> dataFormatClass) Creates a new instance.
AbstractNoReduceDirectOutputMapper(Class<? extends T> dataType, String outputId, String rawBasePath, String rawResourcePath, Class<? extends DataFormat<? super T>> dataFormatClass) Creates a new instance.

Method Summary

Modifier and Type	Method and Description
protected void	runInternal(org.apache.hadoop.mapreduce.Mapper.Context context) Invokes Mapper#run(Context) internally.

Methods inherited from class com.asakusafw.runtime.flow.MapperWithRuntimeResource

run

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

cleanup, map, setup

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AbstractNoReduceDirectOutputMapper

public AbstractNoReduceDirectOutputMapper(Class<? extends T> dataType,
                                          String rawBasePath,
                                          String rawResourcePath,
                                          Class<? extends DataFormat<? super T>> dataFormatClass)

Creates a new instance.

Parameters:

dataType - target data type

rawBasePath - target base path

rawResourcePath - target resource path

dataFormatClass - output data format

Throws:

IllegalArgumentException - if some parameters were null

AbstractNoReduceDirectOutputMapper

public AbstractNoReduceDirectOutputMapper(Class<? extends T> dataType,
                                          String outputId,
                                          String rawBasePath,
                                          String rawResourcePath,
                                          Class<? extends DataFormat<? super T>> dataFormatClass)

Creates a new instance.

Parameters:

dataType - target data type

outputId - the output ID (nullable)

rawBasePath - target base path

rawResourcePath - target resource path

dataFormatClass - output data format

Throws:

IllegalArgumentException - if some parameters were null

Since:

0.8.1

Method Detail

runInternal

protected void runInternal(org.apache.hadoop.mapreduce.Mapper.Context context)
                    throws IOException,
                           InterruptedException

Description copied from class: MapperWithRuntimeResource

Invokes Mapper#run(Context) internally. Clients can override this method and implement customized run method.

Overrides:

runInternal in class MapperWithRuntimeResource<Object,T,Object,Object>

Parameters:

context - current context

Throws:

IOException - if task is failed by I/O error

InterruptedException - if task execution is interrupted