com.asakusafw.runtime.stage.input

Class TemporaryInputFormat<T>

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.NullWritable,T>

com.asakusafw.runtime.stage.input.TemporaryInputFormat<T>

Type Parameters:

T - data type

public final class TemporaryInputFormat<T>
extends org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.NullWritable,T>

A temporary input format.

Since:

0.2.5

Version:

0.7.0

Constructor Summary

Constructors

Constructor and Description
TemporaryInputFormat()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.NullWritable,T>	createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)
static List<org.apache.hadoop.fs.Path>	getInputPaths(org.apache.hadoop.mapreduce.JobContext context) Returns input paths.
List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext context)
List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext context, List<StageInput> inputList) Computes and returns splits for the specified inputs.
static void	setInputPaths(org.apache.hadoop.mapreduce.Job job, List<org.apache.hadoop.fs.Path> paths) Configures input paths.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TemporaryInputFormat

public TemporaryInputFormat()

Method Detail

getSplits

public List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context)
                                                       throws IOException,
                                                              InterruptedException

Specified by:

getSplits in class org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.NullWritable,T>

Throws:

IOException

InterruptedException

getSplits

public List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context,
                                                              List<StageInput> inputList)
                                                       throws IOException,
                                                              InterruptedException

Computes and returns splits for the specified inputs.

Parameters:

context - current job context

inputList - target input list

Returns:

the computed splits

Throws:

IOException - if failed to compute splits

InterruptedException - if interrupted while computing inputs

IllegalArgumentException - if some parameters were null

setInputPaths

public static void setInputPaths(org.apache.hadoop.mapreduce.Job job,
                                 List<org.apache.hadoop.fs.Path> paths)
                          throws IOException

Configures input paths.

Parameters:

job - current job

paths - source paths

Throws:

IOException - if failed to resolve paths

IllegalArgumentException - if some parameters were null

getInputPaths

public static List<org.apache.hadoop.fs.Path> getInputPaths(org.apache.hadoop.mapreduce.JobContext context)
                                                     throws IOException

Returns input paths.

Parameters:

context - current job

Returns:

the input paths, or an empty list if they are not set

Throws:

IOException - if failed to resolve paths

IllegalArgumentException - if some parameters were null

Since:

0.7.0

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.NullWritable,T> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                        org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                                 throws IOException,
                                                                                                        InterruptedException

Specified by:

createRecordReader in class org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.NullWritable,T>

Throws:

IOException

InterruptedException