T
- data typepublic final class TemporaryInputFormat<T>
extends org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.NullWritable,T>
Constructor and Description |
---|
TemporaryInputFormat() |
Modifier and Type | Method and Description |
---|---|
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.NullWritable,T> |
createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
org.apache.hadoop.mapreduce.TaskAttemptContext context) |
static List<org.apache.hadoop.fs.Path> |
getInputPaths(org.apache.hadoop.mapreduce.JobContext context)
Returns input paths.
|
List<org.apache.hadoop.mapreduce.InputSplit> |
getSplits(org.apache.hadoop.mapreduce.JobContext context) |
List<org.apache.hadoop.mapreduce.InputSplit> |
getSplits(org.apache.hadoop.mapreduce.JobContext context,
List<StageInput> inputList)
Computes and returns splits for the specified inputs.
|
static void |
setInputPaths(org.apache.hadoop.mapreduce.Job job,
List<org.apache.hadoop.fs.Path> paths)
Configures input paths.
|
public List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context) throws IOException, InterruptedException
getSplits
in class org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.NullWritable,T>
IOException
InterruptedException
public List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext context, List<StageInput> inputList) throws IOException, InterruptedException
context
- current job contextinputList
- target input listIOException
- if failed to compute splitsInterruptedException
- if interrupted while computing inputsIllegalArgumentException
- if some parameters were null
public static void setInputPaths(org.apache.hadoop.mapreduce.Job job, List<org.apache.hadoop.fs.Path> paths) throws IOException
job
- current jobpaths
- source pathsIOException
- if failed to resolve pathsIllegalArgumentException
- if some parameters were null
public static List<org.apache.hadoop.fs.Path> getInputPaths(org.apache.hadoop.mapreduce.JobContext context) throws IOException
context
- current jobIOException
- if failed to resolve pathsIllegalArgumentException
- if some parameters were null
public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.NullWritable,T> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context) throws IOException, InterruptedException
createRecordReader
in class org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.NullWritable,T>
IOException
InterruptedException
Copyright © 2011–2018 Asakusa Framework Team. All rights reserved.