com.asakusafw.runtime.stage.input

Class StageInputSplit

java.lang.Object

org.apache.hadoop.mapreduce.InputSplit

com.asakusafw.runtime.stage.input.StageInputSplit

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.io.Writable

public class StageInputSplit
extends org.apache.hadoop.mapreduce.InputSplit
implements org.apache.hadoop.io.Writable, org.apache.hadoop.conf.Configurable

An implementation of Hadoop InputSplit for handling multiple Map operations.

Since:

0.1.0

Version:

0.2.6

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	StageInputSplit.Source Represents a pair of InputSplit and its InputFormat class.

Constructor Summary

Constructors

Constructor and Description
StageInputSplit() Creates a new instance for the serialization framework.
StageInputSplit(Class<? extends org.apache.hadoop.mapreduce.Mapper<?,?,?,?>> mapperClass, List<StageInputSplit.Source> sources) Creates a new instance.
StageInputSplit(Class<? extends org.apache.hadoop.mapreduce.Mapper<?,?,?,?>> mapperClass, List<StageInputSplit.Source> sources, String[] locations) Creates a new instance.
StageInputSplit(org.apache.hadoop.mapreduce.InputSplit original, Class<? extends org.apache.hadoop.mapreduce.InputFormat<?,?>> formatClass, Class<? extends org.apache.hadoop.mapreduce.Mapper<?,?,?,?>> mapperClass) Deprecated. Use StageInputSplit(Class, List) instead

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.conf.Configuration	getConf()
Class<? extends org.apache.hadoop.mapreduce.InputFormat<?,?>>	getFormatClass() Deprecated. Use getSources() instead.
long	getLength()
String[]	getLocations()
Class<? extends org.apache.hadoop.mapreduce.Mapper<?,?,?,?>>	getMapperClass() Returns the mapper class for handling this.
org.apache.hadoop.mapreduce.InputSplit	getOriginal() Deprecated. Use getSources() instead.
List<StageInputSplit.Source>	getSources() Returns the sources.
void	readFields(DataInput in)
void	setConf(org.apache.hadoop.conf.Configuration conf)
void	write(DataOutput out)

Methods inherited from class org.apache.hadoop.mapreduce.InputSplit

getLocationInfo

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StageInputSplit

public StageInputSplit()

Creates a new instance for the serialization framework.

StageInputSplit

@Deprecated
public StageInputSplit(org.apache.hadoop.mapreduce.InputSplit original,
                                   Class<? extends org.apache.hadoop.mapreduce.InputFormat<?,?>> formatClass,
                                   Class<? extends org.apache.hadoop.mapreduce.Mapper<?,?,?,?>> mapperClass)

Deprecated. Use StageInputSplit(Class, List) instead

Creates a new instance.

Parameters:

original - the actual InputSplit

formatClass - the InputFormat for handling this split

mapperClass - the Mapper for handling this split

Throws:

IllegalArgumentException - if some parameters are null

StageInputSplit

public StageInputSplit(Class<? extends org.apache.hadoop.mapreduce.Mapper<?,?,?,?>> mapperClass,
                       List<StageInputSplit.Source> sources)

Creates a new instance.

Parameters:

mapperClass - target mapper class

sources - input format and splits

Throws:

IllegalArgumentException - if some parameters were null

Since:

0.2.6

StageInputSplit

public StageInputSplit(Class<? extends org.apache.hadoop.mapreduce.Mapper<?,?,?,?>> mapperClass,
                       List<StageInputSplit.Source> sources,
                       String[] locations)

Creates a new instance.

Parameters:

mapperClass - target mapper class

sources - input format and splits

locations - hint for locations (nullable)

Throws:

IllegalArgumentException - if some parameters were null

Since:

0.2.6

Method Detail

getLength

public long getLength()
               throws IOException,
                      InterruptedException

Specified by:

getLength in class org.apache.hadoop.mapreduce.InputSplit

Throws:

IOException

InterruptedException

getLocations

public String[] getLocations()
                      throws IOException,
                             InterruptedException

Specified by:

getLocations in class org.apache.hadoop.mapreduce.InputSplit

Throws:

IOException

InterruptedException

getOriginal

@Deprecated
public org.apache.hadoop.mapreduce.InputSplit getOriginal()

Deprecated. Use getSources() instead.

Returns the actual input split.

Returns:

the actual input split

getFormatClass

@Deprecated
public Class<? extends org.apache.hadoop.mapreduce.InputFormat<?,?>> getFormatClass()

Deprecated. Use getSources() instead.

Returns the input format for handling this.

Returns:

the input format for handling this

getSources

public List<StageInputSplit.Source> getSources()

Returns the sources.

Returns:

the sources

Since:

0.2.6

getMapperClass

public Class<? extends org.apache.hadoop.mapreduce.Mapper<?,?,?,?>> getMapperClass()

Returns the mapper class for handling this.

Returns:

the mapper class for handling this

write

public void write(DataOutput out)
           throws IOException

Specified by:

write in interface org.apache.hadoop.io.Writable

Throws:

IOException

readFields

public void readFields(DataInput in)
                throws IOException

Specified by:

readFields in interface org.apache.hadoop.io.Writable

Throws:

IOException

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable