com.asakusafw.windgate.hadoopfs

Class HadoopFsMirror

java.lang.Object

com.asakusafw.windgate.core.resource.ResourceMirror

com.asakusafw.windgate.hadoopfs.HadoopFsMirror

All Implemented Interfaces:

Closeable, AutoCloseable

@SimulationSupport
public class HadoopFsMirror
extends ResourceMirror

An abstract implementation of ResourceMirror directly using Hadoop File System.

Since:

0.2.2

Version:

0.4.0

See Also:

FileProcess

Constructor Summary

Constructors

Constructor and Description
HadoopFsMirror(org.apache.hadoop.conf.Configuration configuration, HadoopFsProfile profile, ParameterList arguments) Creates a new instance.

Method Summary

Modifier and Type	Method and Description
void	close()
<T> DrainDriver<T>	createDrain(ProcessScript<T> script) Creates a new drain driver for this resource.
<T> SourceDriver<T>	createSource(ProcessScript<T> script) Creates a new source driver for this resource.
String	getName() Returns the name of this resource.
void	prepare(GateScript script) Prepares this resource for the specified execution.

Methods inherited from class com.asakusafw.windgate.core.resource.ResourceMirror

isTransactional, onSessionCompleting, onSessionCreated

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopFsMirror

public HadoopFsMirror(org.apache.hadoop.conf.Configuration configuration,
                      HadoopFsProfile profile,
                      ParameterList arguments)

Creates a new instance.

Parameters:

configuration - the hadoop configuration

profile - the profile

arguments - the arguments

Throws:

IllegalArgumentException - if any parameter is null

Method Detail

getName

public String getName()

Description copied from class: ResourceMirror

Returns the name of this resource.

Specified by:

getName in class ResourceMirror

Returns:

the name of this resource

prepare

public void prepare(GateScript script)
             throws IOException

Description copied from class: ResourceMirror

Prepares this resource for the specified execution. This method will be invoked only once for each instance.

Specified by:

prepare in class ResourceMirror

Parameters:

script - target script

Throws:

IOException - if failed to prepare this resource

createSource

public <T> SourceDriver<T> createSource(ProcessScript<T> script)
                                 throws IOException

Description copied from class: ResourceMirror

Creates a new source driver for this resource. This method will be invoked only after ResourceMirror.prepare(GateScript) was completed.

Specified by:

createSource in class ResourceMirror

Type Parameters:

T - target data model type

Parameters:

script - target process

Returns:

the created driver

Throws:

IOException - if failed to open this resource

createDrain

public <T> DrainDriver<T> createDrain(ProcessScript<T> script)
                               throws IOException

Description copied from class: ResourceMirror

Creates a new drain driver for this resource. This method will be invoked only after ResourceMirror.prepare(GateScript) was completed.

Specified by:

createDrain in class ResourceMirror

Type Parameters:

T - target data model type

Parameters:

script - target process

Returns:

the created driver

Throws:

IOException - if failed to open this resource

close

public void close()
           throws IOException

Throws:

IOException