com.asakusafw.yaess.jsch

Class SshHadoopScriptHandler

java.lang.Object

com.asakusafw.yaess.core.ExecutionScriptHandlerBase

com.asakusafw.yaess.basic.ProcessHadoopScriptHandler

com.asakusafw.yaess.jsch.SshHadoopScriptHandler

All Implemented Interfaces:

ExecutionScriptHandler<HadoopScript>, HadoopScriptHandler, Service

public class SshHadoopScriptHandler
extends ProcessHadoopScriptHandler

Basic implementation of HadoopScriptHandler using local processes. This handler just launches a command with following arguments in its tail.

1. class name
2. batch-id
3. flow-id
4. execution-id
5. batch-arguments
6. hadoop properties (with "-D")

Additionally, the handler lanuches a command if hadoop.cleanup is true.

1. ProcessHadoopScriptHandler.CLEANUP_STAGE_CLASS
2. batch-id
3. flow-id
4. execution-id
5. batch-arguments
6. hadoop properties (with "-D")

Profile format

# <position> = 0, 1, 2, ...
# <prefix command token> can contain "@[position],"
# this will be replaced as original command tokens (0-origin position)
hadoop = <this class name>
hadoop.command.<position> = $<prefix command token>
hadoop.ssh.user=asakusa
hadoop.ssh.host=localhost
hadoop.ssh.port=22
hadoop.ssh.privateKey=${HOME}/.ssh/id_dsa
hadoop.ssh.passPhrase=
hadoop.env.ASAKUSA_HOME = ${ASAKUSA_HOME}
hadoop.cleanup = whether enables cleanup
hadoop.env.<key> = $<extra environment variables>
hadoop.prop.<key> = $<extra Hadoop properties>

Since:

0.2.3

Field Summary

Fields inherited from class com.asakusafw.yaess.basic.ProcessHadoopScriptHandler

CLEANUP_STAGE_CLASS, KEY_CLEANUP, KEY_WORKING_DIRECTORY, PATH_EXECUTE, VAR_BATCH_ID, VAR_EXECUTION_ID, VAR_FLOW_ID

Fields inherited from interface com.asakusafw.yaess.core.ExecutionScriptHandler

DEFAULT_RESOURCE_ID, ENV_EXTENSION_PREFIX, KEY_ENV_PREFIX, KEY_PROP_PREFIX, KEY_RESOURCE

Constructor Summary

Constructors

Constructor and Description
SshHadoopScriptHandler()

Method Summary

Modifier and Type	Method and Description
protected void	configureExtension(ServiceProfile<?> profile) Configures this handler internally (extension point).
protected ProcessExecutor	getCommandExecutor() Returns command executor for this handler (extension point).

Methods inherited from class com.asakusafw.yaess.basic.ProcessHadoopScriptHandler

cleanUp, doConfigure, execute, getPathSegmentSeparator

Methods inherited from class com.asakusafw.yaess.core.ExecutionScriptHandlerBase

configure, getEnvironmentVariables, getHandlerId, getProperties, getResourceId, setUp, voidCleanUp, voidSetUp

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.asakusafw.yaess.core.ExecutionScriptHandler

getEnvironmentVariables, getHandlerId, getProperties, getResourceId, setUp

Methods inherited from interface com.asakusafw.yaess.core.Service

configure

Constructor Detail

SshHadoopScriptHandler

public SshHadoopScriptHandler()

Method Detail

configureExtension

protected void configureExtension(ServiceProfile<?> profile)
                           throws InterruptedException,
                                  IOException

Description copied from class: ProcessHadoopScriptHandler

Configures this handler internally (extension point).

Specified by:

configureExtension in class ProcessHadoopScriptHandler

Parameters:

profile - the profile of this service

Throws:

InterruptedException - if interrupted in configuration

IOException - if failed to configure this service

getCommandExecutor

protected ProcessExecutor getCommandExecutor()

Description copied from class: ProcessHadoopScriptHandler

Returns command executor for this handler (extension point).

Specified by:

getCommandExecutor in class ProcessHadoopScriptHandler

Returns:

command executor