com.asakusafw.runtime.util.cache

Class ConcurrentBatchFileCacheRepository

java.lang.Object

com.asakusafw.runtime.util.cache.ConcurrentBatchFileCacheRepository

All Implemented Interfaces:

BatchFileCacheRepository

public class ConcurrentBatchFileCacheRepository
extends Object
implements BatchFileCacheRepository

Executes FileCacheRepository.resolve(Path) concurrently.

Since:

0.7.0

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	ConcurrentBatchFileCacheRepository.ExceptionHandler Exception handler.

Constructor Summary

Constructors

Constructor and Description
ConcurrentBatchFileCacheRepository(FileCacheRepository repository, ExecutorService executor) Creates a new instance with default exception handler.
ConcurrentBatchFileCacheRepository(FileCacheRepository repository, ExecutorService executor, ConcurrentBatchFileCacheRepository.ExceptionHandler exceptionHandler) Creates a new instance.

Method Summary

Modifier and Type	Method and Description
Map<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path>	resolve(List<? extends org.apache.hadoop.fs.Path> files) Put files into remote cache and returns a mapping original files into cached path.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ConcurrentBatchFileCacheRepository

public ConcurrentBatchFileCacheRepository(FileCacheRepository repository,
                                          ExecutorService executor)

Creates a new instance with default exception handler.

Parameters:

repository - the batch processing target FileCacheRepository

executor - the executor for process each file

ConcurrentBatchFileCacheRepository

public ConcurrentBatchFileCacheRepository(FileCacheRepository repository,
                                          ExecutorService executor,
                                          ConcurrentBatchFileCacheRepository.ExceptionHandler exceptionHandler)

Creates a new instance.

Parameters:

repository - the batch processing target FileCacheRepository

executor - the executor for process each file

exceptionHandler - exception handler for processing each file, or null to just report (as 'WARN' level) for each exception

Method Detail

resolve

public Map<org.apache.hadoop.fs.Path,org.apache.hadoop.fs.Path> resolve(List<? extends org.apache.hadoop.fs.Path> files)
                                                                 throws IOException,
                                                                        InterruptedException

Description copied from interface: BatchFileCacheRepository

Put files into remote cache and returns a mapping original files into cached path.

Specified by:

resolve in interface BatchFileCacheRepository

Parameters:

files - the target file paths

Returns:

the resolved mapping original files into cached path; the cached path may be null if this cannot prepare cache for the corresponding original file

Throws:

IOException - if failed to put the file into cache

InterruptedException - if interrupted while resolving cache file