Package | Description |
---|---|
com.asakusafw.directio.hive.orc |
ORCFile format bridge between Asakusa and Hive.
|
com.asakusafw.directio.hive.orc.v1 |
ORCFile format bridge for Hive v1.
|
com.asakusafw.directio.hive.orc.v2 |
ORCFile format bridge for Hive v2.
|
com.asakusafw.directio.hive.parquet |
Parquet file format bridge between Asakusa and Hive.
|
com.asakusafw.directio.hive.parquet.v1 |
Parquet format bridge for Hive v1.
|
com.asakusafw.directio.hive.parquet.v2 |
Parquet format bridge for Hive v2.
|
com.asakusafw.runtime.directio |
Direct I/O access from Asakusa Framework.
|
com.asakusafw.runtime.directio.hadoop |
Direct I/O access for Hadoop Environment.
|
com.asakusafw.runtime.directio.keepalive |
Keep-alive utilities for Direct I/O access.
|
com.asakusafw.runtime.io |
Classes for data model input/output.
|
com.asakusafw.runtime.io.csv.directio |
Direct I/O adapters for CSV format.
|
com.asakusafw.runtime.io.json |
Extracting and generating JSON files.
|
com.asakusafw.runtime.io.json.directio |
Direct I/O adapters of JSON files.
|
com.asakusafw.runtime.io.line |
Line reader and emitter.
|
com.asakusafw.runtime.io.line.directio |
Direct I/O adapters of line read/write.
|
com.asakusafw.runtime.io.sequencefile |
Utility classes for
SequenceFile . |
com.asakusafw.runtime.io.text |
Extracting and generating formatted text files.
|
com.asakusafw.runtime.io.text.directio |
Direct I/O adapters of formatted text files.
|
com.asakusafw.runtime.io.util |
Utilities about I/O access.
|
com.asakusafw.runtime.stage.temporary |
Temporary storage for each stage.
|
com.asakusafw.testdriver.core |
Core classes of test moderator.
|
com.asakusafw.testdriver.directio |
Moderates test input/result using Direct I/O.
|
com.asakusafw.testdriver.windgate |
Moderates test input/result using WindGate.
|
com.asakusafw.windgate.hadoopfs.temporary |
WindGate drivers for temporary files.
|
Modifier and Type | Class and Description |
---|---|
class |
OrcFileOutput<T>
An implementation of
ModelOutput for creating ORCFile. |
Modifier and Type | Method and Description |
---|---|
abstract <T> ModelOutput<T> |
Compatibility.createOutput(AbstractOrcFileFormat<T> format,
Class<? extends T> dataType,
org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.Path path,
Counter counter)
|
ModelOutput<T> |
AbstractOrcFileFormat.createOutput(Class<? extends T> dataType,
org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.Path path,
Counter counter) |
Modifier and Type | Method and Description |
---|---|
<T> ModelOutput<T> |
CompatibilityV1.createOutput(AbstractOrcFileFormat<T> format,
Class<? extends T> dataType,
org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.Path path,
Counter counter) |
Modifier and Type | Method and Description |
---|---|
<T> ModelOutput<T> |
CompatibilityV2.createOutput(AbstractOrcFileFormat<T> format,
Class<? extends T> dataType,
org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.Path path,
Counter counter) |
Modifier and Type | Method and Description |
---|---|
abstract <T> ModelOutput<T> |
Compatibility.createOutput(AbstractParquetFileFormat<T> format,
Class<? extends T> dataType,
org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.Path path,
Counter counter)
|
ModelOutput<T> |
AbstractParquetFileFormat.createOutput(Class<? extends T> dataType,
org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.Path path,
Counter counter) |
Modifier and Type | Class and Description |
---|---|
class |
ParquetFileOutput<T>
An implementation of
ModelOutput for writing Parquet files. |
Modifier and Type | Method and Description |
---|---|
<T> ModelOutput<T> |
CompatibilityV1.createOutput(AbstractParquetFileFormat<T> format,
Class<? extends T> dataType,
org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.Path path,
Counter counter) |
Modifier and Type | Method and Description |
---|---|
<T> ModelOutput<T> |
CompatibilityV2.createOutput(AbstractParquetFileFormat<T> format,
Class<? extends T> dataType,
org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.Path path,
Counter counter) |
Modifier and Type | Method and Description |
---|---|
abstract ModelOutput<T> |
BinaryStreamFormat.createOutput(Class<? extends T> dataType,
String path,
OutputStream stream)
Creates a new
ModelOutput for the specified properties. |
<T> ModelOutput<T> |
DirectDataSource.openOutput(OutputAttemptContext context,
DataDefinition<T> definition,
String basePath,
String resourcePath,
Counter counter)
Opens a resource for output.
|
Modifier and Type | Method and Description |
---|---|
ModelOutput<T> |
SequenceFileFormat.createOutput(Class<? extends T> dataType,
org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.Path path,
Counter counter) |
abstract ModelOutput<T> |
HadoopFileFormat.createOutput(Class<? extends T> dataType,
org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.Path path,
Counter counter)
Creates a new
ModelOutput for the specified properties. |
ModelOutput<T> |
HadoopFileFormatAdapter.createOutput(Class<? extends T> dataType,
org.apache.hadoop.fs.FileSystem fileSystem,
org.apache.hadoop.fs.Path path,
Counter counter) |
<T> ModelOutput<T> |
HadoopDataSourceCore.openOutput(OutputAttemptContext context,
DataDefinition<T> definition,
String basePath,
String resourcePath,
Counter counter) |
<T> ModelOutput<T> |
HadoopDataSource.openOutput(OutputAttemptContext context,
DataDefinition<T> definition,
String basePath,
String resourcePath,
Counter counter) |
Modifier and Type | Method and Description |
---|---|
<T> ModelOutput<T> |
KeepAliveDataSource.openOutput(OutputAttemptContext context,
DataDefinition<T> definition,
String basePath,
String resourcePath,
Counter counter) |
Modifier and Type | Method and Description |
---|---|
ModelOutput<T> |
ModelIoFactory.createModelOutput(OutputStream out)
Creates a new
ModelOutput for the target OutputStream . |
ModelOutput<T> |
ModelIoFactory.createModelOutput(RecordEmitter emitter)
Creates a new
ModelOutput for the target RecordEmitter . |
Modifier and Type | Method and Description |
---|---|
ModelOutput<T> |
AbstractCsvStreamFormat.createOutput(Class<? extends T> dataType,
String path,
OutputStream stream) |
Modifier and Type | Interface and Description |
---|---|
interface |
JsonOutput<T>
/**
Output as JSON format data.
|
Modifier and Type | Method and Description |
---|---|
ModelOutput<T> |
AbstractJsonStreamFormat.createOutput(Class<? extends T> dataType,
String path,
OutputStream stream) |
Modifier and Type | Class and Description |
---|---|
class |
BasicLineOutput
A simple line writer for text with any charset encoding.
|
class |
LineOutput
A simple line writer for text.
|
class |
Utf8LineOutput
A simple line writer for UTF-8 text.
|
Modifier and Type | Method and Description |
---|---|
ModelOutput<T> |
AbstractLineStreamFormat.createOutput(Class<? extends T> dataType,
String path,
OutputStream stream) |
Modifier and Type | Class and Description |
---|---|
class |
SequenceFileModelOutput<T>
An implementation of
ModelOutput using SequenceFile . |
Modifier and Type | Interface and Description |
---|---|
interface |
TextOutput<T>
/**
Output to text files.
|
Modifier and Type | Method and Description |
---|---|
ModelOutput<T> |
AbstractTextStreamFormat.createOutput(Class<? extends T> dataType,
String path,
OutputStream stream) |
Modifier and Type | Class and Description |
---|---|
class |
VoidModelOutput<T>
Void implementation of
ModelInput . |
Modifier and Type | Class and Description |
---|---|
class |
TemporaryFileOutput<T extends org.apache.hadoop.io.Writable>
Output raw data.
|
Modifier and Type | Method and Description |
---|---|
static <V> ModelOutput<V> |
TemporaryStorage.openOutput(org.apache.hadoop.conf.Configuration conf,
Class<V> dataType,
OutputStream output)
Opens a temporary
ModelOutput for the specified output. |
static <V> ModelOutput<V> |
TemporaryStorage.openOutput(org.apache.hadoop.conf.Configuration conf,
Class<V> dataType,
OutputStream output,
org.apache.hadoop.io.compress.CompressionCodec compressionCodec)
Opens a temporary
ModelOutput for the specified output. |
static <V> ModelOutput<V> |
TemporaryStorage.openOutput(org.apache.hadoop.conf.Configuration conf,
Class<V> dataType,
org.apache.hadoop.fs.Path path)
Opens a temporary
ModelOutput for the specified path. |
static <V> ModelOutput<V> |
TemporaryStorage.openOutput(org.apache.hadoop.conf.Configuration conf,
Class<V> dataType,
org.apache.hadoop.fs.Path path,
org.apache.hadoop.io.compress.CompressionCodec compressionCodec)
Opens a temporary
ModelOutput for the specified path. |
Modifier and Type | Method and Description |
---|---|
<V> ModelOutput<V> |
SpiExporterRetriever.createOutput(DataModelDefinition<V> definition,
ExporterDescription description,
TestContext context) |
<V> ModelOutput<V> |
SpiImporterPreparator.createOutput(DataModelDefinition<V> definition,
ImporterDescription description,
TestContext context) |
abstract <V> ModelOutput<V> |
AbstractImporterPreparator.createOutput(DataModelDefinition<V> definition,
T description)
Creates a
ModelOutput to prepare the resource which the importer will use. |
abstract <V> ModelOutput<V> |
AbstractExporterRetriever.createOutput(DataModelDefinition<V> definition,
T description)
Creates a
ModelOutput to prepare what the exporter will use. |
<V> ModelOutput<V> |
AbstractImporterPreparator.createOutput(DataModelDefinition<V> definition,
T description,
TestContext context)
Redirects to
createOutput(definition, description) . |
<V> ModelOutput<V> |
ExporterRetriever.createOutput(DataModelDefinition<V> definition,
T description,
TestContext context)
Creates a
ModelOutput to prepare what the exporter will use. |
<V> ModelOutput<V> |
AbstractExporterRetriever.createOutput(DataModelDefinition<V> definition,
T description,
TestContext context)
Redirects to
createOutput(definition, description) . |
<V> ModelOutput<V> |
ImporterPreparator.createOutput(DataModelDefinition<V> definition,
T description,
TestContext context)
Creates a
ModelOutput to prepare the resource which the importer will use. |
<T> ModelOutput<T> |
TestDataPreparator.prepare(Class<T> type,
ExporterDescription description)
Deprecated.
Opens the target exporter's output to prepare it.
|
<T> ModelOutput<T> |
TestDataPreparator.prepare(Class<T> type,
ImporterDescription description)
Deprecated.
Opens the target importer's input to prepare it.
|
Modifier and Type | Method and Description |
---|---|
<V> ModelOutput<V> |
DirectFileInputPreparator.createOutput(DataModelDefinition<V> definition,
DirectFileInputDescription description,
TestContext context) |
<V> ModelOutput<V> |
DirectFileOutputRetriever.createOutput(DataModelDefinition<V> definition,
DirectFileOutputDescription description,
TestContext context) |
<T> ModelOutput<T> |
DirectIoTestHelper.openOutput(Class<T> dataType,
DirectFileInputDescription description)
Opens output for the target input.
|
Modifier and Type | Class and Description |
---|---|
class |
WindGateOutput<T>
An implementation of
ModelOutput using DrainDriver . |
Modifier and Type | Method and Description |
---|---|
<V> ModelOutput<V> |
WindGateExporterRetriever.createOutput(DataModelDefinition<V> definition,
WindGateExporterDescription description,
TestContext context) |
<V> ModelOutput<V> |
WindGateImporterPreparator.createOutput(DataModelDefinition<V> definition,
WindGateImporterDescription description,
TestContext context) |
Constructor and Description |
---|
ModelOutputDrainDriver(ModelOutput<T> output)
Creates a new instance.
|
Copyright © 2011–2019 Asakusa Framework Team. All rights reserved.