Uses of Interface
com.asakusafw.runtime.io.ModelInput

Packages that use ModelInput

Package	Description
com.asakusafw.directio.hive.orc	ORCFile format bridge between Asakusa and Hive.
com.asakusafw.directio.hive.orc.v1	ORCFile format bridge for Hive v1.
com.asakusafw.directio.hive.orc.v2	ORCFile format bridge for Hive v2.
com.asakusafw.directio.hive.parquet	Parquet file format bridge between Asakusa and Hive.
com.asakusafw.directio.hive.parquet.v1	Parquet format bridge for Hive v1.
com.asakusafw.directio.hive.parquet.v2	Parquet format bridge for Hive v2.
com.asakusafw.runtime.directio	Direct I/O access from Asakusa Framework.
com.asakusafw.runtime.directio.api	User APIs of Direct I/O.
com.asakusafw.runtime.directio.api.legacy	The legacy Direct I/O implementations.
com.asakusafw.runtime.directio.hadoop	Direct I/O access for Hadoop Environment.
com.asakusafw.runtime.directio.keepalive	Keep-alive utilities for Direct I/O access.
com.asakusafw.runtime.io	Classes for data model input/output.
com.asakusafw.runtime.io.csv.directio	Direct I/O adapters for CSV format.
com.asakusafw.runtime.io.json	Extracting and generating JSON files.
com.asakusafw.runtime.io.json.directio	Direct I/O adapters of JSON files.
com.asakusafw.runtime.io.line	Line reader and emitter.
com.asakusafw.runtime.io.line.directio	Direct I/O adapters of line read/write.
com.asakusafw.runtime.io.sequencefile	Utility classes for SequenceFile.
com.asakusafw.runtime.io.text	Extracting and generating formatted text files.
com.asakusafw.runtime.io.text.directio	Direct I/O adapters of formatted text files.
com.asakusafw.runtime.io.util	Utilities about I/O access.
com.asakusafw.runtime.stage.temporary	Temporary storage for each stage.
com.asakusafw.testdriver.directio	Moderates test input/result using Direct I/O.
com.asakusafw.windgate.hadoopfs.ssh	WindGate resources using Hadoop FileSystem via SSH connection.
com.asakusafw.windgate.hadoopfs.temporary	WindGate drivers for temporary files.

Uses of ModelInput in com.asakusafw.directio.hive.orc

Classes in com.asakusafw.directio.hive.orc that implement ModelInput

Modifier and Type	Class and Description
class	OrcFileInput<T> An implementation of ModelInput for reading ORCFile.

Methods in com.asakusafw.directio.hive.orc that return ModelInput

Modifier and Type	Method and Description
abstract <T> ModelInput<T>	Compatibility.createInput(AbstractOrcFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter) delegate from AbstractOrcFileFormat.createInput(Class, FileSystem, Path, long, long, Counter).
ModelInput<T>	AbstractOrcFileFormat.createInput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)

Uses of ModelInput in com.asakusafw.directio.hive.orc.v1

Methods in com.asakusafw.directio.hive.orc.v1 that return ModelInput

Modifier and Type	Method and Description
<T> ModelInput<T>	CompatibilityV1.createInput(AbstractOrcFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)

Uses of ModelInput in com.asakusafw.directio.hive.orc.v2

Methods in com.asakusafw.directio.hive.orc.v2 that return ModelInput

Modifier and Type	Method and Description
<T> ModelInput<T>	CompatibilityV2.createInput(AbstractOrcFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)

Uses of ModelInput in com.asakusafw.directio.hive.parquet

Methods in com.asakusafw.directio.hive.parquet that return ModelInput

Modifier and Type	Method and Description
abstract <T> ModelInput<T>	Compatibility.createInput(AbstractParquetFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter) delegate from AbstractParquetFileFormat.createInput(Class, FileSystem, Path, long, long, Counter).
ModelInput<T>	AbstractParquetFileFormat.createInput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)

Uses of ModelInput in com.asakusafw.directio.hive.parquet.v1

Classes in com.asakusafw.directio.hive.parquet.v1 that implement ModelInput

Modifier and Type	Class and Description
class	ParquetFileInput<T> An implementation of ModelInput for reading Parquet files.

Methods in com.asakusafw.directio.hive.parquet.v1 that return ModelInput

Modifier and Type	Method and Description
<T> ModelInput<T>	CompatibilityV1.createInput(AbstractParquetFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)

Uses of ModelInput in com.asakusafw.directio.hive.parquet.v2

Methods in com.asakusafw.directio.hive.parquet.v2 that return ModelInput

Modifier and Type	Method and Description
<T> ModelInput<T>	CompatibilityV2.createInput(AbstractParquetFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)

Uses of ModelInput in com.asakusafw.runtime.directio

Classes in com.asakusafw.runtime.directio that implement ModelInput

Modifier and Type	Class and Description
class	FilteredModelInput<T> An implementation of ModelInput with DataFilter.

Methods in com.asakusafw.runtime.directio that return ModelInput

Modifier and Type	Method and Description
ModelInput<T>	BinaryStreamFormat.createInput(Class<? extends T> dataType, String path, InputStream stream) Creates a new ModelInput for the specified properties.
abstract ModelInput<T>	BinaryStreamFormat.createInput(Class<? extends T> dataType, String path, InputStream stream, long offset, long fragmentSize) Creates a new ModelInput for the specified properties.
<T> ModelInput<T>	DirectDataSource.openInput(DataDefinition<T> definition, DirectInputFragment fragment, Counter counter) Opens a fragment for input.

Constructors in com.asakusafw.runtime.directio with parameters of type ModelInput

Constructor and Description
FilteredModelInput(ModelInput<T> delegate, DataFilter<? super T> filter) Creates a new instance.

Uses of ModelInput in com.asakusafw.runtime.directio.api

Methods in com.asakusafw.runtime.directio.api that return ModelInput

Modifier and Type	Method and Description
static <T> ModelInput<T>	DirectIo.open(Class<? extends DataFormat<T>> formatClass, String basePath, String resourcePattern) Returns data model objects from Direct I/O data sources.
<T> ModelInput<T>	DirectIoApi.open(Class<? extends DataFormat<T>> formatClass, String basePath, String resourcePattern) Returns data model objects from Direct I/O data sources.
<T> ModelInput<T>	DirectIoDelegate.open(Class<? extends DataFormat<T>> formatClass, String basePath, String resourcePattern)

Uses of ModelInput in com.asakusafw.runtime.directio.api.legacy

Methods in com.asakusafw.runtime.directio.api.legacy that return ModelInput

Modifier and Type	Method and Description
static <T> ModelInput<T>	LegacyDirectIo.open(Class<? extends DataFormat<T>> formatClass, String basePath, String resourcePattern) Returns data model objects from Direct I/O data sources.

Uses of ModelInput in com.asakusafw.runtime.directio.hadoop

Methods in com.asakusafw.runtime.directio.hadoop that return ModelInput

Modifier and Type	Method and Description
ModelInput<T>	HadoopFileFormat.createInput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, Counter counter) Creates a new ModelInput for the specified properties.
ModelInput<T>	SequenceFileFormat.createInput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)
abstract ModelInput<T>	HadoopFileFormat.createInput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter) Creates a new ModelInput for the specified properties.
ModelInput<T>	HadoopFileFormatAdapter.createInput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)
<T> ModelInput<T>	HadoopDataSourceCore.openInput(DataDefinition<T> definition, DirectInputFragment fragment, Counter counter)
<T> ModelInput<T>	HadoopDataSource.openInput(DataDefinition<T> definition, DirectInputFragment fragment, Counter counter)

Uses of ModelInput in com.asakusafw.runtime.directio.keepalive

Methods in com.asakusafw.runtime.directio.keepalive that return ModelInput

Modifier and Type	Method and Description
<T> ModelInput<T>	KeepAliveDataSource.openInput(DataDefinition<T> definition, DirectInputFragment fragment, Counter counter)

Uses of ModelInput in com.asakusafw.runtime.io

Methods in com.asakusafw.runtime.io that return ModelInput

Modifier and Type	Method and Description
ModelInput<T>	ModelIoFactory.createModelInput(InputStream in) Creates a new ModelInput for the target InputStream.
ModelInput<T>	ModelIoFactory.createModelInput(RecordParser parser) Creates a new ModelInput for the target RecordParser.

Uses of ModelInput in com.asakusafw.runtime.io.csv.directio

Methods in com.asakusafw.runtime.io.csv.directio that return ModelInput

Modifier and Type	Method and Description
ModelInput<T>	AbstractCsvStreamFormat.createInput(Class<? extends T> dataType, String path, InputStream stream, long offset, long fragmentSize)

Uses of ModelInput in com.asakusafw.runtime.io.json

Subinterfaces of ModelInput in com.asakusafw.runtime.io.json

Modifier and Type	Interface and Description
interface	JsonInput<T> Input from JSON format data.

Uses of ModelInput in com.asakusafw.runtime.io.json.directio

Methods in com.asakusafw.runtime.io.json.directio that return ModelInput

Modifier and Type	Method and Description
ModelInput<T>	AbstractJsonStreamFormat.createInput(Class<? extends T> dataType, String path, InputStream stream, long offset, long fragmentSize)

Uses of ModelInput in com.asakusafw.runtime.io.line

Classes in com.asakusafw.runtime.io.line that implement ModelInput

Modifier and Type	Class and Description
class	BasicLineInput A simple line reader for text with any charset encoding.
class	LineInput A simple line reader for text.
class	Utf8LineInput A simple line reader for UTF-8 text.

Uses of ModelInput in com.asakusafw.runtime.io.line.directio

Methods in com.asakusafw.runtime.io.line.directio that return ModelInput

Modifier and Type	Method and Description
ModelInput<T>	AbstractLineStreamFormat.createInput(Class<? extends T> dataType, String path, InputStream stream, long offset, long fragmentSize)

Uses of ModelInput in com.asakusafw.runtime.io.sequencefile

Classes in com.asakusafw.runtime.io.sequencefile that implement ModelInput

Modifier and Type	Class and Description
class	SequenceFileModelInput<T extends org.apache.hadoop.io.Writable> A bridge implementation to SequenceFile into ModelInput.

Uses of ModelInput in com.asakusafw.runtime.io.text

Subinterfaces of ModelInput in com.asakusafw.runtime.io.text

Modifier and Type	Interface and Description
interface	TextInput<T> Input from text files.

Uses of ModelInput in com.asakusafw.runtime.io.text.directio

Methods in com.asakusafw.runtime.io.text.directio that return ModelInput

Modifier and Type	Method and Description
ModelInput<T>	AbstractTextStreamFormat.createInput(Class<? extends T> dataType, String path, InputStream stream, long offset, long fragmentSize)

Uses of ModelInput in com.asakusafw.runtime.io.util

Classes in com.asakusafw.runtime.io.util that implement ModelInput

Modifier and Type	Class and Description
class	VoidModelInput<T> Void implementation of ModelInput.

Uses of ModelInput in com.asakusafw.runtime.stage.temporary

Classes in com.asakusafw.runtime.stage.temporary that implement ModelInput

Modifier and Type	Class and Description
class	TemporaryFileInput<T extends org.apache.hadoop.io.Writable> Input raw data.

Methods in com.asakusafw.runtime.stage.temporary that return ModelInput

Modifier and Type	Method and Description
static <V> ModelInput<V>	TemporaryStorage.openInput(org.apache.hadoop.conf.Configuration conf, Class<V> dataType, org.apache.hadoop.fs.FileStatus status, InputStream input) Opens a temporary ModelInput for the specified path.
static <V> ModelInput<V>	TemporaryStorage.openInput(org.apache.hadoop.conf.Configuration conf, Class<V> dataType, org.apache.hadoop.fs.Path path) Opens a temporary ModelInput for the specified path.

Uses of ModelInput in com.asakusafw.testdriver.directio

Methods in com.asakusafw.testdriver.directio that return ModelInput

Modifier and Type	Method and Description
<T> ModelInput<T>	DirectIoTestHelper.openInput(Class<T> dataType, DirectFileOutputDescription description) Opens input for the target output.

Uses of ModelInput in com.asakusafw.windgate.hadoopfs.ssh

Methods in com.asakusafw.windgate.hadoopfs.ssh that return ModelInput

Modifier and Type	Method and Description
ModelInput<T>	FileListModelInputProvider.open()

Uses of ModelInput in com.asakusafw.windgate.hadoopfs.temporary

Methods in com.asakusafw.windgate.hadoopfs.temporary that return ModelInput

Modifier and Type	Method and Description
ModelInput<T>	ModelInputProvider.open() Opens the current temporary file prepared by the ModelInputProvider.next() method.
ModelInput<T>	FileSystemModelInputProvider.open()