Uses of Class
com.asakusafw.runtime.directio.Counter

Packages that use Counter

Package	Description
com.asakusafw.directio.hive.orc	ORCFile format bridge between Asakusa and Hive.
com.asakusafw.directio.hive.orc.v1	ORCFile format bridge for Hive v1.
com.asakusafw.directio.hive.orc.v2	ORCFile format bridge for Hive v2.
com.asakusafw.directio.hive.parquet	Parquet file format bridge between Asakusa and Hive.
com.asakusafw.directio.hive.parquet.v1	Parquet format bridge for Hive v1.
com.asakusafw.directio.hive.parquet.v2	Parquet format bridge for Hive v2.
com.asakusafw.runtime.directio	Direct I/O access from Asakusa Framework.
com.asakusafw.runtime.directio.hadoop	Direct I/O access for Hadoop Environment.
com.asakusafw.runtime.directio.keepalive	Keep-alive utilities for Direct I/O access.
com.asakusafw.runtime.directio.util	Generic utilities for direct I/O access.

Uses of Counter in com.asakusafw.directio.hive.orc

Methods in com.asakusafw.directio.hive.orc with parameters of type Counter

Modifier and Type	Method and Description
abstract <T> ModelInput<T>	Compatibility.createInput(AbstractOrcFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter) delegate from AbstractOrcFileFormat.createInput(Class, FileSystem, Path, long, long, Counter).
ModelInput<T>	AbstractOrcFileFormat.createInput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)
abstract <T> ModelOutput<T>	Compatibility.createOutput(AbstractOrcFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, Counter counter) delegate from AbstractOrcFileFormat.createOutput(Class, FileSystem, Path, Counter).
ModelOutput<T>	AbstractOrcFileFormat.createOutput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, Counter counter)

Constructors in com.asakusafw.directio.hive.orc with parameters of type Counter

Constructor and Description
OrcFileInput(DataModelDescriptor descriptor, DataModelMapping configuration, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter) Creates a new instance.
OrcFileInput(DataModelDescriptor descriptor, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter) Creates a new instance.
OrcFileOutput(DataModelDescriptor descriptor, org.apache.hadoop.fs.Path path, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.hive.ql.io.orc.OrcFile.WriterOptions options, Counter counter) Creates a new instance.
OrcFileOutput(DataModelDescriptor descriptor, org.apache.hadoop.fs.Path path, org.apache.hadoop.hive.ql.io.orc.OrcFile.WriterOptions options, Counter counter) Creates a new instance.

Uses of Counter in com.asakusafw.directio.hive.orc.v1

Methods in com.asakusafw.directio.hive.orc.v1 with parameters of type Counter

Modifier and Type	Method and Description
<T> ModelInput<T>	CompatibilityV1.createInput(AbstractOrcFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)
<T> ModelOutput<T>	CompatibilityV1.createOutput(AbstractOrcFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, Counter counter)

Uses of Counter in com.asakusafw.directio.hive.orc.v2

Methods in com.asakusafw.directio.hive.orc.v2 with parameters of type Counter

Modifier and Type	Method and Description
<T> ModelInput<T>	CompatibilityV2.createInput(AbstractOrcFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)
<T> ModelOutput<T>	CompatibilityV2.createOutput(AbstractOrcFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, Counter counter)

Uses of Counter in com.asakusafw.directio.hive.parquet

Methods in com.asakusafw.directio.hive.parquet with parameters of type Counter

Modifier and Type	Method and Description
abstract <T> ModelInput<T>	Compatibility.createInput(AbstractParquetFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter) delegate from AbstractParquetFileFormat.createInput(Class, FileSystem, Path, long, long, Counter).
ModelInput<T>	AbstractParquetFileFormat.createInput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)
abstract <T> ModelOutput<T>	Compatibility.createOutput(AbstractParquetFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, Counter counter) delegate from AbstractParquetFileFormat.createOutput(Class, FileSystem, Path, Counter).
ModelOutput<T>	AbstractParquetFileFormat.createOutput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, Counter counter)

Uses of Counter in com.asakusafw.directio.hive.parquet.v1

Methods in com.asakusafw.directio.hive.parquet.v1 with parameters of type Counter

Modifier and Type	Method and Description
<T> ModelInput<T>	CompatibilityV1.createInput(AbstractParquetFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)
<T> ModelOutput<T>	CompatibilityV1.createOutput(AbstractParquetFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, Counter counter)

Constructors in com.asakusafw.directio.hive.parquet.v1 with parameters of type Counter

Constructor and Description
ParquetFileInput(DataModelDescriptor descriptor, DataModelMapping mappingConfiguration, org.apache.hadoop.conf.Configuration hadoopConfiguration, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter) Creates a new instance.
ParquetFileOutput(DataModelDescriptor descriptor, org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path path, ParquetFileOutput.Options options, Counter counter) Creates a new instance.

Uses of Counter in com.asakusafw.directio.hive.parquet.v2

Methods in com.asakusafw.directio.hive.parquet.v2 with parameters of type Counter

Modifier and Type	Method and Description
<T> ModelInput<T>	CompatibilityV2.createInput(AbstractParquetFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)
<T> ModelOutput<T>	CompatibilityV2.createOutput(AbstractParquetFileFormat<T> format, Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, Counter counter)

Constructors in com.asakusafw.directio.hive.parquet.v2 with parameters of type Counter

Constructor and Description
ParquetFileInput(DataModelDescriptor descriptor, DataModelMapping mappingConfiguration, org.apache.hadoop.conf.Configuration hadoopConfiguration, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter) Creates a new instance.
ParquetFileOutput(DataModelDescriptor descriptor, org.apache.hadoop.conf.Configuration configuration, org.apache.hadoop.fs.Path path, ParquetFileOutput.Options options, Counter counter) Creates a new instance.

Uses of Counter in com.asakusafw.runtime.directio

Methods in com.asakusafw.runtime.directio that return Counter

Modifier and Type	Method and Description
Counter	OutputTransactionContext.getCounter() Returns the operation counter.
Counter	OutputAttemptContext.getCounter() Returns the operation counter.

Methods in com.asakusafw.runtime.directio with parameters of type Counter

Modifier and Type	Method and Description
boolean	DirectDataSource.delete(String basePath, ResourcePattern resourcePattern, boolean recursive, Counter counter) Deletes resources.
List<ResourceInfo>	DirectDataSource.list(String basePath, ResourcePattern resourcePattern, Counter counter) List resources.
<T> ModelInput<T>	DirectDataSource.openInput(DataDefinition<T> definition, DirectInputFragment fragment, Counter counter) Opens a fragment for input.
<T> ModelOutput<T>	DirectDataSource.openOutput(OutputAttemptContext context, DataDefinition<T> definition, String basePath, String resourcePath, Counter counter) Opens a resource for output.

Constructors in com.asakusafw.runtime.directio with parameters of type Counter

Constructor and Description
OutputAttemptContext(String transactionId, String attemptId, String outputId, Counter counter) Creates a new instance.
OutputTransactionContext(String transactionId, String outputId, Counter counter) Creates a new instance.

Uses of Counter in com.asakusafw.runtime.directio.hadoop

Subclasses of Counter in com.asakusafw.runtime.directio.hadoop

Modifier and Type	Class and Description
class	ProgressableCounter Counter which reports a progress using Progressable.

Methods in com.asakusafw.runtime.directio.hadoop with parameters of type Counter

Modifier and Type	Method and Description
ModelInput<T>	HadoopFileFormat.createInput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, Counter counter) Creates a new ModelInput for the specified properties.
ModelInput<T>	SequenceFileFormat.createInput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)
abstract ModelInput<T>	HadoopFileFormat.createInput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter) Creates a new ModelInput for the specified properties.
ModelInput<T>	HadoopFileFormatAdapter.createInput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter)
ModelOutput<T>	SequenceFileFormat.createOutput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, Counter counter)
abstract ModelOutput<T>	HadoopFileFormat.createOutput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, Counter counter) Creates a new ModelOutput for the specified properties.
ModelOutput<T>	HadoopFileFormatAdapter.createOutput(Class<? extends T> dataType, org.apache.hadoop.fs.FileSystem fileSystem, org.apache.hadoop.fs.Path path, Counter counter)
boolean	HadoopDataSourceCore.delete(String basePath, ResourcePattern resourcePattern, boolean recursive, Counter counter)
boolean	HadoopDataSource.delete(String basePath, ResourcePattern resourcePattern, boolean recursive, Counter counter)
List<ResourceInfo>	HadoopDataSourceCore.list(String basePath, ResourcePattern resourcePattern, Counter counter)
List<ResourceInfo>	HadoopDataSource.list(String basePath, ResourcePattern resourcePattern, Counter counter)
static void	HadoopDataSourceUtil.move(Counter counter, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path from, org.apache.hadoop.fs.Path to) Moves all files in source directory into target directory.
static void	HadoopDataSourceUtil.move(Counter counter, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path from, org.apache.hadoop.fs.Path to, int threads) Moves all files in source directory into target directory.
static void	HadoopDataSourceUtil.moveFromLocal(Counter counter, org.apache.hadoop.fs.LocalFileSystem localFs, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path from, org.apache.hadoop.fs.Path to) Moves all files in source directory into target directory.
<T> ModelInput<T>	HadoopDataSourceCore.openInput(DataDefinition<T> definition, DirectInputFragment fragment, Counter counter)
<T> ModelInput<T>	HadoopDataSource.openInput(DataDefinition<T> definition, DirectInputFragment fragment, Counter counter)
<T> ModelOutput<T>	HadoopDataSourceCore.openOutput(OutputAttemptContext context, DataDefinition<T> definition, String basePath, String resourcePath, Counter counter)
<T> ModelOutput<T>	HadoopDataSource.openOutput(OutputAttemptContext context, DataDefinition<T> definition, String basePath, String resourcePath, Counter counter)

Uses of Counter in com.asakusafw.runtime.directio.keepalive

Methods in com.asakusafw.runtime.directio.keepalive with parameters of type Counter

Modifier and Type	Method and Description
boolean	KeepAliveDataSource.delete(String basePath, ResourcePattern resourcePattern, boolean recursive, Counter counter)
List<ResourceInfo>	KeepAliveDataSource.list(String basePath, ResourcePattern resourcePattern, Counter counter)
<T> ModelInput<T>	KeepAliveDataSource.openInput(DataDefinition<T> definition, DirectInputFragment fragment, Counter counter)
<T> ModelOutput<T>	KeepAliveDataSource.openOutput(OutputAttemptContext context, DataDefinition<T> definition, String basePath, String resourcePath, Counter counter)

Uses of Counter in com.asakusafw.runtime.directio.util

Constructors in com.asakusafw.runtime.directio.util with parameters of type Counter

Constructor and Description
CountInputStream(InputStream target, Counter counter) Creates a new instance.
CountOutputStream(OutputStream stream, Counter counter) Creates a new instance.