com.asakusafw.directio.hive.parquet.v2

Class ParquetFileInput<T>

java.lang.Object

com.asakusafw.directio.hive.parquet.v2.ParquetFileInput<T>

Type Parameters:

T - the data model type

All Implemented Interfaces:

ModelInput<T>, Closeable, AutoCloseable

public class ParquetFileInput<T>
extends Object
implements ModelInput<T>

An implementation of ModelInput for reading Parquet files.

Since:

0.7.0

Constructor Summary

Constructors

Constructor and Description
ParquetFileInput(DataModelDescriptor descriptor, DataModelMapping mappingConfiguration, org.apache.hadoop.conf.Configuration hadoopConfiguration, org.apache.hadoop.fs.Path path, long offset, long fragmentSize, Counter counter) Creates a new instance.

Method Summary

Modifier and Type	Method and Description
void	close()
boolean	readTo(T model) Reads contents and write them into the target data model object.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ParquetFileInput

public ParquetFileInput(DataModelDescriptor descriptor,
                        DataModelMapping mappingConfiguration,
                        org.apache.hadoop.conf.Configuration hadoopConfiguration,
                        org.apache.hadoop.fs.Path path,
                        long offset,
                        long fragmentSize,
                        Counter counter)

Creates a new instance.

Parameters:

descriptor - the target data model descriptor

mappingConfiguration - the DataModelDriver configuration

hadoopConfiguration - the hadoop configuration

path - the path to the target file

offset - starting stream offset

fragmentSize - suggested fragment bytes count

counter - the current counter

Method Detail

readTo

public boolean readTo(T model)
               throws IOException

Description copied from interface: ModelInput

Reads contents and write them into the target data model object. The target data model object will be changed even if the next data does not exist.

Specified by:

readTo in interface ModelInput<T>

Parameters:

model - the target data model object

Returns:

true if the next data was successfully read, or false if there is no any more

Throws:

IOException - if error occurred while reading the next data

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException