com.asakusafw.runtime.directio

Interface FragmentableDataFormat<T>

Type Parameters:

T - the type of target data model

All Superinterfaces:

DataFormat<T>

All Known Implementing Classes:

AbstractCsvStreamFormat, AbstractJsonStreamFormat, AbstractLineStreamFormat, AbstractOrcFileFormat, AbstractParquetFileFormat, AbstractTextStreamFormat, BinaryStreamFormat, ConfigurableBinaryStreamFormat, HadoopFileFormat, HadoopFileFormatAdapter, OrcFileFormat, ParquetFileFormat, SequenceFileFormat

public interface FragmentableDataFormat<T>
extends DataFormat<T>

Data model format which can be fragmented. Client should not implement this interface directly.

Since:

0.2.6

Version:

0.9.0

Method Summary

Modifier and Type	Method and Description
default long	getMinimumFragmentSize() Returns the lower limit of fragment size (in bytes).
default long	getPreferredFragmentSize() Returns the preferred fragment size (in bytes).

Methods inherited from interface com.asakusafw.runtime.directio.DataFormat

getSupportedType

Method Detail

getPreferredFragmentSize

default long getPreferredFragmentSize()
                               throws IOException,
                                      InterruptedException

Returns the preferred fragment size (in bytes).

Returns:

the preferred fragment size, or -1 as infinite

Throws:

IOException - if failed to compute bytes count

InterruptedException - if interrupted

getMinimumFragmentSize

default long getMinimumFragmentSize()
                             throws IOException,
                                    InterruptedException

Returns the lower limit of fragment size (in bytes). Each fragment must not smaller than this size.

Returns:

the lower limit of fragment size, or -1 as infinite (never split into fragments)

Throws:

IOException - if failed to compute bytes count

InterruptedException - if interrupted