com.asakusafw.runtime.mapreduce.simple

Class KeyValueSorter<K,V>

java.lang.Object

com.asakusafw.runtime.mapreduce.simple.KeyValueSorter<K,V>

Type Parameters:

K - key object type

V - value object type

All Implemented Interfaces:

Closeable, AutoCloseable

public class KeyValueSorter<K,V>
extends Object
implements Closeable

Simple implementation of key-value pair sorter.

Since:

0.7.1

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	KeyValueSorter.Options Settings for KeyValueSorter.

Constructor Summary

Constructors

Constructor and Description
KeyValueSorter(org.apache.hadoop.io.serializer.SerializationFactory serialization, Class<K> keyClass, Class<V> valueClass, org.apache.hadoop.io.RawComparator<?> comparator, KeyValueSorter.Options options) Creates a new instance.

Method Summary

Modifier and Type	Method and Description
void	close()
Class<K>	getKeyClass() Returns the target key class.
long	getRecordCount() Returns the total record count.
long	getSizeInBytes() Returns the total size in bytes.
Class<V>	getValueClass() Returns the target value class.
void	put(K key, V value) Puts key and value into this buffer.
Source<KeyValueSlice>	sort() Sort previously added key-value pairs.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KeyValueSorter

public KeyValueSorter(org.apache.hadoop.io.serializer.SerializationFactory serialization,
                      Class<K> keyClass,
                      Class<V> valueClass,
                      org.apache.hadoop.io.RawComparator<?> comparator,
                      KeyValueSorter.Options options)

Creates a new instance.

Parameters:

serialization - the serialization factory

keyClass - the key class

valueClass - the value class

comparator - the shuffle sort comparator

options - the sorter options

Method Detail

getKeyClass

public Class<K> getKeyClass()

Returns the target key class.

Returns:

the key class

getValueClass

public Class<V> getValueClass()

Returns the target value class.

Returns:

the value class

put

public void put(K key,
                V value)
         throws IOException,
                InterruptedException

Puts key and value into this buffer.

Parameters:

key - the key object

value - the value object

Throws:

IOException - if failed to put objects

InterruptedException - if interrupted while putting object

getRecordCount

public long getRecordCount()

Returns the total record count.

Returns:

the total record count

getSizeInBytes

public long getSizeInBytes()

Returns the total size in bytes.

Returns:

the total size in bytes

sort

public Source<KeyValueSlice> sort()
                           throws IOException,
                                  InterruptedException

Sort previously added key-value pairs.

Returns:

the sorted source

Throws:

IOException - if failed to sort pairs

InterruptedException - if interrupted while preparing

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException