hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chris Nauroth <cnaur...@hortonworks.com>
Subject Re: PriorityQueueWritable
Date Mon, 15 Oct 2012 17:37:35 GMT
Hello Aseem,

I'm aware of nothing in Hadoop or related projects that provides a
PriorityQueueWritable.  You could achieve this by taking some existing
priority queue class and subclassing it or wrapping it to implement the
Writable.write and Writable.readFields methods.

If you could give us some additional context around what you want to solve,
then we might be able to offer some other suggestions.  For example,
depending on the problem, maybe you could sort values and wrap them in
ArrayWritable (which already exists), which would save you the trouble of
coding your own custom Writable.

Thank you,

On Mon, Oct 15, 2012 at 9:56 AM, Aseem Anand <aseem.iiith@gmail.com> wrote:

> Hi,
> Is anyone familiar with a PriorityQueueWritable to be used to pass data
> from mapper to reducers ?
> Regards,
> Aseem

View raw message