hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Task does not enter reduce function after secondary sort
Date Sun, 04 Nov 2012 21:03:46 GMT
Sounds like an override issue to me. If you can share your code, we
can take a quick look - otherwise, try annotating your reduce(…)
method with @Override and recompiling to see if it really is the right
signature Java expects.

On Mon, Nov 5, 2012 at 1:48 AM, Aseem Anand <aseem.iiith@gmail.com> wrote:
> Hi,
> I am using a Secondary Sort for my Hadoop program. My map function emits
> (Text,NullWritable) where Text contains the composite key and appropriate
> comparison functions are made and a custom Partitioner . These seem to be
> working fine.
> I have been struggling with the problem that these values are not being
> received by the reduce function and instead automatically get written to the
> hdfs in x number of files where x is the number of reducers. I have made
> sure the reduce function is set to my Reduce function and not identity
> reduce.
> Can someone please explain this behavior and what could be possibly wrong ?
> Thanks & Regards,
> Aseem

Harsh J

View raw message