Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hadoop.apache.org
Received-SPF: pass (nike.apache.org: domain of harsh@cloudera.com designates
 209.85.223.176 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAMhLnmjXchwYEJr3+Gmc_AAEioKw86sedECB9w+K-9tQCTaiow@mail.gmail.com>
References: 
 <CAMhLnmjXchwYEJr3+Gmc_AAEioKw86sedECB9w+K-9tQCTaiow@mail.gmail.com>
From: Harsh J <harsh@cloudera.com>
Date: Mon, 5 Nov 2012 02:33:46 +0530
Message-ID: 
 <CAOcnVr2vf2ijgXv7TarV+CTvHTKOgB0AOKjLMN+9iROh7GnpyQ@mail.gmail.com>
Subject: Re: Task does not enter reduce function after secondary sort
To: user@hadoop.apache.org
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

Sounds like an override issue to me. If you can share your code, we
can take a quick look - otherwise, try annotating your reduce(=85)
method with @Override and recompiling to see if it really is the right
signature Java expects.

On Mon, Nov 5, 2012 at 1:48 AM, Aseem Anand <aseem.iiith@gmail.com> wrote:
> Hi,
> I am using a Secondary Sort for my Hadoop program. My map function emits
> (Text,NullWritable) where Text contains the composite key and appropriate
> comparison functions are made and a custom Partitioner . These seem to be
> working fine.
>
> I have been struggling with the problem that these values are not being
> received by the reduce function and instead automatically get written to =
the
> hdfs in x number of files where x is the number of reducers. I have made
> sure the reduce function is set to my Reduce function and not identity
> reduce.
>
> Can someone please explain this behavior and what could be possibly wrong=
 ?
>
> Thanks & Regards,
> Aseem


--=20
Harsh J