Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (nike.apache.org: domain of ndimiduk@gmail.com designates
 209.85.220.173 as permitted sender)
MIME-Version: 1.0
In-Reply-To: <1406820000591-4062141.post@n3.nabble.com>
References: <1406820000591-4062141.post@n3.nabble.com>
From: Nick Dimiduk <ndimiduk@gmail.com>
Date: Thu, 31 Jul 2014 12:06:48 -0700
Message-ID: 
 <CANZa=GvSboXf+yEDd6ustW1Vd=TGmek8M4Nrw=Mex9HQPOCsbA@mail.gmail.com>
Subject: Re: Hbase Mapreduce API - Reduce to a file is not working properly.
To: hbase-user <user@hbase.apache.org>
Content-Type: multipart/alternative; boundary=089e01177721b3ed2904ff81fad4

--089e01177721b3ed2904ff81fad4
Content-Type: text/plain; charset=UTF-8

Hi Parkirat,

I don't follow the reducer problem you're having. Can you post your code
that configures the job? I assume you're using TableMapReduceUtil someplace.

Your reducer is removing duplicate values? Sounds like you need to update
it's logic to only emit a value once. Pastebin-ing your reducer code may be
helpful as well.

-n


On Thu, Jul 31, 2014 at 8:20 AM, Parkirat <parkiratbigdata@gmail.com> wrote:

> Hi All,
>
> I am using Mapreduce API to read Hbase Table, based on some scan operation
> in mapper and putting the data to a file in reducer.
> I am using Hbase Version "Version 0.94.5.23".
>
> *Problem:*
> Now in my job, my mapper output a key as text and value as text, but my
> reducer output key as text and value as nullwritable, but it seems *hbase
> mapreduce api dont consider reducer*, and outputs both key and value as
> text.
>
> Moreover if the same key comes twice, it goes to the file twice, even if my
> reducer want to log it only once.
>
> Could anybody help me with this problem?
>
> Regards,
> Parkirat Singh Bagga.
>
>
>
> --
> View this message in context:
> http://apache-hbase.679495.n3.nabble.com/Hbase-Mapreduce-API-Reduce-to-a-file-is-not-working-properly-tp4062141.html
> Sent from the HBase User mailing list archive at Nabble.com.
>

--089e01177721b3ed2904ff81fad4--