hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eason.Lee" <leongf...@gmail.com>
Subject Re: Records missing
Date Fri, 06 Nov 2009 08:33:27 GMT
Sorry for reply to late~

2009/11/6 stack <stack@duboce.net>

> For sure all your keys are unique?  Write them as output from your job and
> count that output too (does the reduce count match the map count)?
> St.Ack
>
> Yes, they are unique, I have just checked it~~
I don't have reduce. Just save records into hbase in the map.
But i just did a test , collect all the row keys, and found that the reduce
count matches the map count


> On Wed, Nov 4, 2009 at 10:30 PM, Eason.Lee <leongfans@gmail.com> wrote:
>
> > 0.20.1
> >
> > I didn't see any error during upload~~
> >
> > and there is no error in logs
> >
> > 2009/11/5 Jean-Daniel Cryans <jdcryans@apache.org>
> >
> > > Which version of HBase? Any region server crash during the upload?
> > >
> > > J-D
> > >
> > > On Wed, Nov 4, 2009 at 10:09 PM, Eason.Lee <leongfans@gmail.com>
> wrote:
> > > > I have dumped all my data into Hbase using mapreduce
> > > > the result shows i have processed 4,413,160 records
> > > > But there are only 4217742 rows in the table(count by rowcounter)
> > > >
> > > > dump:
> > > > Map input records 4,413,160 0 4,413,160count:
> > > > Map input records 4,217,742 0 4,217,742
> > > > There is no error,and row key is unique(
> > > > Math.Random()+"_"+fileName+"_"+currentPosition )
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message