Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of jdcryans@gmail.com designates
 209.85.220.169 as permitted sender)
MIME-Version: 1.0
Sender: jdcryans@gmail.com
In-Reply-To: 
 <CAE6kwsPLCgoGaW6aMzK7MU+_cBmfqiuTmMbSMqSVnb+4ndQDnQ@mail.gmail.com>
References: 
 <CAE6kwsO=8na0Zr5uZN5-JpyRk2duWUJS8_-7f46LEMVVd_qgxQ@mail.gmail.com>
	<CAE6kwsPLCgoGaW6aMzK7MU+_cBmfqiuTmMbSMqSVnb+4ndQDnQ@mail.gmail.com>
Date: Thu, 1 May 2014 08:01:15 -0700
Message-ID: 
 <CAGpTDNcNk=b960iW5XXyq-d-OTqL6Ls6oim3zJfwm9VvM0gkRQ@mail.gmail.com>
Subject: Re: Error loading SHA-1 keys with load bulk
From: Jean-Daniel Cryans <jdcryans@apache.org>
To: "user@hbase.apache.org" <user@hbase.apache.org>
Content-Type: multipart/alternative; boundary=047d7bacb770c1f63a04f857efdf

--047d7bacb770c1f63a04f857efdf
Content-Type: text/plain; charset=UTF-8

Are you using HFileOutputFormat.configureIncrementalLoad() to set up the
partitioner and the reducers? That will take care of ordering your keys.

J-D


On Thu, May 1, 2014 at 5:38 AM, Guillermo Ortiz <konstt2000@gmail.com>wrote:

> I have been looking at the code in HBase, but, I don't really understand
> what this error happens. Why can I put in HBase those keys?
>
>
> 2014-04-30 17:57 GMT+02:00 Guillermo Ortiz
> <konstt2000@gmail.com<javascript:_e(%7B%7D,'cvml','konstt2000@gmail.com
> ');>
> >:
>
> > I'm using HBase with MapReduce to load a lot of data, so I have decide to
> > do it with bulk load.
> >
> >
> > I parse my keys with SHA1, but when I try to load them, I got this
> > exception.
> >
> > java.io.IOException: Added a key not lexically larger than previous
> key=\x00(6e9e59f36a7ec2ac54635b2d353e53e677839046\x01l\x00\x00\x01E\xB3>\xC9\xC7\x0E,
> lastkey=\x00(b313a9f1f57c8a07c81dc3221c6151cf3637506a\x01l\x00\x00\x01E\xAE\x18k\x87\x0E
> >       at
> org.apache.hadoop.hbase.io.hfile.AbstractHFileWriter.checkKey(AbstractHFileWriter.java:207)
> >       at
> org.apache.hadoop.hbase.io.hfile.HFileWriterV2.append(HFileWriterV2.java:324)
> >       at
> org.apache.hadoop.hbase.io.hfile.HFileWriterV2.append(HFileWriterV2.java:289)
> >       at
> org.apache.hadoop.hbase.regionserver.StoreFile$Writer.append(StoreFile.java:1206)
> >       at
> org.apache.hadoop.hbase.mapreduce.HFileOutputFormat$1.write(HFileOutputFormat.java:168)
> >       at
> org.apache.hadoop.hbase.mapreduce.HFileOutputFormat$1.write(HFileOutputFormat.java:124)
> >       at
> org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.write(ReduceTask.java:551)
> >       at
> org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:85)
> >
> > I work with HBase 0.94.6. I have been loking for if I could define any
> reducer, since, I have defined no one. I have read something about
> KeyValueSortReducer but, I don'tknow if there's something that extends
> TableReducer or I'm lookging for a wrong way.
> >
> >
> >
>

--047d7bacb770c1f63a04f857efdf--