Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hbase-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of anty.rao@gmail.com designates
 209.85.222.195 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=RIXuIubnZMthi8hfebQXwj6KaaHAAX7dmx6AQWNOiYY5EeyfTZE+01Yj7pvpHH6c7J
         AHFILHY1+ZkYQmYpfkoNqZtZpykVNHBbvKYHSC9pk3MwbyXaWy/ZoLZU2SCl+2cDBuqs
         Ah6byNnKZDohPK1IPAHraJ5PomuzBXUtYL4yU=
MIME-Version: 1.0
In-Reply-To: <d1f4cc950910110151g7276ac2amb78a944b75f8343c@mail.gmail.com>
References: <d1f4cc950910102254p21cec758q456032589781913c@mail.gmail.com>
	 <7c962aed0910102354o33e637a7k49c53851395861bd@mail.gmail.com>
	 <d1f4cc950910110151g7276ac2amb78a944b75f8343c@mail.gmail.com>
Date: Thu, 15 Oct 2009 16:35:29 +0800
Message-ID: <d1f4cc950910150135h6904be3cgf97988c141e7746e@mail.gmail.com>
Subject: Re: about HBASE-48
From: Anty <anty.rao@gmail.com>
To: hbase-user@hadoop.apache.org
Content-Type: multipart/alternative; boundary=00504502964d6a1a670475f52930

--00504502964d6a1a670475f52930
Content-Type: text/plain; charset=ISO-8859-1

Hi:
       stack.
       I did the test last time assuming the talbe xyz was a new table,does
the script also works if the table xyz already exists?

 ./bin/hbase org.jruby.Main bin/loadtable.rb xyz /tmp/testWritingPEData/


On Sun, Oct 11, 2009 at 4:51 PM, Anty <anty.rao@gmail.com> wrote:

> Hi:
>       stack,thanks for your replying.
>       I just use the deault hash partitioner.I am a HBase newbie,but i will
> do my best to work on this issue fellowing HBASE-1901.
>
> On Sun, Oct 11, 2009 at 2:54 PM, stack <stack@duboce.net> wrote:
>
>> On Sat, Oct 10, 2009 at 10:54 PM, Anty <anty.rao@gmail.com> wrote:
>>
>> > Hi:
>> >    statck
>> >     i did some tests on bulk load tools of HBASE-48.
>> >
>>
>> Thanks for trying it out.
>>
>>
>> > I took files made by TestHFileOutputFormat test and passed them to the
>> > script you wrote.It did works ,but it seems to be something unusual.For
>> > each
>> > region ,the STARTKEY and ENDKEY is nearly the same,the ENDKY is bigger
>> than
>> > STARTKEY by nearly 1,e.g.
>> >  STARTKEY=>'0000009447',ENDKY=>'0000009448';
>> >  STARTKEY=>'0000020476',ENDKY=>'0000020477';
>> > ...
>> >
>> >
>> Did you do your own partitioner or just use default hash partitioner?
>>
>>
>>
>> >        i also have some doubts about TestHFileOutputFormat,the default
>> > partitioner is hash partitioner,however ,the hash partitioner can't meet
>> > requirements of TestHFileOutputFormat ,just as you said we need to
>> ensure a
>> > total ordering of all keys and we need to supply a partitioner that does
>> > total ordering(but you didn't add a new  partitioner in
>> > TestHFileOutputFormat).
>> >
>>
>> This is broke then as you point out.   We should make something like what
>> is
>> described in https://issues.apache.org/jira/browse/HBASE-1901 for
>> TestHFileOutputFormat?
>>
>>
>>
>>
>> >   so ,I think TestHFileOutputFormat use the hash partitionar ,it does
>> not
>> > do  totoal ordering,different regions would have rows intercross ,which
>> is
>> > not correct for hbase.And I found the firstKey,lastKey of the files mady
>> by
>> > TestHFileOutputFormat is indeed intercross.
>> >    if the bulk tools is just the beginning,needed further improvement?I
>> > think the bulk tools is very usefull.
>> >
>> >
>> Can you help us improve it?  What do you think we need to do next
>> (hbase-901?)
>>
>> Thanks for writing Anty Rao.
>> St.Ack
>>
>
>
>
> --
> Anty Rao
>


-- 
Anty Rao

--00504502964d6a1a670475f52930--