Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of nanhengwu@gmail.com
 designates 209.85.210.169 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type:content-transfer-encoding;
        b=Y9U087ykpue+/bqXos/BRUhBSWQ6pG6RDEzp3Sa6Ol0abcmpGFGN+7YEvmTjVbhVUw
         AMJz53dwHmFQycdUL2t2bE5hhMC7hPsKAEVqRA6KO4bM56h5v+YREucOcWCIfYr9sOzz
         qY1/tHRiuPD76krC+5fSjAeHmAQbLQC888/cs=
MIME-Version: 1.0
In-Reply-To: <AANLkTikjLiWsQQmZq=4ETz5yA9swf8DD+aQmtoGHU2A-@mail.gmail.com>
References: <AANLkTikUy-g_=rEbySY7BTuJfkch8NByTahnHpHCjMQT@mail.gmail.com>
	<AANLkTikjLiWsQQmZq=4ETz5yA9swf8DD+aQmtoGHU2A-@mail.gmail.com>
Date: Thu, 27 Jan 2011 21:08:50 -0800
Message-ID: <AANLkTimEWNbZ6=DL7i=4myvXytrw6sA0Se8HmUBZSsL3@mail.gmail.com>
Subject: Re: Use loadtable.rb with compressed data?
From: Nanheng Wu <nanhengwu@gmail.com>
To: user@hbase.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Hi Stack, thanks for the answers! I am reasonably sure the
partitioning is OK because I just ran the same MR job with compression
turned off and everything works. I'd like to move to 0.90 but for the
short term I am stuck with 0.20. Is there anything I can do, maybe
copy some files from the 0.90 branch and tweak them to run on 0.20?
Please advice. thank you!

On Thu, Jan 27, 2011 at 9:04 PM, Stack <stack@duboce.net> wrote:
> loadtable.rb doesn't care about file content; it just moves files and
> updates .META.
>
> You sure you did the partitioning correctly? =A0Not seeing anything
> would come of incorrectly done partitioner. =A0There may also have been
> a bug in partitioner around this time. =A0Can you move to 0.90.0? =A0Bulk
> uploader is much improved there (It was rewritten between 0.20.6 and
> 0.90.0 and the new implementation has been given a much better
> airing).
>
> Yours,
> St.Ack
>
> On Thu, Jan 27, 2011 at 8:54 PM, Nanheng Wu <nanhengwu@gmail.com> wrote:
>> Hi,
>>
>> I am using hbase 0.20.6. =A0Is it possible for the loadtable.rb script
>> to create the table from compressed output? I have a MR job where the
>> reducer outputs Gzip compressed HFiles. When I ran loadtable.rb it
>> didn't have any complaints and seemed to update the meta data table
>> correctly. But when I tried to query against the table no data would
>> come back (scan show 0 zero etc). Does anyone know if it's possible?
>> or If I must create tables from compressed HFIles directly, what other
>> options do I have besides the script? Thanks!
>>
>