hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lord Khan Han <khanuniver...@gmail.com>
Subject Re: Hbase export / import Why doubling the Table Size ?
Date Sat, 10 Dec 2011 00:05:30 GMT
Thanks for your time..

Is there any reliable way to copy table between these cluster instead of
export/import?



On Sat, Dec 10, 2011 at 1:39 AM, lars hofhansl <lhofhansl@yahoo.com> wrote:

> Hmm... I'm afraid I am out of options. If you want you can try to copy the
> table
> from CHD3u2 and your CDH3B4 system, and see if the size remains doubled.
>
> Does this happen with very small table, too? If so, you could take a small
> sample
> HFile and upload it (both the CHD3B4 and CDH3u2 versions) somewhere so
> that we can have a look.
>
>
> -- Lars
>
>
> ----- Original Message -----
> From: Lord Khan Han <khanuniverse1@gmail.com>
> To: user@hbase.apache.org; lars hofhansl <lhofhansl@yahoo.com>
> Cc:
> Sent: Friday, December 9, 2011 2:45 PM
> Subject: Re: Hbase export / import Why doubling the Table Size ?
>
> in same configured cluster (carbon copy)  when I made import  there is no
> increas on size.. same size..
>
> problem in the cdh3u2..
>
>
> On Sat, Dec 10, 2011 at 12:42 AM, lars hofhansl <lhofhansl@yahoo.com>
> wrote:
>
> > What happens when you export/import into the same (CDH3B4) cluster using
> a
> > new table name?
> > Does the size double as well?
> >
> >
> >
> > ----- Original Message -----
> > From: Lord Khan Han <khanuniverse1@gmail.com>
> > To: user@hbase.apache.org; lars hofhansl <lhofhansl@yahoo.com>
> > Cc:
> > Sent: Friday, December 9, 2011 2:27 PM
> > Subject: Re: Hbase export / import Why doubling the Table Size ?
> >
> > I flush  ed  and major_compact  ed ..  nothing changed...   i am stuck
> this
> > last two days...:(  any idea?
> >
> >
> > On Sat, Dec 10, 2011 at 12:11 AM, Lord Khan Han <khanuniverse1@gmail.com
> > >wrote:
> >
> > > Now flushed  and compacting again..
> > >
> > > one more clue:
> > >
> > > I tested to import CDH3B4 (same as exported cluster) with lzo..  all is
> > > okay.. table size is same..
> > > than I upgrade to cdh3u2  table also is ok and same size..
> > >
> > > But when I try to import in cdh3u2  this size doubling happens..
> > >
> > >
> > >
> > >
> > > On Sat, Dec 10, 2011 at 12:07 AM, Lord Khan Han <
> khanuniverse1@gmail.com
> > >wrote:
> > >
> > >> I made major_compact but not flush...  will do now with flush..
> > >>
> > >>
> > >>
> > >> On Fri, Dec 9, 2011 at 11:58 PM, lars hofhansl <lhofhansl@yahoo.com
> > >wrote:
> > >>
> > >>> Can you try flushing and compacting the table? How did you measure
> the
> > >>> size?
> > >>>
> > >>> Both can be done from the shell using the 'flush' and 'major_compact'
> > >>> commands, resp.
> > >>>
> > >>>
> > >>>
> > >>> ----- Original Message -----
> > >>> From: Lord Khan Han <khanuniverse1@gmail.com>
> > >>> To: user@hbase.apache.org
> > >>> Cc:
> > >>> Sent: Friday, December 9, 2011 1:50 PM
> > >>> Subject: Hbase export / import Why doubling the Table Size ?
> > >>>
> > >>> Hi ,
> > >>>
> > >>> We are usng CDH3B4  and want to upgrade to CDH3u2.  Before doing this
> > >>> we make a separate cluster with same config and installed CDH3u2.
> > >>>
> > >>> We exported our hbase table from cdh3b4  cluster  and import it to
> the
> > >>> new cdh3u2  cluster. Table is LZO and both cluster config is same.
> > >>>
> > >>> After import finished hbase table size doubled!! even its configured
> > >>> to use LZO.  We changed table to snappy  import again and same
> result.
> > >>> Table size multiplied x 2  in new cdh3u2  cluster.
> > >>>
> > >>> We didnt find why ? Is there any ideas for this ?
> > >>>
> > >>> thanks
> > >>>
> > >>> Khan
> > >>>
> > >>>
> > >>
> > >
> >
> >
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message