hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kim young ill <khi...@googlemail.com>
Subject Re: Storing extremely large size file
Date Tue, 17 Apr 2012 18:07:02 GMT
i plan to move some data from relational-db to hbase, most of them are
binary with some hundreds KBs, would like to hear some
best-practice/tuning  for storing this kind of data
thanx

On Tue, Apr 17, 2012 at 7:50 PM, Jean-Daniel Cryans <jdcryans@apache.org>wrote:

> Yes, you fine tuned it properly :)  But in general I wouldn't
> recommend it to new users.
>
> J-D
>
> On Tue, Apr 17, 2012 at 10:47 AM, Jack Levin <magnito@gmail.com> wrote:
> > Whats wrong with that size?  We store > 15MB routinely into our image
> hbase.
> >
> > -Jack
> >
> > On Tue, Apr 17, 2012 at 10:46 AM, Jean-Daniel Cryans
> > <jdcryans@apache.org> wrote:
> >> Make sure the config is changed client-side not server-side.
> >>
> >> Also you might not want to store 12MB values in HBase.
> >>
> >> J-D
> >>
> >> On Tue, Apr 17, 2012 at 6:06 AM, vishnupriyaa <vpatoffice@gmail.com>
> wrote:
> >>>
> >>> I want to save a file of size 12MB but an exception occuring like this
> >>> KeyValue size too large.
> >>> I have set the value of hbase.client.keyvalue.maxsize in
> hbase-site.xml and
> >>> hbase-default.xml to 3GB
> >>> but the default value 10MB is taking for
> hbase.client.keyvalue.maxsize.How
> >>> could I change the value of hbase.client.keyvalue.maxsize or how to
> store
> >>> the file of extremely large size.
> >>> --
> >>> View this message in context:
> http://old.nabble.com/Storing-extremely-large-size-file-tp33701522p33701522.html
> >>> Sent from the HBase User mailing list archive at Nabble.com.
> >>>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message