Mailing-List: contact user-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of doug.meil@explorysmedical.com
 designates 65.55.88.15 as permitted sender)
Received-SPF: pass (mail16-tx2: domain of explorysmedical.com designates
 157.56.244.181 as permitted sender) client-ip=157.56.244.181;
 envelope-from=doug.meil@explorysmedical.com;
 helo=CH1PRD0410HT001.namprd04.prod.outlook.com ;.outlook.com ;
From: Doug Meil <doug.meil@explorysmedical.com>
To: "user@hbase.apache.org" <user@hbase.apache.org>
Subject: Re: length and size of a column family name or qualifier vs. amount
 of disk storage
Thread-Topic: length and size of a column family name or qualifier vs.
 amount of disk storage
Thread-Index: AQHM6z7f2PZGZTC3QE2Q+D1fWukcNpY8qQyA//+2pwA=
Date: Tue, 14 Feb 2012 18:18:11 +0000
Message-ID: <CB600F5A.24958%doug.meil@explorysmedical.com>
In-Reply-To: 
 <CAGpTDNdtWueVfwFSeQoPhJoOLs3j+oAw5_GFQmso+TaCjSkCfw@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
Content-Type: text/plain; charset="us-ascii"
Content-ID: <6A0E45728AA6F04A8701D6E1DBF6CD4E@namprd04.prod.outlook.com>
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0


Also see here...

http://hbase.apache.org/book.html#keyvalue

Compression will make it better on disk, but it will inflate over the wire.


On 2/14/12 12:40 PM, "Jean-Daniel Cryans" <jdcryans@apache.org> wrote:

>> We are assuming the longer cf/qual would be written to HDFS billions of
>> times and would be wasteful.  Is that a correct assumption?
>
>Yes, also that's covered a bit in:
>http://hbase.apache.org/book.html#keysize
>
>>
>> Does the answer change if you use Snappy compression?
>
>Any compression will make it better, also have a look at this jira
>which was recently committed to trunk (adding prefix compression):
>https://issues.apache.org/jira/browse/HBASE-4218
>
>J-D
>