hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From lars hofhansl <la...@apache.org>
Subject Re: Storing images in Hbase
Date Fri, 11 Jan 2013 03:51:03 GMT
Interesting. That's close to a PB if my math is correct.
Is there a write up about this somewhere? Something that we could link from the HBase homepage?

-- Lars


----- Original Message -----
From: Jack Levin <magnito@gmail.com>
To: user@hbase.apache.org
Cc: Andrew Purtell <apurtell@apache.org>
Sent: Thursday, January 10, 2013 9:24 AM
Subject: Re: Storing images in Hbase

We stored about 1 billion images into hbase with file size up to 10MB.
Its been running for close to 2 years without issues and serves
delivery of images for Yfrog and ImageShack.  If you have any
questions about the setup, I would be glad to answer them.

-Jack

On Sun, Jan 6, 2013 at 1:09 PM, Mohit Anchlia <mohitanchlia@gmail.com> wrote:
> I have done extensive testing and have found that blobs don't belong in the
> databases but are rather best left out on the file system. Andrew outlined
> issues that you'll face and not to mention IO issues when compaction occurs
> over large files.
>
> On Sun, Jan 6, 2013 at 12:52 PM, Andrew Purtell <apurtell@apache.org> wrote:
>
>> I meant this to say "a few really large values"
>>
>> On Sun, Jan 6, 2013 at 12:49 PM, Andrew Purtell <apurtell@apache.org>
>> wrote:
>>
>> > Consider if the split threshold is 2 GB but your one row contains 10 GB
>> as
>> > really large value.
>>
>>
>>
>>
>>  --
>> Best regards,
>>
>>    - Andy
>>
>> Problems worthy of attack prove their worth by hitting back. - Piet Hein
>> (via Tom White)
>>


Mime
View raw message