hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peter W." <pe...@marketingbrokers.com>
Subject Re: Use HDFS as a long term storage solution?
Date Thu, 06 Sep 2007 19:04:32 GMT

It should be possible but I'm not currently doing so. I think this  
is how one of the major video sites stores thumbnail images.

Maybe someone with more knowledge can help.


Peter W.

Dongsheng Wang wrote:

> now sure about the advantage of using HBase over HDFS, can you give  
> some insights on that?
> - dongsheng
> Peter W. wrote:
> Hello,
> Could images be turned into byte arrays and stored in HBase? Also,
> you will need a JVM that
> supports the -d64 flag otherwise you can only allocate up to 2048M to
> each machine.
> ...
> Dongsheng Wang wrote:
>> We are looking at using HDFS as a long term storage solution. We
>> want to use it to stored lots of files. The file could be big and
>> small, they are images, videos etc... We only write the files once,
>> and may read them many times. Sounds like it is perfect to use HDFS.

View raw message