hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peter W." <pe...@marketingbrokers.com>
Subject Re: Use HDFS as a long term storage solution?
Date Thu, 06 Sep 2007 19:04:32 GMT
Hello,

It should be possible but I'm not currently doing so. I think this  
method
is how one of the major video sites stores thumbnail images.

Maybe someone with more knowledge can help.

Regards,

Peter W.


Dongsheng Wang wrote:

> now sure about the advantage of using HBase over HDFS, can you give  
> some insights on that?
>
> - dongsheng
>
> Peter W. wrote:
>
> Hello,
>
> Could images be turned into byte arrays and stored in HBase? Also,
> you will need a JVM that
> supports the -d64 flag otherwise you can only allocate up to 2048M to
> each machine.
>
> ...
>
>
> Dongsheng Wang wrote:
>
>>
>> We are looking at using HDFS as a long term storage solution. We
>> want to use it to stored lots of files. The file could be big and
>> small, they are images, videos etc... We only write the files once,
>> and may read them many times. Sounds like it is perfect to use HDFS.

Mime
View raw message