hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rocks <nutchmaill...@gmail.com>
Subject Re: Hi,can hbase store picture and video such as blob field ? Any other simply question.
Date Tue, 11 Aug 2009 02:02:56 GMT
And i am still puzzled with the simple question, where is my hbase storage
file in my HDFS ?In the command "bin/hadoop dfs -ls" , i cannot see anything
related to hbase file.

can anyone give me a answer?

On Tue, Aug 11, 2009 at 9:20 AM, Rocks <nutchmaillist@gmail.com> wrote:

> oh´╝îthanks, can you give me a CDNS tools or tutorial to solve the metioned
> problem?
>
>
>
> On Tue, Aug 11, 2009 at 4:20 AM, Ryan Rawson <ryanobjc@gmail.com> wrote:
>
>> HBase can help one overcome the 'small file' problem of HDFS.  But
>> HBase may not be the best methodology once files get beyond a certain
>> size (that size might be in the 10mb+ area).  However that is no
>> longer 'small files' and HDFS would be suitable again.
>>
>> Another aspect to consider is that access for a single row is mediated
>> by a single regionserver, which means if you have extremely high load
>> on only a few rows, you might not achieve scalability.  Caching layers
>> (reverse proxies, cdns) can help solve this. But if you are looking at
>> a high volume, high performance download server that can handle
>> millions of clients asking for the same object, you might need to
>> think a bit more.
>>
>> -ryan
>>
>> On Mon, Aug 10, 2009 at 1:13 PM, Tim Sell<trsell@gmail.com> wrote:
>> > Yes you can store binary data in hbase, all data in hbase is treated
>> > as just raw bytes.
>> > It would probably suit well things like thumbnails? I think youtube
>> > uses bigtable for the thumbnail images of their videos. And they store
>> > their actual videos in cdn's (and gfs for the longtail I guess).
>> >
>> > So if you have a lot of large binaries, you'll probably want just the
>> > links in hbase, with the files elsewhere. Maybe mogilefs is more
>> > suitable then hdfs though, because hdfs doesn't like lots of "small"
>> > files?
>> >
>> > ~Tim.
>> >
>> >
>> > 2009/8/10 Rocks <nutchmaillist@gmail.com>:
>> >> Hi,i want to konw whether hbase can store picture  and video as blob
>> field?
>> >> Maybe I  should store the picture path in it ,and point to the pic or
>> video
>> >> in file system?
>> >> but how to store the pic and video ,how to define the path pointed to
>> the
>> >> file system in top of hadoop? Can anyone give me some suggestion?
>> >> And  i am still uncertain where is my hbase storage file in my HDFS ?In
>> the
>> >> command "bin/hadoop dfs -ls" , i cannot see anything related to hbase
>> file.
>> >> It will be greatly appreciated if you give me some hlep.
>> >>
>> >
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message