hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stack <st...@duboce.net>
Subject Re: advice needed on storing large objects on hdfs
Date Mon, 30 Jan 2012 05:42:07 GMT
On Sun, Jan 29, 2012 at 8:36 PM, Rohit Kelkar <rohitkelkar@gmail.com> wrote:
> Hi Loan, this seems interesting. But in your approach I have a follow
> up question -  would I be able to take advantage of data locality
> while running map-reduce tasks? My understanding is that the locality
> would be with respect to the references to those objects and not the
> actual objects themselves.

If you are mapreducing against hbase, locality should be respected:
i.e. the <5mb objects should be on the local regionserver.  The bigger
stuff maybe local -- it would depend on how it was written.

Not sure what you mean above when you talk of references vs actual objects.


View raw message