hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Leon Mergen" <l...@solatis.com>
Subject Re: Hadoop and retrieving data from HDFS
Date Thu, 24 Apr 2008 18:46:37 GMT
On Thu, Apr 24, 2008 at 8:41 PM, Bryan Duxbury <bryan@rapleaf.com> wrote:

> I think what you're saying is that you are mostly interested in data
> locality. I don't think it's done yet, but it would be pretty easy to make
> HBase provide start keys as well as region locations for splits for a
> MapReduce job. In theory, that would give you all the pieces you need to run
> locality-aware processing.


Aha, so that is the definition: locality aware processing. Yeah, that sounds
exactly like what I'm looking for.

So, as far as I understand it, it is (technically) possible, but it's just
not available within hadoop yet?

-- 
Leon Mergen
http://www.solatis.com

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message