hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Dunning <tdunn...@veoh.com>
Subject Re: [core-user] Processing binary files Howto??
Date Mon, 17 Mar 2008 18:18:51 GMT

You can certainly do this, but you are simply repeating the work that hadoop
developers have already done.

Can you say what kind of satellite data you will be processing?  If it is
imagery, then I would imagine that Google's use of map-reduce to prepare
image tiles for Google maps would be an interesting example.

On 3/17/08 11:12 AM, "Alfonso Olias Sanz" <alfonso.olias.sanz@gmail.com>

> Another thing we want to considerer is to make our simple grid aware
> of the data location in order to move the task to the node which
> contains the data. A way of getting the hostname were the
> filename-block is and then calling the dfs API from that node.

View raw message