hadoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Tell Hadoop to store pairs of files at the same location(s) on HDFS
Date Wed, 05 Dec 2012 17:58:41 GMT
You are probably talking of
https://issues.apache.org/jira/browse/HDFS-2576 and similar JIRAs.
This feature isn't available in HDFS yet, but may arrive soon.

On Wed, Dec 5, 2012 at 11:23 PM, Sigurd Spieckermann
<sigurd.spieckermann@gmail.com> wrote:
> Hi guys,
> I have been wondering if there's a way (hack'ish would be okay too) to tell
> Hadoop that two files shall be stored together at the same location(s). It
> would benefit map-side join performance if it could be done somehow because
> all map tasks would be able to read data from a local copy. Does anyone know
> a way?
> -Sigurd

Harsh J

View raw message