hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Xun TANG <tangxun.al...@gmail.com>
Subject Re: Where's downlink.data file?
Date Fri, 03 May 2013 16:14:32 GMT
Anyone has similar experience? Any suggestion welcome. I am stuck here for
a week now...

Thanks,
Alice


On Sun, Apr 28, 2013 at 5:38 PM, Xun TANG <tangxun.alice@gmail.com> wrote:

> According to this link
> http://wiki.apache.org/hadoop/HowToDebugMapReducePrograms
>
> I am trying to find out where the downlink.data file is actually stored.
> I have set the variable keep.failed.task.files to true in mapred-site.xml,
> and hadoop.pipes.command-file.keep to true in the config.xml file that I
> pass to the pipes mapreduce task.
> Yet, there is no downlink.data file that I can locate either locally or on
> hdfs.
>
> I assume from the instructions for debugging that I should run the entire
> task in distributed mapreduce mode, collect the input in downlink.data and
> then run the mapreduce task with just the downlink.data. I am assuming
> 'task working directory' refers to where I ran 'hadoop pipes ...'. I've
> done a 'locate downlink.data' but nothing found.
>
> Am I making some incorrect assumption here? Or anything else needs to be
> set?
>
> I am running Hadoop 1.0.4
>
>
> Thanks,
> Alice
>

Mime
View raw message