hadoop-hdfs-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ravi Prakash <ravi...@ymail.com>
Subject Re: Getting the configuration object for a MapReduce job from the DataNode
Date Mon, 22 Oct 2012 06:00:52 GMT
Hi Adrian,

Please use user@hadoop.apache.org for user-related questions

Which version of Hadoop are you using? Where do you want the object? In a map/reduce task?
For the currently executing job or for a different job?

In 0.23, you can use the RM webservices. https://issues.apache.org/jira/browse/MAPREDUCE-2863
. I'm sorry I wasn't able to find a hosted version of the documentation, but here's the source
which ought to be built easily : http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/HistoryServerRest.apt.vm?revision=1399289&view=markup
. If you'd like the formatted HTML, just build the source using mvn site 


 From: Adrian Suarez <suarezadrian1@gmail.com>
To: mapreduce-dev@hadoop.apache.org 
Sent: Thursday, October 18, 2012 4:23 PM
Subject: Getting the configuration object for a MapReduce job from the DataNode
What's the best way to get the configuration object for a job, assuming
that I only know the job ID? I remember seeing some method or constructor
that creates a configuration object from an XML file, and I know that the
job's configuration file gets saved in the logs directory, but I'm
wondering if there is a more correct way of doing this that doesn't involve
assuming the existence of an XML file with a particular name.
View raw message