hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Prajakta Kalmegh <pkalm...@gmail.com>
Subject Re: Using REST to get ApplicationMaster info
Date Thu, 28 Jun 2012 15:12:16 GMT
Hi Harsh

Can you tell me where can I find my AM logs? I could find the
RM/NM/HistoryServer/Container logs but not AM logs :(

I looked in the RM logs to see if I have any entry for 'Web app /mapreduce'
to see if it actually starts on RM as indicated in the link, but it does
not.

I will file a JIRA once I know where the default value is set for the same.
Maybe instead of removing the misleading links, we can fix them once I know
how to retrieve data from the ApplicationMaster URL.

Regards,
Prajakta


On Thu, Jun 28, 2012 at 8:16 PM, Harsh J <harsh@cloudera.com> wrote:

> As far as I can tell, the MR WebApp, as the name itself indicates on
> its doc page, starts only at the MR AM (which may be running at any
> NM), and it starts as an ephemeral port logged at in the AM logs
> usually as:
>
> INFO Web app /mapreduce started at [PORT]
>
> That it starts its own server with an ephemeral access point makes
> sense, since each job uses its own AM and having a common location may
> not work with the form of REST API documented at your link. Can you
> please file a JIRA to fix the doc and remove the proxy server refs,
> which are misleading?
>
> Do correct me if I'm wrong.
>
> On Thu, Jun 28, 2012 at 6:13 PM, Prajakta Kalmegh <pkalmegh@gmail.com>
> wrote:
> > Hi
> >
> > I am trying to get the ApplicationMaster info using the <http://<proxy
> http
> > address:port>/proxy/{appid}/ws/v1/mapreduce/info> link as described on
> the <
> >
> http://hadoop.apache.org/common/docs/r2.0.0-alpha/hadoop-yarn/hadoop-yarn-site/MapredAppMasterRest.html
> >
> > page.
> >
> > I am able to access and retrieve JSON response for other modules
> > (ResourceManager, NodeManager and HistoryServer). However, I am getting
> > 'Page not found' when I try to use my ResourceManager Http address to
> > access the ApplicationMaster info. I am using <
> > http://localhost:8088/proxy/{appid}/ws/v1/mapreduce/info> to retrieve
> JSON
> > response.
> >
> > The instructions say "The application master should be accessed via the
> > proxy. This proxy is configurable to run either on the resource manager
> or
> > on a separate host."
> >
> > My yarn-default.xml contains:
> >  <property>
> >    <description>The address for the web proxy as HOST:PORT, if this is
> not
> >     given then the proxy will run as part of the RM</description>
> >     <name>yarn.web-proxy.address</name>
> >     <value/>
> >  </property>
> >
> > and I did not set a value explicitly in yarn-site.xml.  Any idea how I
> can
> > get this working? Thanks in advance.
> >
> > Regards,
> > Prajakta
>
>
>
> --
> Harsh J
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message