hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Graves (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-4102) job counters not available in Jobhistory webui for killed jobs
Date Tue, 08 May 2012 14:51:49 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13270501#comment-13270501
] 

Thomas Graves commented on MAPREDUCE-4102:
------------------------------------------

Thanks, the changes here look good.  Would you also mind updating the web services job counters
to handle the same thing? Unfortunately the counter code between the web services and the
web ui is not common yet. 

 curl  -i 'http://jobhistoyrserver:19888/ws/v1/history/mapreduce/jobs/job_1336487148705_0002/counters'
HTTP/1.1 500 Internal Server Error
Content-Type: application/json
Transfer-Encoding: chunked
Server: Jetty(6.1.26)

{"RemoteException":{"exception":"NullPointerException","javaClassName":"java.lang.NullPointerException"}}

Otherwise we could file a separate jira to handle this too if you don't think you can get
to it.


                
> job counters not available in Jobhistory webui for killed jobs
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-4102
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4102
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: webapps
>    Affects Versions: 0.23.2, 2.0.0
>            Reporter: Thomas Graves
>            Assignee: Bhallamudi Venkata Siva Kamesh
>         Attachments: MAPREDUCE-4102-1.patch, MAPREDUCE-4102.patch, MAPREDUCE-4102.patch
>
>
> Run a simple wordcount or sleep, and kill the job before it finishes.  Go to the job
history web ui and click the "Counters" link for that job. It displays "500 error".
> The job history log has:
> Caused by: com.google.inject.ProvisionException: Guice provision errors:
> 2012-04-03 19:42:53,148 ERROR org.apache.hadoop.yarn.webapp.Dispatcher: error handling
URI: /jobhistory/jobcounters/job_1333482028750_0001
> java.lang.reflect.InvocationTargetException
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
> ...
> ..
> ...
> 1) Error injecting constructor, java.lang.NullPointerException
>   at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:56)
>   while locating org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock
> ...
> ..
> ...
> Caused by: java.lang.NullPointerException    at org.apache.hadoop.mapreduce.counters.AbstractCounters.incrAllCounters(AbstractCounters.java:328)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.getCounters(CountersBlock.java:188)
>     at org.apache.hadoop.mapreduce.v2.app.webapp.CountersBlock.<init>(CountersBlock.java:57)
>     at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> There are task counters available if you drill down into successful tasks though.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message