hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jason Lowe (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3942) Timeline store to read events from HDFS
Date Mon, 28 Sep 2015 19:45:05 GMT

    [ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933864#comment-14933864
] 

Jason Lowe commented on YARN-3942:
----------------------------------

Greg wrote:
bq. I was even able to create the problem with the REST/WS endpoint... http://xlabhadnnh2.example.com:8188/ws/v1/applicationhistory/apps/application_1443218824767_0002/appattempts/appattempt_1443218824767_0002_000001/containers/container_1443218824767_0002_01_000001

That looks like a problem with the application history server rather than the timeline server
and the entity file timeline store.  The key exception appears to be this part at the end:
{noformat}
Caused by: org.apache.hadoop.yarn.webapp.WebAppException: Error rendering block: nestLevel=6
expected 5
at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:69)
at org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:77)
at org.apache.hadoop.yarn.webapp.View.render(View.java:235)
at org.apache.hadoop.yarn.webapp.view.HtmlPage$Page.subView(HtmlPage.java:49)
at org.apache.hadoop.yarn.webapp.hamlet.HamletImpl$EImp._v(HamletImpl.java:117)
at org.apache.hadoop.yarn.webapp.hamlet.Hamlet$TD._(Hamlet.java:845)
at org.apache.hadoop.yarn.webapp.view.TwoColumnLayout.render(TwoColumnLayout.java:56)
at org.apache.hadoop.yarn.webapp.view.HtmlPage.render(HtmlPage.java:82)
at org.apache.hadoop.yarn.webapp.Controller.render(Controller.java:212)
at org.apache.hadoop.yarn.server.applicationhistoryservice.webapp.AHSController.app(AHSController.java:38)
{noformat}

Looks like some malformed Hamlet code or something where a block wasn't closed when it should
have been.  Doing a quick JIRA search popped up YARN-3110 which is fixed in 2.8 and appears
to be fixing the same exception.

Jonathan wrote:
bq. Can we wrap the mkdirs command in the EntityFilleTimelineStore to do a exists check on
the directories before doing a mkdirs.

Yeah, that's a good catch.  I'll get a patch up later this week with that fix.

> Timeline store to read events from HDFS
> ---------------------------------------
>
>                 Key: YARN-3942
>                 URL: https://issues.apache.org/jira/browse/YARN-3942
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: timelineserver
>            Reporter: Jason Lowe
>            Assignee: Jason Lowe
>         Attachments: YARN-3942-leveldb.001.patch, YARN-3942-leveldb.002.patch, YARN-3942.001.patch
>
>
> This adds a new timeline store plugin that is intended as a stop-gap measure to mitigate
some of the issues we've seen with ATS v1 while waiting for ATS v2.  The intent of this plugin
is to provide a workable solution for running the Tez UI against the timeline server on a
large-scale clusters running many thousands of jobs per day.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message