hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhijie Shen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1
Date Wed, 14 Jan 2015 20:15:37 GMT

    [ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277597#comment-14277597
] 

Zhijie Shen commented on YARN-2928:
-----------------------------------

One correlated issue I want to raise here is aggregated log service. Currently, only JHS is
serving the aggregated logs for completed MR jobs and control the log file retention. It doesn't
cover the different workloads on YARN as well as the long running services that will never
end. We thought of making ATS the hub to serve aggregated logs before, but didn't achieve
it in the time frame of ATS current gen.

Therefore, though aggregated log service is the part of the major goal of ATS next gen - scalability,
I hope we'd better take into account in the future, when designing the reader and GUI.

> Application Timeline Server (ATS) next gen: phase 1
> ---------------------------------------------------
>
>                 Key: YARN-2928
>                 URL: https://issues.apache.org/jira/browse/YARN-2928
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: timelineserver
>            Reporter: Sangjin Lee
>            Assignee: Sangjin Lee
>            Priority: Critical
>         Attachments: ATSv2.rev1.pdf, ATSv2.rev2.pdf
>
>
> We have the application timeline server implemented in yarn per YARN-1530 and YARN-321.
Although it is a great feature, we have recognized several critical issues and features that
need to be addressed.
> This JIRA proposes the design and implementation changes to address those. This is phase
1 of this effort.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message