hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vrushali C (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-9335) [atsv2] Restrict the number of elements held in timeline collector when backend is unreachable for async calls
Date Thu, 04 Apr 2019 05:49:00 GMT

    [ https://issues.apache.org/jira/browse/YARN-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809528#comment-16809528
] 

Vrushali C commented on YARN-9335:
----------------------------------

Hi Abhishek,
Could you check applying this patch as well? It seems to not work for me. Do you see anything
incorrect in my command below:

{code}
[tw-mbp13-channapattan hadoop (trunk)]$ git apply -p0 ~/Downloads/YARN-9335.003.patch
error: a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/conf/YarnConfiguration.java:
No such file or directory
error: a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml:
No such file or directory
error: a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/main/java/org/apache/hadoop/yarn/server/timelineservice/collector/TimelineCollector.java:
No such file or directory
error: a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/test/java/org/apache/hadoop/yarn/server/timelineservice/collector/TestTimelineCollector.java:
No such file or directory
[tw-mbp13-channapattan hadoop (trunk)]$ git apply -p1 ~/Downloads/YARN-9335.003.patch
error: patch failed: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/main/java/org/apache/hadoop/yarn/server/timelineservice/collector/TimelineCollector.java:221
error: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice/src/main/java/org/apache/hadoop/yarn/server/timelineservice/collector/TimelineCollector.java:
patch does not apply
[tw-mbp13-channapattan hadoop (trunk)]$
{code}


> [atsv2] Restrict the number of elements held in timeline collector when backend is unreachable
for async calls
> --------------------------------------------------------------------------------------------------------------
>
>                 Key: YARN-9335
>                 URL: https://issues.apache.org/jira/browse/YARN-9335
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>            Reporter: Vrushali C
>            Assignee: Abhishek Modi
>            Priority: Major
>         Attachments: YARN-9335.001.patch, YARN-9335.002.patch, YARN-9335.003.patch
>
>
> For ATSv2 , if the backend is unreachable, the number/size of data held in timeline collector's
memory increases significantly. This is not good for the NM memory. 
> Filing jira to set a limit on how many/much should be retained by the timeline collector
in memory in case the backend is not reachable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message