hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuan Gong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3700) ATS Web Performance issue at load time when large number of jobs
Date Wed, 27 May 2015 19:37:26 GMT

    [ https://issues.apache.org/jira/browse/YARN-3700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14561576#comment-14561576
] 

Xuan Gong commented on YARN-3700:
---------------------------------

bq. getAllApplications -> getApplications?

Done

bq. Can we use -1 or 0 instead of Long.MAX_VALUE to indicate appsNum not provided?

Can not. The default value for GetApplicationsRequest-->getLimit() is Long.MAX_VALUE

Also, test the patch locally.
* Set yarn.timeline-service.generic-application-history.max-applications as 1
* run two MR pi examples
* go to http://localhost:8188/applicationhistory/apps and http://localhost:8188/ws/v1/applicationhistory/apps.
Both of them are showing only one application which is the latest application
* http://localhost:8188/applicationhistory/apps?apps.num=2 and http://localhost:8188/ws/v1/applicationhistory/apps?limit=2.
Both of them are showing two applications

> ATS Web Performance issue at load time when large number of jobs
> ----------------------------------------------------------------
>
>                 Key: YARN-3700
>                 URL: https://issues.apache.org/jira/browse/YARN-3700
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager, webapp, yarn
>            Reporter: Xuan Gong
>            Assignee: Xuan Gong
>         Attachments: YARN-3700.1.patch, YARN-3700.2.1.patch, YARN-3700.2.2.patch, YARN-3700.2.patch,
YARN-3700.3.patch, YARN-3700.4.patch
>
>
> Currently, we will load all the apps when we try to load the yarn timelineservice web
page. If we have large number of jobs, it will be very slow.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message