hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Xuan Gong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-3700) ATS Web Performance issue at load time when large number of jobs
Date Wed, 27 May 2015 19:37:26 GMT

    [ https://issues.apache.org/jira/browse/YARN-3700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14561576#comment-14561576

Xuan Gong commented on YARN-3700:

bq. getAllApplications -> getApplications?


bq. Can we use -1 or 0 instead of Long.MAX_VALUE to indicate appsNum not provided?

Can not. The default value for GetApplicationsRequest-->getLimit() is Long.MAX_VALUE

Also, test the patch locally.
* Set yarn.timeline-service.generic-application-history.max-applications as 1
* run two MR pi examples
* go to http://localhost:8188/applicationhistory/apps and http://localhost:8188/ws/v1/applicationhistory/apps.
Both of them are showing only one application which is the latest application
* http://localhost:8188/applicationhistory/apps?apps.num=2 and http://localhost:8188/ws/v1/applicationhistory/apps?limit=2.
Both of them are showing two applications

> ATS Web Performance issue at load time when large number of jobs
> ----------------------------------------------------------------
>                 Key: YARN-3700
>                 URL: https://issues.apache.org/jira/browse/YARN-3700
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: resourcemanager, webapp, yarn
>            Reporter: Xuan Gong
>            Assignee: Xuan Gong
>         Attachments: YARN-3700.1.patch, YARN-3700.2.1.patch, YARN-3700.2.2.patch, YARN-3700.2.patch,
YARN-3700.3.patch, YARN-3700.4.patch
> Currently, we will load all the apps when we try to load the yarn timelineservice web
page. If we have large number of jobs, it will be very slow.

This message was sent by Atlassian JIRA

View raw message