hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wangda Tan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (YARN-7254) UI and metrics changes related to absolute resource configuration
Date Wed, 11 Oct 2017 17:57:01 GMT

    [ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16200681#comment-16200681
] 

Wangda Tan commented on YARN-7254:
----------------------------------

Thanks [~sunilg], 

This is capacities on UI for the updated patch:
{code}
  Configured Capacity:  <memory:8192, vCores:8>
  Configured Max Capacity:  <memory:0, vCores:0>
  Effective Capacity: <memory:6000, vCores:5> (100.0%)
  Effective Max Capacity: <memory:6000, vCores:12> (100.0%)
{code}

For the configured max capacity, instead of showing 0/0, is it better to show (unlimited)?

Same for REST API:
{code}
<configuredMaxResource>
  <memory>0</memory>
  <vCores>0</vCores>
</configuredMaxResource>
{code}

Can we skip configuredMaxResource showing on REST API when it is not configured? (which is
the truth I think).

bq. Configured was 8GB and 8 Cores and cluster capacity was 5.8GB and 12 cores. Since this
value is lesser when we try with Default Calculator, effectiveMinRatio is kicking in and reducing
the whole res down.

I think we need to fix this in a separate patch: effective ratio need to be calculated for
*individual resource types*.

bq. cc and javac are due to UI build. Unrelated to the patch. I ll check test failures.

Are cc/javac issues are fixed in later patches of trunk? If so, do you think is it better
to sync this branch to latest trunk since we need to do this sooner or later?

> UI and metrics changes related to absolute resource configuration
> -----------------------------------------------------------------
>
>                 Key: YARN-7254
>                 URL: https://issues.apache.org/jira/browse/YARN-7254
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: capacity scheduler
>            Reporter: Sunil G
>            Assignee: Sunil G
>         Attachments: YARN-7254.001.patch, YARN-7254.002.patch, YARN-7254.YARN-5881.002.patch,
YARN-7254.YARN-5881.003.patch
>
>
> Impact on UI and metrics related to absolute resource configuration on CS



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org


Mime
View raw message