hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yong Zhang (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-10598) Support configurable RPC fair share
Date Mon, 07 Sep 2015 03:59:46 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-10598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14733230#comment-14733230
] 

Yong Zhang commented on HADOOP-10598:
-------------------------------------

Is it in this way, for example, if RPC server receive 10 calls as A, B, B, A, C, C, D, A,
B, C.
then server side will create 4 queues for A, B, C and D.
Q-A: 3 calls
Q-B: 3 calls
Q-C: 3 calls
Q-D: 1 calls
Then RPC server will try to get call in fair way: Q-A, Q-B, Q-C,Q-D, Q-A, Q-B, Q-C, Q-A, Q-B,
Q-C.
Q-A, Q-B, Q-C,Q-D will be kept for a short time (can be configured), then will be deleted.

> Support configurable RPC fair share
> -----------------------------------
>
>                 Key: HADOOP-10598
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10598
>             Project: Hadoop Common
>          Issue Type: Sub-task
>            Reporter: Ming Ma
>
> It will be useful if we can support RPC min fair share on a per user or group basis.
That will be useful for SLA jobs in a shared cluster. It will be complementary to the history-based
soft policy defined in fair queue's history RPC server.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message