hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ming Ma (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-13189) FairCallQueue makes callQueue larger than the configured capacity.
Date Fri, 10 Jun 2016 23:38:21 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-13189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15325511#comment-15325511

Ming Ma commented on HADOOP-13189:

Thanks Konstantin. Did you use https://issues.apache.org/jira/browse/HADOOP-10285 to change
call CallQueue?

bq. when all requests go only into the high priority queue one should probably switch to the
default queue as FairCallQueue functionality is not utilized.

This only happens at a given point of time, with FairCallQueue is useful in other times on
the same NN.

> FairCallQueue makes callQueue larger than the configured capacity.
> ------------------------------------------------------------------
>                 Key: HADOOP-13189
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13189
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: ipc
>    Affects Versions: 2.6.0
>            Reporter: Konstantin Shvachko
>            Assignee: Vinitha Reddy Gankidi
>         Attachments: HADOOP-13189.001.patch, HADOOP-13189.002.patch, HADOOP-13189.003.patch
> {{FairCallQueue}} divides {{callQueue}} into multiple (4 by default) sub-queues, with
each sub-queue corresponding to a different level of priority. The constructor for {{FairCallQueue}}
takes the same parameter {{capacity}} as the default CallQueue implementation, and allocates
all its sub-queues of size {{capacity}}. With 4 levels of priority (sub-queues) by default
it results in the total callQueue size 4 times larger than it should be based on the configuration.
> {{capacity}} should be divided by the number of sub-queues at some place.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message