Return-Path: X-Original-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Delivered-To: apmail-hadoop-common-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2AB391934B for ; Tue, 29 Mar 2016 05:21:26 +0000 (UTC) Received: (qmail 34378 invoked by uid 500); 29 Mar 2016 05:21:25 -0000 Delivered-To: apmail-hadoop-common-issues-archive@hadoop.apache.org Received: (qmail 34325 invoked by uid 500); 29 Mar 2016 05:21:25 -0000 Mailing-List: contact common-issues-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-issues@hadoop.apache.org Delivered-To: mailing list common-issues@hadoop.apache.org Received: (qmail 34255 invoked by uid 99); 29 Mar 2016 05:21:25 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Mar 2016 05:21:25 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id ABA822C1F5C for ; Tue, 29 Mar 2016 05:21:25 +0000 (UTC) Date: Tue, 29 Mar 2016 05:21:25 +0000 (UTC) From: "Xiaoyu Yao (JIRA)" To: common-issues@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (HADOOP-12916) Allow different Hadoop IPC Call Queue throttling policies with FCQ/BackOff MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HADOOP-12916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HADOOP-12916: -------------------------------- Attachment: HADOOP-12916.05.patch Thanks [~arpitagarwal] and [~szetszwo] for the review. Update the patch that 1) Fixing exception handling when constructing the scheduler instance. 2) Keep the default decay factor and decay windows size to the same as the original FCQ. 3) Enable decay on the average response time for scheduler decision. I don't change the Configuration#getTimeDurations() to return a List because it incurs extra box/unbox overhead. A long array should be good for many cases. > Allow different Hadoop IPC Call Queue throttling policies with FCQ/BackOff > -------------------------------------------------------------------------- > > Key: HADOOP-12916 > URL: https://issues.apache.org/jira/browse/HADOOP-12916 > Project: Hadoop Common > Issue Type: Improvement > Components: ipc > Reporter: Xiaoyu Yao > Assignee: Xiaoyu Yao > Attachments: HADOOP-12916.00.patch, HADOOP-12916.01.patch, HADOOP-12916.02.patch, HADOOP-12916.03.patch, HADOOP-12916.04.patch, HADOOP-12916.05.patch > > > Currently back off policy from HADOOP-10597 is hard coded to base on whether call queue is full. This ticket is open to allow flexible back off policies such as moving average of response time in RPC calls of different priorities. -- This message was sent by Atlassian JIRA (v6.3.4#6332)