Return-Path: X-Original-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id CFF1810203 for ; Fri, 28 Jun 2013 21:21:22 +0000 (UTC) Received: (qmail 51521 invoked by uid 500); 28 Jun 2013 21:21:21 -0000 Delivered-To: apmail-hadoop-hdfs-dev-archive@hadoop.apache.org Received: (qmail 51405 invoked by uid 500); 28 Jun 2013 21:21:20 -0000 Mailing-List: contact hdfs-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-dev@hadoop.apache.org Received: (qmail 51295 invoked by uid 99); 28 Jun 2013 21:21:20 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 28 Jun 2013 21:21:20 +0000 Date: Fri, 28 Jun 2013 21:21:20 +0000 (UTC) From: "Suresh Srinivas (JIRA)" To: hdfs-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (HDFS-4942) Add retry cache support in Namenode MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Suresh Srinivas created HDFS-4942: ------------------------------------- Summary: Add retry cache support in Namenode Key: HDFS-4942 URL: https://issues.apache.org/jira/browse/HDFS-4942 Project: Hadoop HDFS Issue Type: Improvement Components: ha, namenode Reporter: Suresh Srinivas Assignee: Suresh Srinivas In current HA mechanism with FailoverProxyProvider and non HA setups with RetryProxy retry a request from the RPC layer. If the retried request has already been processed at the namenode, the subsequent attempts fail for idempotent operations such as create, append, delete, rename etc. This will cause application failures during HA failover, network issues etc. This jira proposes adding retry cache at the namenode to handle these failures. More details in the comments. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira