Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 54330200BB6 for ; Fri, 21 Oct 2016 04:02:00 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 52D11160AF5; Fri, 21 Oct 2016 02:02:00 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 98BB1160AE0 for ; Fri, 21 Oct 2016 04:01:59 +0200 (CEST) Received: (qmail 39823 invoked by uid 500); 21 Oct 2016 02:01:58 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 39781 invoked by uid 99); 21 Oct 2016 02:01:58 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 21 Oct 2016 02:01:58 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 942EC2C014E for ; Fri, 21 Oct 2016 02:01:58 +0000 (UTC) Date: Fri, 21 Oct 2016 02:01:58 +0000 (UTC) From: "Hudson (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-16752) Upgrading from 1.2 to 1.3 can lead to replication failures due to difference in RPC size limit MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 21 Oct 2016 02:02:00 -0000 [ https://issues.apache.org/jira/browse/HBASE-16752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15593677#comment-15593677 ] Hudson commented on HBASE-16752: -------------------------------- SUCCESS: Integrated in Jenkins build HBase-1.3-JDK7 #48 (See [https://builds.apache.org/job/HBase-1.3-JDK7/48/]) HBASE-16752 addendum. Do not retry large request for client versions (garyh: rev 3efa3b911294fe0a42440e2aef3865898d91acc0) * (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/ipc/RpcServer.java * (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/exceptions/RequestTooBigException.java > Upgrading from 1.2 to 1.3 can lead to replication failures due to difference in RPC size limit > ---------------------------------------------------------------------------------------------- > > Key: HBASE-16752 > URL: https://issues.apache.org/jira/browse/HBASE-16752 > Project: HBase > Issue Type: Bug > Components: Replication, rpc > Affects Versions: 2.0.0, 1.3.0 > Reporter: Ashu Pachauri > Assignee: Ashu Pachauri > Fix For: 2.0.0, 1.3.0, 1.4.0 > > Attachments: HBASE-16752.V1.patch, HBASE-16752.V2.patch, HBASE-16752.addendum.patch > > > In HBase 1.2, we don't limit size of a single RPC but in 1.3 we limit it by default to 256 MB. This means that during upgrade scenarios (or when source is 1.2 peer is already on 1.3), it's possible to encounter a situation where we try to send an rpc with size greater than 256 MB because we never unroll a WALEdit while sending replication traffic. > RpcServer throws the underlying exception locally, but closes the connection with returning the underlying error to the client, and client only sees a "Broken pipe" error. > I am not sure what is the proper fix here (or if one is needed) to make sure this does not happen, but we should return the underlying exception to the RpcClient, because without it, it can be difficult to diagnose the problem, especially for someone new to HBase. -- This message was sent by Atlassian JIRA (v6.3.4#6332)