Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id D4ABC200B62 for ; Fri, 29 Jul 2016 05:41:22 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id D34B8160AA9; Fri, 29 Jul 2016 03:41:22 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 254B7160A85 for ; Fri, 29 Jul 2016 05:41:21 +0200 (CEST) Received: (qmail 59027 invoked by uid 500); 29 Jul 2016 03:41:21 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 58974 invoked by uid 99); 29 Jul 2016 03:41:21 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 29 Jul 2016 03:41:21 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id CA1DB2C0D66 for ; Fri, 29 Jul 2016 03:41:20 +0000 (UTC) Date: Fri, 29 Jul 2016 03:41:20 +0000 (UTC) From: "stack (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-15638) Shade protobuf MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 29 Jul 2016 03:41:23 -0000 [ https://issues.apache.org/jira/browse/HBASE-15638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15398663#comment-15398663 ] stack commented on HBASE-15638: ------------------------------- Ok. Putting this aside for the moment. Let me upload latest. Am going to work on purge/narrowing our pb references in a sub issue next. > Shade protobuf > -------------- > > Key: HBASE-15638 > URL: https://issues.apache.org/jira/browse/HBASE-15638 > Project: HBase > Issue Type: Bug > Components: Protobufs > Reporter: stack > Assignee: stack > Priority: Critical > Attachments: 15638v2.patch, HBASE-15638.master.001.patch, HBASE-15638.master.002.patch, HBASE-15638.master.003 (1).patch, HBASE-15638.master.003 (1).patch, HBASE-15638.master.003 (1).patch, HBASE-15638.master.003.patch, HBASE-15638.master.003.patch, HBASE-15638.master.004.patch, HBASE-15638.master.005.patch, HBASE-15638.master.006.patch, HBASE-15638.master.007.patch, HBASE-15638.master.007.patch, HBASE-15638.master.008.patch, as.far.as.server.patch > > > Shade protobufs so we can move to a different version without breaking the world. We want to get up on pb3 because it has unsafe methods that allow us save on copies; it also has some means of dealing with BBs so we can pass it offheap DBBs. We'll probably want to change PB3 to open it up some more too so we can stay offheap as we traverse PB. This issue comes of [~anoop.hbase] and [~ram_krish]'s offheaping of the readpath work. > This change is mostly straight-forward but there are some tricky bits: > # How to interface with HDFS? It wants its ByteStrings. Here in particular in FanOutOneBlockAsyncDFSOutputSaslHelper: > {code} > if (payload != null) { > builder.setPayload(ByteString.copyFrom(payload)); > } > {code} > # [~busbey] also points out that we need to take care of endpoints done as pb. Test at least. > Let me raise this one on the dev list too. -- This message was sent by Atlassian JIRA (v6.3.4#6332)