Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id BF065200BB2 for ; Fri, 14 Oct 2016 21:52:23 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id BC1A8160AD3; Fri, 14 Oct 2016 19:52:23 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 3C417160ADD for ; Fri, 14 Oct 2016 21:52:23 +0200 (CEST) Received: (qmail 63658 invoked by uid 500); 14 Oct 2016 19:52:22 -0000 Mailing-List: contact issues-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@hbase.apache.org Received: (qmail 63606 invoked by uid 99); 14 Oct 2016 19:52:22 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 14 Oct 2016 19:52:22 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 2ABE32C4C75 for ; Fri, 14 Oct 2016 19:52:22 +0000 (UTC) Date: Fri, 14 Oct 2016 19:52:22 +0000 (UTC) From: "Hudson (JIRA)" To: issues@hbase.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HBASE-16818) Avoid multiple copies of binary data during the conversion from Result to Row MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 archived-at: Fri, 14 Oct 2016 19:52:23 -0000 [ https://issues.apache.org/jira/browse/HBASE-16818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15576311#comment-15576311 ] Hudson commented on HBASE-16818: -------------------------------- FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #1786 (See [https://builds.apache.org/job/HBase-Trunk_matrix/1786/]) HBASE-16818 Avoid multiple copies of binary data during the conversion (tedyu: rev a68c0e2a34186e2f9e8725d7c5b2cb5c88bab148) * (edit) hbase-spark/src/main/scala/org/apache/hadoop/hbase/spark/DefaultSource.scala > Avoid multiple copies of binary data during the conversion from Result to Row > ----------------------------------------------------------------------------- > > Key: HBASE-16818 > URL: https://issues.apache.org/jira/browse/HBASE-16818 > Project: HBase > Issue Type: Improvement > Components: spark > Reporter: Weiqing Yang > Assignee: Weiqing Yang > Fix For: 2.0.0 > > Attachments: HBASE-16818_v0.patch > > > In the buildRow() of HBaseRelation, CellUtil.cloneValue will already create a copy of the data. If the data type is BinaryType, another copy is being made within Utils.hbaseFieldToScalaType in Utils.scala. Generally, binary data can be fairly large, so copying may be an expensive operation. -- This message was sent by Atlassian JIRA (v6.3.4#6332)