Return-Path: <dev-return-6262-archive-asf-public=cust-asf.ponee.io@crunch.apache.org>
X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io
Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io
Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183])
	by cust-asf2.ponee.io (Postfix) with ESMTP id 4C663200BDE
	for <archive-asf-public-internal@cust-asf2.ponee.io>; Thu,  1 Dec 2016 10:08:00 +0100 (CET)
Received: by cust-asf.ponee.io (Postfix)
	id 4B1B3160B0B; Thu,  1 Dec 2016 09:08:00 +0000 (UTC)
Delivered-To: archive-asf-public@cust-asf.ponee.io
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by cust-asf.ponee.io (Postfix) with SMTP id 9E6A3160B0F
	for <archive-asf-public@cust-asf.ponee.io>; Thu,  1 Dec 2016 10:07:59 +0100 (CET)
Received: (qmail 12174 invoked by uid 500); 1 Dec 2016 09:07:58 -0000
Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:dev-help@crunch.apache.org>
List-Unsubscribe: <mailto:dev-unsubscribe@crunch.apache.org>
List-Post: <mailto:dev@crunch.apache.org>
List-Id: <dev.crunch.apache.org>
Reply-To: dev@crunch.apache.org
Delivered-To: mailing list dev@crunch.apache.org
Received: (qmail 11909 invoked by uid 500); 1 Dec 2016 09:07:58 -0000
Delivered-To: apmail-incubator-crunch-dev@incubator.apache.org
Received: (qmail 11902 invoked by uid 99); 1 Dec 2016 09:07:58 -0000
Received: from arcas.apache.org (HELO arcas) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Dec 2016 09:07:58 +0000
Received: from arcas.apache.org (localhost [127.0.0.1])
	by arcas (Postfix) with ESMTP id 669BA2C2A66
	for <crunch-dev@incubator.apache.org>; Thu,  1 Dec 2016 09:07:58 +0000 (UTC)
Date: Thu, 1 Dec 2016 09:07:58 +0000 (UTC)
From: "Tom White (JIRA)" <jira@apache.org>
To: crunch-dev@incubator.apache.org
Message-ID: <JIRA.13015200.1477422831000.411030.1480583278417@Atlassian.JIRA>
In-Reply-To: <JIRA.13015200.1477422831000@Atlassian.JIRA>
References: <JIRA.13015200.1477422831000@Atlassian.JIRA> <JIRA.13015200.1477422831802@arcas>
Subject: [jira] [Commented] (CRUNCH-626) HBaseSourceTarget Binary
 compatibility across HBase versions
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394
archived-at: Thu, 01 Dec 2016 09:08:00 -0000


    [ https://issues.apache.org/jira/browse/CRUNCH-626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15711412#comment-15711412 ] 

Tom White commented on CRUNCH-626:
----------------------------------

It doesn't affect this issue, but FYI the HBase APIs are changing again in HBase 2, so there'll be more work to support that (particularly HFile) when it's generally available. See CRUNCH-619.

> HBaseSourceTarget Binary compatibility across HBase versions
> ------------------------------------------------------------
>
>                 Key: CRUNCH-626
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-626
>             Project: Crunch
>          Issue Type: Improvement
>          Components: IO
>            Reporter: Micah Whitacre
>            Assignee: Micah Whitacre
>         Attachments: CRUNCH-626.patch
>
>
> Currently Crunch targets HBase 1.0.   Certain vendors however are trying to maintain API compatibility with HBase 0.96, 0.98, 1.0, and all 1.x.  
> While the API compatibility is ok across these versions, it was however not binary compatible as HBase changed the method signature from returning void[1] to returning OperationWithAttributes[1] (and in later versions Scan).
> This results in an exception like the following, when you try to use the latest Crunch 0.14 release against that vendor's distribution of HBase which we should be theoretically compatible with.
> {noformat}
> java.lang.NoSuchMethodError: org.apache.hadoop.hbase.client.Scan.setAttribute(Ljava/lang/String;[B)Lorg/apache/hadoop/hbase/client/Scan;
> at org.apache.crunch.io.hbase.HBaseSourceTarget.<init>(HBaseSourceTarget.java:112)
> at org.apache.crunch.io.hbase.HBaseSourceTarget.<init>(HBaseSourceTarget.java:96)
> at org.apache.crunch.io.hbase.HBaseSourceTarget.<init>(HBaseSourceTarget.java:88)
> {noformat}
> [1] - https://github.com/apache/hbase/blob/rel/0.98.0/hbase-client/src/main/java/org/apache/hadoop/hbase/client/OperationWithAttributes.java#L40
> [2] - https://github.com/apache/hbase/blob/rel/1.0.0/hbase-client/src/main/java/org/apache/hadoop/hbase/client/OperationWithAttributes.java#L41



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)