Return-Path: X-Original-To: apmail-crunch-dev-archive@www.apache.org Delivered-To: apmail-crunch-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6E83D184B4 for ; Wed, 22 Jul 2015 16:38:05 +0000 (UTC) Received: (qmail 64867 invoked by uid 500); 22 Jul 2015 16:38:04 -0000 Delivered-To: apmail-crunch-dev-archive@crunch.apache.org Received: (qmail 64831 invoked by uid 500); 22 Jul 2015 16:38:04 -0000 Mailing-List: contact dev-help@crunch.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@crunch.apache.org Delivered-To: mailing list dev@crunch.apache.org Received: (qmail 64734 invoked by uid 500); 22 Jul 2015 16:38:04 -0000 Delivered-To: apmail-incubator-crunch-dev@incubator.apache.org Received: (qmail 64725 invoked by uid 99); 22 Jul 2015 16:38:04 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 22 Jul 2015 16:38:04 +0000 Date: Wed, 22 Jul 2015 16:38:04 +0000 (UTC) From: "Tyler Kohn (JIRA)" To: crunch-dev@incubator.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (CRUNCH-549) crunch 0.12 not compatible with hbase 1.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Tyler Kohn created CRUNCH-549: --------------------------------- Summary: crunch 0.12 not compatible with hbase 1.0 Key: CRUNCH-549 URL: https://issues.apache.org/jira/browse/CRUNCH-549 Project: Crunch Issue Type: Bug Reporter: Tyler Kohn I'm using a patched (thanks - CRUNCH-540) version of 0.12 with CDH 5.4.3 and getting: 2015-07-22 08:54:55,235 FATAL [main] org.apache.hadoop.mapred.YarnChild: Error running child : java.lang.NoSuchMethodError: org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(Lorg/apache/hadoop/hbase/KeyValue;)V at org.apache.crunch.io.hbase.HFileOutputFormatForCrunch$1.write(HFileOutputFormatForCrunch.java:102) at org.apache.crunch.io.hbase.HFileOutputFormatForCrunch$1.write(HFileOutputFormatForCrunch.java:95) at org.apache.crunch.io.CrunchOutputs$OutputState.write(CrunchOutputs.java:296) at org.apache.crunch.io.CrunchOutputs.write(CrunchOutputs.java:175) at org.apache.crunch.impl.mr.emit.MultipleOutputEmitter.emit(MultipleOutputEmitter.java:41) at org.apache.crunch.MapFn.process(MapFn.java:34) at org.apache.crunch.impl.mr.run.RTNode.process(RTNode.java:98) at org.apache.crunch.impl.mr.emit.IntermediateEmitter.emit(IntermediateEmitter.java:56) at org.apache.crunch.lib.PTables$1.process(PTables.java:163) at org.apache.crunch.lib.PTables$1.process(PTables.java:160) at org.apache.crunch.impl.mr.run.RTNode.process(RTNode.java:98) at org.apache.crunch.impl.mr.emit.IntermediateEmitter.emit(IntermediateEmitter.java:56) at looking at the code in 0.12, HFileOutputFormatForCrunch is trying to write a KV (writer.append(kv);) into HFile.Writer HFile.Writer got rid of append(KeyValue kv) and now only supports Append(Cell cell) in hbase 1.x. Am I doing something wrong? I noticed that crunch0.12 compiles agains hbase 0.98.1 and that version does have that interface still there. if that's the case, is it possible to get a cdh5 compatible version of crunch? thanks for the help. not sure this is a *bug* necessarily but confused. -- This message was sent by Atlassian JIRA (v6.3.4#6332)