Return-Path: X-Original-To: apmail-hadoop-common-user-archive@www.apache.org Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0A3A9DB66 for ; Tue, 14 Aug 2012 21:18:19 +0000 (UTC) Received: (qmail 25037 invoked by uid 500); 14 Aug 2012 21:18:14 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 24884 invoked by uid 500); 14 Aug 2012 21:18:14 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hadoop.apache.org Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 24875 invoked by uid 99); 14 Aug 2012 21:18:14 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Aug 2012 21:18:14 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FSL_RCVD_USER,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of harsh@cloudera.com designates 209.85.214.176 as permitted sender) Received: from [209.85.214.176] (HELO mail-ob0-f176.google.com) (209.85.214.176) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 Aug 2012 21:18:09 +0000 Received: by obbtb18 with SMTP id tb18so1364025obb.35 for ; Tue, 14 Aug 2012 14:17:48 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding:x-gm-message-state; bh=p6DnQdbvqWy1LZzJ5y7USV8ERuvz3A2NRx5jKY9NtE0=; b=HUhAhKT6c4FoSYS6XCKwUL50O6Pnn3XfB/YUv9wpCOCeSGwEINdJcVbDq6AJdPwwZN RsLVsfzJGSaWMHtbP6yZ/IX6C6E203cqh2lvHT3SiISGNNYslDkkYxMSMA7XvMZ5CGfP MZ3tsvIiOpfOlrkAMpcdnMidKtuafltVOcYwkABeUz3sCgfDfYbGq90+I5Dg8UYQO8F2 lwwxpYnjPcA8AjaQFbZ2Bt2OX8C2aNDS2iikWCwERkddjVCEbk1Ft3hkW8QiHPk8BS76 r+USje8CbgxnXwEMM124RSFKIaktxkrZBgPQZh05ZSGKErhO8b+COTwJrKNuBxuI4j+5 8i/w== Received: by 10.182.47.9 with SMTP id z9mr21559044obm.58.1344979068645; Tue, 14 Aug 2012 14:17:48 -0700 (PDT) MIME-Version: 1.0 Received: by 10.76.11.168 with HTTP; Tue, 14 Aug 2012 14:17:26 -0700 (PDT) In-Reply-To: References: From: Harsh J Date: Wed, 15 Aug 2012 02:47:26 +0530 Message-ID: Subject: Re: pipes(pydoop) and hbase classpath To: user@hadoop.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Gm-Message-State: ALoCoQmbC8xR1oRmD7t/DRz8LWGgxmPQLkj6XNwxf9WXef3mS/U2FB+/UWOaYd9Ym1i4iS8skEIh X-Virus-Checked: Checked by ClamAV on apache.org Hi, Per: > org.apache.hadoop.hbase.mapreduce.TableInputFormat not org.apache.hadoop.mapred.InputFormat Pydoop seems to be expecting you to pass it an old API class for InputFormat/etc. but you've passed in the newer class. I am unsure what part of your code exactly may be at fault since I do not have access to it, but you probably want to use the deprecated org.apache.hadoop.hbase.mapred.* package classes such as org.apache.hadoop.hbase.mapred.TableInputFormat, and not the org.apache.hadoop.hbase.mapreduce.* classes, as you are using at the moment. HTH! On Wed, Aug 15, 2012 at 2:39 AM, H=E5vard Wahl Kongsg=E5rd wrote: > Hi, I'am trying to read hbase key-values with pipes(pydoop). As hadoop > is unable to find the hbase jar files. I get > > Exception in thread "main" java.lang.RuntimeException: > java.lang.RuntimeException: class > org.apache.hadoop.hbase.mapreduce.TableInputFormat not > org.apache.hadoop.mapred.InputFormat > > have added export > HADOOP_CLASSPATH=3D/usr/lib/hbase/hbase-0.90.6-cdh3u4.jar to my > hadoop-env.sh > > According to the doc from cloudera, > https://ccp.cloudera.com/display/CDHDOC/HBase+Installation#HBaseInstallat= ion-UsingMapReducewithHBase > TableMapReduceUtil.addDependencyJars(job); can be used as an > alternative. But is that possible with pipes? > > -H=E5vard --=20 Harsh J