Return-Path: 
 <dev-return-27051-apmail-hbase-dev-archive=hbase.apache.org@hbase.apache.org>
X-Original-To: apmail-hbase-dev-archive@www.apache.org
Delivered-To: apmail-hbase-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id 748E996A3
	for <apmail-hbase-dev-archive@www.apache.org>;
 Thu, 23 Feb 2012 03:44:27 +0000 (UTC)
Received: (qmail 83042 invoked by uid 500); 23 Feb 2012 03:44:26 -0000
Delivered-To: apmail-hbase-dev-archive@hbase.apache.org
Received: (qmail 82975 invoked by uid 500); 23 Feb 2012 03:44:26 -0000
Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:dev-help@hbase.apache.org>
List-Unsubscribe: <mailto:dev-unsubscribe@hbase.apache.org>
List-Post: <mailto:dev@hbase.apache.org>
List-Id: <dev.hbase.apache.org>
Reply-To: dev@hbase.apache.org
Delivered-To: mailing list dev@hbase.apache.org
Received: (qmail 82922 invoked by uid 99); 23 Feb 2012 03:44:25 -0000
Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 03:44:25 +0000
X-ASF-Spam-Status: No, hits=1.5 required=5.0
	tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS
X-Spam-Check-By: apache.org
Received-SPF: pass (nike.apache.org: domain of yuzhihong@gmail.com designates
 209.85.212.169 as permitted sender)
Received: from [209.85.212.169] (HELO mail-wi0-f169.google.com)
 (209.85.212.169)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 23 Feb 2012 03:44:17 +0000
Received: by wibhj13 with SMTP id hj13so637165wib.14
        for <dev@hbase.apache.org>; Wed, 22 Feb 2012 19:43:56 -0800 (PST)
Received-SPF: pass (google.com: domain of yuzhihong@gmail.com designates
 10.180.78.233 as permitted sender) client-ip=10.180.78.233;
Authentication-Results: mr.google.com;
 spf=pass (google.com: domain of yuzhihong@gmail.com designates 10.180.78.233
 as permitted sender) smtp.mail=yuzhihong@gmail.com;
 dkim=pass header.i=yuzhihong@gmail.com
Received: from mr.google.com ([10.180.78.233])
        by 10.180.78.233 with SMTP id e9mr2110453wix.0.1329968636660 (num_hops
 = 1);
        Wed, 22 Feb 2012 19:43:56 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        bh=Kq7AczUQKZmhC/uCaYsy6/2voQEVJrFbGTVr6R0MqjA=;
        b=p0p1fgZXzgOtrggpbkHNxFC0lUrHVyYK1V6PVRe5JwUxYxt2Yt2KfaktVyqLft6sTv
         DvXRs+wlegAoMH2JJkAioYJ/SDmIX7X1J7snHhTWiNHajI06+nBj05upViUUkeR7WMrK
         OwsHieuh4C1H7dy7OEYfuPXpWPHe1XWgT9Srk=
MIME-Version: 1.0
Received: by 10.180.78.233 with SMTP id e9mr1746327wix.0.1329968636586; Wed,
 22 Feb 2012 19:43:56 -0800 (PST)
Received: by 10.216.122.138 with HTTP; Wed, 22 Feb 2012 19:43:56 -0800 (PST)
In-Reply-To: <1329964568.47397.YahooMailNeo@web121705.mail.ne1.yahoo.com>
References: <1329964568.47397.YahooMailNeo@web121705.mail.ne1.yahoo.com>
Date: Wed, 22 Feb 2012 19:43:56 -0800
Message-ID: 
 <CALte62y81z=VXSpB6scWWSO=YuGKw0KGvuZ1YrbsWNrV_HyU2g@mail.gmail.com>
Subject: Re: Some HBase M/R confusion
From: Ted Yu <yuzhihong@gmail.com>
To: dev@hbase.apache.org, lars hofhansl <lhofhansl@yahoo.com>
Content-Type: multipart/alternative; boundary=f46d043c81bc256cb404b999744a
X-Virus-Checked: Checked by ClamAV on apache.org

--f46d043c81bc256cb404b999744a
Content-Type: text/plain; charset=ISO-8859-1

Lars:
Is the second problem present in insecure HBase ?

Thanks

On Wed, Feb 22, 2012 at 6:36 PM, lars hofhansl <lhofhansl@yahoo.com> wrote:

> According to the documentation there are two ways to run HBase M/R jobs:
>
>
> 1. The HBase book states to run M/R jobs like export here:
> http://hbase.apache.org/book/ops_mgt.html#export
> bin/hbase org.apache.hadoop.hbase.mapreduce.Export <tablename>
> <outputdir> [<versions> [<starttime> [<endtime>]]]
>
> 2. Whereas the Javadoc says here:
> http://hbase.apache.org/docs/current/api/org/apache/hadoop/hbase/mapreduce/package-summary.html#package_description
> HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase classpath`
> ${HADOOP_HOME}/bin/hadoop jar ${HBASE_HOME}/hbase-0.90.0.jar export ...
>
>
> In the first case (#1) I find that the job allways fails to create the
> output dir:
> java.io.IOException: Mkdirs failed to create
> file:/exports/_temporary/_attempt_local_0001_m_000000_0
>     at
> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:378)
>
> ...
>
>
> In the 2nd case (#2) I get past the creation of the output dir, and then
> it fails because it cannot find class com.google.protobuf.Message.
> I am using the HBase security branch and find that I need to add
> com.google.protobuf.Message.class in TableMapReduceUtil.addDependencyJars.
> If I do that, I can successfully run an export jobs using method #2.
>
>
> The 2nd issue I found looks like a bug with the HBase security branch.
> I am not sure about the first issue, is the documentation in the HBase
> book outdated?
>
>
> -- Lars
>
>

--f46d043c81bc256cb404b999744a--