Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 6FBA311C02 for ; Wed, 11 Jun 2014 01:59:31 +0000 (UTC) Received: (qmail 68025 invoked by uid 500); 11 Jun 2014 01:59:29 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 67960 invoked by uid 500); 11 Jun 2014 01:59:29 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Received: (qmail 67949 invoked by uid 99); 11 Jun 2014 01:59:29 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Jun 2014 01:59:29 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of yuzhihong@gmail.com designates 209.85.160.169 as permitted sender) Received: from [209.85.160.169] (HELO mail-yk0-f169.google.com) (209.85.160.169) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 11 Jun 2014 01:59:25 +0000 Received: by mail-yk0-f169.google.com with SMTP id q200so867969ykb.14 for ; Tue, 10 Jun 2014 18:59:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=gmhiB94l4o4FJMzfl6gTMyjtC/WsOyInKVYg2fqzIpQ=; b=XXcm/fl0u94onCpqaB2odFKuqWx8izL/ZmfB9f8Txuu555ZNXVhHdoW3J86s7HtiPY CILugtnDYfv2KYF0cZrVRr8CooTo23kcSHu15JcJBAtw4YcxXOHLwGJI+ifh05Zwqoz1 5lXi8mSkH59u8XJVOG2YziCwlTyCo2ecvzd/L/PqKCkhEoJItVp/rwECn3xQ4yRnb9Uk vo3ql5WKNalHNn9zafr1c2ezy8QLRM9cqd/NU67wy+ZShOrYS8SJE5gbEZNtyWftZWwj GFnxq5tw+8Q3DKEjTNPXbsfASqvaeFlXhrylj98iVvvyrTrUzU7lefP0WMZvoCUXSHpG 0P8g== MIME-Version: 1.0 X-Received: by 10.236.0.200 with SMTP id 48mr1460276yhb.72.1402451941541; Tue, 10 Jun 2014 18:59:01 -0700 (PDT) Received: by 10.170.55.213 with HTTP; Tue, 10 Jun 2014 18:59:01 -0700 (PDT) In-Reply-To: References: Date: Tue, 10 Jun 2014 18:59:01 -0700 Message-ID: Subject: Re: secure bulkload hfiles Failed 0.94.15 From: Ted Yu To: "user@hbase.apache.org" Content-Type: multipart/alternative; boundary=089e0153712eca4a5204fb85c96b X-Virus-Checked: Checked by ClamAV on apache.org --089e0153712eca4a5204fb85c96b Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Please take a look at http://hbase.apache.org/book.html#completebulkload Notice the command which starts with: HADOOP_CLASSPATH=3D`${HBASE_HOME}/bin/hbase classpath` On Tue, Jun 10, 2014 at 6:41 PM, Bi,hongyu=E2=80=94mike = wrote: > Hi , > I got into trouble in bulkload hfiles to hbase after i enable HBase ACL i= n > hbase-site.xml > > hbase.rpc.engine > org.apache.hadoop.hbase.ipc.SecureRpcEngine > > > hbase.coprocessor.master.classes > org.apache.hadoop.hbase.security.access.AccessController > > > hbase.coprocessor.region.classes > > > org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.h= adoop.hbase.security.access.AccessController,org.apache.hadoop.hbase.securi= ty.access.SecureBulkLoadEndpoint > > > I run the command as hdfs( hadoop/hbase super user) on hmaster server > hadoop jar hbase-0.94.15-cdh4.6.0-security.jar completebulkload > hdfs://nameservicexxx:8020/hfiles_2hbase/ hbasetablename > > From the exception it seems mapreduce didn't know the hbase.rpc.engine > and still use the writeableRpcEngine,should i add the hbase.rpc.engine to > mapred-site.xml and restart the jobtracker+tasktracker=EF=BC=9For other s= olution? > very appreciate for your help:) > > > 14/06/11 09:31:45 INFO client.HConnectionManager$HConnectionImplementatio= n: > getMaster attempt 2 of 14 failed; retrying after sleep of 1002 > java.io.IOException: Call to xxx/xxx:60000 failed on local exception: > java.io.EOFException > at > > org.apache.hadoop.hbase.ipc.HBaseClient.wrapException(HBaseClient.java:10= 47) > at > org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:1016) > at > > org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcE= ngine.java:87) > at $Proxy7.getProtocolVersion(Unknown Source) > at > > org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.= java:141) > at > > org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementati= on.getMaster(HConnectionManager.java:813) > at > org.apache.hadoop.hbase.client.HBaseAdmin.(HBaseAdmin.java:127) > at > > org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.(LoadIncrem= entalHFiles.java:114) > at > > org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.main(LoadIncremen= talHFiles.java:792) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java= :39) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > > org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDri= ver.java:72) > at > org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:144) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java= :39) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.hbase.mapreduce.Driver.main(Driver.java:51) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java= :39) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorI= mpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at org.apache.hadoop.util.RunJar.main(RunJar.java:208) > Caused by: java.io.EOFException > at java.io.DataInputStream.readInt(DataInputStream.java:375) > at > > org.apache.hadoop.hbase.ipc.HBaseClient$Connection.receiveResponse(HBaseC= lient.java:654) > at > > org.apache.hadoop.hbase.ipc.HBaseClient$Connection.run(HBaseClient.java:5= 88) > --089e0153712eca4a5204fb85c96b--