Return-Path: X-Original-To: apmail-hbase-user-archive@www.apache.org Delivered-To: apmail-hbase-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id EAFDF18780 for ; Fri, 30 Oct 2015 15:56:36 +0000 (UTC) Received: (qmail 67784 invoked by uid 500); 30 Oct 2015 15:56:35 -0000 Delivered-To: apmail-hbase-user-archive@hbase.apache.org Received: (qmail 67725 invoked by uid 500); 30 Oct 2015 15:56:35 -0000 Mailing-List: contact user-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@hbase.apache.org Delivered-To: mailing list user@hbase.apache.org Delivered-To: moderator for user@hbase.apache.org Received: (qmail 61570 invoked by uid 99); 30 Oct 2015 15:54:31 -0000 X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.121 X-Spam-Level: X-Spam-Status: No, score=-0.121 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=BUXUXIY8vVGiIi1h4HtkfGA3ZqassQt1XXLzB/q5868=; b=QnpSkjl+EIgkoK8XZ4DlS9UISGQzD7dIegvWL6crupGEAH9sZamlAoLj5RnqfNpZHb WOJ0el09XOldlV5chqmHdp7CKJY1WW0E/68L5wsOnTNxsvvAYQDdRy6aBxcbEfTXZV4F h74dz/UDUgvuCMWVLMNKC5RfCUkOSQCiKBhaqzgbQc1JiC3dchub2Wrk3N1PPVb+fnXt JN5wvFM9DXEYyN8vmQCOky9Z0BIbEHXi76eUaIrSNcsKFgFn5f5UaBB/sy5cs1MoaXSj RLwpQriy2vDJ/x+qrKkl4XI8CtwAXfRa7PuPJxP44DogqrhsG2+zEU8ynOlerIZTQuVc FSLw== X-Received: by 10.112.129.200 with SMTP id ny8mr4360791lbb.10.1446220461843; Fri, 30 Oct 2015 08:54:21 -0700 (PDT) MIME-Version: 1.0 From: =?UTF-8?B?THVrw6HFoSBMYWxpbnNrw70=?= Date: Fri, 30 Oct 2015 16:53:52 +0100 Message-ID: Subject: Error when using the included mapreduce tools (e.g. CopyTable) To: user@hbase.apache.org Content-Type: text/plain; charset=UTF-8 I have a clean setup with HBase 1.1.2 and I created a test table: hbase(main):002:0> create 't1', {NAME => 'f1'} 0 row(s) in 1.4460 seconds => Hbase::Table - t1 hbase(main):006:0> put 't1', '1', 'f1:a', 'a' 0 row(s) in 0.0150 seconds hbase(main):007:0> put 't1', '2', 'f1:a', 'b' 0 row(s) in 0.0070 seconds hbase(main):008:0> scan 't1' ROW COLUMN+CELL 1 column=f1:a, timestamp=1446219543171, value=a 2 column=f1:a, timestamp=1446219549259, value=b 2 row(s) in 0.0170 seconds When I try to copy it with using "CopyTable", I get an error from the MR task and I can't figure out what's wrong. This is the command that I'm running: hbase org.apache.hadoop.hbase.mapreduce.CopyTable --new.name=t2 t1 And this is the error I get in the MR job history: 2015-10-30 15:40:49,459 FATAL [IPC Server handler 1 on 39938] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task: attempt_1446219462725_0001_m_000000_0 - exited : java.io.IOException: Cannot create a record reader because of a previous error. Please look at the previous logs lines from the task's full log for more details. at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.createRecordReader(TableInputFormatBase.java:174) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.(MapTask.java:515) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:758) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) Caused by: java.lang.IllegalStateException: The input format instance has not been properly initialized. Ensure you call initializeTable either in your constructor or initialize method at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getTable(TableInputFormatBase.java:585) at org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.createRecordReader(TableInputFormatBase.java:169) ... 8 more Googling for the "input format instance has not been properly initialized" error only brings up some Spark related problem. I get the same error when trying to use "RowCounter", for example. Any ideas what am I doing wrong? Thank you, Lukas