Return-Path: X-Original-To: apmail-hbase-dev-archive@www.apache.org Delivered-To: apmail-hbase-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 01CA619A0 for ; Tue, 19 Apr 2011 21:31:18 +0000 (UTC) Received: (qmail 4578 invoked by uid 500); 19 Apr 2011 21:31:17 -0000 Delivered-To: apmail-hbase-dev-archive@hbase.apache.org Received: (qmail 4544 invoked by uid 500); 19 Apr 2011 21:31:17 -0000 Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hbase.apache.org Delivered-To: mailing list dev@hbase.apache.org Received: (qmail 4536 invoked by uid 99); 19 Apr 2011 21:31:17 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Apr 2011 21:31:17 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,RFC_ABUSE_POST,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of jdcryans@gmail.com designates 209.85.210.41 as permitted sender) Received: from [209.85.210.41] (HELO mail-pz0-f41.google.com) (209.85.210.41) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Apr 2011 21:31:10 +0000 Received: by pzk32 with SMTP id 32so88137pzk.14 for ; Tue, 19 Apr 2011 14:30:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; bh=OxmZWCNXF5hRVKcnTGHB+hLL16O8iEAXyrm1r+X1Mxo=; b=aEzO1K5YwbEFLp4v9wbydpluRNL2d3t03AZWcY4hEtmVHGBo2ZOH6IWzr+kI+qfTts a83x23NilQVS2UGA1QXYdhHSslnSSDdsjf3LlKVQQhR71x/4rO6YRAIVaLnq3iERQO5B xeGjS0bQaHwPX2gTBpkLmpjTP9YjoT4/OHwb8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:content-type :content-transfer-encoding; b=wW0unRaDM2FSq8wISexlEwt8FULZweqePZoBH12JTk+/90J1Ki6e77BW1hOxF3HTUc Go2plAzSqDnFPNy+o3wEbdvAI6sWoDCVWZ1up80VvPbHKkAftpfXg5ygoWO+eShe9f2+ Z6y68+1QsGxuQF3ksJgdTM9FJLG+QfQIivKXM= MIME-Version: 1.0 Received: by 10.68.20.199 with SMTP id p7mr9838244pbe.40.1303248647615; Tue, 19 Apr 2011 14:30:47 -0700 (PDT) Sender: jdcryans@gmail.com Received: by 10.68.48.167 with HTTP; Tue, 19 Apr 2011 14:30:47 -0700 (PDT) In-Reply-To: References: Date: Tue, 19 Apr 2011 14:30:47 -0700 X-Google-Sender-Auth: 46P9CyAWBJ1qZ0d6ocV-ZKcP8Ac Message-ID: Subject: Re: using RegionSplitter From: Jean-Daniel Cryans To: dev@hbase.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org Nothing comes to mind, I'd have to read the code. J-D On Tue, Apr 19, 2011 at 2:24 PM, Ted Yu wrote: > Thanks J-D. > > Now I see: > 11/04/19 21:22:03 DEBUG util.RegionSplitter: No _balancedSplit file. > Calculating splits... > 11/04/19 21:22:03 DEBUG client.MetaScanner: Scanning .META. starting at > row=3DM2M-INTEGRATION-DIMENSIONS-1303180666422,,00000000000000 for > max=3D2147483647 rows > 11/04/19 21:22:04 DEBUG util.RegionSplitter: Table > M2M-INTEGRATION-DIMENSIONS-1303180666422 has 5 regions that will be split= . > Exception in thread "main" java.lang.NumberFormatException: For input > string: ">" > =A0 =A0 =A0 =A0at > java.lang.NumberFormatException.forInputString(NumberFormatException.java= :48) > =A0 =A0 =A0 =A0at java.lang.Integer.parseInt(Integer.java:449) > =A0 =A0 =A0 =A0at java.math.BigInteger.(BigInteger.java:316) > =A0 =A0 =A0 =A0at > org.apache.hadoop.hbase.util.RegionSplitter$MD5StringSplit.convertToBigIn= teger(RegionSplitter.java:779) > =A0 =A0 =A0 =A0at > org.apache.hadoop.hbase.util.RegionSplitter$MD5StringSplit.split(RegionSp= litter.java:704) > =A0 =A0 =A0 =A0at > org.apache.hadoop.hbase.util.RegionSplitter.getSplits(RegionSplitter.java= :639) > =A0 =A0 =A0 =A0at > org.apache.hadoop.hbase.util.RegionSplitter.rollingSplit(RegionSplitter.j= ava:362) > =A0 =A0 =A0 =A0at > org.apache.hadoop.hbase.util.RegionSplitter.main(RegionSplitter.java:291) > > On Tue, Apr 19, 2011 at 2:12 PM, Jean-Daniel Cryans = wrote: > >> In general IIRC that message means that you need to have your hadoop >> configuration folder in HBase's classpath. >> >> J-D >> >> On Tue, Apr 19, 2011 at 2:05 PM, Ted Yu wrote: >> > Hi, >> > In 0.90.2, I tried to use RegionSplitter: >> > [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase >> > org.apache.hadoop.hbase.util.RegionSplitter -r -o 2 >> > 'M2M-INTEGRATION-DIMENSIONS-1303180666422' >> > ... >> > 11/04/19 21:02:33 DEBUG >> client.HConnectionManager$HConnectionImplementation: >> > Cache hit for row <> in tableName >> M2M-INTEGRATION-DIMENSIONS-1303180666422: >> > location server us01-ciqps1-grid07.carrieriq.com:60020, location regio= n >> name >> > >> M2M-INTEGRATION-DIMENSIONS-1303180666422,,1303180669457.19be2774054a672e= 905554bcaf73d5e0. >> > Exception in thread "main" java.lang.IllegalArgumentException: Wrong F= S: >> > hdfs:// >> > >> us01-ciqps1-name01.carrieriq.com:9000/hbase/M2M-INTEGRATION-DIMENSIONS-1= 303180666422/_balancedSplit >> , >> > expected: file:/// >> > =A0 =A0 =A0 =A0at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem= .java:352) >> > =A0 =A0 =A0 =A0at >> > >> org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.ja= va:47) >> > =A0 =A0 =A0 =A0at >> > >> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem= .java:368) >> > =A0 =A0 =A0 =A0at >> > >> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.jav= a:251) >> > =A0 =A0 =A0 =A0at org.apache.hadoop.fs.FileSystem.exists(FileSystem.ja= va:690) >> > =A0 =A0 =A0 =A0at >> > >> org.apache.hadoop.hbase.util.RegionSplitter.getSplits(RegionSplitter.jav= a:612) >> > =A0 =A0 =A0 =A0at >> > >> org.apache.hadoop.hbase.util.RegionSplitter.rollingSplit(RegionSplitter.= java:362) >> > =A0 =A0 =A0 =A0at >> > org.apache.hadoop.hbase.util.RegionSplitter.main(RegionSplitter.java:2= 91) >> > >> > Has anyone experienced this ? >> > >> > Thanks >> > >> >