Mailing-List: contact dev-help@hbase.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hbase.apache.org
Received-SPF: pass (athena.apache.org: domain of yuzhihong@gmail.com
 designates 74.125.83.169 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:date:message-id:subject:from:to
         :content-type;
        b=Rt1TmYHyFC9GMhpx+VImK8aZYLqnZZnJ0Fuln0G5yzZvDa25NbEs6Z51uBJBs10W6U
         L6mjD2lAEq5TYuft9KH9fGS9YIdEV/XPmc18abY47P/w0nKoGH2OjYQBt3awtNo7FhIZ
         RwdDUvjfTT5VRfcoB8izhtB95wwIsVDURqzCo=
MIME-Version: 1.0
In-Reply-To: <BANLkTimkb-+UvsqN-Tc3inwRWDubfSCyFg@mail.gmail.com>
References: <BANLkTi=+J0_iMAJc6fugqs2=E34-d=iwmA@mail.gmail.com>
	<BANLkTi=ux5maf9RpgBmMv8EJ30Gr4jKhnw@mail.gmail.com>
	<BANLkTimkb-+UvsqN-Tc3inwRWDubfSCyFg@mail.gmail.com>
Date: Tue, 19 Apr 2011 14:45:52 -0700
Message-ID: <BANLkTim262Bi=jbbeu1zVE8HJnZ32C-5FA@mail.gmail.com>
Subject: Re: using RegionSplitter
From: Ted Yu <yuzhihong@gmail.com>
To: dev@hbase.apache.org
Content-Type: multipart/alternative; boundary=bcaec520eee5a8e52a04a14c6e0b

--bcaec520eee5a8e52a04a14c6e0b
Content-Type: text/plain; charset=ISO-8859-1

There is assumption that start and end keys can be converted to BigInteger:
    public byte[] split(byte[] start, byte[] end) {
      BigInteger s = convertToBigInteger(start);
      BigInteger e = convertToBigInteger(end);

The assumption doesn't hold in our use case.

On Tue, Apr 19, 2011 at 2:24 PM, Ted Yu <yuzhihong@gmail.com> wrote:

> Thanks J-D.
>
> Now I see:
> 11/04/19 21:22:03 DEBUG util.RegionSplitter: No _balancedSplit file.
> Calculating splits...
> 11/04/19 21:22:03 DEBUG client.MetaScanner: Scanning .META. starting at
> row=M2M-INTEGRATION-DIMENSIONS-1303180666422,,00000000000000 for
> max=2147483647 rows
> 11/04/19 21:22:04 DEBUG util.RegionSplitter: Table
> M2M-INTEGRATION-DIMENSIONS-1303180666422 has 5 regions that will be split.
> Exception in thread "main" java.lang.NumberFormatException: For input
> string: ">"
>         at
> java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
>         at java.lang.Integer.parseInt(Integer.java:449)
>         at java.math.BigInteger.<init>(BigInteger.java:316)
>         at
> org.apache.hadoop.hbase.util.RegionSplitter$MD5StringSplit.convertToBigInteger(RegionSplitter.java:779)
>         at
> org.apache.hadoop.hbase.util.RegionSplitter$MD5StringSplit.split(RegionSplitter.java:704)
>         at
> org.apache.hadoop.hbase.util.RegionSplitter.getSplits(RegionSplitter.java:639)
>
>         at
> org.apache.hadoop.hbase.util.RegionSplitter.rollingSplit(RegionSplitter.java:362)
>         at
> org.apache.hadoop.hbase.util.RegionSplitter.main(RegionSplitter.java:291)
>
> On Tue, Apr 19, 2011 at 2:12 PM, Jean-Daniel Cryans <jdcryans@apache.org>wrote:
>
>> In general IIRC that message means that you need to have your hadoop
>> configuration folder in HBase's classpath.
>>
>> J-D
>>
>> On Tue, Apr 19, 2011 at 2:05 PM, Ted Yu <yuzhihong@gmail.com> wrote:
>> > Hi,
>> > In 0.90.2, I tried to use RegionSplitter:
>> > [hadoop@us01-ciqps1-name01 hbase]$ bin/hbase
>> > org.apache.hadoop.hbase.util.RegionSplitter -r -o 2
>> > 'M2M-INTEGRATION-DIMENSIONS-1303180666422'
>> > ...
>> > 11/04/19 21:02:33 DEBUG
>> client.HConnectionManager$HConnectionImplementation:
>> > Cache hit for row <> in tableName
>> M2M-INTEGRATION-DIMENSIONS-1303180666422:
>> > location server us01-ciqps1-grid07.carrieriq.com:60020, location region
>> name
>> >
>> M2M-INTEGRATION-DIMENSIONS-1303180666422,,1303180669457.19be2774054a672e905554bcaf73d5e0.
>> > Exception in thread "main" java.lang.IllegalArgumentException: Wrong FS:
>> > hdfs://
>> >
>> us01-ciqps1-name01.carrieriq.com:9000/hbase/M2M-INTEGRATION-DIMENSIONS-1303180666422/_balancedSplit
>> ,
>> > expected: file:///
>> >        at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:352)
>> >        at
>> >
>> org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:47)
>> >        at
>> >
>> org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:368)
>> >        at
>> >
>> org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:251)
>> >        at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:690)
>> >        at
>> >
>> org.apache.hadoop.hbase.util.RegionSplitter.getSplits(RegionSplitter.java:612)
>> >        at
>> >
>> org.apache.hadoop.hbase.util.RegionSplitter.rollingSplit(RegionSplitter.java:362)
>> >        at
>> >
>> org.apache.hadoop.hbase.util.RegionSplitter.main(RegionSplitter.java:291)
>> >
>> > Has anyone experienced this ?
>> >
>> > Thanks
>> >
>>
>
>

--bcaec520eee5a8e52a04a14c6e0b--