Mailing-List: contact hbase-user-help@hadoop.apache.org; run by ezmlm
Precedence: bulk
Reply-To: hbase-user@hadoop.apache.org
Received-SPF: pass (athena.apache.org: domain of saint.ack@gmail.com
 designates 74.125.92.24 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:sender:in-reply-to:references:date
         :x-google-sender-auth:message-id:subject:from:to:content-type
         :content-transfer-encoding;
        b=Hkx4MYg3LC/8tYTzcT14tIUi9ITIco91JC60w3XXONjHEHAKtzY88cCQhoojFmF1ed
         Y6+3uNoA7bO7WC5GkplKEKJq+FYR8m2qrkRNQEQymFwiY6m0Zs0ikX1BtrK3qAQv3Fgd
         D8LL1YFwYZdvYWcw2DcfJECFjrKLS8uaXcudo=
MIME-Version: 1.0
Sender: saint.ack@gmail.com
In-Reply-To: 
 <49A7BA114AAC6A48B9C44CB06B7B987E08C91CFE@HYDSVWIN004X.ivycomptech.partygaming.local>
References: <a70416aa1001180847y701df3dai704ee3286e0cd54f@mail.gmail.com>
	 <7c962aed1001181513j34a48923j9999afeb7632498b@mail.gmail.com>
	 <49A7BA114AAC6A48B9C44CB06B7B987E08B886C3@HYDSVWIN004X.ivycomptech.partygaming.local>
	 <a4779b311001190856g514e41a8o9d043b8487a5bf9c@mail.gmail.com>
	 <49A7BA114AAC6A48B9C44CB06B7B987E08C11BA5@HYDSVWIN004X.ivycomptech.partygaming.local>
	 <7c962aed1001211112r22d5cacdv6e046f95e4336af9@mail.gmail.com>
	 <49A7BA114AAC6A48B9C44CB06B7B987E08C11BB5@HYDSVWIN004X.ivycomptech.partygaming.local>
	 <7c962aed1001211121n584c2839pf0677ba5d31082f@mail.gmail.com>
	 <7c457ebe1001211522u2c00a848sc2bb1014a925ba7e@mail.gmail.com>
	 <49A7BA114AAC6A48B9C44CB06B7B987E08C91CFE@HYDSVWIN004X.ivycomptech.partygaming.local>
Date: Fri, 22 Jan 2010 15:30:17 -0800
Message-ID: <7c962aed1001221530o3add7354q7226721fc890b020@mail.gmail.com>
Subject: Re: Support for MultiGet / SQL In clause -- error in patch HBASE-1845
From: Stack <stack@duboce.net>
To: hbase-user@hadoop.apache.org
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

Check your master log.  Something is seriously off if you do not have
a reachable .META. table.
St.Ack

On Fri, Jan 22, 2010 at 1:09 PM, Sriram Muthuswamy Chittathoor
<sriramc@ivycomptech.com> wrote:
> I applied the hbase-0.20.3 version / hadoop 0.20.1. =A0But after starting
> hbase I keep getting the error below when I go to the hbase shell
>
> [ppoker@karisimbivir1 hbase-0.20.3]$ ./bin/hbase shell
> HBase Shell; enter 'help<RETURN>' for list of supported commands.
> Version: 0.20.3, r900041, Sat Jan 16 17:20:21 PST 2010
> hbase(main):001:0> list
> NativeException:
> org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
> contact region server null for region , row '', but failed after 7
> attempts.
> Exceptions:
> org.apache.hadoop.hbase.TableNotFoundException: .META.
> org.apache.hadoop.hbase.TableNotFoundException: .META.
> org.apache.hadoop.hbase.TableNotFoundException: .META.
> org.apache.hadoop.hbase.TableNotFoundException: .META.
> org.apache.hadoop.hbase.TableNotFoundException: .META.
> org.apache.hadoop.hbase.TableNotFoundException: .META.
> org.apache.hadoop.hbase.TableNotFoundException: .META.
>
>
>
> Also when I try to create a table programatically I get this --
> 10/01/22 15:48:23 INFO zookeeper.ClientCnxn: Attempting connection to
> server localhost/127.0.0.1:2181
> 10/01/22 15:48:23 INFO zookeeper.ClientCnxn: Priming connection to
> java.nio.channels.SocketChannel[connected local=3D/127.0.0.1:43775
> remote=3Dlocalhost/127.0.0.1:2181]
> 10/01/22 15:48:23 INFO zookeeper.ClientCnxn: Server connection
> successful
> Exception in thread "main"
> org.apache.hadoop.hbase.TableNotFoundException: .META.
> =A0 =A0 =A0 =A0at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateReg
> ionInMeta(HConnectionManager.java:684)
> =A0 =A0 =A0 =A0at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateReg
> ion(HConnectionManager.java:634)
> =A0 =A0 =A0 =A0at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateReg
> ion(HConnectionManager.java:601)
> =A0 =A0 =A0 =A0at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateReg
> ionInMeta(HConnectionManager.java:675)
> =A0 =A0 =A0 =A0at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateReg
> ion(HConnectionManager.java:638)
> =A0 =A0 =A0 =A0at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateReg
> ion(HConnectionManager.java:601)
> =A0 =A0 =A0 =A0at org.apache.hadoop.hbase.client.HTable.<init>(HTable.jav=
a:128)
> =A0 =A0 =A0 =A0at org.apache.hadoop.hbase.client.HTable.<init>(HTable.jav=
a:106)
> =A0 =A0 =A0 =A0at test.CreateTable.main(CreateTable.java:36)
>
>
>
> Any clues ?
>
>
>
> -----Original Message-----
> From: Dan Washusen [mailto:dan@reactive.org]
> Sent: Friday, January 22, 2010 4:53 AM
> To: hbase-user@hadoop.apache.org
> Subject: Re: Support for MultiGet / SQL In clause -- error in patch
> HBASE-1845
>
> If you want to give the "indexed" contrib package a try you'll need to
> do
> the following:
>
> =A0 1. Include the contrib jars (export HBASE_CLASSPATH=3D(`find
> =A0 /path/to/hbase/hbase-0.20.3/contrib/indexed -name '*jar' | tr -s "\n"
> ":"`)
> =A0 2. Set the 'hbase.hregion.impl' property to
> =A0 'org.apache.hadoop.hbase.regionserver.IdxRegion' in your
> hbase-site.xml
>
> Once you've done that you can create a table with an index using:
>
>> =A0 =A0 // define which qualifiers need an index (choosing the correct
> type)
>> =A0 =A0 IdxColumnDescriptor columnDescriptor =3D new
>> IdxColumnDescriptor("columnFamily");
>> =A0 =A0 columnDescriptor.addIndexDescriptor(
>> =A0 =A0 =A0 new IdxIndexDescriptor("qualifier", IdxQualifierType.BYTE_AR=
RAY)
>> =A0 =A0 );
>>
>> =A0 =A0 HTableDescriptor tableDescriptor =3D new HTableDescriptor("table=
");
>> =A0 =A0 tableDescriptor.addFamily(columnDescriptor);
>>
>
> Then when you want to perform a scan with an index hint:
>
>> =A0 =A0 Scan scan =3D new IdxScan(
>> =A0 =A0 =A0 =A0 =A0 new Comparison("columnFamily", "qualifier",
>> =A0 =A0 =A0 =A0 =A0 =A0 =A0 Comparison.Operator.EQ, Bytes.toBytes("foo")=
)
>> =A0 =A0 =A0 );
>>
>
> You have to keep in mind that the index hint is only a hint. =A0It
> guarantees
> that your scan will get all rows that match the hint but you'll more
> than
> likely receive rows that don't. =A0For this reason I'd suggest that you
> also
> include a filter along with the scan:
>
>> =A0 =A0 =A0 Scan scan =3D new IdxScan(
>> =A0 =A0 =A0 =A0 =A0 new Comparison("columnFamily", "qualifier",
>> =A0 =A0 =A0 =A0 =A0 =A0 =A0 Comparison.Operator.EQ, Bytes.toBytes("foo")=
)
>> =A0 =A0 =A0 );
>> =A0 =A0 =A0 scan.setFilter(
>> =A0 =A0 =A0 =A0 =A0 new SingleColumnValueFilter(
>> =A0 =A0 =A0 =A0 =A0 =A0 =A0 "columnFamily", "qualifer",
> CompareFilter.CompareOp.EQUAL,
>> =A0 =A0 =A0 =A0 =A0 =A0 =A0 new BinaryComparator("foo")
>> =A0 =A0 =A0 =A0 =A0 )
>> =A0 =A0 =A0 );
>>
>
> Cheers,
> Dan
>
>
> 2010/1/22 stack <stack@duboce.net>
>
>>
> http://people.apache.org/~jdcryans/hbase-0.20.3-candidate-2/<http://peop
> le.apache.org/%7Ejdcryans/hbase-0.20.3-candidate-2/>
>>
>> There is a bit of documentation if you look at javadoc for the
>> 'indexed' contrib (This is what hbase-2073 is called on commit).
>>
>> St.Ack
>>
>> P.S. We had a thread going named "HBase bulk load". =A0You got all the
>> answers you need on that one?
>>
>> On Thu, Jan 21, 2010 at 11:19 AM, Sriram Muthuswamy Chittathoor
>> <sriramc@ivycomptech.com> wrote:
>> >
>> > Great. =A0Can I migrate to 0.20.3RC2 easily. =A0I am on 0.20.2. Can u
> pass
>> > me the link
>> >
>> > -----Original Message-----
>> > From: saint.ack@gmail.com [mailto:saint.ack@gmail.com] On Behalf Of
>> > stack
>> > Sent: Friday, January 22, 2010 12:42 AM
>> > To: hbase-user@hadoop.apache.org
>> > Subject: Re: Support for MultiGet / SQL In clause -- error in patch
>> > HBASE-1845
>> >
>> > IIRC, hbase-1845 was a sketch only and not yet complete. =A0Its
> probably
>> > rotted since any ways.
>> >
>> > Have you looked at hbase-2037 since committed and available in
>> > 0.20.3RC2.
>> > =A0Would this help you with your original problem?
>> >
>> > St.Ack
>> >
>> > On Thu, Jan 21, 2010 at 9:10 AM, Sriram Muthuswamy Chittathoor <
>> > sriramc@ivycomptech.com> wrote:
>> >
>> > > I tried applying the patch to the hbase source code =A0hbase 0.20.2
> and
>> > I
>> > > get the errors below. =A0Do you know if this needs to be applied to
> a
>> > > specific hbase version. Is there a version which works with 0.20.2
> or
>> > > later ??
>> > > Basically HRegionServer =A0and HTable patching fails.
>> > >
>> > >
>> > > Thanks for the help
>> > >
>> > > patch -p0 -i batch.patch
>> > >
>> > > patching file src/java/org/apache/hadoop/hbase/client/Get.java
>> > > Hunk #1 succeeded at 61 (offset 2 lines).
>> > > Hunk #2 succeeded at 347 (offset 31 lines).
>> > > patching file
> src/java/org/apache/hadoop/hbase/client/HConnection.java
>> > > patching file
>> > > src/java/org/apache/hadoop/hbase/client/HConnectionManager.java
>> > > Hunk #3 succeeded at 1244 (offset 6 lines).
>> > > patching file src/java/org/apache/hadoop/hbase/client/HTable.java
>> > > Hunk #2 succeeded at 73 (offset 8 lines).
>> > > Hunk #4 FAILED at 405.
>> > > Hunk #5 succeeded at 671 with fuzz 2 (offset 26 lines).
>> > > 1 out of 5 hunks FAILED -- saving rejects to file
>> > > src/java/org/apache/hadoop/hbase/client/HTable.java.rej
>> > > patching file src/java/org/apache/hadoop/hbase/client/Multi.java
>> > > patching file
>> > src/java/org/apache/hadoop/hbase/client/MultiCallable.java
>> > > patching file
> src/java/org/apache/hadoop/hbase/client/MultiResult.java
>> > > patching file src/java/org/apache/hadoop/hbase/client/Row.java
>> > > patching file
>> > > src/java/org/apache/hadoop/hbase/io/HbaseObjectWritable.java
>> > > Hunk #2 succeeded at 156 with fuzz 1 (offset 3 lines).
>> > > patching file
>> > src/java/org/apache/hadoop/hbase/ipc/HRegionInterface.java
>> > > Hunk #2 succeeded at 247 (offset 2 lines).
>> > > patching file
>> > > src/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
>> > > Hunk #1 succeeded at 78 (offset -1 lines).
>> > > Hunk #2 FAILED at 2515.
>> > > 1 out of 2 hunks FAILED -- saving rejects to file
>> > >
> src/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java.rej
>> > > patching file
> src/test/org/apache/hadoop/hbase/client/TestHTable.java
>> > > Hunk #2 FAILED at 333.
>> > > 1 out of 2 hunks FAILED -- saving rejects to file
>> > > src/test/org/apache/hadoop/hbase/client/TestHTable.java.rej
>> > >
>> > >
>> > >
>> > >
>> > > -----Original Message-----
>> > > From: Marc Limotte [mailto:mslimotte@gmail.com]
>> > > Sent: Tuesday, January 19, 2010 10:26 PM
>> > > To: hbase-user@hadoop.apache.org
>> > > Subject: Re: Support for MultiGet / SQL In clause
>> > >
>> > > Sriram,
>> > >
>> > > Would a secondary index help you:
>> > >
>> >
> http://hadoop.apache.org/hbase/docs/r0.20.2/api/org/apache/hadoop/hbase/
>> > > client/tableindexed/package-summary.html#package_description
>> > > .
>> > >
>> > > The index is stored in a separate table, but the index is managed
> for
>> > > you.
>> > >
>> > > I don't think you can do an arbitrary "in" query, though. =A0If the
> keys
>> > > that
>> > > you want to include in the "in" are reasonably close neighbors,
> you
>> > > could do
>> > > a scan and skip ones that are uninteresting. =A0You could also try a
>> > batch
>> > > Get
>> > > by applying a separate patch, see
>> > > http://issues.apache.org/jira/browse/HBASE-1845.
>> > >
>> > > Marc Limotte
>> > >
>> > > On Tue, Jan 19, 2010 at 8:45 AM, Sriram Muthuswamy Chittathoor <
>> > > sriramc@ivycomptech.com> wrote:
>> > >
>> > > > Is there any support for this. =A0I want to do this
>> > > >
>> > > > 1. =A0Create a second table to maintain mapping between secondary
>> > column
>> > > > and the rowid's of the primary table
>> > > >
>> > > > 2. =A0Use this second table to get the rowid's to lookup from the
>> > > primary
>> > > > table using a SQL In like clause ---
>> > > >
>> > > > Basically I am doing this to speed up querying by =A0Non-row key
>> > > columns.
>> > > >
>> > > > Thanks
>> > > >
>> > > > Sriram C
>> > > >
>> > > >
>> > > > This email is sent for and on behalf of Ivy Comptech Private
>> > Limited.
>> > > Ivy
>> > > > Comptech Private Limited is a limited liability company.
>> > > >
>> > > > This email and any attachments are confidential, and may be
> legally
>> > > > privileged and protected by copyright. If you are not the
> intended
>> > > recipient
>> > > > dissemination or copying of this email is prohibited. If you
> have
>> > > received
>> > > > this in error, please notify the sender by replying by email and
>> > then
>> > > delete
>> > > > the email completely from your system.
>> > > > Any views or opinions are solely those of the sender. =A0This
>> > > communication
>> > > > is not intended to form a binding contract on behalf of Ivy
> Comptech
>> > > Private
>> > > > Limited unless expressly indicated to the contrary and properly
>> > > authorised.
>> > > > Any actions taken on the basis of this email are at the
> recipient's
>> > > own
>> > > > risk.
>> > > >
>> > > > Registered office:
>> > > > Ivy Comptech Private Limited, Cyber Spazio, Road No. 2, Banjara
>> > Hills,
>> > > > Hyderabad 500 033, Andhra Pradesh, India. Registered number:
> 37994.
>> > > > Registered in India. A list of members' names is available for
>> > > inspection at
>> > > > the registered office.
>> > > >
>> > > >
>> > >
>>
>