hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HBASE-1500) KeyValue$KeyComparator array overrun
Date Thu, 11 Jun 2009 21:29:07 GMT

     [ https://issues.apache.org/jira/browse/HBASE-1500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Andrew Purtell updated HBASE-1500:
----------------------------------

    Attachment: test.log.gz
                test.rb

To reproduce, run the attached script using the latest trunk.

{{./bin/hbase shell test.rb}}

Wait for the split to finish. Then, try a count:

{{./bin/hbase shell}}
{{hbase> count 'test'}}

{code}
count 'test'

09/06/11 14:23:32 DEBUG client.HConnectionManager$TableServers: address: 192.168
.56.1:22720, regioninfo: REGION => {NAME => 'test,,1244755386281', STARTKEY => '
', ENDKEY => '7fd99653bf71ea6c747d34db7846c708', ENCODED => 1840196805, TABLE =>
 {{NAME => 'test', FAMILIES => [{NAME => 'content', VERSIONS => '3', COMPRESSION
 => 'NONE', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLO
CKCACHE => 'false'}, {NAME => 'info', VERSIONS => '3', COMPRESSION => 'NONE',
TT
L => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'fa
lse'}]}}
09/06/11 14:23:32 DEBUG client.HConnectionManager$TableServers: Cache hit for ro
w <> in tableName .META.: location server 192.168.56.1:22720, location region na
me .META.,,1
09/06/11 14:23:32 DEBUG client.HTable$ClientScanner: Creating scanner over test
starting at key ''
09/06/11 14:23:32 DEBUG client.HTable$ClientScanner: Advancing internal scanner
to startKey at ''
09/06/11 14:23:32 DEBUG client.HConnectionManager$TableServers: Cache hit for ro
w <> in tableName test: location server 192.168.56.1:22720, location region name
 test,,1244755386281
Current count: 1000, row: ffe83c9f18ab2f057cd6435f04228377

09/06/11 14:23:33 DEBUG client.HTable$ClientScanner: Advancing forward from regi
on REGION => {NAME => 'test,,1244755386281', STARTKEY => '', ENDKEY => '7fd99653
bf71ea6c747d34db7846c708', ENCODED => 1840196805, TABLE => {{NAME => 'test', FAM
ILIES => [{NAME => 'content', VERSIONS => '3', COMPRESSION => 'NONE', TTL =>
'21
47483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'false'}, {
NAME => 'info', VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', BLO
CKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'false'}]}}
09/06/11 14:23:33 DEBUG client.HTable$ClientScanner: Advancing internal scanner
to startKey at '7fd99653bf71ea6c747d34db7846c708'
NativeException: java.lang.RuntimeException: org.apache.hadoop.hbase.client.Retr
iesExhaustedException: Trying to contact region server null for region , row '7f
d99653bf71ea6c747d34db7846c708', but failed after 5 attempts.
Exceptions:
java.lang.ArrayIndexOutOfBoundsException: 32
java.lang.ArrayIndexOutOfBoundsException: 32
java.lang.ArrayIndexOutOfBoundsException: 32
java.lang.ArrayIndexOutOfBoundsException: 32
java.lang.ArrayIndexOutOfBoundsException: 32
        from org/apache/hadoop/hbase/client/HTable.java:2002:in `hasNext'
        from sun.reflect.GeneratedMethodAccessor2:-1:in `invoke'
{code}

Probably the script does a bit more than is strictly necessary to reproduce. 

Attached also is the master+regionserver log at DEBUG level from the test. 

> KeyValue$KeyComparator array overrun
> ------------------------------------
>
>                 Key: HBASE-1500
>                 URL: https://issues.apache.org/jira/browse/HBASE-1500
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.20.0
>            Reporter: Andrew Purtell
>            Priority: Blocker
>             Fix For: 0.20.0
>
>         Attachments: hbase.log.gz, test.log.gz, test.rb
>
>
> {code}
> 09/06/08 22:58:47 INFO zookeeper.ZooKeeper: Initiating client connection, host=B
> OA03:2181,BOA02:2181,BOA01:2181,BOA04:2181 sessionTimeout=10000 watcher=org.apac
> he.hadoop.hbase.zookeeper.WatcherWrapper@518bf072
> 09/06/08 22:58:47 INFO zookeeper.ClientCnxn: zookeeper.disableAutoWatchReset is
> false
> 09/06/08 22:58:47 INFO zookeeper.ClientCnxn: Attempting connection to server BOA
> 04/172.20.3.231:2181
> 09/06/08 22:58:47 INFO zookeeper.ClientCnxn: Priming connection to java.nio.chan
> nels.SocketChannel[connected local=/172.20.3.232:40296 remote=BOA04/172.20.3.231
> :2181]
> 09/06/08 22:58:47 INFO zookeeper.ClientCnxn: Server connection successful
> 09/06/08 22:58:47 WARN mapred.JobClient: Use GenericOptionsParser for parsing th
> e arguments. Applications should implement Tool for the same.
> 09/06/08 22:58:47 WARN mapred.JobClient: No job jar file set.  User classes may
> not be found. See JobConf(Class) or JobConf#setJar(String).
> 09/06/08 22:58:47 INFO zookeeper.ZooKeeper: Initiating client connection, host=B
> OA03:2181,BOA02:2181,BOA01:2181,BOA04:2181 sessionTimeout=10000 watcher=org.apac
> he.hadoop.hbase.zookeeper.WatcherWrapper@362f0d54
> 09/06/08 22:58:47 INFO zookeeper.ClientCnxn: Attempting connection to server BOA
> 03/172.20.3.230:2181
> 09/06/08 22:58:47 INFO zookeeper.ClientCnxn: Priming connection to java.nio.chan
> nels.SocketChannel[connected local=/172.20.3.232:42792 remote=BOA03/172.20.3.230
> :2181]
> 09/06/08 22:58:47 INFO zookeeper.ClientCnxn: Server connection successful
> 09/06/08 22:58:48 INFO mapred.TableInputFormatBase: split: 0->BOA04.trendmicro.c
> om:,01e33c601a7a9dd0ddb5c8427438f2f1
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 32
>         at org.apache.hadoop.hbase.util.Bytes.compareTo(Bytes.java:798)
>         at org.apache.hadoop.hbase.KeyValue$KeyComparator.compareRows(KeyValue.j
> ava:1760)
>         at org.apache.hadoop.hbase.KeyValue$KeyComparator.compare(KeyValue.java:
> 1696)
>         at org.apache.hadoop.hbase.KeyValue$KeyComparator.compare(KeyValue.java:
> 1755)
>         at org.apache.hadoop.hbase.KeyValue$KeyComparator.compare(KeyValue.java:
> 1687)
>         at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getCac
> hedLocation(HConnectionManager.java:697)
>         at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locate
> RegionInMeta(HConnectionManager.java:541)
>         at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locate
> Region(HConnectionManager.java:525)
>         at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locate
> Region(HConnectionManager.java:488)
>         at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getReg
> ionLocation(HConnectionManager.java:342)
>         at org.apache.hadoop.hbase.client.HTable.getRegionLocation(HTable.java:1
> 91)
>         at org.apache.hadoop.hbase.mapred.TableInputFormatBase.getSplits(TableIn
> putFormatBase.java:296)
>         at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:742)
>         at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1026)
>         at net.iridiant.crawler.mapred.DocumentParser.main(Unknown Source)
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message