hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lars George (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-3492) NPE while splitting table with empty column family store
Date Mon, 31 Jan 2011 09:30:12 GMT

    [ https://issues.apache.org/jira/browse/HBASE-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12988705#comment-12988705
] 

Lars George commented on HBASE-3492:
------------------------------------

During the NPE I also get a .META. like this

{code}
hbase(main):020:0> scan '.META.', { COLUMNS => ['info:regioninfo'] }
ROW                                       COLUMN+CELL                                    
                                                                       
 testtable,,1296464923560.4712495ddd39cae column=info:regioninfo, timestamp=1296464924169,
value=REGION => {NAME => 'testtable,,1296464923560.4712495ddd39cae8c09
 8c090348acc5d9aa7.                       0348acc5d9aa7.', STARTKEY => '', ENDKEY =>
'row-mdc', ENCODED => 4712495ddd39cae8c090348acc5d9aa7, TABLE => {{NAME => '
                                          testtable', FAMILIES => [{NAME => 'cf1', BLOOMFILTER
=> 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIO
                                          NS => '3', TTL => '2147483647', BLOCKSIZE
=> '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'cf2', BLOO
                                          MFILTER => 'NONE', REPLICATION_SCOPE => '0',
COMPRESSION => 'NONE', VERSIONS => '3', TTL => '2147483647', BLOCKSIZE => 
                                          '65536', IN_MEMORY => 'false', BLOCKCACHE =>
'true'}]}}                                                                
 testtable,row-mdc,1296465498825.f3b822c1 column=info:regioninfo, timestamp=1296465499372,
value=REGION => {NAME => 'testtable,row-mdc,1296465498825.f3b822c1e314
 e31442a0de850d1c2aa5ccec.                42a0de850d1c2aa5ccec.', STARTKEY => 'row-mdc',
ENDKEY => 'row-seq', ENCODED => f3b822c1e31442a0de850d1c2aa5ccec, TABLE 
                                          => {{NAME => 'testtable', FAMILIES => [{NAME
=> 'cf1', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 
                                          'NONE', VERSIONS => '3', TTL => '2147483647',
BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME 
                                          => 'cf2', BLOOMFILTER => 'NONE', REPLICATION_SCOPE
=> '0', COMPRESSION => 'NONE', VERSIONS => '3', TTL => '2147483647',
                                           BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}]}}                                                  
 testtable,row-seq,1296465498825.5f083c64 column=info:regioninfo, timestamp=1296465802030,
value=REGION => {NAME => 'testtable,row-seq,1296465498825.5f083c641da7
 1da708244de17443b88d8df8.                08244de17443b88d8df8.', STARTKEY => 'row-seq',
ENDKEY => '', ENCODED => 5f083c641da708244de17443b88d8df8, OFFLINE => tr
                                          ue, SPLIT => true, TABLE => {{NAME => 'testtable',
FAMILIES => [{NAME => 'cf1', BLOOMFILTER => 'NONE', REPLICATION_SCOP
                                          E => '0', COMPRESSION => 'NONE', VERSIONS
=> '3', TTL => '2147483647', BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOC
                                          KCACHE => 'true'}, {NAME => 'cf2', BLOOMFILTER
=> 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => 
                                          '3', TTL => '2147483647', BLOCKSIZE => '65536',
IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}                         
 testtable,row-seq,1296465801544.0b037fd8 column=info:regioninfo, timestamp=1296465802204,
value=REGION => {NAME => 'testtable,row-seq,1296465801544.0b037fd873a9
 73a955a8b813736663a46deb.                55a8b813736663a46deb.', STARTKEY => 'row-seq',
ENDKEY => 'row-vfk', ENCODED => 0b037fd873a955a8b813736663a46deb, TABLE 
                                          => {{NAME => 'testtable', FAMILIES => [{NAME
=> 'cf1', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 
                                          'NONE', VERSIONS => '3', TTL => '2147483647',
BLOCKSIZE => '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME 
                                          => 'cf2', BLOOMFILTER => 'NONE', REPLICATION_SCOPE
=> '0', COMPRESSION => 'NONE', VERSIONS => '3', TTL => '2147483647',
                                           BLOCKSIZE => '65536', IN_MEMORY => 'false',
BLOCKCACHE => 'true'}]}}                                                  
 testtable,row-vfk,1296465801544.cc8129ba column=info:regioninfo, timestamp=1296465802204,
value=REGION => {NAME => 'testtable,row-vfk,1296465801544.cc8129ba713c
 713ce041892b784398647372.                e041892b784398647372.', STARTKEY => 'row-vfk',
ENDKEY => '', ENCODED => cc8129ba713ce041892b784398647372, TABLE => {{NA
                                          ME => 'testtable', FAMILIES => [{NAME =>
'cf1', BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE',
                                           VERSIONS => '3', TTL => '2147483647', BLOCKSIZE
=> '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'cf2
                                          ', BLOOMFILTER => 'NONE', REPLICATION_SCOPE =>
'0', COMPRESSION => 'NONE', VERSIONS => '3', TTL => '2147483647', BLOCKS
                                          IZE => '65536', IN_MEMORY => 'false', BLOCKCACHE
=> 'true'}]}}                                                         
5 row(s) in 0.1060 seconds
{code}

Note the wrong endkey where the NPE struck. Messy!

> NPE while splitting table with empty column family store
> --------------------------------------------------------
>
>                 Key: HBASE-3492
>                 URL: https://issues.apache.org/jira/browse/HBASE-3492
>             Project: HBase
>          Issue Type: Bug
>          Components: regionserver
>    Affects Versions: 0.90.0
>            Reporter: Lars George
>            Priority: Minor
>
> I did a simple test on trunk where I create a table (after wiping the local /tmp/hbase-<username>):
> {code}
> hbase(main):001:0> create 'testtable', 'cf1', 'cf2'                              
                                                                   
> {code}
> Then I inserted 17k rows:
> {code}
> hbase(main):002:0> for i in 'a'..'z' do for j in 'a'..'z' do for k in 'a'..'z' do
put 'testtable', "row-#{i}#{j}#{k}", "cf1:#{k}", "#{k}" end end end
> {code}
> and called 
> {code}
> hbase(main):003:0> split 'testttable'
> {code}
> and the logs gave this NPE and _no_ split was performed:
> {code}
> 2011-01-31 10:06:38,534 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Started memstore
flush for testtable,,1296461957099.2528e23534565a83e2c8590d33f3a47c., current region memstore
size 3.5m
> 2011-01-31 10:06:38,575 DEBUG org.apache.hadoop.hbase.regionserver.HRegion: Finished
snapshotting, commencing flushing stores
> 2011-01-31 10:06:38,856 INFO org.apache.hadoop.hbase.regionserver.Store: Renaming flushed
file at file:/tmp/hbase-larsgeorge/hbase/testtable/2528e23534565a83e2c8590d33f3a47c/.tmp/5265602271926296451
to file:/tmp/hbase-larsgeorge/hbase/testtable/2528e23534565a83e2c8590d33f3a47c/cf1/5349044325262044918
> 2011-01-31 10:06:38,861 INFO org.apache.hadoop.hbase.regionserver.Store: Added file:/tmp/hbase-larsgeorge/hbase/testtable/2528e23534565a83e2c8590d33f3a47c/cf1/5349044325262044918,
entries=17576, sequenceid=17588, memsize=3.5m, filesize=549.9k
> 2011-01-31 10:06:38,863 INFO org.apache.hadoop.hbase.regionserver.HRegion: Finished memstore
flush of ~3.5m for region testtable,,1296461957099.2528e23534565a83e2c8590d33f3a47c. in 328ms,
sequenceid=17588, compaction requested=false
> 2011-01-31 10:06:38,869 INFO org.apache.hadoop.hbase.regionserver.HRegion: Starting compaction
on region testtable,,1296461957099.2528e23534565a83e2c8590d33f3a47c.
> 2011-01-31 10:06:38,870 INFO org.apache.hadoop.hbase.regionserver.HRegion: aborted compaction
on region testtable,,1296461957099.2528e23534565a83e2c8590d33f3a47c. after 0sec
> 2011-01-31 10:06:38,872 ERROR org.apache.hadoop.hbase.regionserver.CompactSplitThread:
Compaction failed for region testtable,,1296461957099.2528e23534565a83e2c8590d33f3a47c.
> java.lang.NullPointerException
>         at org.apache.hadoop.hbase.regionserver.Store.checkSplit(Store.java:1367)
>         at org.apache.hadoop.hbase.regionserver.Store.compact(Store.java:633)
>         at org.apache.hadoop.hbase.regionserver.HRegion.compactStores(HRegion.java:793)
>         at org.apache.hadoop.hbase.regionserver.CompactSplitThread.run(CompactSplitThread.java:81)
> 2011-01-31 10:06:38,873 DEBUG org.apache.hadoop.hbase.regionserver.CompactSplitThread:
Compaction requested for testtable,,1296461957099.2528e23534565a83e2c8590d33f3a47c. because
User-triggered split; priority=1, compaction queue size=0
> {code}
> I added a row with data in cf2:
> {code}
> hbase(main):005:0> put 'testtable', 'row1', 'cf2', 'test1'                       
                                                                   
> {code}
> and the tried to split the table again like above and now it worked.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message