hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ryan Rawson <ryano...@gmail.com>
Subject Re: [jira] Commented: (HBASE-1715) compaction failure in ScanWildcardColumnTracker.checkColumn
Date Tue, 28 Jul 2009 02:27:38 GMT
that looks like 2 column families in the same file???

On Mon, Jul 27, 2009 at 6:58 PM, Andrew Purtell (JIRA)<jira@apache.org> wrote:
>
>    [ https://issues.apache.org/jira/browse/HBASE-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12735889#action_12735889
]
>
> Andrew Purtell commented on HBASE-1715:
> ---------------------------------------
>
> The schema:
>
> {noformat}
> hbase(main):004:0> htd = admin.getTableDescriptor(Bytes.toBytes('content'))
> => #<Java::OrgApacheHadoopHbase::HTableDescriptor:0x2d6f4ce0 @java_object=#<Java::JavaObject:0x66201d6d>>
> hbase(main):005:0> htd.toString
> => "{NAME => 'content', FAMILIES => [{NAME => 'content', VERSIONS => '1',
COMPRESSION => 'GZ', TTL => '2147483647',
>    BLOCKSIZE => '65536', IN_MEMORY => 'false',BLOCKCACHE => 'true'},
> {NAME => 'info', VERSIONS => '100', COMPRESSION => 'NONE', TTL => '2147483647',
BLOCKSIZE => '65536',
>    IN_MEMORY => 'false', BLOCKCACHE =>  'true'},
> {NAME => 'url', VERSIONS => '1', COMPRESSION => 'GZ', TTL => '2147483647',
BLOCKSIZE => '65536',
>    IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}"
> {noformat}
>
>> compaction failure in ScanWildcardColumnTracker.checkColumn
>> -----------------------------------------------------------
>>
>>                 Key: HBASE-1715
>>                 URL: https://issues.apache.org/jira/browse/HBASE-1715
>>             Project: Hadoop HBase
>>          Issue Type: Bug
>>            Reporter: Andrew Purtell
>>            Priority: Blocker
>>             Fix For: 0.20.0
>>
>>         Attachments: HBASE-1715-v2.patch, HBASE-1715.patch
>>
>>
>> I have at least one region that won't compact.
>> {noformat}
>> hbase> status 'detailed'
>> [...]
>> content,0b41cdd2ee9b36b0674ad423089800ba,1248257816633
>>      stores=3, storefiles=113, storefileSizeMB=1213, memstoreSizeMB=0, storefileIndexSizeMB=0
>> [...]
>> hbase> major_compact 'content'
>> [...]
>> hbase> status 'detailed'
>> [...]
>> content,0b41cdd2ee9b36b0674ad423089800ba,1248257816633
>>      stores=3, storefiles=113, storefileSizeMB=1213, memstoreSizeMB=0, storefileIndexSizeMB=0
>> [...]
>> hbase> major_compact 'content,0b41cdd2ee9b36b0674ad423089800ba,1248257816633'
>> [...]
>> hbase> status 'detailed'
>> [...]
>> content,0b41cdd2ee9b36b0674ad423089800ba,1248257816633
>>      stores=3, storefiles=113, storefileSizeMB=1213, memstoreSizeMB=0, storefileIndexSizeMB=0
>> [...]
>> {noformat}
>> {noformat}
>> $ hadoop fs -ls /hbase/content/1226419153/content
>> Found 37 items
>> -rw-r--r--   2 hadoop supergroup   86422089 2009-07-24 16:11 /hbase/content/1226419153/content/1045181559873943545
>> -rw-r--r--   2 hadoop supergroup    7167852 2009-07-26 05:13 /hbase/content/1226419153/content/1225211885117827793
>> -rw-r--r--   2 hadoop supergroup       2678 2009-07-24 20:24 /hbase/content/1226419153/content/1275251824404920815
>> -rw-r--r--   2 hadoop supergroup   10288489 2009-07-26 02:16 /hbase/content/1226419153/content/1386224161790061095
>> -rw-r--r--   2 hadoop supergroup   16111798 2009-07-24 23:43 /hbase/content/1226419153/content/1454452327579297030
>> -rw-r--r--   2 hadoop supergroup   12650208 2009-07-26 23:31 /hbase/content/1226419153/content/1534514745508157864
>> -rw-r--r--   2 hadoop supergroup    6994590 2009-07-27 10:45 /hbase/content/1226419153/content/1706519919143970421
>> -rw-r--r--   2 hadoop supergroup   13449537 2009-07-26 20:53 /hbase/content/1226419153/content/2186668356269910871
>> -rw-r--r--   2 hadoop supergroup   10397457 2009-07-26 22:15 /hbase/content/1226419153/content/2292706332643873473
>> -rw-r--r--   2 hadoop supergroup    6481576 2009-07-27 05:59 /hbase/content/1226419153/content/2438489739664745000
>> -rw-r--r--   2 hadoop supergroup   10810191 2009-07-25 19:48 /hbase/content/1226419153/content/2538008511360230014
>> -rw-r--r--   2 hadoop supergroup   13877559 2009-07-27 18:26 /hbase/content/1226419153/content/2772019170563217117
>> -rw-r--r--   2 hadoop supergroup   12796040 2009-07-26 10:14 /hbase/content/1226419153/content/2902101782772083009
>> -rw-r--r--   2 hadoop supergroup    6541657 2009-07-27 01:06 /hbase/content/1226419153/content/3113808018684114931
>> -rw-r--r--   2 hadoop supergroup    8655428 2009-07-25 18:17 /hbase/content/1226419153/content/3817932211925236778
>> -rw-r--r--   2 hadoop supergroup    1445535 2009-07-27 16:10 /hbase/content/1226419153/content/4286233593585189878
>> -rw-r--r--   2 hadoop supergroup    9139508 2009-07-27 02:11 /hbase/content/1226419153/content/495340788313226264
>> -rw-r--r--   2 hadoop supergroup    3313459 2009-07-26 05:57 /hbase/content/1226419153/content/5167064731599803595
>> -rw-r--r--   2 hadoop supergroup    9473393 2009-07-26 14:44 /hbase/content/1226419153/content/5490426319631514899
>> -rw-r--r--   2 hadoop supergroup    9321224 2009-07-26 19:40 /hbase/content/1226419153/content/5790825797519034907
>> -rw-r--r--   2 hadoop supergroup   12171283 2009-07-27 12:20 /hbase/content/1226419153/content/6036401533248383324
>> -rw-r--r--   2 hadoop supergroup  824790136 2009-07-23 22:28 /hbase/content/1226419153/content/6211942192349190964
>> -rw-r--r--   2 hadoop supergroup    9905606 2009-07-27 07:45 /hbase/content/1226419153/content/6295275445036553977
>> -rw-r--r--   2 hadoop supergroup   23857510 2009-07-27 17:02 /hbase/content/1226419153/content/6535266251812885635
>> -rw-r--r--   2 hadoop supergroup    9177439 2009-07-26 11:21 /hbase/content/1226419153/content/6625735185665629662
>> -rw-r--r--   2 hadoop supergroup    6916543 2009-07-27 20:15 /hbase/content/1226419153/content/6934569497672884872
>> -rw-r--r--   2 hadoop supergroup    8818427 2009-07-27 13:48 /hbase/content/1226419153/content/7162767181372457089
>> -rw-r--r--   2 hadoop supergroup   12028925 2009-07-25 08:48 /hbase/content/1226419153/content/7254368961746328584
>> -rw-r--r--   2 hadoop supergroup   14695089 2009-07-27 09:16 /hbase/content/1226419153/content/728058506789102941
>> -rw-r--r--   2 hadoop supergroup    9154325 2009-07-27 03:43 /hbase/content/1226419153/content/7462549804082617977
>> -rw-r--r--   2 hadoop supergroup   22295283 2009-07-27 21:46 /hbase/content/1226419153/content/7498645200757573769
>> -rw-r--r--   2 hadoop supergroup    5414671 2009-07-27 15:27 /hbase/content/1226419153/content/758918234053985701
>> -rw-r--r--   2 hadoop supergroup   11260015 2009-07-26 08:16 /hbase/content/1226419153/content/7626050291010778604
>> -rw-r--r--   2 hadoop supergroup   11309116 2009-07-26 12:57 /hbase/content/1226419153/content/7704085331915902813
>> -rw-r--r--   2 hadoop supergroup    6326623 2009-07-26 17:58 /hbase/content/1226419153/content/7735737241739599956
>> -rw-r--r--   2 hadoop supergroup        832 2009-07-24 20:15 /hbase/content/1226419153/content/8170327402351444879
>> -rw-r--r--   2 hadoop supergroup   13480887 2009-07-26 16:32 /hbase/content/1226419153/content/890729481029340216
>> {noformat}
>> Relevant nonstandard options:
>> {noformat}
>> <property>
>>   <name>hbase.hregion.max.filesize</name>
>>   <value>1073741824</value>
>> </property>
>> {noformat}
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
>

Mime
View raw message