hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Andrew Purtell (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-1309) HFile catches key in Memcache with empty value
Date Sun, 05 Apr 2009 19:29:13 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12695894#action_12695894
] 

Andrew Purtell commented on HBASE-1309:
---------------------------------------

In my opinion HBase should not dictate to users what they can or cannot store into the system.

I did not say anything about empty keys, which of course makes no sense. 

The particular circumstance in this place is a crawling application that stores content indexed
by SHA-1 hash but also includes a family 'url:' which stores, for each unique object according
to hash, the list of URLs where it was encountered. The URLs are stored as column qualifiers
to produce a list of unique values with no need for scanning for duplicate elimination etc.
There is no need to store data also because all the data is already in the key. 

> HFile catches key in Memcache with empty value
> ----------------------------------------------
>
>                 Key: HBASE-1309
>                 URL: https://issues.apache.org/jira/browse/HBASE-1309
>             Project: Hadoop HBase
>          Issue Type: Bug
>    Affects Versions: 0.20.0
>            Reporter: Andrew Purtell
>         Attachments: hbase-hadoop-regionserver-nashua.zip
>
>
> 2009-04-05 02:12:56,497 FATAL org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay
of hlog required. Forcing server shutdown
> org.apache.hadoop.hbase.DroppedSnapshotException: region: content,,1238896745127
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:878)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:771)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:229)
> 	at org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:139)
> Caused by: java.io.IOException: Value cannot be null or empty
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkValue(HFile.java:485)
> 	at org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
> 	at org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:501)
> 	at org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:463)
> 	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:863)
> 	... 3 more

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message