hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anoop Sam John (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12041) AssertionError in HFilePerformanceEvaluation.UniformRandomReadBenchmark
Date Tue, 23 Sep 2014 05:13:34 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14144358#comment-14144358
] 

Anoop Sam John commented on HBASE-12041:
----------------------------------------

bq. We then pass the Cell through to DBE. That does the actual serializing. It needs serializer
too? Or, rather, it is THE Serializer We should ask DBE to serialize the key to add to the
index? 
It is THE serializer IMO.
Atleast to the index we write the key as it would look like in KV. So I am not sure whether
it will be correct to ask the DBE to create a key to be added to index .
bq.In Writer, it needs to be able to figure key to add to the hfile index at least. It wants
the comparator to ensure all is in order. 
Yes we use KVComparator here inside the HFileWriter to compare the keys and make sure they
are in order. (The name only is KVComparator  actually it compares Cells)  And the key to
index we create using the rk,cf,q,ts,type from Cell and serializing as in KeyValue. That is
the writer decides the way.

> AssertionError in HFilePerformanceEvaluation.UniformRandomReadBenchmark
> -----------------------------------------------------------------------
>
>                 Key: HBASE-12041
>                 URL: https://issues.apache.org/jira/browse/HBASE-12041
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.99.1
>            Reporter: Jean-Marc Spaggiari
>            Assignee: stack
>
> {code}
> 2014-09-19 05:18:54,719 INFO  [0] hbase.HFilePerformanceEvaluation: Running UniformRandomReadBenchmark
for 1000000 rows.
> 2014-09-19 05:18:54,719 INFO  [0] hfile.CacheConfig: CacheConfig:disabled
> Exception in thread "0" java.lang.AssertionError: Expected 0000472128 but got 0000472127
>         at org.apache.hadoop.hbase.PerformanceEvaluationCommons.assertKey(PerformanceEvaluationCommons.java:50)
>         at org.apache.hadoop.hbase.PerformanceEvaluationCommons.assertKey(PerformanceEvaluationCommons.java:45)
>         at org.apache.hadoop.hbase.HFilePerformanceEvaluation$UniformRandomReadBenchmark.doRow(HFilePerformanceEvaluation.java:295)
>         at org.apache.hadoop.hbase.HFilePerformanceEvaluation$RowOrientedBenchmark.run(HFilePerformanceEvaluation.java:169)
>         at org.apache.hadoop.hbase.HFilePerformanceEvaluation.runBenchmark(HFilePerformanceEvaluation.java:121)
>         at org.apache.hadoop.hbase.HFilePerformanceEvaluation$2.run(HFilePerformanceEvaluation.java:87)
>         at java.lang.Thread.run(Thread.java:744)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message