hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Todd Lipcon (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-2884) TestHFileOutputFormat intermittent diff: LoadIncrementalHFiles should put expected data in table expected:<2048> but was:<1024>
Date Wed, 28 Jul 2010 17:45:17 GMT

    [ https://issues.apache.org/jira/browse/HBASE-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12893273#action_12893273
] 

Todd Lipcon commented on HBASE-2884:
------------------------------------

Looked at this a bit -- the thing is that it's expecting 2048 entries, which would indicate
mapred.map.tasks was set to 2. Each mapper is expected to generate 1024 rows. But, we seed
Random() in RandomKVGeneratingMapper with System.currentTimeMillis - perhaps in this flaky
case both mappers started in the same millisecond and thus generated identical data. When
we go and scan, we only get 1024 rows because we just double-inserted everything?

> TestHFileOutputFormat intermittent diff: LoadIncrementalHFiles should put expected data
in table expected:<2048> but was:<1024>
> -------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-2884
>                 URL: https://issues.apache.org/jira/browse/HBASE-2884
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Kannan Muthukkaruppan
>         Attachments: TestHFileOutputFormat-output.txt, TestHFileOutputFormat.txt
>
>
> {code}
> Tests run: 5, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 160.582 sec <<<
FAILURE!
> testMRIncrementalLoad(org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat)  Time
elapsed: 85.676 sec  <<< FAILURE!
> java.lang.AssertionError: LoadIncrementalHFiles should put expected data in table expected:<2048>
but was:<1024>
>         at org.junit.Assert.fail(Assert.java:91)
>         at org.junit.Assert.failNotEquals(Assert.java:645)
>         at org.junit.Assert.assertEquals(Assert.java:126)
>         at org.junit.Assert.assertEquals(Assert.java:470)
>         at org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat.doIncrementalLoadTest(TestHFileOutputFormat.java:300)
>         at org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat.testMRIncrementalLoad(TestHFileOutputFormat.java:248)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> {code}
> Will upload full test output shortly.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message