hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Enis Soztutar (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-8377) IntegrationTestBigLinkedList calculates wrap for linked list size incorrectly
Date Thu, 18 Apr 2013 23:13:16 GMT

    [ https://issues.apache.org/jira/browse/HBASE-8377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13635815#comment-13635815
] 

Enis Soztutar commented on HBASE-8377:
--------------------------------------

Thanks Sergey for taking a look. 
count parameter is mainly used to track the index of the record generated from this map task
(client name). We save this in the row to help with debugging. So if a map task generates
25M, they will share the same client name, but will have counts: 0..24999999. 
We should do >= instead of >, because count=0 is also passed at the first run. We only
ignore count = -1. 
count + 1 should really be count + i to add the index. 

                
> IntegrationTestBigLinkedList calculates wrap for linked list size incorrectly
> -----------------------------------------------------------------------------
>
>                 Key: HBASE-8377
>                 URL: https://issues.apache.org/jira/browse/HBASE-8377
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Enis Soztutar
>            Assignee: Enis Soztutar
>             Fix For: 0.98.0, 0.94.8, 0.95.1
>
>         Attachments: hbase-8377_v1.patch
>
>
> There is a bug in IntegrationTestBigLinkedList that it reads the wrong config key to
calculate the wrap size for the linked list. It uses num mappers, instead of num recors per
mapper. This has not been caught before, because it causes the test to fail only if 1M is
not divisible by num mappers. So launching the job with num mappers 1, 2, 4, 5 would succeed,
while 6 will fail, etc. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message