hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12782) ITBLL fails for me if generator does anything but 5M per maptask
Date Sat, 31 Jan 2015 03:39:36 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299632#comment-14299632
] 

stack commented on HBASE-12782:
-------------------------------

This fix helps. The 125M and 250M tests pass where before they always failed. Looks like the
500M failed so some more stuff to fix it seems. Will open new issue for that.

[~jeffreyz] I should turn on DLR. I think I have tooling to figure any dataloss.  Should use
it while it fresh.

We need to have IT tests running with regularity (stating the obvious).  Might have caught
this bug at commit-time.

> ITBLL fails for me if generator does anything but 5M per maptask
> ----------------------------------------------------------------
>
>                 Key: HBASE-12782
>                 URL: https://issues.apache.org/jira/browse/HBASE-12782
>             Project: HBase
>          Issue Type: Bug
>          Components: integration tests
>    Affects Versions: 1.0.0, 0.98.9
>            Reporter: stack
>            Assignee: stack
>            Priority: Critical
>             Fix For: 1.0.0, 2.0.0, 1.1.0, 0.98.11
>
>         Attachments: 12782-0.98-addendum.txt, 12782.fix.txt, 12782.search.plus.archive.recovered.edits.txt,
12782.search.plus.txt, 12782.search.txt, 12782.unit.test.and.it.test.txt, 12782.unit.test.writing.txt,
12782v2.0.98.txt, 12782v2.txt, 12782v3.0.98.txt, 12782v3.txt, 12782v4.txt
>
>
> Anyone else seeing this?  If I do an ITBLL with generator doing 5M rows per maptask,
all is good -- verify passes. I've been running 5 servers and had one splot per server.  So
below works:
> HADOOP_CLASSPATH="/home/stack/conf_hbase:`/home/stack/hbase/bin/hbase classpath`" ./hadoop/bin/hadoop
--config ~/conf_hadoop org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList --monkey
serverKilling Generator 5 5000000 g1.tmp
> or if I double the map tasks, it works:
> HADOOP_CLASSPATH="/home/stack/conf_hbase:`/home/stack/hbase/bin/hbase classpath`" ./hadoop/bin/hadoop
--config ~/conf_hadoop org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList --monkey
serverKilling Generator 10 5000000 g2.tmp
> ...but if I change the 5M to 50M or 25M, Verify fails.
> Looking into it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message