hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-12782) ITBLL fails for me if generator does anything but 5M per maptask
Date Sat, 31 Jan 2015 07:03:35 GMT

    [ https://issues.apache.org/jira/browse/HBASE-12782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299704#comment-14299704
] 

stack commented on HBASE-12782:
-------------------------------

Hmm. No the 500M test actually passed:

{code}
	org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList$Verify$Counts
		REFERENCED=500000000
	File Input Format Counters
		Bytes Read=0
	File Output Format Counters
		Bytes Written=96
...

{code}

> ITBLL fails for me if generator does anything but 5M per maptask
> ----------------------------------------------------------------
>
>                 Key: HBASE-12782
>                 URL: https://issues.apache.org/jira/browse/HBASE-12782
>             Project: HBase
>          Issue Type: Bug
>          Components: integration tests
>    Affects Versions: 1.0.0, 0.98.9
>            Reporter: stack
>            Assignee: stack
>            Priority: Critical
>             Fix For: 1.0.0, 2.0.0, 1.1.0, 0.98.11
>
>         Attachments: 12782-0.98-addendum.txt, 12782.fix.txt, 12782.search.plus.archive.recovered.edits.txt,
12782.search.plus.txt, 12782.search.txt, 12782.unit.test.and.it.test.txt, 12782.unit.test.writing.txt,
12782v2.0.98.txt, 12782v2.txt, 12782v3.0.98.txt, 12782v3.txt, 12782v4.txt
>
>
> Anyone else seeing this?  If I do an ITBLL with generator doing 5M rows per maptask,
all is good -- verify passes. I've been running 5 servers and had one splot per server.  So
below works:
> HADOOP_CLASSPATH="/home/stack/conf_hbase:`/home/stack/hbase/bin/hbase classpath`" ./hadoop/bin/hadoop
--config ~/conf_hadoop org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList --monkey
serverKilling Generator 5 5000000 g1.tmp
> or if I double the map tasks, it works:
> HADOOP_CLASSPATH="/home/stack/conf_hbase:`/home/stack/hbase/bin/hbase classpath`" ./hadoop/bin/hadoop
--config ~/conf_hadoop org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList --monkey
serverKilling Generator 10 5000000 g2.tmp
> ...but if I change the 5M to 50M or 25M, Verify fails.
> Looking into it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message