hbase-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ted Yu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HBASE-2645) HLog writer can do 1-2 sync operations after lease has been recovered for split process.
Date Wed, 31 Oct 2012 16:43:13 GMT

    [ https://issues.apache.org/jira/browse/HBASE-2645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13487935#comment-13487935
] 

Ted Yu commented on HBASE-2645:
-------------------------------

{code}
r1403977 | stack | 2012-10-30 21:48:37 -0700 (Tue, 30 Oct 2012) | 1 line

HLog writer can do 1-2 sync operations after lease has been recovered for split process.
{code}
I don't see JIRA number in the checkin message.

Second, in https://builds.apache.org/job/PreCommit-HBASE-Build/3197//testReport/org.apache.hadoop.hbase.regionserver.wal/TestHLogSplit/testLogCannotBeWrittenOnceParsed/
:
{code}
Error Message

The log file could have at most 1 extra log entry, but can't have less. Zombie could write
6559 and logfile had only 6520 in logfile=hdfs://localhost:44865/hbase/t1/bbb/recovered.edits/0000000000000000001

Stacktrace

java.lang.AssertionError: The log file could have at most 1 extra log entry, but can't have
less. Zombie could write 6559 and logfile had only 6520 in logfile=hdfs://localhost:44865/hbase/t1/bbb/recovered.edits/0000000000000000001
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.hadoop.hbase.regionserver.wal.TestHLogSplit.testLogCannotBeWrittenOnceParsed(TestHLogSplit.java:190)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
{code}
                
> HLog writer can do 1-2 sync operations after lease has been recovered for split process.
> ----------------------------------------------------------------------------------------
>
>                 Key: HBASE-2645
>                 URL: https://issues.apache.org/jira/browse/HBASE-2645
>             Project: HBase
>          Issue Type: Bug
>          Components: Filters
>    Affects Versions: 0.90.4
>            Reporter: Cosmin Lehene
>            Assignee: Todd Lipcon
>            Priority: Blocker
>             Fix For: 0.96.0
>
>         Attachments: 2645.txt, 2645v2.txt, 2645v3.txt
>
>
> TestHLogSplit.testLogCannotBeWrittenOnceParsed is failing. 
> This test starts a thread that writes one edit to the log, syncs and counts. During this,
a HLog.splitLog operation is started. splitLog recovers the log lease before reading the log,
so that the original regionserver could not wake up and write after the split process started.
 
> The test compares the number of edits reported by the split process and by the writer
thread. Writer thread (called zombie in the test) should report <=  than the splitLog (sync()
might raise after the last edit gets written and the edit won't get counted by zombie thread).
However it appears that the zombie counts 1-2 more edits. So it looks like it can sync without
a lease.
> This might be a hdfs-0.20 related issue. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message