accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Keith Turner (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (ACCUMULO-2405) Race condition in MetadataIT.mergeMeta()
Date Tue, 25 Feb 2014 17:30:20 GMT

     [ https://issues.apache.org/jira/browse/ACCUMULO-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Keith Turner updated ACCUMULO-2405:
-----------------------------------

    Fix Version/s: 1.6.0

> Race condition in MetadataIT.mergeMeta()
> ----------------------------------------
>
>                 Key: ACCUMULO-2405
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2405
>             Project: Accumulo
>          Issue Type: Bug
>         Environment: 2ef2d88598f5e14f8f96b77fecca66dcd7196448 
>            Reporter: Keith Turner
>             Fix For: 1.6.0
>
>
> Saw the following error while running ITs.
> {noformat}
> mergeMeta(org.apache.accumulo.test.functional.MetadataIT)  Time elapsed: 10.39 sec  <<<
FAILURE!
> java.lang.AssertionError
> 	at org.junit.Assert.fail(Assert.java:86)
> 	at org.junit.Assert.assertTrue(Assert.java:41)
> 	at org.junit.Assert.assertTrue(Assert.java:52)
> 	at org.apache.accumulo.test.functional.MetadataIT.mergeMeta(MetadataIT.java:103)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
> 	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> 	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
> 	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> 	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
> {noformat}
> Looking at the test it merges the metadata table, sleeps for 2 secs, and then scans for
delete entries. Looking in the logs I think the AGC deleted the delete entries while the test
was sleeping.
> Saw the following in the master log
> {noformat}
> 2014-02-25 12:06:36,981 [master.EventCoordinator] INFO : Merge state of !0<< set
to MERGING
> 2014-02-25 12:06:37,047 [master.EventCoordinator] INFO : Merge state of !0<< set
to COMPLETE
> 2014-02-25 12:06:37,169 [state.MergeStats] INFO : Computing next merge state for !0<<
which is presently COMPLETE isDelete : false
> 2014-02-25 12:06:37,189 [master.EventCoordinator] INFO : Merge state of !0<< set
to NONE
> 2014-02-25 12:06:37,212 [tableOps.MasterRepo] INFO : removing merge information No Merge
in progress
> 2014-02-25 12:06:37,213 [master.EventCoordinator] INFO : Merge state of !0 cleared
> {noformat}
> Then saw the following in the AGC logs.
> {noformat}
> 2014-02-25 12:06:39,335 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/t-000003u
> 2014-02-25 12:06:39,335 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/t-000003v
> 2014-02-25 12:06:39,335 [fs.TrashPolicyDefault] INFO : Namenode trash configuration:
Deletion interval = 0 minutes, Emptier interval = 0 minutes.
> 2014-02-25 12:06:39,335 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/t-000003w
> 2014-02-25 12:06:39,336 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/t-000003y
> 2014-02-25 12:06:39,336 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/table_info
> 2014-02-25 12:06:39,336 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/t-000003x
>   .
>   .
>   .
> 2014-02-25 12:06:39,343 [impl.RootTabletLocator] TRACE: tid=12 oid=91  Found root tablet
at host1:40158|1446a02ccfe0002 in 0.000 secs
> 2014-02-25 12:06:39,344 [impl.TabletServerBatchWriter] TRACE: Started sending 15 mutations
to 1 tablet servers
> 2014-02-25 12:06:39,344 [impl.ThriftTransportPool] TRACE: Using existing connection to
host1:40158
> 2014-02-25 12:06:39,366 [impl.ThriftTransportPool] TRACE: Returned connection host1:40158
(120000) ioCount : 586
> 2014-02-25 12:06:39,367 [impl.TabletServerBatchWriter] TRACE: sent 15 mutations to host1:40158
in 0.02 secs (681.82 mutations/sec) with 0 failures
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message