accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Keith Turner (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ACCUMULO-2405) Race condition in MetadataIT.mergeMeta()
Date Tue, 25 Feb 2014 17:30:19 GMT
Keith Turner created ACCUMULO-2405:
--------------------------------------

             Summary: Race condition in MetadataIT.mergeMeta()
                 Key: ACCUMULO-2405
                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2405
             Project: Accumulo
          Issue Type: Bug
         Environment: 2ef2d88598f5e14f8f96b77fecca66dcd7196448 
            Reporter: Keith Turner


Saw the following error while running ITs.

{noformat}
mergeMeta(org.apache.accumulo.test.functional.MetadataIT)  Time elapsed: 10.39 sec  <<<
FAILURE!
java.lang.AssertionError
	at org.junit.Assert.fail(Assert.java:86)
	at org.junit.Assert.assertTrue(Assert.java:41)
	at org.junit.Assert.assertTrue(Assert.java:52)
	at org.apache.accumulo.test.functional.MetadataIT.mergeMeta(MetadataIT.java:103)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
{noformat}

Looking at the test it merges the metadata table, sleeps for 2 secs, and then scans for delete
entries. Looking in the logs I think the AGC deleted the delete entries while the test was
sleeping.

Saw the following in the master log

{noformat}
2014-02-25 12:06:36,981 [master.EventCoordinator] INFO : Merge state of !0<< set to
MERGING
2014-02-25 12:06:37,047 [master.EventCoordinator] INFO : Merge state of !0<< set to
COMPLETE
2014-02-25 12:06:37,169 [state.MergeStats] INFO : Computing next merge state for !0<<
which is presently COMPLETE isDelete : false
2014-02-25 12:06:37,189 [master.EventCoordinator] INFO : Merge state of !0<< set to
NONE
2014-02-25 12:06:37,212 [tableOps.MasterRepo] INFO : removing merge information No Merge in
progress
2014-02-25 12:06:37,213 [master.EventCoordinator] INFO : Merge state of !0 cleared
{noformat}

Then saw the following in the AGC logs.

{noformat}
2014-02-25 12:06:39,335 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/t-000003u
2014-02-25 12:06:39,335 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/t-000003v
2014-02-25 12:06:39,335 [fs.TrashPolicyDefault] INFO : Namenode trash configuration: Deletion
interval = 0 minutes, Emptier interval = 0 minutes.
2014-02-25 12:06:39,335 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/t-000003w
2014-02-25 12:06:39,336 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/t-000003y
2014-02-25 12:06:39,336 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/table_info
2014-02-25 12:06:39,336 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/t-000003x
  .
  .
  .
2014-02-25 12:06:39,343 [impl.RootTabletLocator] TRACE: tid=12 oid=91  Found root tablet at
host1:40158|1446a02ccfe0002 in 0.000 secs
2014-02-25 12:06:39,344 [impl.TabletServerBatchWriter] TRACE: Started sending 15 mutations
to 1 tablet servers
2014-02-25 12:06:39,344 [impl.ThriftTransportPool] TRACE: Using existing connection to host1:40158
2014-02-25 12:06:39,366 [impl.ThriftTransportPool] TRACE: Returned connection host1:40158
(120000) ioCount : 586
2014-02-25 12:06:39,367 [impl.TabletServerBatchWriter] TRACE: sent 15 mutations to host1:40158
in 0.02 secs (681.82 mutations/sec) with 0 failures
{noformat}



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message