Return-Path: X-Original-To: apmail-accumulo-notifications-archive@minotaur.apache.org Delivered-To: apmail-accumulo-notifications-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2DAEF10BD2 for ; Thu, 27 Feb 2014 17:15:27 +0000 (UTC) Received: (qmail 63137 invoked by uid 500); 27 Feb 2014 17:15:24 -0000 Delivered-To: apmail-accumulo-notifications-archive@accumulo.apache.org Received: (qmail 63107 invoked by uid 500); 27 Feb 2014 17:15:24 -0000 Mailing-List: contact notifications-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: jira@apache.org Delivered-To: mailing list notifications@accumulo.apache.org Received: (qmail 63005 invoked by uid 99); 27 Feb 2014 17:15:21 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 27 Feb 2014 17:15:21 +0000 Date: Thu, 27 Feb 2014 17:15:21 +0000 (UTC) From: "ASF subversion and git services (JIRA)" To: notifications@accumulo.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (ACCUMULO-2405) Race condition in MetadataIT.mergeMeta() MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/ACCUMULO-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13914747#comment-13914747 ] ASF subversion and git services commented on ACCUMULO-2405: ----------------------------------------------------------- Commit 948216cbf54df5caf119b5e4c84cfdc114da3507 in accumulo's branch refs/heads/master from [~ecn] [ https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=948216c ] ACCUMULO-2405 use a simpler loop > Race condition in MetadataIT.mergeMeta() > ---------------------------------------- > > Key: ACCUMULO-2405 > URL: https://issues.apache.org/jira/browse/ACCUMULO-2405 > Project: Accumulo > Issue Type: Bug > Environment: 2ef2d88598f5e14f8f96b77fecca66dcd7196448 > Reporter: Keith Turner > Assignee: Eric Newton > Fix For: 1.6.0 > > > Saw the following error while running ITs. > {noformat} > mergeMeta(org.apache.accumulo.test.functional.MetadataIT) Time elapsed: 10.39 sec <<< FAILURE! > java.lang.AssertionError > at org.junit.Assert.fail(Assert.java:86) > at org.junit.Assert.assertTrue(Assert.java:41) > at org.junit.Assert.assertTrue(Assert.java:52) > at org.apache.accumulo.test.functional.MetadataIT.mergeMeta(MetadataIT.java:103) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) > at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) > at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74) > {noformat} > Looking at the test it merges the metadata table, sleeps for 2 secs, and then scans for delete entries. Looking in the logs I think the AGC deleted the delete entries while the test was sleeping. > Saw the following in the master log > {noformat} > 2014-02-25 12:06:36,981 [master.EventCoordinator] INFO : Merge state of !0<< set to MERGING > 2014-02-25 12:06:37,047 [master.EventCoordinator] INFO : Merge state of !0<< set to COMPLETE > 2014-02-25 12:06:37,169 [state.MergeStats] INFO : Computing next merge state for !0<< which is presently COMPLETE isDelete : false > 2014-02-25 12:06:37,189 [master.EventCoordinator] INFO : Merge state of !0<< set to NONE > 2014-02-25 12:06:37,212 [tableOps.MasterRepo] INFO : removing merge information No Merge in progress > 2014-02-25 12:06:37,213 [master.EventCoordinator] INFO : Merge state of !0 cleared > {noformat} > Then saw the following in the AGC logs. > {noformat} > 2014-02-25 12:06:39,335 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/t-000003u > 2014-02-25 12:06:39,335 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/t-000003v > 2014-02-25 12:06:39,335 [fs.TrashPolicyDefault] INFO : Namenode trash configuration: Deletion interval = 0 minutes, Emptier interval = 0 minutes. > 2014-02-25 12:06:39,335 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/t-000003w > 2014-02-25 12:06:39,336 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/t-000003y > 2014-02-25 12:06:39,336 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/table_info > 2014-02-25 12:06:39,336 [gc.SimpleGarbageCollector] DEBUG: Deleting file:/local/disk1/jenkins/workspace/accumulo16/test/target/mini-tests/org.apache.accumulo.test.functional.SimpleMacIT/1393347971697_26818/accumulo/tables/!0/t-000003x > . > . > . > 2014-02-25 12:06:39,343 [impl.RootTabletLocator] TRACE: tid=12 oid=91 Found root tablet at host1:40158|1446a02ccfe0002 in 0.000 secs > 2014-02-25 12:06:39,344 [impl.TabletServerBatchWriter] TRACE: Started sending 15 mutations to 1 tablet servers > 2014-02-25 12:06:39,344 [impl.ThriftTransportPool] TRACE: Using existing connection to host1:40158 > 2014-02-25 12:06:39,366 [impl.ThriftTransportPool] TRACE: Returned connection host1:40158 (120000) ioCount : 586 > 2014-02-25 12:06:39,367 [impl.TabletServerBatchWriter] TRACE: sent 15 mutations to host1:40158 in 0.02 secs (681.82 mutations/sec) with 0 failures > {noformat} -- This message was sent by Atlassian JIRA (v6.1.5#6160)