accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Newton (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-2206) close consistency check failure
Date Thu, 16 Jan 2014 18:21:23 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13873697#comment-13873697
] 

Eric Newton commented on ACCUMULO-2206:
---------------------------------------

The first occurrence was was on node3 (found by scanning the monitor log):

{noformat}
2014-01-16 13:10:33,451 [tserver.Tablet] ERROR: tserver:node3 Closed tablet 3;2de232;2dc237
has walog entries in accumulo.metadata [3;2de232; hdfs://node2:9000/home/user/accumulo/wal/node5+46372/c0260a2a-487c-47a6-991d-50007e357a63
(36)]
{noformat}

This tablet was loaded at 13:10:18:
{noformat}
2014-01-16 13:10:18,795 [master.EventCoordinator] INFO : tablet 3;2de232;2dc237 was loaded
on node3:34029
{noformat}

When the tablet was loaded, the WAL was used for recovery, with no mutations applied.

The !METADATA table WAL had been deleted, so I could not verify the mutations.  The metadata
tablet !0;~< and the root table +r were online and did not have any recovery run on them.

Re-running the test with the trash on.


> close consistency check failure
> -------------------------------
>
>                 Key: ACCUMULO-2206
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2206
>             Project: Accumulo
>          Issue Type: Bug
>          Components: tserver
>         Environment: 10-node test cluster
>            Reporter: Eric Newton
>            Assignee: Eric Newton
>              Labels: 16_qa_bug
>
> while running the continuous ingest, with agitation, there are multiple close-consistency
check failures in the logs:
> {noformat}
> Failed to do close consistency check for tablet 3;2de232;2dc237
> 	java.lang.RuntimeException: Closed tablet 3;2de232;2dc237 has walog entries in accumulo.metadata
[3;2de232; hdfs://namenode:9000/home/user/accumulo/wal/host5+46372/c0260a2a-487c-47a6-991d-50007e357a63
(36)]
> 		at org.apache.accumulo.tserver.Tablet.closeConsistencyCheck(Tablet.java:2779)
> 		at org.apache.accumulo.tserver.Tablet.completeClose(Tablet.java:2726)
> 		at org.apache.accumulo.tserver.Tablet.close(Tablet.java:2604)
> 		at org.apache.accumulo.tserver.TabletServer$UnloadTabletHandler.run(TabletServer.java:2750)
> 		at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
> 		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
> 		at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> 		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
> 		at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
> {noformat}
> Running verification to see if there was any data loss.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message