accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-2082) Major compacting files not empty
Date Mon, 23 Dec 2013 22:07:50 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13855966#comment-13855966
] 

Josh Elser commented on ACCUMULO-2082:
--------------------------------------

I correlated some logs from the randomwalk clients that would have affected the tablet which
first saw a MajC failure.

{noformat}
18:12:33 Compact everything
18:12:44 Compact (r0500e, r0dd4f]
18:13:01 Merge (r0527, r14b05]
18:13:59 First MajC failure (inlined from tserver logs)
18:14:39 Merge (r04cbc, r05c8a]
{noformat}

There were two other active RW processes, one in Sequential and one in Security. Both of these
appear to be doing things in isolation. I'm hopeful that a re-run of just the Bulk stuff will
net a similar result. Meanwhile, I'll make sure tickets exists for the unexpected RW failures.

> Major compacting files not empty
> --------------------------------
>
>                 Key: ACCUMULO-2082
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2082
>             Project: Accumulo
>          Issue Type: Bug
>            Reporter: Josh Elser
>
> Saw this during a randomwalk:
> {noformat}
> MajC Failed, message = Major compacting files not empty [hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qir.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qip.rf, hdfs://nameservice/accumulo/tables/p/b-0001qh4/I0001qh5.rf,
hdfs://nameservice/accumulo/tables/p/b-0001qgt/I0001qgv.rf, hdfs://nameservice/accumulo/tables/p/b-0001qg5/I0001qg6.rf,
hdfs://nameservice/accumulo/tables/p/b-0001qem/I0001qeo.rf, hdfs://nameservice/accumulo/tables/p/b-0001qgj/I0001qgk.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qis.rf, hdfs://nameservice/accumulo/tables/p/b-0001qga/I0001qgb.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/A0001pg9.rf]
> 	java.lang.IllegalStateException: Major compacting files not empty [hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qir.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qip.rf, hdfs://nameservice/accumulo/tables/p/b-0001qh4/I0001qh5.rf,
hdfs://nameservice/accumulo/tables/p/b-0001qgt/I0001qgv.rf, hdfs://nameservice/accumulo/tables/p/b-0001qg5/I0001qg6.rf,
hdfs://nameservice/accumulo/tables/p/b-0001qem/I0001qeo.rf, hdfs://nameservice/accumulo/tables/p/b-0001qgj/I0001qgk.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qis.rf, hdfs://nameservice/accumulo/tables/p/b-0001qga/I0001qgb.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/A0001pg9.rf]
> 		at org.apache.accumulo.tserver.Tablet$DatafileManager.reserveMajorCompactingFiles(Tablet.java:933)
> 		at org.apache.accumulo.tserver.Tablet._majorCompact(Tablet.java:3187)
> 		at org.apache.accumulo.tserver.Tablet.majorCompact(Tablet.java:3371)
> 		at org.apache.accumulo.tserver.Tablet.access$4700(Tablet.java:168)
> 		at org.apache.accumulo.tserver.Tablet$CompactionRunner.run(Tablet.java:2849)
> 		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
> 		at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
> 		at java.lang.Thread.run(Thread.java:744)
> {noformat}
> I don't actually know if it's a problem. A first read over that section of the code wasn't
obvious to me one way or the other. 



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message