accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-2082) Major compacting files not empty
Date Mon, 23 Dec 2013 19:44:50 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13855881#comment-13855881
] 

Josh Elser commented on ACCUMULO-2082:
--------------------------------------

Some more information: the tablet that failed the majc was split about 2 minutes before the
first failure happened. After the split, there were a number of bulk imports interspersed
with two user-initiated major compactions that appear to have finished successfully.

On the third user-initiated compaction, we failed on an exception similar to the one above.
After about 2 minutes to repeated majc failure, the tablet was unloaded and not reloaded anywhere
else, so I have to assume that the table was deleted (likely a fair assumption given what
the randomwalk was doing).

> Major compacting files not empty
> --------------------------------
>
>                 Key: ACCUMULO-2082
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2082
>             Project: Accumulo
>          Issue Type: Bug
>            Reporter: Josh Elser
>
> Saw this during a randomwalk:
> {noformat}
> MajC Failed, message = Major compacting files not empty [hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qir.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qip.rf, hdfs://nameservice/accumulo/tables/p/b-0001qh4/I0001qh5.rf,
hdfs://nameservice/accumulo/tables/p/b-0001qgt/I0001qgv.rf, hdfs://nameservice/accumulo/tables/p/b-0001qg5/I0001qg6.rf,
hdfs://nameservice/accumulo/tables/p/b-0001qem/I0001qeo.rf, hdfs://nameservice/accumulo/tables/p/b-0001qgj/I0001qgk.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qis.rf, hdfs://nameservice/accumulo/tables/p/b-0001qga/I0001qgb.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/A0001pg9.rf]
> 	java.lang.IllegalStateException: Major compacting files not empty [hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qir.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qip.rf, hdfs://nameservice/accumulo/tables/p/b-0001qh4/I0001qh5.rf,
hdfs://nameservice/accumulo/tables/p/b-0001qgt/I0001qgv.rf, hdfs://nameservice/accumulo/tables/p/b-0001qg5/I0001qg6.rf,
hdfs://nameservice/accumulo/tables/p/b-0001qem/I0001qeo.rf, hdfs://nameservice/accumulo/tables/p/b-0001qgj/I0001qgk.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qis.rf, hdfs://nameservice/accumulo/tables/p/b-0001qga/I0001qgb.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/A0001pg9.rf]
> 		at org.apache.accumulo.tserver.Tablet$DatafileManager.reserveMajorCompactingFiles(Tablet.java:933)
> 		at org.apache.accumulo.tserver.Tablet._majorCompact(Tablet.java:3187)
> 		at org.apache.accumulo.tserver.Tablet.majorCompact(Tablet.java:3371)
> 		at org.apache.accumulo.tserver.Tablet.access$4700(Tablet.java:168)
> 		at org.apache.accumulo.tserver.Tablet$CompactionRunner.run(Tablet.java:2849)
> 		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
> 		at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
> 		at java.lang.Thread.run(Thread.java:744)
> {noformat}
> I don't actually know if it's a problem. A first read over that section of the code wasn't
obvious to me one way or the other. 



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message