accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-2082) Major compacting files not empty
Date Mon, 23 Dec 2013 17:59:50 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13855802#comment-13855802
] 

Josh Elser commented on ACCUMULO-2082:
--------------------------------------

Looking over this, it's not obvious to me yet what's happening here. My first hunch was that
there was another compaction that tried to run over an overlapping set of files for the given
Tablet. I've ruled that out, however, because of the check against the {{majocCompactionInProgress}
member of {{Tablet}}. It doesn't appear possible to run multiple compactions over the same
Tablet (even if the compaction files are disjoint).

> Major compacting files not empty
> --------------------------------
>
>                 Key: ACCUMULO-2082
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2082
>             Project: Accumulo
>          Issue Type: Bug
>            Reporter: Josh Elser
>
> Saw this during a randomwalk:
> {noformat}
> MajC Failed, message = Major compacting files not empty [hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qir.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qip.rf, hdfs://nameservice/accumulo/tables/p/b-0001qh4/I0001qh5.rf,
hdfs://nameservice/accumulo/tables/p/b-0001qgt/I0001qgv.rf, hdfs://nameservice/accumulo/tables/p/b-0001qg5/I0001qg6.rf,
hdfs://nameservice/accumulo/tables/p/b-0001qem/I0001qeo.rf, hdfs://nameservice/accumulo/tables/p/b-0001qgj/I0001qgk.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qis.rf, hdfs://nameservice/accumulo/tables/p/b-0001qga/I0001qgb.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/A0001pg9.rf]
> 	java.lang.IllegalStateException: Major compacting files not empty [hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qir.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qip.rf, hdfs://nameservice/accumulo/tables/p/b-0001qh4/I0001qh5.rf,
hdfs://nameservice/accumulo/tables/p/b-0001qgt/I0001qgv.rf, hdfs://nameservice/accumulo/tables/p/b-0001qg5/I0001qg6.rf,
hdfs://nameservice/accumulo/tables/p/b-0001qem/I0001qeo.rf, hdfs://nameservice/accumulo/tables/p/b-0001qgj/I0001qgk.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/C0001qis.rf, hdfs://nameservice/accumulo/tables/p/b-0001qga/I0001qgb.rf,
hdfs://nameservice/accumulo/tables/p/t-0001pfx/A0001pg9.rf]
> 		at org.apache.accumulo.tserver.Tablet$DatafileManager.reserveMajorCompactingFiles(Tablet.java:933)
> 		at org.apache.accumulo.tserver.Tablet._majorCompact(Tablet.java:3187)
> 		at org.apache.accumulo.tserver.Tablet.majorCompact(Tablet.java:3371)
> 		at org.apache.accumulo.tserver.Tablet.access$4700(Tablet.java:168)
> 		at org.apache.accumulo.tserver.Tablet$CompactionRunner.run(Tablet.java:2849)
> 		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
> 		at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
> 		at java.lang.Thread.run(Thread.java:744)
> {noformat}
> I don't actually know if it's a problem. A first read over that section of the code wasn't
obvious to me one way or the other. 



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message