accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Keith Turner (JIRA)" <j...@apache.org>
Subject [jira] [Created] (ACCUMULO-3541) Seeing CompactionCanceledException errors in monitor
Date Wed, 28 Jan 2015 21:16:34 GMT
Keith Turner created ACCUMULO-3541:
--------------------------------------

             Summary: Seeing CompactionCanceledException errors in monitor
                 Key: ACCUMULO-3541
                 URL: https://issues.apache.org/jira/browse/ACCUMULO-3541
             Project: Accumulo
          Issue Type: Bug
    Affects Versions: 1.6.2
            Reporter: Keith Turner
             Fix For: 1.6.3


For 1.6.2RC3 I was running continuous ingest on a 20 node cluster w/o agitation.  Whenever
compacting tablets were closed I would see an error like the following on the monitor.

{noformat}
java.lang.RuntimeException: org.apache.accumulo.tserver.Compactor$CompactionCanceledException
	java.lang.RuntimeException: org.apache.accumulo.tserver.Compactor$CompactionCanceledException
		at org.apache.accumulo.tserver.Tablet.majorCompact(Tablet.java:3351)
		at org.apache.accumulo.tserver.Tablet.access$4800(Tablet.java:174)
		at org.apache.accumulo.tserver.Tablet$CompactionRunner.run(Tablet.java:2809)
		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
		at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
		at java.lang.Thread.run(Thread.java:744)
	Caused by: org.apache.accumulo.tserver.Compactor$CompactionCanceledException
		at org.apache.accumulo.tserver.Compactor.compactLocalityGroup(Compactor.java:527)
		at org.apache.accumulo.tserver.Compactor.call(Compactor.java:363)
		at org.apache.accumulo.tserver.Tablet._majorCompact(Tablet.java:3235)
		at org.apache.accumulo.tserver.Tablet.majorCompact(Tablet.java:3344)
		... 8 more
{noformat} 

Looking in the tserver logs for the corresponding error I found the following.

{noformat}
2015-01-28 20:27:17,726 [tserver.Tablet] DEBUG: Starting MajC 2;5a5a5a5a5a5a5a6;569696969696969c
(NORMAL) [hdfs://node-11:9000/accumulo/tables/2/t-000004m/F00001a6.rf, hdfs://node-11:9000/accumulo/tables/2/t-000004m/F00001a4.rf,
hdfs://node-11:9000/accumulo/tables/2/t-000004m/F000019y.rf, hdfs://node-11:9000/accumulo/tables/2/t-000004m/F00001a0.rf]
--> hdfs://node-11:9000/accumulo/tables/2/t-000004m/C00001a7.rf_tmp  []

2015-01-28 20:27:51,384 [tserver.Tablet] DEBUG: initiateClose(saveState=true queueMinC=false
disableWrites=false) 2;5a5a5a5a5a5a5a6;569696969696969c
2015-01-28 20:27:53,064 [tserver.Tablet] DEBUG: Major compaction canceled, extent = 2;5a5a5a5a5a5a5a6;569696969696969c
2015-01-28 20:27:53,144 [tserver.Tablet] ERROR: java.lang.RuntimeException: org.apache.accumulo.tserver.Compactor$CompactionCanceledException
java.lang.RuntimeException: org.apache.accumulo.tserver.Compactor$CompactionCanceledException
        at org.apache.accumulo.tserver.Tablet.majorCompact(Tablet.java:3351)
        at org.apache.accumulo.tserver.Tablet.access$4800(Tablet.java:174)
        at org.apache.accumulo.tserver.Tablet$CompactionRunner.run(Tablet.java:2809)
        at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
        at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
        at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.accumulo.tserver.Compactor$CompactionCanceledException
        at org.apache.accumulo.tserver.Compactor.compactLocalityGroup(Compactor.java:527)
        at org.apache.accumulo.tserver.Compactor.call(Compactor.java:363)
        at org.apache.accumulo.tserver.Tablet._majorCompact(Tablet.java:3235)
        at org.apache.accumulo.tserver.Tablet.majorCompact(Tablet.java:3344)
        ... 8 more

2015-01-28 20:28:12,646 [tserver.Tablet] TABLET_HIST: 2;5a5a5a5a5a5a5a6;569696969696969c closed
2015-01-28 20:28:12,770 [tserver.Tablet] TABLET_HIST: 2;5a5a5a5a5a5a5a6;569696969696969c split
2;5878c;569696969696969c 2;5a5a5a5a5a5a5a6;5878c
{noformat}

Cancelling a compaction because a tablet is closed is not an error, its normal.  Issuing an
error for this circumstance seems like new behaviour, I am going to investigate and see if
this is new in 1.6.2.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message