accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Keith Turner (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-3541) Seeing CompactionCanceledException errors in monitor
Date Wed, 28 Jan 2015 21:46:34 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14295910#comment-14295910
] 

Keith Turner commented on ACCUMULO-3541:
----------------------------------------

I think I have tracked this down, I think commit [34dda79|https://git-wip-us.apache.org/repos/asf?p=accumulo.git;h=34dda79
] added a log message that caused this.  If so then its new behaviour.  I am going to look
into fixing. 

> Seeing CompactionCanceledException errors in monitor
> ----------------------------------------------------
>
>                 Key: ACCUMULO-3541
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-3541
>             Project: Accumulo
>          Issue Type: Bug
>    Affects Versions: 1.6.2
>            Reporter: Keith Turner
>             Fix For: 1.6.3
>
>
> For 1.6.2RC3 I was running continuous ingest on a 20 node cluster w/o agitation.  Whenever
compacting tablets were closed I would see an error like the following on the monitor.
> {noformat}
> java.lang.RuntimeException: org.apache.accumulo.tserver.Compactor$CompactionCanceledException
> 	java.lang.RuntimeException: org.apache.accumulo.tserver.Compactor$CompactionCanceledException
> 		at org.apache.accumulo.tserver.Tablet.majorCompact(Tablet.java:3351)
> 		at org.apache.accumulo.tserver.Tablet.access$4800(Tablet.java:174)
> 		at org.apache.accumulo.tserver.Tablet$CompactionRunner.run(Tablet.java:2809)
> 		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
> 		at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
> 		at java.lang.Thread.run(Thread.java:744)
> 	Caused by: org.apache.accumulo.tserver.Compactor$CompactionCanceledException
> 		at org.apache.accumulo.tserver.Compactor.compactLocalityGroup(Compactor.java:527)
> 		at org.apache.accumulo.tserver.Compactor.call(Compactor.java:363)
> 		at org.apache.accumulo.tserver.Tablet._majorCompact(Tablet.java:3235)
> 		at org.apache.accumulo.tserver.Tablet.majorCompact(Tablet.java:3344)
> 		... 8 more
> {noformat} 
> Looking in the tserver logs for the corresponding error I found the following.
> {noformat}
> 2015-01-28 20:27:17,726 [tserver.Tablet] DEBUG: Starting MajC 2;5a5a5a5a5a5a5a6;569696969696969c
(NORMAL) [hdfs://node-11:9000/accumulo/tables/2/t-000004m/F00001a6.rf, hdfs://node-11:9000/accumulo/tables/2/t-000004m/F00001a4.rf,
hdfs://node-11:9000/accumulo/tables/2/t-000004m/F000019y.rf, hdfs://node-11:9000/accumulo/tables/2/t-000004m/F00001a0.rf]
--> hdfs://node-11:9000/accumulo/tables/2/t-000004m/C00001a7.rf_tmp  []
> 2015-01-28 20:27:51,384 [tserver.Tablet] DEBUG: initiateClose(saveState=true queueMinC=false
disableWrites=false) 2;5a5a5a5a5a5a5a6;569696969696969c
> 2015-01-28 20:27:53,064 [tserver.Tablet] DEBUG: Major compaction canceled, extent = 2;5a5a5a5a5a5a5a6;569696969696969c
> 2015-01-28 20:27:53,144 [tserver.Tablet] ERROR: java.lang.RuntimeException: org.apache.accumulo.tserver.Compactor$CompactionCanceledException
> java.lang.RuntimeException: org.apache.accumulo.tserver.Compactor$CompactionCanceledException
>         at org.apache.accumulo.tserver.Tablet.majorCompact(Tablet.java:3351)
>         at org.apache.accumulo.tserver.Tablet.access$4800(Tablet.java:174)
>         at org.apache.accumulo.tserver.Tablet$CompactionRunner.run(Tablet.java:2809)
>         at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
>         at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
>         at java.lang.Thread.run(Thread.java:744)
> Caused by: org.apache.accumulo.tserver.Compactor$CompactionCanceledException
>         at org.apache.accumulo.tserver.Compactor.compactLocalityGroup(Compactor.java:527)
>         at org.apache.accumulo.tserver.Compactor.call(Compactor.java:363)
>         at org.apache.accumulo.tserver.Tablet._majorCompact(Tablet.java:3235)
>         at org.apache.accumulo.tserver.Tablet.majorCompact(Tablet.java:3344)
>         ... 8 more
> 2015-01-28 20:28:12,646 [tserver.Tablet] TABLET_HIST: 2;5a5a5a5a5a5a5a6;569696969696969c
closed
> 2015-01-28 20:28:12,770 [tserver.Tablet] TABLET_HIST: 2;5a5a5a5a5a5a5a6;569696969696969c
split 2;5878c;569696969696969c 2;5a5a5a5a5a5a5a6;5878c
> {noformat}
> Cancelling a compaction because a tablet is closed is not an error, its normal.  Issuing
an error for this circumstance seems like new behaviour, I am going to investigate and see
if this is new in 1.6.2.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message