accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Keith Turner (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-1345) Provide feedback that a compaction is "stuck"
Date Fri, 06 Sep 2013 22:50:51 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13760719#comment-13760719
] 

Keith Turner commented on ACCUMULO-1345:
----------------------------------------

Here is an example of what this the commit I just made does.  Below shows configuring accumulo
to warn if a compaction does not make progress in 30 seconds AND then setting the slow iterator
to sleep for 60 seconds.

{noformat}
root@test16> config -s tserver.compaction.warn.time=30s
root@test16> table foo
root@test16 foo> config -t foo -s table.iterator.minc.slow=100,org.apache.accumulo.test.functional.SlowIterator
root@test16 foo> config -t foo -s table.iterator.minc.slow.opt.sleepTime=60000
root@test16 foo> insert r1 cf1 cq1 v1
root@test16 foo> flush -t foo 
2013-09-06 18:43:38,299 [shell.Shell] INFO : Flush of table foo initiated...
{noformat}

Eventually, the following shows up in the tserver logs.   

{noformat}
2013-09-06 18:44:27,044 [tabletserver.CompactionWatcher] WARN : Compaction of 2<< has
not made progress for at least 39999ms
java.lang.Exception: Possible stack trace of compaction stuck on 2<<
        at java.lang.Thread.sleep(Native Method)
        at org.apache.accumulo.core.util.UtilWaitThread.sleep(UtilWaitThread.java:26)
        at org.apache.accumulo.test.functional.SlowIterator.next(SlowIterator.java:56)
        at org.apache.accumulo.server.tabletserver.Compactor.compactLocalityGroup(Compactor.java:499)
        at org.apache.accumulo.server.tabletserver.Compactor.call(Compactor.java:357)
        at org.apache.accumulo.server.tabletserver.MinorCompactor.call(MinorCompactor.java:96)
        at org.apache.accumulo.server.tabletserver.Tablet.minorCompact(Tablet.java:2085)
        at org.apache.accumulo.server.tabletserver.Tablet.access$4300(Tablet.java:157)
        at org.apache.accumulo.server.tabletserver.Tablet$MinorCompactionTask.run(Tablet.java:2172)
        at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
        at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
        at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
        at java.lang.Thread.run(Thread.java:662)
2013-09-06 18:44:38,384 [tabletserver.Compactor] DEBUG: Compaction 2<< 1 read | 1 written
|      0 entries/sec | 60.006 secs
2013-09-06 18:44:47,043 [tabletserver.CompactionWatcher] INFO : Compaction of 2<< is
no longer stuck
{noformat}


                
> Provide feedback that a compaction is "stuck"
> ---------------------------------------------
>
>                 Key: ACCUMULO-1345
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-1345
>             Project: Accumulo
>          Issue Type: Bug
>          Components: tserver
>            Reporter: Mike Drob
>            Assignee: Keith Turner
>             Fix For: 1.6.0
>
>
> The system should be able to detect when a compaction has not read or written data in
a while, indicating that it may be stuck on something (e.g. an infinite loop in a user iterator).

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message