accumulo-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Josh Elser (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ACCUMULO-2862) Major Compaction issues
Date Thu, 05 Jun 2014 23:50:01 GMT

    [ https://issues.apache.org/jira/browse/ACCUMULO-2862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14019418#comment-14019418
] 

Josh Elser commented on ACCUMULO-2862:
--------------------------------------

It appears this may be caused by a split, trying to happen when a MajC is running.

{noformat}
2014-06-05 19:29:17,722 [tablet.Compactor] DEBUG: Compaction 2<;60079 1,425,087 read |
1,425,087 written | 191,286 entries/sec |  7.450 secs
2014-06-05 19:29:17,724 [tablet.Tablet] DEBUG: Logs for memory compacted: 2<;60079 192.168.2.21:52059/hdfs://localhost:8020/accumulo17/wal/192.168.2.21+52059/f3018455-29c8-49ab-bb6d-b8c4720fdf18
2014-06-05 19:29:17,724 [tablet.Tablet] DEBUG: Logs for memory compacted: 2<;60079 192.168.2.21:52059/hdfs://localhost:8020/accumulo17/wal/192.168.2.21+52059/d8855654-40c5-4ed7-bafb-c0a8104be55d
2014-06-05 19:29:17,724 [tablet.Tablet] DEBUG: Logs for current memory: 2<;60079 192.168.2.21:52059/hdfs://localhost:8020/accumulo17/wal/192.168.2.21+52059/f3018455-29c8-49ab-bb6d-b8c4720fdf18
2014-06-05 19:29:17,726 [log.TabletServerLogger] DEBUG:  wrote MinC finish  3244: writeTime:0ms
2014-06-05 19:29:17,727 [tablet.DatafileManager] TABLET_HIST: 2<;60079 MinC [memory] ->
hdfs://localhost:8020/accumulo17/tables/2/default_tablet/F00002dp.rf
2014-06-05 19:29:17,727 [tablet.DatafileManager] DEBUG: MinC finish lock 0.00 secs 2<;60079
2014-06-05 19:29:17,727 [tserver.NativeMap] DEBUG: Deallocating native map 0x00007fe53aa99610
2014-06-05 19:29:17,766 [tserver.TabletServerResourceManager] DEBUG: Commits held for   3.51
secs
2014-06-05 19:29:17,768 [tserver.TabletServer] DEBUG: UpSess 192.168.2.21:53501 39 in 1.242s,
at=[0 0 0.00 1] ft=1.241s(pt=1.241s lt=0.000s ct=0.000s)
2014-06-05 19:29:17,878 [util.FileUtil] DEBUG: Found midPoint from indexes in   0.11 secs.

2014-06-05 19:29:17,929 [tablet.Tablet] DEBUG: initiateClose(saveState=true queueMinC=false
disableWrites=false) 2<;60079
2014-06-05 19:29:17,966 [tablet.Tablet] DEBUG: Major compaction canceled, extent = 2<;60079
2014-06-05 19:29:17,967 [util.NamingThreadFactory] ERROR: Thread "major compactor 4" died
org.apache.accumulo.tserver.tablet.Compactor$CompactionCanceledException
java.lang.RuntimeException: org.apache.accumulo.tserver.tablet.Compactor$CompactionCanceledException
        at org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1970)
        at org.apache.accumulo.tserver.tablet.CompactionRunner.run(CompactionRunner.java:42)
        at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
        at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.accumulo.tserver.tablet.Compactor$CompactionCanceledException
        at org.apache.accumulo.tserver.tablet.Compactor.compactLocalityGroup(Compactor.java:370)
        at org.apache.accumulo.tserver.tablet.Compactor.call(Compactor.java:206)
        at org.apache.accumulo.tserver.tablet.Tablet._majorCompact(Tablet.java:1853)
        at org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1962)
        ... 7 more
2014-06-05 19:29:17,967 [tserver.NativeMap] DEBUG: Allocated native map 0x00007fe53ac406d0
2014-06-05 19:29:18,016 [tablet.MinorCompactor] DEBUG: Begin minor compaction hdfs://localhost:8020/accumulo17/tables/2/default_tablet/F00002ds.rf_tmp
2<;60079
{noformat}

I can't say I know why it's happening yet, though.

> Major Compaction issues
> -----------------------
>
>                 Key: ACCUMULO-2862
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2862
>             Project: Accumulo
>          Issue Type: Bug
>          Components: tserver
>            Reporter: Josh Elser
>            Assignee: Eric Newton
>             Fix For: 1.7.0
>
>         Attachments: eric-proposed-changes.diff
>
>
> Since the last round of tserver/tablet refactoring, I've been getting some spurious errors
while running two tservers on a single node with a single continuous ingest client.
> {noformat}
> java.lang.RuntimeException: java.lang.IllegalStateException: Major compacting files not
empty [...]
> 	at org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1998)
> 	at org.apache.accumulo.tserver.tablet.CompactionRunner.run(CompactionRunner.java:42)
> 	at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
> 	at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
> 	at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.IllegalStateException: Major compacting files not empty [...]
> 	at org.apache.accumulo.tserver.tablet.DatafileManager.reserveMajorCompactingFiles(DatafileManager.java:484)
> 	at org.apache.accumulo.tserver.tablet.Tablet._majorCompact(Tablet.java:1797)
> 	at org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1986)
> 	... 7 more
> 2014-06-05 16:46:
> {noformat}
> As well as some CompactionCanceledExceptions.
> {noformat}
> Thread "major compactor 2" died org.apache.accumulo.tserver.tablet.Compactor$CompactionCanceledException
> 	java.lang.RuntimeException: org.apache.accumulo.tserver.tablet.Compactor$CompactionCanceledException
> 		at org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1970)
> 		at org.apache.accumulo.tserver.tablet.CompactionRunner.run(CompactionRunner.java:42)
> 		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:42)
> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 		at org.apache.accumulo.trace.instrument.TraceRunnable.run(TraceRunnable.java:47)
> 		at org.apache.accumulo.core.util.LoggingRunnable.run(LoggingRunnable.java:34)
> 		at java.lang.Thread.run(Thread.java:745)
> 	Caused by: org.apache.accumulo.tserver.tablet.Compactor$CompactionCanceledException
> 		at org.apache.accumulo.tserver.tablet.Compactor.compactLocalityGroup(Compactor.java:370)
> 		at org.apache.accumulo.tserver.tablet.Compactor.call(Compactor.java:206)
> 		at org.apache.accumulo.tserver.tablet.Tablet._majorCompact(Tablet.java:1853)
> 		at org.apache.accumulo.tserver.tablet.Tablet.majorCompact(Tablet.java:1962)
> 		... 7 more
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message