asterixdb-notifications mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jianfeng Jia (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (ASTERIXDB-1438) BufferCache spins indefinitely when cache is exceeded
Date Mon, 16 May 2016 22:09:12 GMT

    [ https://issues.apache.org/jira/browse/ASTERIXDB-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15285517#comment-15285517
] 

Jianfeng Jia commented on ASTERIXDB-1438:
-----------------------------------------

I hit a similar case on a lower configuration instance recently. When it ran Insertion works
it would never finish. The logs showed a long list of BufferCache activities that creating
and closing the files. 

The logs looks like following. Hope it helps.
{code}
May 15, 2016 12:56:23 PM org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness flush
INFO: Started a flush operation for index: LSMBTree [/nc1/iodevice1/storage/partition_0/hackathon/log_device_idx_log_device/]
...
May 15, 2016 12:56:23 PM org.apache.hyracks.storage.common.buffercache.BufferCache createFile
INFO: Creating file: /nc1/iodevice1/storage/partition_0/hackathon/log_device_idx_log_device/2016-05-15-12-56-23-706_2016-05-15-12-56-23-706_f
in cache: org.apache.hyracks.storage.common.buffercache.BufferCache@6c284af
May 15, 2016 12:56:23 PM org.apache.hyracks.storage.common.buffercache.BufferCache openFile
INFO: Opening file: 3248 in cache: org.apache.hyracks.storage.common.buffercache.BufferCache@6c284af
May 15, 2016 12:56:23 PM org.apache.hyracks.storage.common.buffercache.BufferCache createFile
INFO: Creating file: /nc1/iodevice1/storage/partition_0/hackathon/log_device_idx_log_device/2016-05-15-12-56-23-706_2016-05-15-12-56-23-706_b
in cache: org.apache.hyracks.storage.common.buffercache.BufferCache@6c284af
May 15, 2016 12:56:23 PM org.apache.hyracks.storage.common.buffercache.BufferCache openFile
INFO: Opening file: 3249 in cache: org.apache.hyracks.storage.common.buffercache.BufferCache@6c284af
May 15, 2016 12:56:23 PM org.apache.hyracks.storage.common.buffercache.BufferCache closeFile
INFO: Closing file: 3249 in cache: org.apache.hyracks.storage.common.buffercache.BufferCache@6c284af
May 15, 2016 12:56:23 PM org.apache.hyracks.storage.common.buffercache.BufferCache closeFile
INFO: Closed file: 3249 in cache: org.apache.hyracks.storage.common.buffercache.BufferCache@6c284af
May 15, 2016 12:56:23 PM org.apache.hyracks.storage.common.buffercache.BufferCache openFile
INFO: Opening file: 3249 in cache: org.apache.hyracks.storage.common.buffercache.BufferCache@6c284af
May 15, 2016 12:56:23 PM org.apache.asterix.transaction.management.service.locking.LockManagerStats
logCounters
INFO: { lock : 1, instantLock : 0, tryLock : 1781454, instantTryLock : 44837154, unlock :
1780961, releaseLocks : 430 }
May 15, 2016 12:56:25 PM org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness flush
INFO: Finished the flush operation for index: LSMBTree [/nc1/iodevice1/storage/partition_0/hackathon/log_device_idx_log_device/]
May 15, 2016 12:56:26 PM org.apache.hyracks.storage.am.lsm.common.impls.LSMHarness flush
INFO: Started a flush operation for index: LSMBTree [/nc1/iodevice1/storage/partition_0/hackathon/log_device_idx_log_device/]
...
May 15, 2016 12:56:26 PM org.apache.hyracks.storage.common.buffercache.BufferCache createFile
INFO: Creating file: /nc1/iodevice1/storage/partition_0/hackathon/log_device_idx_log_device/2016-05-15-12-56-26-434_2016-05-15-12-56-26-434_f
in cache: org.apache.hyracks.storage.common.buffercache.BufferCache@6c284af
May 15, 2016 12:56:26 PM org.apache.hyracks.storage.common.buffercache.BufferCache openFile
INFO: Opening file: 3250 in cache: org.apache.hyracks.storage.common.buffercache.BufferCache@6c284af
May 15, 2016 12:56:26 PM org.apache.hyracks.storage.common.buffercache.BufferCache createFile
INFO: Creating file: /nc1/iodevice1/storage/partition_0/hackathon/log_device_idx_log_device/2016-05-15-12-56-26-434_2016-05-15-12-56-26-434_b
in cache: org.apache.hyracks.storage.common.buffercache.BufferCache@6c284af
{code}

> BufferCache spins indefinitely when cache is exceeded
> -----------------------------------------------------
>
>                 Key: ASTERIXDB-1438
>                 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1438
>             Project: Apache AsterixDB
>          Issue Type: Bug
>            Reporter: Michael Blow
>            Assignee: Michael Blow
>            Priority: Critical
>
> In case of cache exhaustion, BufferCache.findPage/confiscatePage() will spin forever
waiting for pages to be returned to the cache.  These should give up and fail the request
after a reasonable number of attempts.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message