geode-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Anilkumar Gingade <aging...@pivotal.io>
Subject Re: DiskStore exception while region data evicted
Date Wed, 22 Nov 2017 20:15:56 GMT
Hi Gregory,

Is the node stopped and restarted? If so how many times?
It looks like the evict operation freed up 2401bytes...But at that time the
current bucket size (as per stats) is (2401 -1425 =) 976bytes...Since the
updated bucket memory stat was -ve, the system thrown exception...

If you have reproducible scenario, can you send it across...Or steps to
reproduce...
Can you send your cache xml (or region configuration). And logs and stats
if possible.

-Anil.



On Tue, Nov 21, 2017 at 9:04 AM, Guy Turkenits <Guy.Turkenits@amdocs.com>
wrote:

> + Viki
>
> From: Gregory Vortman
> Sent: Tuesday, November 21, 2017 6:49 PM
> To: user@geode.apache.org; dev@geode.apache.org
> Cc: *Technology - Digital - BSS – Charging - GEODE team <
> PBGRCMRMGEODEteam@int.amdocs.com>; Guy Turkenits <Guy.Turkenits@Amdocs.com
> >
> Subject: DiskStore exception while region data evicted
>
> Hi team,
> One of the grid members went down and entire cache is closed whenever
> Partition region got an LRU threshold and overflow to disk is started:
> <lru-entry-count maximum="200000" action="overflow-to-disk"/>
>
> Disk-store defined with 40GB.
>
> Actual metrics while crashed: entries on disk 700000, bytes only on disk
> ~1GB.
> There is much room in the File system.
>
> Can you help to understand the following exception:
>
> [severe 2017/11/21 15:41:05.678 IST host1-pwinfo1 <Asynchronous disk
> writer for region ExternalRecord-overflow> tid=0xdc] Fatal error from
> asynchronous flusher thread
> org.apache.geode.InternalGemFireError: Bucket
> BucketRegion[path='/__PR/_B__EXTERNAL__RECORDS__1_171;serial=6025;primary=true]
> size (-1425) negative after applying delta of -2401
>         at org.apache.geode.internal.cache.BucketRegion.
> updateBucketMemoryStats(BucketRegion.java:2291)
>         at org.apache.geode.internal.cache.BucketRegion.updateBucket2Size(
> BucketRegion.java:2279)
>         at org.apache.geode.internal.cache.BucketRegion.updateSizeOnEvict(
> BucketRegion.java:2157)
>         at org.apache.geode.internal.cache.DiskEntry$Helper.
> writeEntryToDisk(DiskEntry.java:1441)
>         at org.apache.geode.internal.cache.DiskEntry$Helper.
> doAsyncFlush(DiskEntry.java:1388)
>         at org.apache.geode.internal.cache.DiskStoreImpl$
> FlusherThread.run(DiskStoreImpl.java:1729)
>         at java.lang.Thread.run(Thread.java:748)
>
> [error 2017/11/21 15:41:05.679 IST host1-pwinfo1 <Asynchronous disk writer
> for region ExternalRecord-overflow> tid=0xdc] A DiskAccessException has
> occurred while writing to the disk for disk sto
> re ExternalRecord-overflow. The cache will be closed.
> org.apache.geode.cache.DiskAccessException: For DiskStore:
> ExternalRecord-overflow: Fatal error from asynchronous flusher thread,
> caused by org.apache.geode.InternalGemFireError: Bucket BucketRegion
> [path='/__PR/_B__EXTERNAL__RECORDS__1_171;serial=6025;primary=true] size
> (-1425) negative after applying delta of -2401
>         at org.apache.geode.internal.cache.DiskStoreImpl$
> FlusherThread.run(DiskStoreImpl.java:1774)
>         at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.geode.InternalGemFireError: Bucket
> BucketRegion[path='/__PR/_B__EXTERNAL__RECORDS__1_171;serial=6025;primary=true]
> size (-1425) negative after applying delta of -2401
>         at org.apache.geode.internal.cache.BucketRegion.
> updateBucketMemoryStats(BucketRegion.java:2291)
>         at org.apache.geode.internal.cache.BucketRegion.updateBucket2Size(
> BucketRegion.java:2279)
>         at org.apache.geode.internal.cache.BucketRegion.updateSizeOnEvict(
> BucketRegion.java:2157)
>         at org.apache.geode.internal.cache.DiskEntry$Helper.
> writeEntryToDisk(DiskEntry.java:1441)
>         at org.apache.geode.internal.cache.DiskEntry$Helper.
> doAsyncFlush(DiskEntry.java:1388)
>         at org.apache.geode.internal.cache.DiskStoreImpl$
> FlusherThread.run(DiskStoreImpl.java:1729)
>         ... 1 more
>
> Thanks
>
> Gregory Vortman
>
>
> This message and the information contained herein is proprietary and
> confidential and subject to the Amdocs policy statement,
>
> you may review at https://www.amdocs.com/about/email-disclaimer <
> https://www.amdocs.com/about/email-disclaimer>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message