ignite-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alexei Scherbakov (JIRA)" <j...@apache.org>
Subject [jira] [Created] (IGNITE-4552) Optimize GridDhtLocalPartition.rmvQueue
Date Tue, 17 Jan 2017 07:57:27 GMT
Alexei Scherbakov created IGNITE-4552:
-----------------------------------------

             Summary: Optimize GridDhtLocalPartition.rmvQueue
                 Key: IGNITE-4552
                 URL: https://issues.apache.org/jira/browse/IGNITE-4552
             Project: Ignite
          Issue Type: Bug
          Components: cache
    Affects Versions: 1.6
            Reporter: Alexei Scherbakov
             Fix For: 2,0


Current implementation stores deferred entry removals in rmvQueue for consistency guaranties.

This can lead to significant heap over-usage(I observed several Gbs) in case of many caches
with removals, because currently queue is cleared lazily after reaching max capacity(200_000
by default).

This can be mitigated by using lower IGNITE_ATOMIC_CACHE_DELETE_HISTORY_SIZE, but can lead
to consistency issues in case of frequent cache updates.

Possible optimizations:

* Use single fixed size queue per all caches to overcome limitations of IGNITE_ATOMIC_CACHE_DELETE_HISTORY_SIZE
workaround.

* Do queue cleaning in background

* Move queue to an off-heap.







--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message