ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From vkulichenko <valentin.kuliche...@gmail.com>
Subject Re: Heap memory estimation rules
Date Wed, 19 Aug 2015 05:27:34 GMT
Hi,

How many backups and indexes do you have?

You can roughly do the estimation like this:
- Get your original data size and double it. Cache can potentially have both
serialized and deserialized form of each key and value, so the required
memory doubles in the worst case.
- If you have backups, you should multiple by their quantity.
- Indexes also require memory. Usually they add around 30%, but it depends
on how many you have them.
- Also you should add around 200-300MB per node for internals and some spare
memory for GC to operate.

I would recommend you to take a look at offheap memory:
https://apacheignite.readme.io/docs/off-heap-memory. This mode is more
compact because it doesn't store deserialized values and also does not
depend on GC. But in some cases it can cause ~20% performance degradation
(this is true mostly for queries because they imply a lot of index lookups).

Does this make sense for you?

-Val



--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Heap-memory-estimation-rules-tp1042p1046.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Mime
View raw message