ignite-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Дмитрий Сорокин <sbt.sorokin....@gmail.com>
Subject Prewarming of page memory after node restart
Date Mon, 04 Mar 2019 14:00:56 GMT
Hi Igniters!

I want to propose the new feature for Ignite - prewarming of page memory.

The essence of prewarming feature is that after restarting the node is to
load into memory those pages that were loaded before last shutdown. I have
implemented the PoC of prewarming of page memory, which makes dump of IDs
of loaded pages before node shutdown and, optionally, at runtime. When node
restarts, special worker loads the pages with saved IDs in memory, and
restore phase depending on configuration may or may not to wait the end of
prewarming process. Persentage of hottest loaded pages may be configured,
if dumping of all of ones is not need. Prewarming process is multithreaded
(optionally) and has heuristical throttling algorithm.
PrewarmingConfiguration is the only change of public API, and was added as
property of DataRegionConfiguration, which non-null value enables the
prewarming feature.

Link to the Jira ticket: https://issues.apache.org/jira/browse/IGNITE-11457

Link to the PR: https://github.com/apache/ignite/pull/6223.

I would like to receive feedback on this prewarming feature concept.

  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message