From user-return-17883-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Mon Feb 19 17:54:31 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 74025180607 for ; Mon, 19 Feb 2018 17:54:30 +0100 (CET) Received: (qmail 20323 invoked by uid 500); 19 Feb 2018 16:54:29 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 20313 invoked by uid 99); 19 Feb 2018 16:54:29 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 19 Feb 2018 16:54:29 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id B2ACCC20FC for ; Mon, 19 Feb 2018 16:54:28 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.898 X-Spam-Level: * X-Spam-Status: No, score=1.898 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id uBlGlx30bG0A for ; Mon, 19 Feb 2018 16:54:26 +0000 (UTC) Received: from mail-io0-f181.google.com (mail-io0-f181.google.com [209.85.223.181]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 0DF0D5F473 for ; Mon, 19 Feb 2018 16:54:26 +0000 (UTC) Received: by mail-io0-f181.google.com with SMTP id 30so6711860iog.2 for ; Mon, 19 Feb 2018 08:54:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=tYwVT5Md//0Fl4IH/T0pKRoFklPuaUl9Vr8EfUzIeLo=; b=MOePL/LVbZOOEnn41B93HaCGXduRfUmA4UntVbNhDAFadSL/bAdXhiSQHM745dSA1k 9hZBnhyUaFDtTpoQOtBUyf7lNN1Zu/GoXBJYjvhEvF1b6po/+wLJ5XghB3BHTT7GJaKp VmUdA67a94zznVt31TdeJmQ2xpG64IKQhJQnNkBmE2hqH4kTn5K6j1uqxeUNOvljDjMu FLq76kuz7j4Z5g41LBE38JkC8oqBtjK1e+IKCI5UTzpdQW7RxFYgA6Zmgh7FN6PaQ6c+ NO+7YvEjA7mXZvOXuWije1UV4Oj1j8FMPJW5DY6+4ZmrPnh2ktydNy1FvhTbyASCyk+H nEPA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=tYwVT5Md//0Fl4IH/T0pKRoFklPuaUl9Vr8EfUzIeLo=; b=uXXmb4VHJFI78UPPy/4mXgbf4WZNRjvGWCogndWuNFn9ab1hi5Nk2XzrmjjhIW1Uwv cE0KbmanQPB1snmRvTLL51rHF5edDJkH7K8VBMWDEBbu4AYKu/6hoXAhpyZ22ivbjsYx 6bXSczartqXnJnv9z8glvEylvGXt+WqI4yzcNuAXf2w7w2l9R22L7VmZl/HXBTAhL4dl 1Ia/JDC6DNdXsblTvmSukojRiRSY5PfkZACjnLMcAMtfg2PHI8AQDkQFABmAa7RQ+SP1 qwnvJ41fYcizclog6Q1x2WmUsQBBuuDR+xZzUB6XbFu1xWB2oQFxzU+tx8QdNFhuvnpj J7Mg== X-Gm-Message-State: APf1xPD5gnjAWAVNmOh15I837Fo5RTZK1XMbSohoNeoTyiRD1+i+HG7Z va2SY/YgKX8wImGZxdMDjjQGjiz8XFvzyhdmwU0= X-Google-Smtp-Source: AH8x224HqqNv+Vk2wLczVwCLwKeP/TEUHEavVxQh0NoSqzzQy781jEmkv8IapTMpHhYmja73ru9W3N0VV3WVKx/Q4Vc= X-Received: by 10.107.4.196 with SMTP id 187mr20334110ioe.146.1519059265213; Mon, 19 Feb 2018 08:54:25 -0800 (PST) MIME-Version: 1.0 References: <18de91bcb218a9630c371470800caa3f@mail.gmail.com> <1518624876789-0.post@n6.nabble.com> In-Reply-To: <1518624876789-0.post@n6.nabble.com> From: Dmitry Pavlov Date: Mon, 19 Feb 2018 16:54:14 +0000 Message-ID: Subject: Re: Write ahead log and early eviction of new elements To: user@ignite.apache.org Content-Type: multipart/alternative; boundary="001a113efd62e5592c0565938b77" --001a113efd62e5592c0565938b77 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Michail, To avoid confusion between real evictions and PDS-enabled region pages rotation with disk we've desided to call second process as 'page replacement'. In future releases all messages related to page purge to disk will contain 'page replacement' instead of eviction. Hope it helps to separate these two process. Sincerely, Dmitriy Pavlov =D1=81=D1=80, 14 =D1=84=D0=B5=D0=B2=D1=80. 2018 =D0=B3. =D0=B2 19:14, Mikha= il : > Hi Raymond, > > >I understand when I add an element to a cache that element is serialized= , > >placed into the local memory for the cache on that server and then place= d > >into the WAL pending checkpointing (merging into the persistence store). > > First, the update will be written into WAL and only then into local memor= y. > > > >What happens if the newly added element is evicted and > > then re-read from the cache by the client before the next checkpoint > > occurs? > > What do you mean by "evicted"? Ignite evicts memory pages to a disk if > there's not enough space to save new record or it needs to load a page fr= om > disk and for this purpose, it will evict some page from memory. > But it will evict the only page that is already saved to the disk. > > Thanks, > Mike. > > > > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ > --001a113efd62e5592c0565938b77 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Michail,

To avoid confusion between = real evictions and PDS-enabled region pages rotation with disk we've de= sided to call second process as 'page replacement'.
<= br>
In future releases all messages related to page purge to disk= will contain 'page replacement' instead of eviction. Hope it helps= to separate these two process.

Sincerely,
Dmitriy Pavlov

=D1=81= =D1=80, 14 =D1=84=D0=B5=D0=B2=D1=80. 2018 =D0=B3. =D0=B2 19:14, Mikhail <= ;michael.cherkasov@gmail.com= >:
Hi Raymond,

>I understand when I add an element to a cache that element is serialize= d,
>placed into the local memory for the cache on that server and then plac= ed
>into the WAL pending checkpointing (merging into the persistence store)= .

First, the update will be written into WAL and only then into local memory.=


>What happens if the newly added element is evicted and
> then re-read from the cache by the client before the next checkpoint > occurs?

What do you mean by "evicted"? Ignite evicts memory pages to a di= sk if
there's not enough space to save new record or it needs to load a page = from
disk and for this purpose, it will evict some page from memory.
But it will evict the only page that is already saved to the disk.

Thanks,
Mike.






--
Sent from: http://apache-ignite-users.70518.x6.nabbl= e.com/
--001a113efd62e5592c0565938b77--