Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id F01F9200D2E for ; Tue, 17 Oct 2017 03:18:03 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id ED0E3160BEA; Tue, 17 Oct 2017 01:18:03 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 14A201609EF for ; Tue, 17 Oct 2017 03:18:02 +0200 (CEST) Received: (qmail 84794 invoked by uid 500); 17 Oct 2017 01:18:02 -0000 Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list dev@ignite.apache.org Received: (qmail 84783 invoked by uid 99); 17 Oct 2017 01:18:02 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 17 Oct 2017 01:18:02 +0000 Received: from mail-qk0-f172.google.com (mail-qk0-f172.google.com [209.85.220.172]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id A94FD1A00A5 for ; Tue, 17 Oct 2017 01:18:01 +0000 (UTC) Received: by mail-qk0-f172.google.com with SMTP id n5so145619qke.11 for ; Mon, 16 Oct 2017 18:18:01 -0700 (PDT) X-Gm-Message-State: AMCzsaWYWr5NwpVDZVVCh6GQ/K8JgluoWWf+/3L86s4jImpptpdK/ini lUyz7m5y/nBo/g4viLmoWYRxKOHcy8t/I+408snk7A== X-Google-Smtp-Source: AOwi7QBTc/o7mRPmPYGjFYbl5QUutOG5wQhAOAgAiXgkp1H6/u9ArqScNke6MrzuAnEH4P7m7Z/eIrFD+BNYV4SA4x4= X-Received: by 10.55.1.8 with SMTP id 8mr17314323qkb.80.1508203080912; Mon, 16 Oct 2017 18:18:00 -0700 (PDT) MIME-Version: 1.0 Received: by 10.140.28.3 with HTTP; Mon, 16 Oct 2017 18:17:19 -0700 (PDT) In-Reply-To: References: <70089e9a-caa9-9236-24ed-1daa6e1f9810@gmail.com> <605757bd-751f-5954-be26-be044c4244ce@gmail.com> <14cd3d61-daba-d2c1-8ef9-646c03a64b35@gmail.com> <768792ac-478a-16b1-c11d-22072804b2e8@gmail.com> <245AE873-0BAD-4ABA-BB37-D4949ED58530@apache.org> <70e5e134-cf04-7812-23e4-0383226f529f@gmail.com> <8D3F9EBD-7821-4088-B86E-A0339B6AFFBA@apache.org> From: Dmitriy Setrakyan Date: Mon, 16 Oct 2017 18:17:19 -0700 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Persistence per memory policy configuration To: dev@ignite.apache.org Content-Type: multipart/alternative; boundary="001a11450c7ce331af055bb3e447" archived-at: Tue, 17 Oct 2017 01:18:04 -0000 --001a11450c7ce331af055bb3e447 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Igniters, we should not have Swap in the property names. Swap is something that behaves completely differently from Ignite persistence, and I don't think it should be present within Ignite altogether. D. On Mon, Oct 16, 2017 at 11:17 AM, Vladimir Ozerov wrote: > +1 to Ivan's suggestion. > > =D0=BF=D0=BD, 16 =D0=BE=D0=BA=D1=82. 2017 =D0=B3. =D0=B2 21:00, Ivan Rako= v : > > > *swapPath* is ok for me. It is also consistent with *walPath* and > > *walArchivePath*. > > > > Regarding persistencePath/storagePath, I don't like the idea when path > > for WAL is implicitly changed, especially when we have separate option > > for it. > > WAL and storage files are already located under same $IGNITE_HOME root. > > From user perspective, there's no need to change root for all > > persistence-related directories as long as $IGNITE_HOME points to the > > correct disk. > > From developer perspective, this change breaks backwards compatibility= . > > Maintaining backwards compatibility in fail-safe way (checking both > > old-style and new-style paths) is complex and hard to maintain in the > > codebase. > > > > Best Regards, > > Ivan Rakov > > > > My vote is for *storagePath* and keeping behavior as is. > > > > On 16.10.2017 16:53, Pavel Tupitsyn wrote: > > > Igniters, another thing to consider: > > > > > > DataRegionConfiguration.SwapFilePath should be SwapPath, > > > since this is actually not a single file, but a directory path. > > > > > > On Fri, Oct 13, 2017 at 7:53 PM, Denis Magda > wrote: > > > > > >> Seems I've got what you=E2=80=99re talking about. > > >> > > >> I=E2=80=99ve tried to change the root directory (*persistencePath*) = and saw > that > > >> only data/indexes were placed to it while wal stayed somewhere in my > > work > > >> dir. It works counterintuitive and causes non productive discussions > > like > > >> we are in arguing about *persistencePath* or *storagePath*. Neither > name > > >> fits this behavior. > > >> > > >> My suggestion will be the following: > > >> - *persistencePath* refers to the path of all storage files > > (data/indexes, > > >> wal, archive). If the path is changed *all the files* will be under > the > > new > > >> directory unless *setWalPath* and *setWalArchivePath* are set > > *explicitly*. > > >> - *setWalPath* overrides the default location of WAL (which is > > >> setPersistencePath) > > >> - *setWalArchivePath* overrides the default location of the archive > > (which > > >> is again has to be setPersistencePath). > > >> > > >> If we follow this approach the configuration and behavior becomes > vivid. > > >> Thoughts? > > >> > > >> =E2=80=94 > > >> Denis > > >> > > >>> On Oct 13, 2017, at 1:21 AM, Ivan Rakov > wrote: > > >>> > > >>> Denis, > > >>> > > >>> Data/index storage and WAL are located under the same root by > default. > > >>> However, this is not mandatory: *storagePath* and *walPath* > properties > > >> can contain both absolute and relative paths. If paths are absolute, > > >> storage and WAL can reside on different devices, like this: > > >>>> storagePath: /storage1/NMVe_drive/storage > > >>>> walPath: /storage2/Big_SSD_drive/wal > > >>> We even recommend this in tuning guide: https://apacheignite.readme= . > > >> io/docs/durable-memory-tuning > > >>> That's why I think *persistencePath* is misleading. > > >>> > > >>> Best Regards, > > >>> Ivan Rakov > > >>> > > >>> On 13.10.2017 5:03, Dmitriy Setrakyan wrote: > > >>>> On Thu, Oct 12, 2017 at 7:01 PM, Denis Magda > > >> wrote: > > >>>>> From what I see after running an example they are under the same > > root > > >>>>> folder and in different subdirectories. The root folder should be > > >> defined > > >>>>> by setPersistencePath as I guess. > > >>>>> > > >>>> If that is the case, then you are right. Then we should not have > > >>>> storagePath or WalPath, and store them both under "persistencePath= " > > >> root. > > >>>> However, I would need Alexey Goncharuk or Ivan Rakov to confirm > this. > > >>>> > > >> > > > > > --001a11450c7ce331af055bb3e447--