From dev-return-32514-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Fri Mar 23 22:34:39 2018 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx-eu-01.ponee.io (Postfix) with SMTP id 24B5718064D for ; Fri, 23 Mar 2018 22:34:38 +0100 (CET) Received: (qmail 61096 invoked by uid 500); 23 Mar 2018 21:34:38 -0000 Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list dev@ignite.apache.org Received: (qmail 61080 invoked by uid 99); 23 Mar 2018 21:34:37 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 23 Mar 2018 21:34:37 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id DE748C013E for ; Fri, 23 Mar 2018 21:34:36 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id 4PcZ9riWx9_y for ; Fri, 23 Mar 2018 21:34:34 +0000 (UTC) Received: from mail-it0-f53.google.com (mail-it0-f53.google.com [209.85.214.53]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id CCA885F36A for ; Fri, 23 Mar 2018 21:34:33 +0000 (UTC) Received: by mail-it0-f53.google.com with SMTP id p67-v6so4287568itc.2 for ; Fri, 23 Mar 2018 14:34:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=3UU4Lt3xoeqknyMO1G1pRD9htgJzwmgj0kBXIZ4mQGM=; b=BMmbk67PwFWBP7dAI/MYr2CymloOA0nEBVtzkPPAJ2Au4UB63VFqa0E0aEDz4hQIJZ axuY9StS5bRQvMf07SqH3hyZ410E3aGbvYZPk96oUUKGImFFHTSf0TggJgKKtdxyOdx4 jdORaXhzdL/XYY4bhW4/LVo4Eh4LLPDl6DJsLvNdhT3J6wo7q8hiFyw7Qjkam2n2BRw7 DBt22vi1NtpnUGkXQQYMQcEY6jsiL13vvI19xiW+W3NW/FpjJELkelARvaQTqEBE87X8 g4gcm7LWSrCpTQe0ZQ0Z7nNWSfaNexcrKKEhOZDnSNKqM2J0gh6vmW8E5xl80HJy/K7R U7CA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=3UU4Lt3xoeqknyMO1G1pRD9htgJzwmgj0kBXIZ4mQGM=; b=Ht9Udo5utOnuNZYHPXy/1p3EQgjJHlqo+R2o8IKLKtaf6U9wX3pcRqGMu/CkJuhWqN Maw0Rz+8UQxZptTQZYgISsLnl5T92NfeBeP7rinUBGyn4mZEQCbMrgFquhM0hoeWcvmO vXDZaxfjX7nO5LWrlNYXM0S0hYiTRtA6+j6Enmrsi2x0SOSNrIehcbp/OpoZJ1lD5Lfp 44dDviQbegY+x48zCa3eM0s8O4UHuBdkbmp+Sf5H8vZ6yRCLKph3IDExmym+2pty7A2J UnenGjXb6FKRl0IQ8iZTXVWUaWT1p9qvXBiH8rg5qXVdFEMO5IbJyYGD/ttW2K6FcC1E pBWQ== X-Gm-Message-State: AElRT7Gy2c03SgdGEyxqnMbF+ycVQHIb5q6doYQxbqBFJBv1X6hR41yW kRwPzO+fGJgdHnT3gtqerrEwbJ7RrkdXIKTQcMM= X-Google-Smtp-Source: AIpwx494gmTkHcmToMh1tjVTI5VjBdOhRdj2/DLpqSB73Y1tvacGZbGN4OKj3CcwJmy4UwBIN9FT08rPGcMz3QMZBHI= X-Received: by 2002:a24:4290:: with SMTP id i138-v6mr3927247itb.105.1521840866450; Fri, 23 Mar 2018 14:34:26 -0700 (PDT) MIME-Version: 1.0 References: <44857f780437831523c7ab8515802df3@mail.gmail.com> In-Reply-To: From: Dmitry Pavlov Date: Fri, 23 Mar 2018 21:34:15 +0000 Message-ID: Subject: Re: Ignite Direct I/O plugin description added to wiki To: dev@ignite.apache.org Cc: Denis Magda Content-Type: multipart/alternative; boundary="0000000000003fdfd405681b300e" --0000000000003fdfd405681b300e Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Prachi, Yes, it's a great description. I'm impressed by how informative and short you managed to make it. Thank you! Sincerely, Dmitriy Pavlov =D1=81=D0=B1, 24 =D0=BC=D0=B0=D1=80. 2018 =D0=B3. =D0=B2 0:29, Prachi Garg = : > Dmitriy, > > I have documented the Direct I/O plugin. Please review [1] and provide > comments/feedback in the ticket [2]. > > [1] > > https://apacheignite.readme.io/v2.4/docs/durable-memory-tuning#section-en= abling-direct-i-o > > [2] https://issues.apache.org/jira/browse/IGNITE-7466 > > > -Prachi > > On Wed, Mar 21, 2018 at 11:22 PM, Dmitry Pavlov > wrote: > > > Yes, will do. > > > > =D1=87=D1=82, 22 =D0=BC=D0=B0=D1=80. 2018 =D0=B3. =D0=B2 1:05, Denis Ma= gda : > > > > > Dmitriy, > > > > > > Thanks for updating the WAL section. Now it makes total sense to me. > > > > > > As for the page with JNA projects, let's get added there! Could you > > > contact the owners? > > > > > > -- > > > Denis > > > > > > > > > On Wed, Mar 21, 2018 at 9:27 AM, Dmitry Pavlov > > > wrote: > > > > > >> Denis, > > >> > > >> one more thing, can/should we mention Ignite Direct IO plugin in lis= t > of > > >> project using JNA here: https://github.com/java-native-access/jna > > >> > > >> Sincerely, > > >> Dmitriy Pavlov > > >> > > >> =D1=81=D1=80, 21 =D0=BC=D0=B0=D1=80. 2018 =D0=B3. =D0=B2 1:59, Denis= Magda : > > >> > > >>> *Dmitriy*, thanks. Astonishing job! We'll add a section to the > durable > > >>> memory tuning page and refer to the wiki for more details: > > >>> https://issues.apache.org/jira/browse/IGNITE-7466 > > >>> > > >>> Please clarify the following: > > >>> > > >>> > Direct I/O mode can't be enabled for Write Ahead Log files. > However, > > >>> when > > >>> > working with plugin, WAL manager applies advising Linux systems d= o > > not > > >>> > store the data of the file in page cache as they are not required= . > > >>> > > >>> > > >>> For me, it means that WAL always goes through the operating system > I/O > > >>> calls. Nothing changes for the WAL. However, I'm not sure what you > > meant > > >>> to > > >>> explain by saying "when working with the plugin (Direct I/O) WAL > > manager > > >>> applies...". Could you rephrase it to bring more clarity? > > >>> > > >>> *Raymond,* > > >>> > > >>> > > >>> If Direct I/O is enabled by default it will bring down the > performance > > of > > >>> read-intensive application because, as Dmitry says, the reads bypas= s > > page > > >>> cache. So, I would recommend using it for write-intensive workloads > > and, > > >>> probably, for mixed-workloads depending on the reads and writes rat= e. > > >>> > > >>> -- > > >>> Denis > > >>> > > >>> > > >>> On Tue, Mar 20, 2018 at 2:29 PM, Raymond Wilson < > > >>> raymond_wilson@trimble.com> > > >>> wrote: > > >>> > > >>> > Looks good! > > >>> > > > >>> > Is there any reason why this should not be a default setting if i= t > > >>> > gracefully downgrades to non-Direct IO if not supported by the OS= ? > > >>> > > > >>> > Thanks, > > >>> > Raymond. > > >>> > > > >>> > -----Original Message----- > > >>> > From: Dmitriy Setrakyan [mailto:dsetrakyan@apache.org] > > >>> > Sent: Wednesday, March 21, 2018 10:23 AM > > >>> > To: dev > > >>> > Subject: Re: Ignite Direct I/O plugin description added to wiki > > >>> > > > >>> > Thanks Dmitry, awesome work! > > >>> > > > >>> > On Wed, Mar 21, 2018 at 12:21 AM, Dmitry Pavlov < > > dpavlov.spb@gmail.com > > >>> > > > >>> > wrote: > > >>> > > > >>> > > Hi Igniters, > > >>> > > > > >>> > > I've added description of new plugin for Direct I/O for native > > >>> > > persistence ( > > >>> > > https://issues.apache.org/jira/browse/IGNITE-6341) to wiki > > >>> > > https://cwiki.apache.org/confluence/display/IGNITE/ > > >>> > > Ignite+Persistent+Store+-+under+the+hood#IgnitePersistentStore- > > >>> > > underthehood-DirectI/O > > >>> > > > > >>> > > > > >>> > > SIncerely, > > >>> > > Dmitriy Pavlov > > >>> > > > > >>> > > > >>> > > >> > > > > > > --0000000000003fdfd405681b300e--