Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id C44D2200D26 for ; Fri, 20 Oct 2017 13:26:33 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id C2C0B160BCB; Fri, 20 Oct 2017 11:26:33 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id E23971609E1 for ; Fri, 20 Oct 2017 13:26:32 +0200 (CEST) Received: (qmail 57037 invoked by uid 500); 20 Oct 2017 11:26:31 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 57027 invoked by uid 99); 20 Oct 2017 11:26:31 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 20 Oct 2017 11:26:31 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 1B81BC3D90 for ; Fri, 20 Oct 2017 11:26:31 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -0.401 X-Spam-Level: X-Spam-Status: No, score=-0.401 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-2.8, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id IAJKNLt_rQic for ; Fri, 20 Oct 2017 11:26:30 +0000 (UTC) Received: from mail-io0-f171.google.com (mail-io0-f171.google.com [209.85.223.171]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id DF9505F566 for ; Fri, 20 Oct 2017 11:26:29 +0000 (UTC) Received: by mail-io0-f171.google.com with SMTP id n137so12902616iod.6 for ; Fri, 20 Oct 2017 04:26:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=KRhcljeGJE3frEYtQ9qgBGjDU4zDP0NSwJueJNX6CaQ=; b=J8v3/tpflCB5mjQgrxZcgdedSR9VPtFst5PMZLM3E+kkrYLCG9sas3GlqpMa6W7UdT gDfiELSUKo3gh3LgjnJrCOWHJ0Xs+2N8251qr0BKMu5v4As/4cfAaecOPV5bfY5EyO1H BiKyYFTW5Xdu6La2Odk0ziodFfbvRysafZjOlumuk96Ah0a046gjfK8LiB4P894BNSug cKpOJ3lxehGmY4djpWJk9dgnS0kJz8z/0JVXxq6pvh+uiICYPDQ+9fKK6ilHll7IQVOF WkRB+teyfvgKVGOQ7bl5FmxuEYbXI6MDlq5hqWdUy2BCAaYZnjzJ721NWrkIcJdoTdvH nRJw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=KRhcljeGJE3frEYtQ9qgBGjDU4zDP0NSwJueJNX6CaQ=; b=EiVcxKEAP6AHpDT+aq3d5cjHfatcN78s07u8iuxUFR7Kjxo7AfR/uR/RXmOClUz4Rr dH4RjoFRjf2e4NEbmHlufu2/ybI//p4KLa2LsLWfmvB6XtVJ4DCfZ1f5v7R9VrOHHYF3 3VJqV19knASn3zR8Vst3z0kqblIbsTfAkFB2gc8zdWyWG2LGvseOZFQst6VFIXRZ1OsB SWx921rXNqihSZ45btmXAyv90VXWOk8miTdVddaoXcuA38Iqayl/8+EYCqaf9YYGUNuu uuiq42h7bGmRkhpATTsvt0CxNJE372iKvxhXDAlJ/AE0Fg+HvJkt/H538k7INH7rCQPK bxFw== X-Gm-Message-State: AMCzsaV8euCnR/4yiXfwn+Z4o8ObJ5nL7n1+d4CPRtWTu/H8L5o3bRla 74rLfBrnPZAo1ZNIrlpl5yxofoF51RC3+NeBAFk= X-Google-Smtp-Source: ABhQp+Tpk76VYBcKXvtK9krR064mrELjejhPTRX1KV3gZEB9GJMes5M8vF/Kp4IV0Y6eVXJDH452C4H6t3K0DDSXkCA= X-Received: by 10.107.8.100 with SMTP id 97mr5917207ioi.83.1508498789104; Fri, 20 Oct 2017 04:26:29 -0700 (PDT) MIME-Version: 1.0 References: <1507706979946-0.post@n6.nabble.com> <1508216226781-0.post@n6.nabble.com> <1508249369392-0.post@n6.nabble.com> <1508307418701-0.post@n6.nabble.com> <1508342315931-0.post@n6.nabble.com> <1508419497695-0.post@n6.nabble.com> In-Reply-To: <1508419497695-0.post@n6.nabble.com> From: Dmitry Pavlov Date: Fri, 20 Oct 2017 11:26:18 +0000 Message-ID: Subject: Re: Inserting data into Ignite got stuck when memory is full with persistent store enabled. To: user@ignite.apache.org Content-Type: multipart/alternative; boundary="001a113f378677ff5c055bf8be7c" archived-at: Fri, 20 Oct 2017 11:26:34 -0000 --001a113f378677ff5c055bf8be7c Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Ray, I checked the dumps and from them it is clear that the client node can not provide more data load, since the cluster is already busy. But there is no activity on the server node. I suppose that the problem could be located on some other server node of the three remaining. The logs you sent earlier also do not contain obvious errors. Could you collect and send the logs and thread dumps from all server nodes? Sincerely, Dmitriy Pavlov =D1=87=D1=82, 19 =D0=BE=D0=BA=D1=82. 2017 =D0=B3. =D0=B2 16:25, Ray : > Hi Dmitriy, > > Thanks for the reply. > > I know the eviction is automatic, but does eviction happen only when the > memory is full? > From the log, I didn't see any "Page evictions started, this will affect > storage performance" message. > > So my guess is that memory is not fully used up and no eviction happened. > > > > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ > --001a113f378677ff5c055bf8be7c Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable

Hi Ray,

I checked= the dumps and from them it is clear that the client node can not provide m= ore data load, since the cluster is already busy. But there is no activity = on the server node.

I suppose that the problem could be located on some other se= rver node of the three remaining. The logs you sent earlier also do not con= tain obvious errors.

Could you collect and send the logs and thread dumps from all server nodes?

=

=C2=A0

Sincerely,

<= p dir=3D"ltr" style=3D"line-height:1.9872;margin-top:0pt;margin-bottom:0pt"= >Dmitriy Pavlov


=D1=87=D1=82, 19 =D0=BE= =D0=BA=D1=82. 2017 =D0=B3. =D0=B2 16:25, Ray <rayliu@cisco.com>:
Hi Dmitriy,

Thanks for the reply.

I know the eviction is automatic, but does eviction happen only when the memory is full?
From the log, I didn't see any "Page evictions started, this will = affect
storage performance" message.

So my guess is that memory is not fully used up and no eviction happened.





--
Sent from: http://apache-ignite-users.70518.x6.nabbl= e.com/
--001a113f378677ff5c055bf8be7c--