From user-return-27879-archive-asf-public=cust-asf.ponee.io@ignite.apache.org Wed Nov 6 12:12:26 2019 Return-Path: X-Original-To: archive-asf-public@cust-asf.ponee.io Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by mx-eu-01.ponee.io (Postfix) with SMTP id D307E180651 for ; Wed, 6 Nov 2019 13:12:25 +0100 (CET) Received: (qmail 58740 invoked by uid 500); 6 Nov 2019 12:12:24 -0000 Mailing-List: contact user-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@ignite.apache.org Delivered-To: mailing list user@ignite.apache.org Received: (qmail 58721 invoked by uid 99); 6 Nov 2019 12:12:24 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Nov 2019 12:12:24 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 122DCC0826 for ; Wed, 6 Nov 2019 12:12:24 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0 X-Spam-Level: X-Spam-Status: No, score=0 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-ec2-va.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id Od3kIKYSIQXe for ; Wed, 6 Nov 2019 12:12:22 +0000 (UTC) Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=209.85.208.67; helo=mail-ed1-f67.google.com; envelope-from=ilya.kasnacheev@gmail.com; receiver= Received: from mail-ed1-f67.google.com (mail-ed1-f67.google.com [209.85.208.67]) by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTPS id 4858FBC57A for ; Wed, 6 Nov 2019 12:12:22 +0000 (UTC) Received: by mail-ed1-f67.google.com with SMTP id p59so19105179edp.7 for ; Wed, 06 Nov 2019 04:12:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=CPZO/M23X5HaYezFGyOQqEgCNQAveBpzAZIqofJa0ns=; b=ud2MFjHtc54wgMoILhVlRHps4P9CWFLK9vwBGSu0e3eYutzj/OhwFHnhDw58IxKKTz Bsv6N5dooHtyUO627lpXcgtx74XXfimKb6FTZ+MQpyoYxxOa02+sTF9u+1F1E8gN73fb U/CtolVA5U5f6tG52iXLghqXMUospRpSgrbvaQoPgp5B3pMOQV2Qe+OUP+JvCieeTqn2 0XdHYj5Di/PFzxqhYfnHpV1rzloC/YxwOPMoQKN8jJk+Ve/3JsqVB+8wKtR7XCn4FcTY PPjgy6yTFAAT+fy/loX89qAPqtJ6VVv6GJCRm6YyRJx9Hqu7yJShri7xy5bo3jm+ryOy brng== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=CPZO/M23X5HaYezFGyOQqEgCNQAveBpzAZIqofJa0ns=; b=cN7xNGWCxbuSqV5SVjhgLfuChaEw/ak7Sp7eO+TYDLu1y7lVmgDj2lNq0GyJPe7VfH iWMYu82J47Azrugg/aOWk8QgUxkLUciqgTwJaSZt9pVz3swfbiYOTF5wrUwCWU5gzEni Yl6/JivsybCsym5vhYP9tSPmwOUX6pK77o8aypPKSTE9PfS8NW5N1nn9fz6hlRC3bRpd E4Lj3ZVp+GJ4QCN+HngLVrl4jzt57SfIErQ4oHQIuTjPBAqHtXefQWQXlXcSh2kMe2uu jibvyD+Gj6mnKLQuHkcWhJIAKx7kq/g9Ih5FQKtx3VgnoGZ19izNMrqbab1n6m6ZWG/G aT4w== X-Gm-Message-State: APjAAAXo4l9XTQNpLzI5xRDg08zN6OnKmOTCx1shxat6O07yEUlflgha kP+xZTYl6pSfuWz1d01FbHi1W8d8Gn2UtZJNfyGaZudp X-Google-Smtp-Source: APXvYqxUAA3XIImndBP3l9lKlEhLY+tiP/kHNAXZItX2B8ktd8le6JBgSAaMjayPLPHPywobzbYdXkOMua+wvZb3VJE= X-Received: by 2002:a17:906:a0f:: with SMTP id w15mr33107947ejf.321.1573042341148; Wed, 06 Nov 2019 04:12:21 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Ilya Kasnacheev Date: Wed, 6 Nov 2019 15:12:09 +0300 Message-ID: Subject: Re: Ignite 2.7.0 YARN deployment - IGNITE_JVM_OPTS doesn't seem to work To: user@ignite.apache.org Content-Type: multipart/related; boundary="000000000000f67a080596ac75c7" --000000000000f67a080596ac75c7 Content-Type: multipart/alternative; boundary="000000000000f67a070596ac75c6" --000000000000f67a070596ac75c6 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello! You should use Static IP Finder without specifying any hosts, Yarn launcher will pass the list of hosts to discover via environment variable. IGNITE_JVM_OPTS should work. Please try to debug this issue, file a ticket against IGNITE JIRA if you have any specifics. Regards, --=20 Ilya Kasnacheev =D0=B2=D1=82, 5 =D0=BD=D0=BE=D1=8F=D0=B1. 2019 =D0=B3. =D0=B2 21:34, Seshan= , Manoj N. (TR Tech, Content & Ops) < manoj.seshan@thomsonreuters.com>: > We are trying to =E2=80=A6 > > 1. Use the G1 garbage collector for smaller stop-the-world GC pauses. > 2. Obtain verbose logs from Ignite for troubleshooting purposes > > > > We have tried setting IGNITE_JVM_OPTS=3D=E2=80=9D-DIGNITE_QUIET=3Dfalse -= XX:+UseG1GC=E2=80=9D, > but the JVM options are not taking effect on the Server nodes. > > > > Please help. > > > > Rgds, Manoj > > > > *Manoj Seshan - Senior Architect* > > Platform Content Technology, Bangalore > > [image: cid:image001.gif@01C95541.6801BF70] > > *Voice:* +91-98806 72987 +91-80-67492572 > > > > *From:* Seshan, Manoj N. (TR Tech, Content & Ops) > *Sent:* Tuesday, November 05, 2019 11:45 PM > *To:* user@ignite.apache.org > *Subject:* Ignite YARN deployment - how to use TCP IP Discovery? > > > > We are using Ignite as a Distributed In-Memory cache, deployed using YARN > on a Hadoop Cluster. We have configured Zookeeper Discovery, and this is > working fine. > > > > Given this is a small 20 node Ignite cluster, Zookeeper Discovery seems > overkill. Would it be possible to switch to TCP Discovery? Multicast > Finding is not an option, as that is disabled. Static IP Finding would al= so > not work, as the Ignite Containers are dynamically allocated by YARN to > arbitrary nodes of the Hadoop Cluster. > > > > Rgds > > > > *Manoj Seshan - Senior Architect* > > Platform Content Technology, Bangalore > > [image: cid:image001.gif@01C95541.6801BF70] > > *Voice:* +91-98806 72987 +91-80-67492572 > > > --000000000000f67a070596ac75c6 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello!

You should use Static= IP Finder without specifying any hosts, Yarn launcher will pass the list o= f hosts to discover via environment variable.

IGNI= TE_JVM_OPTS should work. Please try to debug this issue, file a ticket agai= nst IGNITE JIRA if you have any specifics.

Reg= ards,
--
<= /div>
Ilya Kasnacheev

=

=D0=B2=D1=82, 5 =D0=BD=D0=BE=D1=8F=D0=B1. 2019 =D0=B3. =D0=B2 21:34, = Seshan, Manoj N. (TR Tech, Content & Ops) <manoj.seshan@thomsonreuters.com>:

We are trying to =E2=80=A6

  1. Use the G1 garbage collector for smaller stop-the-world GC pauses= .
  2. Obtain verbose logs from Ignite for troublesho= oting purposes

=C2=A0

We have tried setting IGNITE_JVM_OPTS=3D=E2=80=9D-DI= GNITE_QUIET=3Dfalse -XX:+UseG1GC=E2=80=9D, but the JVM options are not taki= ng effect on the Server nodes.

=C2=A0

Please help.

=C2=A0

Rgds, Manoj

=C2=A0

Manoj Seshan - Sen= ior Architect

Platform Content Techn= ology, Bangalore

3D"cid:image001.gif@01C95541.6801BF70"

Voice: +91-98806 72987=C2=A0 +91-80-67492572

=C2=A0

From: Seshan, Manoj N. (TR Tech, Content &= ; Ops)
Sent: Tuesday, November 05, 2019 11:45 PM
To: user= @ignite.apache.org
Subject: Ignite YARN deployment - how to use TCP IP Discovery?

=C2=A0

We are using Ignite as a Distributed In-Memory cache= , deployed using YARN on a Hadoop Cluster.=C2=A0 We have configured Zookeep= er Discovery, and this is working fine.

=C2=A0

Given this is a small 20 node Ignite cluster, Zookee= per Discovery seems overkill. Would it be possible to switch to TCP Discove= ry? Multicast Finding is not an option, as that is disabled. Static IP Find= ing would also not work, as the Ignite Containers are dynamically allocated by YARN to arbitrary nodes of the Had= oop Cluster.

=C2=A0

Rgds

=C2=A0

Manoj Seshan - Sen= ior Architect

Platform Content Techn= ology, Bangalore

3D"cid:image001.gif@01C95541.6801BF70"

Voice: +91-98806 72987=C2=A0 +91-80-67492572

=C2=A0

--000000000000f67a070596ac75c6-- --000000000000f67a080596ac75c7 Content-Type: image/gif; name="image001.gif" Content-Disposition: inline; filename="image001.gif" Content-Transfer-Encoding: base64 Content-ID: <16e409dfb234cdccc1> X-Attachment-Id: 16e409dfb234cdccc1 R0lGODlhuQAgAHcAMSH/C01TT0ZGSUNFOS4wDQAAAAFzUkdCAK7OHOkAIf8LTVNPRkZJQ0U5LjAX AAAAC21zT1BNU09GRklDRTkuMEI8pPUAIf8LTVNPRkZJQ0U5LjAVAAAACXBIWXMAAA7EAAAOxwG+ Bl3YACwAAAAAuQAgAIcAAAD////+/v73/v7+563+587+xmv+58b+3pz+997+573+1pz3xnv+1q3+ 9+f+vWP+78b+zoT+9+/+xoT+rUL+99b+787+lCH+79b+rVL+/vf+3qX3/vf+xoz+vXP+vWv+/u/+ rUr3xpT+pTn+xnv+9/f+1qX+rVr+pTH+zoz+zpT+nDn+3q331q3+jBD+hAD+797+xmP+1oz+tWP+ 3rX+cwD+tWv+/t61hISEhISEhLXe/u/OnISEnMa13v7e/v6EnM7v/v6EhJzO9/7GnITv/t7e/vf+ vYT+jCGthITGlITW/v7vxpyUxu/etYScxu+chISEhK2UhITvxpSczveElMbG7/7+/tbO7/7+jBj+ 59b+vXv+tVL3xoT+hAj+nEL+lBj+rWOEnJycnITvzpzerYSt1v73ewD+1pT+ewD+pUL39/f+/ue9 lITW9/fnxpSt1veErcbn9+etrYT39+eEhJTG5/7nvZSEnK2tlITn9/f399b+3r3+3sb+tVr31pyc vefnxpycxueErc7WrYTG59aErdbOrYTO9/fv7++Uvd7nvZyUveeEnL3n58bO9+eElL339869nIT+ xnP3tVr358b3jCH+hBDv7961lITO7+/n5+fvzq2cvd7etZSlzu/v786lhITvzqWlpaWlxueEhKXO 5+fnzq3evZTW5+eElK2llISElLXe7+/G5+fn5873zq3+zpz+pUr+ewjn59bn1rXe3t6Epca11t69 pYTG3t7e1rWUtdbWtZStxufe5+fGpYTe3sbevZzn1r3WvZT+lCn+nDHOtZSUrc7W1tbe3s7G1ta9 3t7W1r291tatzt6Utc7O3t6tztbe3r21zt7e3tbWvaWUrca11tbevaXWxq3O1tbexqXW1s7W3t61 1uf+xpT3rVLOzs73vWP+57X+awD3/u/+7+f+nCkAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAI/wAFCBxIsKDBgwgTKlzI sKHDhxAjSpxIsaLFixgzatzIsaPHjyBDihxJsqRJgwMEEiggwMABAQgSnJxJsyZDBQsEMGggQIED AQ8gOIggwabRoycnUBhYYYAFmQIsXMCAtKrVjQ4yTBCgwcEGDh0keFAw4YMAEAlCiLjKti1EDSNI aBD6MgGIAiUUmPBwAgSKFG4DCy6owcOHnw5URBVbYQWLExhIZGiB4cAJnoMzswXh4gWMGC81bLBw YIKMCTNQ06jhYUENGwlv4MhBu7aOHTx6pDybezeN2jl8CJSdQ8cP3sWPg+BRG0iQgb9rC+ctZIjA 5boHEgcufDnw5BqIOP8XGB5IkdnfdRghkv7HdunXmdMeLzFBigUaaNxNYIHFERs2ZGDDBEjQ0IEN KqTQAkM3JGHcdUrosMR1RDzIRA5NCOREDk8I0GAO1UUFRQ5R/LBciVFJ0cNzU3CoYQ5UnMVeFc9p oAR9HuJAo4dJCGFFgxIWBAIRKPJW5BU4HJnkcQQ1uKIASAqBxZAoWgAFjg45kMUICYygBQYgOMDC Flx0oYIJKnhAwwoLePEFC2CEsZBsRZ7IJJU/QADFk9RZgaQYUHTIhBBjGNcgfWSUqCefy0k5JG0d YvfccEnQt6EPSBY50JBByvggj50CyeRASPJZRg5mODkpE5o6dMMZSGj/gYYELFgAgQkzKCBACRDo 1cAWpdnQQRpqaKAQkBOuwUYbUbghwBogMLvEb0+s8awAb+QAxxVJxNFGD3IQOUcUS9DBXg512GHt Gg1waK1Ad2gbLR55aLtsD3pcu0cST3LbrL/OriuAueRaS/AP1u5bsAAKLyHwGtziy3AS5JpLWx1W PPyQBhPQsMUMMPChQQIT/DSQAxhs0IcfKrzQQQR/zJmkw2tY/F2z8QKyxs5rBJKDIPsOQogQhSRh yCFRILJGIoQAp8gai+TACM89/2xuI45IEcUjRECiB8/7Apf0GpEk8Z0hNUuigxs70yFJs88qrPQa YQM3CN3o0dYsz03X//Y0z9cuNEkNlABIQwQwFJCTQCnlV5kJlWRggiWX0HAsxUongkkmUWiSyCaY MKsJJzl0ssnniXiSwyeghDKIKDmMkgMph5Riyia4434KbaSQrkgiwCeCyuqhN5IK6aqsAkkqqIOS hNeks9LKJq1H4Urup2PythvAa1+K54k4ksT3p78yPvinJ9J6I63AksPyqJ++Cemzo57Izgt9kEYG sZCQAB8QKABLuEKeWMAAA2hQgCxiAYZZ8OFYMwMeLSRhO9zRog3fq4UUWJEKW2xigt9z3i1eEQp0 4SIXpdDFLqTAC1u4sBc58EUtoMCKX5wOhJrQXg03AQzacNCD1AsF+/+El4NbbCIY43OFB4EYus59 bn2teGIorPc5EloPe+p7nh4SIYwi2mIYLMwdMWKYu/sxpDBrKoYKMnAABVCFIDQwAQY0wIIDGIMP HVhcbDD3OVpkIoWbsIUfAXmMHCDDFsnooSKCeAtlZCIHrFhGLoTAjGaEQgjOSEYwQlGHZ2yikNAI pCJBlwlWRMMWloTkMhBpi01KbxOO4KQ0NlkKZ7ASiF1c5CeLmDtaKnET0whFKX65RCiGj5PUCKYQ dNFKZAYSd/g7lhcu8JgD/GEDKmgjCLjSgA+wwAEmkAAf9OIFWSwEO1vcRDVK2UFbOPKHtrAGcEhR viTcIp45uEYyKIj/jWSkkjalYEYgbZEN4PjihpIwZTKSoQ0pqGIbC01GLAcBvE1wIwfQ6MYjgVMH XACvBcD5YSD9yApvjHSjtanDN8RHUdwV9JD/zEEKXYg74DHoEitoQRpCYIMwpGACC1ABOGwwAxUo QAIFAIENPsCHS4TDIUvDnQuXOFUXLlQcC6Wp/BCZDHF4tatfxWoybjnVsY4ViJ/jKlbX2tWx1lSq EY2rWD0YPKlWtaoDvSte0zfQuJ5VrzV9l0IcgAYTTMAGNCDBCjrwAZ5OgAQHkABVLGABB6SABsZy SFqfSVWqmlWrqLNqRNk61yVydq+f66tfP5u+1FqVlZ+1BfCW5lrO/z5Tqre1bWvt+lfTmjZ9gk2I BFzghQK4YAUN8MMWBpQCE7RRARwQwDjIAY5ywAaqa8Atbn0LW9DydrVZPattp4rF735WvPLLa1lv WdP7VVS32IPvEoP3Xr0CMXdoDS5CCvMBENAgBSGAwWO30AEaxCIBGHAAAgQCgRBgBqp1jXB6tWu/ 1G4XsGWMb3vrOt7b0pe2Gv7tbHdW0fhVWH7xa+/SQKzht5o4EQ8BQQg6kAAwNEAF5tBCZSUggcqS 4xwjAIcAdtMQEtP3yPRFMZLf22IXl/jJR0axlGfrXtqWeMIjXvGSqbzk1lY5yRGG8v30mxAQqGES XOlSASahAAssAIwEi7vBCAAzEarZ+Vl2znOev7xiPfv5z3cWyLrsXGWNDfrOh/bztQCtZ4p0IAQD YQEbJFABgRQAHRa4iKEHsulOL/rTmxY0qEctMIN4msyjJoinRV1qUgduIgpAwwBkYLmkCoAEFpDA BLapmV732gQsIcEDVYABIvv62MhOtrKXzexmO/vZ0I62tHsdEAA7 --000000000000f67a080596ac75c7--