Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 1FDDE200B54 for ; Wed, 13 Jul 2016 21:45:51 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 1E758160A62; Wed, 13 Jul 2016 19:45:51 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 6A43F160A6A for ; Wed, 13 Jul 2016 21:45:50 +0200 (CEST) Received: (qmail 92714 invoked by uid 500); 13 Jul 2016 19:45:49 -0000 Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list dev@ignite.apache.org Received: (qmail 92629 invoked by uid 99); 13 Jul 2016 19:45:49 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Jul 2016 19:45:49 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id D93DFC04FD for ; Wed, 13 Jul 2016 19:45:48 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.179 X-Spam-Level: * X-Spam-Status: No, score=1.179 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id hiGz7q-UJtOl for ; Wed, 13 Jul 2016 19:45:47 +0000 (UTC) Received: from mail-oi0-f45.google.com (mail-oi0-f45.google.com [209.85.218.45]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 0E9FE5F23D for ; Wed, 13 Jul 2016 19:45:47 +0000 (UTC) Received: by mail-oi0-f45.google.com with SMTP id j185so79761505oih.0 for ; Wed, 13 Jul 2016 12:45:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to; bh=VSHQJnTQylyweSMUTGb8nyAcLeFp0EJ0glZGpINSyUQ=; b=pTBUyXPrG7+0DeTGeEguo8Q2ADdQvp60WnIO0UXkSfZmAhgy9NclRvxdAfZrZ/ZBKO NXrPdELMx+13wkSCOezEmT6fBz6xJR623XkSS8KD9GtGDlHYzmPdjknAde/fHomLLUkJ FHeWV7AWDxVb4hr4jV4343w0Qpe+/Tf3FKxlnNzkOo1el3wZeRKaAZy/K30UEGYqVGPk X7XnxeoLiRfYu8L5eyoBmS8Erm6nxVhDQI5xwltw2NmbxiM24mGKPMHRmUSzvXVwIkbc Zx4lmF8K9B1tmj6kAcjjyXnqARTbY9o5hZ5P5m7CH/9YuqHWmUdcYWbK6BCtwXU/6aZm XfAA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=VSHQJnTQylyweSMUTGb8nyAcLeFp0EJ0glZGpINSyUQ=; b=jZbTXHsZpeMO1nCyVCOC0F1JMfpGuNXUG49/o6x5E003CJSps0WfcLX9v5GncRgopX ZJ3T1sMaiGzUdolZ9y2yNeffGmUQ44D2iXpegSQX7P0OREp2Tt6GuGfBqBkFfBxMFvF+ 9ctiyYzsHhpmAZ2zIQVD7hFrgsxVsMb70n/p9NbYSHw3YmHuH0vbtEYXN1Bm7hL+8JKg 6dqbJE0dHiuYRMGBHpB4m7YKSll77AN9m0y0EqW97D9IDPMeurkL1Z2zBalSCtiq3qqV WR7qFzkhANAqbJfm6WtRigv+E7BVNUa9QbmMx3Z2+C0YmlmabIB3skuSQGQm8f/9F76S ImXQ== X-Gm-Message-State: ALyK8tIRnBjZ3sRFH2CbEQGU+yUK4cVaRt/yE2YvE2L9YideuPZ6wNrr0M42zqOofJ/C11kFjzvtgNyA3mN0rg== X-Received: by 10.157.60.60 with SMTP id q57mr2787258otc.76.1468439139600; Wed, 13 Jul 2016 12:45:39 -0700 (PDT) MIME-Version: 1.0 Received: by 10.157.16.7 with HTTP; Wed, 13 Jul 2016 12:45:20 -0700 (PDT) From: Igor Rudyak Date: Wed, 13 Jul 2016 12:45:20 -0700 Message-ID: Subject: Ignite monitoring To: dev@ignite.apache.org Content-Type: multipart/alternative; boundary=001a11c030224a4e24053789a1a2 archived-at: Wed, 13 Jul 2016 19:45:51 -0000 --001a11c030224a4e24053789a1a2 Content-Type: text/plain; charset=UTF-8 Hi guys, While experimenting with large Ignite clusters I found that lack of monitoring is rather critical problem. I know that Ignite provides number of JMX MBeans to monitor custom metrics in addition to host system metrics (CPU, IO, RAM, ....). The problem is, there are no out of the box solution to monitor all this. Thus you have to manually setup some kind of monitoring tool like Graphite, Grafana, Ganglia and etc. Which involves setting up monitoring agents on all the nodes, uploading JMX agent on all the nodes, selecting appropriate metrics from the plenty of JMX MBeans and preparing config files, tuning Ignite shell scripts to include "java agent" in java launch command. Lots of work and pain, each time you want to create new Ignite cluster. Probably it makes sense to have all these out of the box, by slightly modifying existing and providing additional shell scripts, to bootstrap all monitoring infrastructure? Igor Rudyak --001a11c030224a4e24053789a1a2--