Return-Path: X-Original-To: apmail-mesos-user-archive@www.apache.org Delivered-To: apmail-mesos-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 41D7518B2F for ; Thu, 6 Aug 2015 10:42:34 +0000 (UTC) Received: (qmail 53969 invoked by uid 500); 6 Aug 2015 10:42:33 -0000 Delivered-To: apmail-mesos-user-archive@mesos.apache.org Received: (qmail 53914 invoked by uid 500); 6 Aug 2015 10:42:33 -0000 Mailing-List: contact user-help@mesos.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@mesos.apache.org Delivered-To: mailing list user@mesos.apache.org Received: (qmail 53904 invoked by uid 99); 6 Aug 2015 10:42:33 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 06 Aug 2015 10:42:33 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 6721119C862 for ; Thu, 6 Aug 2015 10:42:33 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.879 X-Spam-Level: ** X-Spam-Status: No, score=2.879 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=3, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd3-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-eu-west.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id Q0yCVlEe7lma for ; Thu, 6 Aug 2015 10:42:32 +0000 (UTC) Received: from mail-wi0-f172.google.com (mail-wi0-f172.google.com [209.85.212.172]) by mx1-eu-west.apache.org (ASF Mail Server at mx1-eu-west.apache.org) with ESMTPS id F3CAE20530 for ; Thu, 6 Aug 2015 10:42:31 +0000 (UTC) Received: by wibhh20 with SMTP id hh20so18194973wib.0 for ; Thu, 06 Aug 2015 03:42:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=JsWbDohpQ6B9yRjgJtoEzPq2WSO8L8C3VyecORs4F4k=; b=vzXe+zZ6hardAF29kNUGf2iDJC9Z3iUcGj/U9oszgg4adpLSB83cxhfnMRMmLvyTjj qBlNQ6oWYKZcUTQrJNmBdCBrgYe9gBtBq1u4t6pcU1OLFxoWPZOQsyyLTipbPc/VxpzA Kf0ANhVBFkUV+Oskv0OwnWhr+h2mTEwGDh+PfMT//mZishVsoMKUOqcZVW2e8bhO2zMo LuhjUHSvrIdpo8S59O5/rjjQ8xxsh+Rd0KOwX785ydeN+tDwu8BnN+74066ThNLQLloo 1FPwhSIdVY/CA9szW8DRrCexL2pEtcwDWtjSb9qFAFf26pYeQ1oqpmrHZzYKKEna6f2R 8n1g== MIME-Version: 1.0 X-Received: by 10.180.104.8 with SMTP id ga8mr5135655wib.5.1438857751783; Thu, 06 Aug 2015 03:42:31 -0700 (PDT) Received: by 10.28.148.199 with HTTP; Thu, 6 Aug 2015 03:42:31 -0700 (PDT) In-Reply-To: <58240D3A-CD59-4CC8-BD2C-0B6FB28D9710@gmail.com> References: <58240D3A-CD59-4CC8-BD2C-0B6FB28D9710@gmail.com> Date: Thu, 6 Aug 2015 18:42:31 +0800 Message-ID: Subject: Re: Getting statistics from Mesos to plot usage and allocation per Framework. From: haosdent To: user@mesos.apache.org Content-Type: multipart/alternative; boundary=f46d044271302d6d5c051ca22d70 --f46d044271302d6d5c051ca22d70 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Sorry, I could not understand this sentence: """ When polling the metrics/snapshot, in my case when running short sub-second tasks, I have to poll even faster than the churn time of tasks to get an accurate picture of resource allocation. """ Could you explain more? On Thu, Aug 6, 2015 at 6:32 PM, Hans van den Bogert wrote: > Hi, > > I=E2=80=99m trying to plot resource usage and allocation. Basically what = I want > can already be seen in the web UI (though not plotted). > 1) amount of allocated resources > 2) actual usage of allocated resources > 3) Max share of a framework / per framework > > Now the allocated resources can be gotten through the metrics page, > although using the metrics/snapshot does give me the problems associated > with polling. When polling the metrics/snapshot, in my case when running > short sub-second tasks, I have to poll even faster than the churn time o= f > tasks to get an accurate picture of resource allocation. > > If I use the (event) log files of master and slaves, I can=E2=80=99t see= usage, > and retrieving/calculating max share per framework is going to be tough, = I > guess. > > Does someone have a solution or idea to plotting the above three listed > metrics accurately. > > Regards, > > Hans van den Bogert --=20 Best Regards, Haosdent Huang --f46d044271302d6d5c051ca22d70 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Sorry, I could not understand this sentence:
"&qu= ot;"
When polli= ng the metrics/snapshot, in my case when running short=C2=A0 sub-second tas= ks, I have to poll even faster than the churn time of tasks to get an accur= ate picture of resource allocation.
"""
Could you explain more?

On Thu, Aug 6, 2= 015 at 6:32 PM, Hans van den Bogert <hansbogert@gmail.com> wrote:
Hi,

I=E2=80=99m trying to plot resource usage and allocation. Basically what I = want can already be seen in the web UI (though not plotted).
1) amount of allocated resources
2) actual usage of allocated resources
3) Max share of a framework / per framework

Now the allocated resources can be gotten through the metrics page, althoug= h using the metrics/snapshot does give me the problems associated with poll= ing. When polling the metrics/snapshot, in my case when running short=C2=A0= sub-second tasks, I have to poll even faster than the churn time of tasks = to get an accurate picture of resource allocation.

If I use the (event) log files of master and slaves,=C2=A0 I can=E2=80=99t = see usage, and retrieving/calculating max share per framework is going to b= e tough, I guess.

Does someone have a solution or idea to plotting the above three listed met= rics accurately.

Regards,

Hans van den Bogert



= --
Best Regards,
Haosdent Huang<= /div>
--f46d044271302d6d5c051ca22d70--