Return-Path: X-Original-To: apmail-incubator-cloudstack-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-cloudstack-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B642CD2BF for ; Thu, 2 Aug 2012 19:21:00 +0000 (UTC) Received: (qmail 12141 invoked by uid 500); 2 Aug 2012 19:21:00 -0000 Delivered-To: apmail-incubator-cloudstack-dev-archive@incubator.apache.org Received: (qmail 12119 invoked by uid 500); 2 Aug 2012 19:21:00 -0000 Mailing-List: contact cloudstack-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cloudstack-dev@incubator.apache.org Delivered-To: mailing list cloudstack-dev@incubator.apache.org Received: (qmail 12111 invoked by uid 99); 2 Aug 2012 19:21:00 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Aug 2012 19:21:00 +0000 X-ASF-Spam-Status: No, hits=0.7 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_NEUTRAL X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: local policy) Received: from [109.72.87.137] (HELO smtp01.mail.pcextreme.nl) (109.72.87.137) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 02 Aug 2012 19:20:56 +0000 Received: from [IPv6:2a00:f10:11c:ab:3543:338:72b5:35ba] (unknown [IPv6:2a00:f10:11c:ab:3543:338:72b5:35ba]) by smtp01.mail.pcextreme.nl (Postfix) with ESMTPA id 3B47876049 for ; Thu, 2 Aug 2012 21:20:35 +0200 (CEST) Message-ID: <501AD303.4010602@widodh.nl> Date: Thu, 02 Aug 2012 21:20:35 +0200 From: Wido den Hollander User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:14.0) Gecko/20120714 Thunderbird/14.0 MIME-Version: 1.0 To: cloudstack-dev@incubator.apache.org Subject: Re: Disk I/O polling References: In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit X-Virus-Checked: Checked by ClamAV on apache.org On 08/02/2012 08:45 PM, Chiradeep Vittal wrote: > True. Ideally performance (and other) monitoring should be an optional > service (module) with its own API etc. > Wido's proposal does not preclude that design (for the future), it seems > to me. > No, I'm not talking about monitoring here, just reporting statistics of an instance. Just like we are accounting CPU and network usage. It's not my intention to do performance monitoring and reporting, no just per instance statistics. Since most Hypervisors already gather this data it's just a matter of collecting and storing. Wido > > > On 8/2/12 10:09 AM, "John Kinsella" wrote: > >> Yeah this is fairly huge�I'm a KVM guy as well so can't comment on the >> other platforms. I've been using an opsview/nagios module that tells me >> when a disk has high IOPs, but we haven't added the code yet to look at >> the individual VM yet. >> >> I guess the only concern that comes to mind is where's the line between >> what your cloud management platform does and what your monitoring >> platform does - don't really need repetition. >> >> John >> >> On Aug 2, 2012, at 8:23 AM, Wido den Hollander wrote: >> >> Hi, >> >> I've been thinking about this for a couple of months while working on RBD. >> >> In public clouds it's very important to know which user is (ab)using your >> storage, so I figured it could be useful if CloudStack would also support >> disk I/O polling. >> >> On the Wiki I started with a document about this: >> http://wiki.cloudstack.org/pages/viewpage.action?pageId=11830451 >> >> I only have experience with KVM, so I'm not sure if and how other >> Hypervisors support this. >> >> For KVM it seems the implementation is rather simple, but I rather not >> make this a KVM-only feature. >> >> The first steps will be to lay the groundwork in CloudStack and the >> polling for disk IOps and then implement it per Hypervisor. >> >> I'd like some input on other Hypervisors to get a better picture of what >> has to be done. >> >> Comments and flames are welcome :) >> >> Wido >> >> >> Stratosec - Secure Infrastructure as a Service >> o: 415.315.9385 >> @johnlkinsella >> >