Return-Path: X-Original-To: apmail-incubator-cloudstack-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-cloudstack-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BDCCFDC1F for ; Tue, 8 Jan 2013 11:03:32 +0000 (UTC) Received: (qmail 35500 invoked by uid 500); 8 Jan 2013 11:03:32 -0000 Delivered-To: apmail-incubator-cloudstack-dev-archive@incubator.apache.org Received: (qmail 35460 invoked by uid 500); 8 Jan 2013 11:03:32 -0000 Mailing-List: contact cloudstack-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cloudstack-dev@incubator.apache.org Delivered-To: mailing list cloudstack-dev@incubator.apache.org Received: (qmail 35443 invoked by uid 99); 8 Jan 2013 11:03:32 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Jan 2013 11:03:32 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of m.kumar@leaseweb.com designates 85.17.130.15 as permitted sender) Received: from [85.17.130.15] (HELO mailhq.ocom.com) (85.17.130.15) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 08 Jan 2013 11:03:25 +0000 Received: from NLHLMEXDB03.ocom.lan ([fe80::645b:6bc9:19b9:a360]) by NLHLMEXHUB01.ocom.lan ([fe80::2c7c:2a9f:f44e:e592%11]) with mapi id 14.02.0318.004; Tue, 8 Jan 2013 12:03:04 +0100 From: Mukesh Kumar To: "cloudstack-dev@incubator.apache.org" Subject: RE: CS 4.0, cloud-usage server calculates all data except network usage Thread-Topic: CS 4.0, cloud-usage server calculates all data except network usage Thread-Index: Ac3dRoh/n46SwDjUSLGpgQ87FC5EIQAZxdxwAASp9xAAAb0QsAPx2QfQ Date: Tue, 8 Jan 2013 11:03:04 +0000 Message-ID: References: <33740054EBF5B64BB213E2E0916F2C13F011BBE701@BANPMAILBOX01.citrite.net> <33740054EBF5B64BB213E2E0916F2C13F011BBE703@BANPMAILBOX01.citrite.net> In-Reply-To: <33740054EBF5B64BB213E2E0916F2C13F011BBE703@BANPMAILBOX01.citrite.net> Accept-Language: en-GB, nl-NL, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [2001:1af8:4100:1103::7] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Virus-Checked: Checked by ClamAV on apache.org Dear Kishan I was following the discussion with Ilia Shakitko. This is indeed the issue we are facing. Thanks for the reply saying=20 "Ilia Shakitko, I changed the fix version for this bug to 4.1. We should definitely fix th= is for 4.1. =20 Thanks for sending the solution as well. Can you please submit the same as = patch on reviewboard? ~kishan" We have to patch the code for now, and once 4.1 is ready, we will update t= he same. Closing this thread. -----Original Message----- From: Kishan Kavala [mailto:Kishan.Kavala@citrix.com]=20 Sent: woensdag, 19 december, 2012 10:03 To: cloudstack-dev@incubator.apache.org Subject: RE: CS 4.0, cloud-usage server calculates all data except network = usage Mukesh, Network stats are collected inside the VR. Below command will show current counters inside VR Iptables nvx -L NETWORK_= STATS You can also look for NetworkUsageAnswer in mgmt logs and entries in user_s= tatistics table. -----Original Message----- From: Mukesh Kumar [mailto:m.kumar@leaseweb.com] Sent: Wednesday, 19 December 2012 1:42 PM To: cloudstack-dev@incubator.apache.org Subject: RE: CS 4.0, cloud-usage server calculates all data except network = usage Dear Kishan Yes, the guest Vm is in Isolated network Name: DefaultIsolatedNetworkOfferingWithSourceNatService Description: Offering for Isolated networks with Source Nat service enabled -----Original Message----- From: Kishan Kavala [mailto:Kishan.Kavala@citrix.com] Sent: woensdag, 19 december, 2012 07:01 To: cloudstack-dev@incubator.apache.org Subject: RE: CS 4.0, cloud-usage server calculates all data except network = usage Mukesh, Traffic stats are fetched from VirtualRouter only in Isolated network cas= e. Can you confirm that your guest Vms are in Isolated network? For shared = networks, CS is integrated with Traffic Sentinel to collect network statist= ics. ~Kishan -----Original Message----- From: Mukesh Kumar [mailto:m.kumar@leaseweb.com] Sent: Tuesday, 18 December 2012 11:10 PM To: cloudstack-dev@incubator.apache.org Subject: CS 4.0, cloud-usage server calculates all data except network usag= e Dear Devs, We are not able to find any Network Usage data with our new setup using Clo= udStack 4.0 (usage server installed). All other statistics are fine except= type 4 & 5, Can that be configuration issue? Our usage settings are: enable.usage.server: true=09 usage.aggregation.timezone: GMT usage.execution.timezone: usage.sanity.check.interval:=20 usage.stats.job.aggregation.range: 5 (During testing phase, it'll be 1440 o= n live) usage.stats.job.exec.time: 15:28 I generated a lot of traffic on one of the instance (called: MUKR-Cloud01-i= 002) & used the following API commands generateUsageRecords&response=3Djson&startdate=3D2012-12-01&enddate=3D2012-= 12-19 Resulted:=20 class stdClass#1 (1) { public $generateusagerecordsresponse =3D> class stdClass#2 (1) { public $success =3D> string(4) "true" } } However, listUsageRecords&response=3Djson&startdate=3D2012-12-01&enddate=3D= 2012-12-19&type=3D5 (or type 4) Resulting: class stdClass#1 (1) { public $listusagerecordsresponse =3D> class stdClass#2 (0) { } } Furthermore, I looked into Management logs, Usage log & Tables. Here is the= summary Traffic generated on instance at 2012-12-18 17:28:43, using admin account (= id: 2): root@MUKR-Cloud01-i002:~# wget http://mirror.leaseweb.com/speedtest/500mb.b= in /dev/null --2012-12-18 17:28:43-- http://mirror.leaseweb.com/speedtest/500mb.bin Resolving mirror.leaseweb.com (mirror.leaseweb.com)... 94.75.223.121, 2001:= 1af8:4030:1:0:dead:beef:cafe Connecting to mirror.leaseweb.com (mirror.leas= eweb.com)|94.75.223.121|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 500000000 (477M) [application/octet-stream] Saving to: `500mb.bin' 100%[=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>] 500,000,000 6.00M/s in 51s Usage Log (during the same time interval): ... 2012-12-18 16:38:00,056 DEBUG [usage.parser.VMInstanceUsageParser] (Usage-J= ob-1:null) Creating VM usage record for vm: SDA-01, type: 2, usage: 0.16666= 7, startDate: Tue Dec 18 17:28:00 CET 2012, endDate: Tue Dec 18 17:38:00 CE= T 2012, for account: 2 2012-12-18 16:38:00,058 DEBUG [usage.parser.NetworkUsageParser] (Usage-Job-= 1:null) Parsing all Network usage events for account: 2 2012-12-18 16:38:00,059 DEBUG [usage.parser.NetworkUsageParser] (Usage-Job-= 1:null) No usage record (0 bytes used) generated for account: 2 2012-12-18 16:38:00,059 DEBUG [usage.parser.NetworkUsageParser] (Usage-Job-= 1:null) No usage record (0 bytes used) generated for account: 2 ... mysql> select * from usage_network; +------------+---------+---------+--------------+------------+------------+= ----------------+--------------------+----------------+-------------------+ | account_id | zone_id | host_id | host_type | network_id | bytes_sent |= bytes_received | agg_bytes_received | agg_bytes_sent | event_time_millis | +------------+---------+---------+--------------+------------+------------+= ----------------+--------------------+----------------+-------------------+ | 2 | 1 | 4 | DomainRouter | 204 | 0 |= 0 | 0 | 0 | 1355846880002 | | 2 | 1 | 4 | DomainRouter | 204 | 0 |= 0 | 0 | 0 | 1355847073495 | | 2 | 1 | 4 | DomainRouter | 204 | 0 |= 0 | 0 | 0 | 1355847480003 | | 2 | 1 | 4 | DomainRouter | 204 | 0 |= 0 | 0 | 0 | 1355847673495 | | 2 | 1 | 4 | DomainRouter | 204 | 0 |= 0 | 0 | 0 | 1355848080002 | | 2 | 1 | 4 | DomainRouter | 204 | 0 |= 0 | 0 | 0 | 1355848680002 | | 2 | 1 | 4 | DomainRouter | 204 | 0 |= 0 | 0 | 0 | 1355848693495 | | 2 | 1 | 6 | DomainRouter | 205 | 0 |= 0 | 0 | 0 | 1355847480003 | | 2 | 1 | 6 | DomainRouter | 205 | 0 |= 0 | 0 | 0 | 1355847673495 | | 2 | 1 | 6 | DomainRouter | 205 | 0 |= 0 | 0 | 0 | 1355848080002 | | 2 | 1 | 6 | DomainRouter | 205 | 0 |= 0 | 0 | 0 | 1355848680002 | | 2 | 1 | 6 | DomainRouter | 205 | 0 |= 0 | 0 | 0 | 1355848693495 | +------------+---------+---------+--------------+------------+------------+= ----------------+--------------------+----------------+-------------------+ mysql> select * from cloud_usage where usage_type in (4, 5); Empty set (0.00 sec) If you need any other info, please reply. Cheers /Mukesh