cloudstack-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrija Panic <andrija.pa...@shapeblue.com>
Subject RE: cloudstack usage server issue
Date Thu, 07 Mar 2019 19:55:22 GMT
Sorry, what OS are you using for management/usage server (they are collocated on same server,
right ?)
Is this RC4 release or some previous RC release, that you are testing ?

andrija.panic@shapeblue.comĀ 
www.shapeblue.com
Amadeus House, Floral Street, London  WC2E 9DPUK
@shapeblue
  
 


-----Original Message-----
From: Andrija Panic 
Sent: 07 March 2019 20:53
To: users@cloudstack.apache.org
Subject: RE: cloudstack usage server issue

Hi Konstantin,

Issues/bugs are raised here https://github.com/apache/cloudstack/issues - so please feel free
to raise it ASAP - since we have a RC4 voting process in place ! (it's very simple) - also
feel free to jump on the voting email thread (before giving  -1, let's first try to reproduce
the issue once more? )

I will try to look into this problem, but can't promise anything (into 4.12 issue).

As for the very first link you shared - the jump in time visible in logs - is this because
of restart, right ?

Also as for aggregation period, 1440 is default (and in production, believe me, should be
kept this way if possible).
Hourly jobs are ok for testing (value of 60 minutes), not sure setting 5 (minutes) makes sense
(perhaps for testing, but I would better stick to 60 min period, and then change execution
time to 5min from now() to be able to test (and restart usage service) - please give it some
time to actually start processing data...

As for the issues changing db.properties file, you should have it like following:

ls -la /etc/cloudstack/usage/
total 4
lrwxrwxrwx. 1 root root   40 Feb 13 20:27 db.properties -> /etc/cloudstack/management/db.properties
lrwxrwxrwx. 1 root root   30 Feb 13 20:27 key -> /etc/cloudstack/management/key
-rw-r--r--. 1 root root 2980 Mar  7 17:22 log4j-cloud.xml First two  are links as you see
- assuming you tried to change correct values in db.properties (to make usage fail to connect
to DB), that should work, otherwise, it's a bug...

Kind regards,
Andrija

-----Original Message-----
From: Konstantin <konstantin.kirsanov@gmail.com>
Sent: 07 March 2019 16:59
To: users@cloudstack.apache.org
Subject: Re: cloudstack usage server issue

I reinstalled 4.11.2 and logs are changed. New error appear

https://i.pozitis.ru/77a661462b182d54a6405484074dcee2.txt

2019-03-07 15:50:00,001 INFO  [cloud.usage.UsageManagerImpl]
(Usage-Job-1:null) (logid:) starting usage job...
2019-03-07 15:50:00,014 DEBUG [cloud.usage.UsageManagerImpl]
(Usage-Job-1:null) (logid:) Not owner of usage job, skipping...
2019-03-07 15:50:00,014 INFO  [cloud.usage.UsageManagerImpl]
(Usage-Job-1:null) (logid:) usage job complete

I cleaned the usage_job table from the records and FINALLY its start working!


How to submit a bug report for the version  4.12.0.0 ?

Could you please do it on my behalf?




On Thu, Mar 7, 2019 at 6:23 PM Konstantin <konstantin.kirsanov@gmail.com>
wrote:

> Dear Andrija,
>
> Thanks a lot for the attention to my issue.
>
> There is logs from usage server:
>
> https://i.pozitis.ru/80d76e3cc5e605be037a088fd014a986.txt
>
> There is config
> https://i.pozitis.ru/8419e465b3ffa63b4d677ae5be85688a.txt
>
> its looks like usage server just ignore cloud_usage DB settings, I 
> tried to put wrong credentials to db.usage.name=cloud_usage params, No 
> matter, Its load the usage details from db.cloud.name=cloud, I think
>
> Here is my global settings
>
> https://i.pozitis.ru/9d3d53fd86997dd649b0e8171ca14c73.txt
>
> I did checked management server log, parsed by "usage", here is 
> result, I see error checking health of usage server, usage server 
> running? false,
> heartbeat: Wed Mar 06 20:00:06 UTC 2019
>
> https://i.pozitis.ru/fd56fdc8a3f7d80fabdec8d4cf563325.txt
>
> I restarted both services, here is debug results
>
> https://i.pozitis.ru/d8a8c06ea31a6ec89e0ca3e5aa89b178.txt
>
> here is usage server logs after restart 
> https://i.pozitis.ru/3bf38d723d2ccfc0e3bb6be785225c48.txt
>
> Would you recommend something to check more?
>
>
> Regads,
> Konstantin
>
>
> On Thu, Mar 7, 2019 at 2:23 PM Andrija Panic 
> <andrija.panic@shapeblue.com>
> wrote:
>
>> Hi Konstantin,
>>
>> Can you please usage upload the logs to somewhere (pastebin is OK) so 
>> we can check ?
>>
>> Did you/can you try with 4.11.2 ?
>>
>> Kind regards,
>> Andrija
>>
>> andrija.panic@shapeblue.com
>> www.shapeblue.com
>> Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue
>>
>>
>>
>>
>> -----Original Message-----
>> From: Konstantin <konstantin.kirsanov@gmail.com>
>> Sent: 06 March 2019 23:20
>> To: users@cloudstack.apache.org
>> Subject: cloudstack usage server issue
>>
>>  I did installed the management server, connect it to ESX HV, the 
>> control part working fine.
>>
>> I deployed the usage server with all guidelines awareness but have no 
>> luck with processing a usage data from "cloud" DB to "cloud_usage" DB 
>> by usage server.
>>
>> I tried to configure, reconfigure and even reinstall everything, but 
>> the last usage server log record is always same:
>>
>> 2019-03-06 18:21:28,903 DEBUG [cloud.usage.UsageManagerImpl] 
>> (main:null)
>> (logid:) Checking to see if usage.vmops.pid exists.
>> 2019-03-06 18:21:28,903 INFO  [cloud.usage.UsageManagerImpl] 
>> (main:null)
>> (logid:) Implementation Version is 4.12.0.0
>> 2019-03-06 18:21:30,865 DEBUG [cloud.usage.UsageManagerImpl] 
>> (main:null)
>> (logid:) Usage stats aggregation time zone: UTC
>> 2019-03-06 18:21:30,866 DEBUG [cloud.usage.UsageManagerImpl] 
>> (main:null)
>> (logid:) Execution Time: Wed Mar 06 18:22:00 UTC 2019
>> 2019-03-06 18:21:30,866 DEBUG [cloud.usage.UsageManagerImpl] 
>> (main:null)
>> (logid:) Current Time: Wed Mar 06 18:21:30 UTC 2019
>> 2019-03-06 18:21:30,874 INFO  [cloud.usage.UsageServer] (main:null)
>> (logid:) UsageServer ready...
>>
>> As you may see, I played with starting time to force usage server to 
>> start the job, but no luck...
>> Its never gave me any logs written and any action taken after "
>> UsageServer ready... "
>> I tried to call
>>
>> [root@cloudstack usage]# cloudmonkey generateUsageRecords
>> startdate=2018-09-01 enddate=2019-09-30 success = True
>>
>> but the "cloud_usage" DB is always empty, the all tables are empty, 
>> no single line in it.
>> In the same time, the "cloud" DB and usage_event table is full of 
>> data with prossessed column "0" for any record in the table.
>>
>> Do you know how to force usage server to start the job?
>>
>> here is my usage params info:
>>
>> enable.usage.server    true
>> publish.usage.events    true
>> quota.usage.smtp.connection.timeout    60
>> quota.usage.smtp.host
>> quota.usage.smtp.password
>> quota.usage.smtp.port
>> quota.usage.smtp.sender
>> quota.usage.smtp.useAuth
>> quota.usage.smtp.user
>> usage.aggregation.timezone    UTC
>> usage.execution.timezone    UTC
>> usage.sanity.check.interval    1
>> usage.snapshot.virtualsize.select    false
>> usage.stats.job.aggregation.range    5 //I changed it from 5 to 60 and
>> 1440
>> with same negative result
>> usage.stats.job.exec.time    18:22 /changed many times to fire job, no
>> luck
>>
>>
>> Regards,
>> Konstantin
>>
>
Mime
View raw message