cloudstack-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Konstantin <konstantin.kirsa...@gmail.com>
Subject Re: cloudstack usage server issue
Date Fri, 08 Mar 2019 11:34:05 GMT
Dear Andrija,

May you give more info about aggregation period of 60 minutes?
My billing software will calc cloud usage by hours, should I keep
aggregation period for 60 minutes or update it to default 1440?



On Thu, Mar 7, 2019 at 10:58 PM Andrija Panic <andrija.panic@shapeblue.com>
wrote:

> Hi Konstantin,
>
> Issues/bugs are raised here https://github.com/apache/cloudstack/issues -
> so please feel free to raise it ASAP - since we have a RC4 voting process
> in place ! (it's very simple) - also feel free to jump on the voting email
> thread (before giving  -1, let's first try to reproduce the issue once
> more? )
>
> I will try to look into this problem, but can't promise anything (into
> 4.12 issue).
>
> As for the very first link you shared - the jump in time visible in logs -
> is this because of restart, right ?
>
> Also as for aggregation period, 1440 is default (and in production,
> believe me, should be kept this way if possible).
> Hourly jobs are ok for testing (value of 60 minutes), not sure setting 5
> (minutes) makes sense (perhaps for testing, but I would better stick to 60
> min period, and then change execution time to 5min from now() to be able to
> test (and restart usage service) - please give it some time to actually
> start processing data...
>
> As for the issues changing db.properties file, you should have it like
> following:
>
> ls -la /etc/cloudstack/usage/
> total 4
> lrwxrwxrwx. 1 root root   40 Feb 13 20:27 db.properties ->
> /etc/cloudstack/management/db.properties
> lrwxrwxrwx. 1 root root   30 Feb 13 20:27 key ->
> /etc/cloudstack/management/key
> -rw-r--r--. 1 root root 2980 Mar  7 17:22 log4j-cloud.xml
> First two  are links as you see - assuming you tried to change correct
> values in db.properties (to make usage fail to connect to DB), that should
> work, otherwise, it's a bug...
>
> Kind regards,
> Andrija
>
> andrija.panic@shapeblue.com
> www.shapeblue.com
> Amadeus House, Floral Street, London  WC2E 9DPUK
> @shapeblue
>
>
>
>
> -----Original Message-----
> From: Konstantin <konstantin.kirsanov@gmail.com>
> Sent: 07 March 2019 16:59
> To: users@cloudstack.apache.org
> Subject: Re: cloudstack usage server issue
>
> I reinstalled 4.11.2 and logs are changed. New error appear
>
> https://i.pozitis.ru/77a661462b182d54a6405484074dcee2.txt
>
> 2019-03-07 15:50:00,001 INFO  [cloud.usage.UsageManagerImpl]
> (Usage-Job-1:null) (logid:) starting usage job...
> 2019-03-07 15:50:00,014 DEBUG [cloud.usage.UsageManagerImpl]
> (Usage-Job-1:null) (logid:) Not owner of usage job, skipping...
> 2019-03-07 15:50:00,014 INFO  [cloud.usage.UsageManagerImpl]
> (Usage-Job-1:null) (logid:) usage job complete
>
> I cleaned the usage_job table from the records and FINALLY its start
> working!
>
>
> How to submit a bug report for the version  4.12.0.0 ?
>
> Could you please do it on my behalf?
>
>
>
>
> On Thu, Mar 7, 2019 at 6:23 PM Konstantin <konstantin.kirsanov@gmail.com>
> wrote:
>
> > Dear Andrija,
> >
> > Thanks a lot for the attention to my issue.
> >
> > There is logs from usage server:
> >
> > https://i.pozitis.ru/80d76e3cc5e605be037a088fd014a986.txt
> >
> > There is config
> > https://i.pozitis.ru/8419e465b3ffa63b4d677ae5be85688a.txt
> >
> > its looks like usage server just ignore cloud_usage DB settings, I
> > tried to put wrong credentials to db.usage.name=cloud_usage params, No
> > matter, Its load the usage details from db.cloud.name=cloud, I think
> >
> > Here is my global settings
> >
> > https://i.pozitis.ru/9d3d53fd86997dd649b0e8171ca14c73.txt
> >
> > I did checked management server log, parsed by "usage", here is
> > result, I see error checking health of usage server, usage server
> > running? false,
> > heartbeat: Wed Mar 06 20:00:06 UTC 2019
> >
> > https://i.pozitis.ru/fd56fdc8a3f7d80fabdec8d4cf563325.txt
> >
> > I restarted both services, here is debug results
> >
> > https://i.pozitis.ru/d8a8c06ea31a6ec89e0ca3e5aa89b178.txt
> >
> > here is usage server logs after restart
> > https://i.pozitis.ru/3bf38d723d2ccfc0e3bb6be785225c48.txt
> >
> > Would you recommend something to check more?
> >
> >
> > Regads,
> > Konstantin
> >
> >
> > On Thu, Mar 7, 2019 at 2:23 PM Andrija Panic
> > <andrija.panic@shapeblue.com>
> > wrote:
> >
> >> Hi Konstantin,
> >>
> >> Can you please usage upload the logs to somewhere (pastebin is OK) so
> >> we can check ?
> >>
> >> Did you/can you try with 4.11.2 ?
> >>
> >> Kind regards,
> >> Andrija
> >>
> >> andrija.panic@shapeblue.com
> >> www.shapeblue.com
> >> Amadeus House, Floral Street, London  WC2E 9DPUK @shapeblue
> >>
> >>
> >>
> >>
> >> -----Original Message-----
> >> From: Konstantin <konstantin.kirsanov@gmail.com>
> >> Sent: 06 March 2019 23:20
> >> To: users@cloudstack.apache.org
> >> Subject: cloudstack usage server issue
> >>
> >>  I did installed the management server, connect it to ESX HV, the
> control
> >> part working fine.
> >>
> >> I deployed the usage server with all guidelines awareness but have no
> >> luck with processing a usage data from "cloud" DB to "cloud_usage" DB by
> >> usage server.
> >>
> >> I tried to configure, reconfigure and even reinstall everything, but the
> >> last usage server log record is always same:
> >>
> >> 2019-03-06 18:21:28,903 DEBUG [cloud.usage.UsageManagerImpl] (main:null)
> >> (logid:) Checking to see if usage.vmops.pid exists.
> >> 2019-03-06 18:21:28,903 INFO  [cloud.usage.UsageManagerImpl] (main:null)
> >> (logid:) Implementation Version is 4.12.0.0
> >> 2019-03-06 18:21:30,865 DEBUG [cloud.usage.UsageManagerImpl] (main:null)
> >> (logid:) Usage stats aggregation time zone: UTC
> >> 2019-03-06 18:21:30,866 DEBUG [cloud.usage.UsageManagerImpl] (main:null)
> >> (logid:) Execution Time: Wed Mar 06 18:22:00 UTC 2019
> >> 2019-03-06 18:21:30,866 DEBUG [cloud.usage.UsageManagerImpl] (main:null)
> >> (logid:) Current Time: Wed Mar 06 18:21:30 UTC 2019
> >> 2019-03-06 18:21:30,874 INFO  [cloud.usage.UsageServer] (main:null)
> >> (logid:) UsageServer ready...
> >>
> >> As you may see, I played with starting time to force usage server to
> >> start the job, but no luck...
> >> Its never gave me any logs written and any action taken after "
> >> UsageServer ready... "
> >> I tried to call
> >>
> >> [root@cloudstack usage]# cloudmonkey generateUsageRecords
> >> startdate=2018-09-01 enddate=2019-09-30
> >> success = True
> >>
> >> but the "cloud_usage" DB is always empty, the all tables are empty, no
> >> single line in it.
> >> In the same time, the "cloud" DB and usage_event table is full of data
> >> with prossessed column "0" for any record in the table.
> >>
> >> Do you know how to force usage server to start the job?
> >>
> >> here is my usage params info:
> >>
> >> enable.usage.server    true
> >> publish.usage.events    true
> >> quota.usage.smtp.connection.timeout    60
> >> quota.usage.smtp.host
> >> quota.usage.smtp.password
> >> quota.usage.smtp.port
> >> quota.usage.smtp.sender
> >> quota.usage.smtp.useAuth
> >> quota.usage.smtp.user
> >> usage.aggregation.timezone    UTC
> >> usage.execution.timezone    UTC
> >> usage.sanity.check.interval    1
> >> usage.snapshot.virtualsize.select    false
> >> usage.stats.job.aggregation.range    5 //I changed it from 5 to 60 and
> >> 1440
> >> with same negative result
> >> usage.stats.job.exec.time    18:22 /changed many times to fire job, no
> >> luck
> >>
> >>
> >> Regards,
> >> Konstantin
> >>
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message