stratos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From david hbase <davidhb...@gmail.com>
Subject Re: Stratos 4.0 autoscaling not work
Date Tue, 17 Mar 2015 19:35:27 GMT
I found the issue is the Scale-up action update too slow. If any idea to
configure this Scale-up action more quick?

Thanks
-D

On Tue, Mar 17, 2015 at 11:51 AM, david hbase <davidhbase@gmail.com> wrote:

> Hi, Team
>
> The auto scaling only work for onetime, after that stoped work, (
> restarted APP / Reboot the instance in openstack still not work.)
>
> The debug log attached here:
>
> [2015-03-17 18:50:04,205] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Avg load avg event: [cluster] lb.lb.domain [network-partition]
> openstack-region1 [value] 1.0
> [2015-03-17 18:50:04,205] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Avg load avg event: [cluster] php.php301.domain [network-partition]
> openstack-region1 [value] 999.0
> [2015-03-17 18:50:04,206] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Member avg of load avg event: [member]
> lb.lb.domain58ac9d95-9ab8-459a-80c2-fd0ec44a0d2e [value] 1.0
> [2015-03-17 18:50:04,206] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Member avg of load avg event: [member]
> php.php301.domaind0e67359-39c5-4aba-b6eb-6dfa602f90d3 [value] 999.0
> [2015-03-17 18:50:04,207] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Avg Memory Consumption event: [cluster] lb.lb.domain [network-partition]
> openstack-region1 [value] 24.856016
> [2015-03-17 18:50:04,208] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Avg Memory Consumption event: [cluster] php.php301.domain
> [network-partition] openstack-region1 [value] 49.108723
> [2015-03-17 18:50:04,209] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Member avg Memory Consumption event: [member]
> lb.lb.domain58ac9d95-9ab8-459a-80c2-fd0ec44a0d2e [value] 24.856016
> [2015-03-17 18:50:04,209] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Member avg Memory Consumption event: [member]
> php.php301.domaind0e67359-39c5-4aba-b6eb-6dfa602f90d3 [value] 49.108723
> [2015-03-17 18:50:04,243] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Member grad of load avg event: [member]
> lb.lb.domain58ac9d95-9ab8-459a-80c2-fd0ec44a0d2e [value] 22.158789
> [2015-03-17 18:50:04,250] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Grad of load avg event: [cluster] lb.lb.domain [network-partition]
> openstack-region1 [value] 22.158789
> [2015-03-17 18:50:04,252] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Member grad of Memory Consumption event: [member]
> lb.lb.domain58ac9d95-9ab8-459a-80c2-fd0ec44a0d2e [value] 0.5358955
> [2015-03-17 18:50:04,253] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Grad of Memory Consumption event: [cluster] lb.lb.domain
> [network-partition] openstack-region1 [value] 0.5358955
> [2015-03-17 18:50:04,337] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Average Rif event: [cluster] php.php301.domain [network-partition]
> openstack-region1 [value] 0.0
> [2015-03-17 18:50:04,338] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Average Rif event: [cluster] lb.lb.domain [network-partition]
> openstack-region1 [value] 0.0
> [2015-03-17 18:50:04,346] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Gradient of Rif event: [cluster] php.php301.domain [network-partition]
> openstack-region1 [value] 0.0
> [2015-03-17 18:50:04,499] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Second Derivation of Memory Consumption event: [cluster] lb.lb.domain
> [network-partition] openstack-region1 [value] 0.0054160617
> [2015-03-17 18:50:04,499] DEBUG
> {org.apache.stratos.autoscaler.NetworkPartitionContext} -  Memory
> consumption stats are reset, ready to do scale check [network partition]
> openstack-region1
> [2015-03-17 18:50:04,502] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Second Derivation of load avg event: [cluster] lb.lb.domain
> [network-partition] openstack-region1 [value] 9.625086E-4
> [2015-03-17 18:50:04,502] DEBUG
> {org.apache.stratos.autoscaler.NetworkPartitionContext} -  Load average
> stats are reset, ready to do scale check [network partition]
> openstack-region1
> [2015-03-17 18:50:04,503] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Member Second Derivation of load avg event: [member]
> lb.lb.domain58ac9d95-9ab8-459a-80c2-fd0ec44a0d2e [value] 9.625086E-4
> [2015-03-17 18:50:04,530] DEBUG
> {org.apache.stratos.autoscaler.message.receiver.health.AutoscalerHealthStatEventReceiver}
> -  Second derivative of Rif event: [cluster] php.php301.domain
> [network-partition] openstack-region1 [value] 0.0
> [2015-03-17 18:50:04,531] DEBUG
> {org.apache.stratos.autoscaler.NetworkPartitionContext} -  Requests in
> flights stats are reset, ready to do scale check [network partition]
> openstack-region1
> [2015-03-17 18:50:15,069] DEBUG
> {org.apache.stratos.autoscaler.monitor.ClusterMonitor} -  Cluster monitor
> is running.. ClusterMonitor [clusterId=php.php301.domain, serviceId=php301,
> deploymentPolicy=Deployment Policy [id]economyDeployment [partitions]
> [org.apache.stratos.cloud.controller.stub.deployment.partition.Partition@692b2214],
> autoscalePolicy=ASPolicy [id=economyPolicyload, displayName=null,
> description=null], lbReferenceType=null]
> [2015-03-17 18:50:15,069] DEBUG
> {org.apache.stratos.autoscaler.monitor.ClusterMonitor} -  Running minimum
> check for partition zone-1
> [2015-03-17 18:50:15,070] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  Running minimum rule:
> [network-partition] openstack-region1 [partition] zone-1
> [2015-03-17 18:50:15,070] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [min-check]
> [network-partition] openstack-region1 [partition] zone-1 Non terminated
> member count: 1
> [2015-03-17 18:50:15,070] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [min-check]
> [network-partition] openstack-region1 [partition] zone-1 Minimum member
> count: 1
> [2015-03-17 18:50:15,070] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  Running obsolete instances
> rule: [partition] zone-1 [network-partition] openstack-region1
> [2015-03-17 18:50:15,070] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [obsolete-check]
> [network-partition] openstack-region1 [partition] zone-1 Obsolete member
> count: 0
> [2015-03-17 18:50:15,071] DEBUG
> {org.apache.stratos.autoscaler.rule.AutoscalerRuleEvaluator} -  Minimum
> check executed for : org.apache.stratos.autoscaler.PartitionContext@1c585de8
>
> [2015-03-17 18:50:15,071] DEBUG
> {org.apache.stratos.autoscaler.monitor.ClusterMonitor} -  Running scale
> check for network partition openstack-region1
> [2015-03-17 18:50:15,071] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} -  Partition
> algorithm is
> [2015-03-17 18:50:15,071] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  Running scale up rule:
> [network-partition] openstack-region1 [cluster] php.php301.domain
> [2015-03-17 18:50:15,071] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]
> [network-partition] openstack-region1 [cluster] php.php301.domain Algorithm
> name: one-after-another
> [2015-03-17 18:50:15,072] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]
> [network-partition] openstack-region1 [cluster] php.php301.domain
> Algorithm: org.apache.stratos.autoscaler.algorithm.OneAfterAnother@51e30103
> [2015-03-17 18:50:15,072] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} -  Predicting the
> value, [average]: 0.0 , [gradient]: 0.0 , [second derivative]: 0.0 , [time
> intervals]: 1
> [2015-03-17 18:50:15,072] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} -  Predicting the
> value, [average]: 49.108723 , [gradient]: 0.0 , [second derivative]: 0.0 ,
> [time intervals]: 1
> [2015-03-17 18:50:15,073] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} -  Predicting the
> value, [average]: 999.0 , [gradient]: 0.0 , [second derivative]: 0.0 ,
> [time intervals]: 1
> [2015-03-17 18:50:15,073] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> php.php301.domain RIF predicted value: 0.0
> [2015-03-17 18:50:15,073] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> php.php301.domain RIF average limit: 0.0
> [2015-03-17 18:50:15,073] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> php.php301.domain MC predicted value: 49.10872268676758
> [2015-03-17 18:50:15,073] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> php.php301.domain MC average limit: 0.0
> [2015-03-17 18:50:15,073] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> php.php301.domain LA predicted value: 999.0
> [2015-03-17 18:50:15,074] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> php.php301.domain LA Average limit: 30.0
> [2015-03-17 18:50:15,074] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> php.php301.domain Scale-up action: false
> [2015-03-17 18:50:15,074] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> php.php301.domain Scale-down action: false
> [2015-03-17 18:50:15,074] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling] No decision made
> to either scale up or scale down ...
> [2015-03-17 18:50:15,074] DEBUG
> {org.apache.stratos.autoscaler.rule.AutoscalerRuleEvaluator} -  Scale check
> executed for : NetworkPartitionContext
> [id=openstack-region1partitionAlgorithm=one-after-another,
> minInstanceCount=1, maxInstanceCount=1]
> [2015-03-17 18:50:23,780] DEBUG
> {org.apache.stratos.autoscaler.monitor.ClusterMonitor} -  Cluster monitor
> is running.. ClusterMonitor [clusterId=lb.lb.domain, serviceId=lb,
> deploymentPolicy=Deployment Policy [id]economyDeployment [partitions]
> [org.apache.stratos.cloud.controller.stub.deployment.partition.Partition@692b2214],
> autoscalePolicy=ASPolicy [id=economyPolicy, displayName=null,
> description=null], lbReferenceType=null]
> [2015-03-17 18:50:23,784] DEBUG
> {org.apache.stratos.autoscaler.monitor.ClusterMonitor} -  Running minimum
> check for partition zone-1
> [2015-03-17 18:50:23,784] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  Running minimum rule:
> [network-partition] openstack-region1 [partition] zone-1
> [2015-03-17 18:50:23,785] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [min-check]
> [network-partition] openstack-region1 [partition] zone-1 Non terminated
> member count: 1
> [2015-03-17 18:50:23,785] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [min-check]
> [network-partition] openstack-region1 [partition] zone-1 Minimum member
> count: 1
> [2015-03-17 18:50:23,785] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  Running obsolete instances
> rule: [partition] zone-1 [network-partition] openstack-region1
> [2015-03-17 18:50:23,785] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [obsolete-check]
> [network-partition] openstack-region1 [partition] zone-1 Obsolete member
> count: 0
> [2015-03-17 18:50:23,785] DEBUG
> {org.apache.stratos.autoscaler.rule.AutoscalerRuleEvaluator} -  Minimum
> check executed for : org.apache.stratos.autoscaler.PartitionContext@211daacc
>
> [2015-03-17 18:50:23,786] DEBUG
> {org.apache.stratos.autoscaler.monitor.ClusterMonitor} -  Running scale
> check for network partition openstack-region1
> [2015-03-17 18:50:23,786] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} -  Partition
> algorithm is
> [2015-03-17 18:50:23,786] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  Running scale up rule:
> [network-partition] openstack-region1 [cluster] lb.lb.domain
> [2015-03-17 18:50:23,786] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]
> [network-partition] openstack-region1 [cluster] lb.lb.domain Algorithm
> name: one-after-another
> [2015-03-17 18:50:23,787] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]
> [network-partition] openstack-region1 [cluster] lb.lb.domain Algorithm:
> org.apache.stratos.autoscaler.algorithm.OneAfterAnother@132e0471
> [2015-03-17 18:50:23,787] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} -  Predicting the
> value, [average]: 0.0 , [gradient]: 0.0 , [second derivative]: 0.0 , [time
> intervals]: 1
> [2015-03-17 18:50:23,787] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} -  Predicting the
> value, [average]: 24.856016 , [gradient]: 0.5358955 , [second derivative]:
> 0.0054160617 , [time intervals]: 1
> [2015-03-17 18:50:23,788] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} -  Predicting the
> value, [average]: 1.0 , [gradient]: 22.158789 , [second derivative]:
> 9.625086E-4 , [time intervals]: 1
> [2015-03-17 18:50:23,788] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> lb.lb.domain RIF predicted value: 0.0
> [2015-03-17 18:50:23,788] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> lb.lb.domain RIF average limit: 40.0
> [2015-03-17 18:50:23,788] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> lb.lb.domain MC predicted value: 25.394620491191745
> [2015-03-17 18:50:23,789] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> lb.lb.domain MC average limit: 100.0
> [2015-03-17 18:50:23,789] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> lb.lb.domain LA predicted value: 23.159269935335033
> [2015-03-17 18:50:23,789] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> lb.lb.domain LA Average limit: 100.0
> [2015-03-17 18:50:23,789] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> lb.lb.domain Scale-up action: false
> [2015-03-17 18:50:23,789] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling]  [cluster]
> lb.lb.domain Scale-down action: false
> [2015-03-17 18:50:23,790] DEBUG
> {org.apache.stratos.autoscaler.rule.RuleLog} -  [scaling] No decision made
> to either scale up or scale down ...
> [2015-03-17 18:50:23,790] DEBUG
> {org.apache.stratos.autoscaler.rule.AutoscalerRuleEvaluator} -  Scale check
> executed for : NetworkPartitionContext
> [id=openstack-region1partitionAlgorithm=one-after-another,
> minInstanceCount=1, maxInstanceCount=1]
>
>
> Please help,
> Thanks
> -D
>

Mime
View raw message