stratos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Imesh Gunaratne <im...@apache.org>
Subject Re: [Discuss] Kubernetes workflow is now working!
Date Fri, 02 Jan 2015 16:38:22 GMT
Raj, this stacktrace should have more information describing the actual
exception.

The error "Mapping qname not fond for the package" is raised by Axis2 while
trying to transform the response from the service. This is not the root
cause of the issue.

On Fri, Jan 2, 2015 at 9:43 PM, Rajkumar Rajaratnam <rajkumarr@wso2.com>
wrote:

> Getting the following exception while deploying an application. Will look
> into it.
>
>
> [2015-01-02 21:31:12,401]  INFO
> {org.apache.stratos.kubernetes.client.KubernetesApiClient} -  Creating
> replication controller: [replication-controller-id]
> php-php-domain0c539d53-c9b9-425a-a97c-b719187ed8c8 [name]
> php-php-domain0c539d53-c9b9-425a-a97c-b719187ed8c8 [docker-image]
> stratos/php:4.1.0-alpha [container-ports] [80] [replicas] 1
> [2015-01-02 21:31:12,402] ERROR
> {org.apache.axis2.rpc.receivers.RPCMessageReceiver} -
> org.apache.axis2.AxisFault: Mapping qname not fond for the package:
> org.apache.stratos.common.beans
> java.lang.RuntimeException: org.apache.axis2.AxisFault: Mapping qname not
> fond for the package: org.apache.stratos.common.beans
>     at
> org.apache.axis2.databinding.utils.BeanUtil.getPropertyQnameList(BeanUtil.java:276)
>     at
> org.apache.axis2.databinding.utils.BeanUtil.getPullParser(BeanUtil.java:72)
>     at
> org.apache.axis2.databinding.utils.reader.ADBXMLStreamReaderImpl.processProperties(ADBXMLStreamReaderImpl.java:994)
>     at
> org.apache.axis2.databinding.utils.reader.ADBXMLStreamReaderImpl.next(ADBXMLStreamReaderImpl.java:850)
>     at org.apache.axis2.util.StreamWrapper.next(StreamWrapper.java:71)
>     at
> org.apache.axiom.om.impl.builder.StAXOMBuilder.parserNext(StAXOMBuilder.java:681)
>     at
> org.apache.axiom.om.impl.builder.StAXOMBuilder.next(StAXOMBuilder.java:214)
>     at
> org.apache.axiom.om.impl.llom.OMSerializableImpl.build(OMSerializableImpl.java:78)
>     at
> org.apache.axiom.om.impl.llom.OMElementImpl.build(OMElementImpl.java:722)
>     at
> org.apache.axiom.om.impl.llom.OMElementImpl.detach(OMElementImpl.java:700)
>     at
> org.apache.axiom.om.impl.llom.OMNodeImpl.setParent(OMNodeImpl.java:105)
>     at
> org.apache.axiom.om.impl.llom.OMElementImpl.addChild(OMElementImpl.java:296)
>     at
> org.apache.axiom.om.impl.llom.OMElementImpl.addChild(OMElementImpl.java:212)
>     at
> org.apache.axis2.rpc.receivers.RPCUtil.processResponse(RPCUtil.java:105)
>     at
> org.apache.axis2.rpc.receivers.RPCUtil.processResponseAsDocLitWrapped(RPCUtil.java:456)
>     at
> org.apache.axis2.rpc.receivers.RPCMessageReceiver.invokeBusinessLogic(RPCMessageReceiver.java:153)
>     at
> org.apache.axis2.receivers.AbstractInOutMessageReceiver.invokeBusinessLogic(AbstractInOutMessageReceiver.java:40)
>
>     at
> org.apache.axis2.receivers.AbstractMessageReceiver.receive(AbstractMessageReceiver.java:110)
>     at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180)
>     at
> org.apache.axis2.transport.http.HTTPTransportUtils.processHTTPPostRequest(HTTPTransportUtils.java:172)
>     at
> org.apache.axis2.transport.http.AxisServlet.doPost(AxisServlet.java:146)
>     at
> org.wso2.carbon.core.transports.CarbonServlet.doPost(CarbonServlet.java:231)
>     at javax.servlet.http.HttpServlet.service(HttpServlet.java:755)
>     at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
>     at
> org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61)
>     at
> org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128)
>     at
> org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:68)
>     at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
>     at
> org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service(DelegationServlet.java:68)
>     at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
>     at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
>     at
> org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter.doFilter(CharacterSetFilter.java:61)
>     at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
>     at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
>     at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
>     at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
>     at
> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
>     at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
>     at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
>     at
> org.wso2.carbon.tomcat.ext.valves.CompositeValve.continueInvocation(CompositeValve.java:178)
>     at
> org.wso2.carbon.tomcat.ext.valves.CarbonTomcatValve$1.invoke(CarbonTomcatValve.java:47)
>     at
> org.wso2.carbon.webapp.mgt.TenantLazyLoaderValve.invoke(TenantLazyLoaderValve.java:56)
>     at
> org.wso2.carbon.tomcat.ext.valves.TomcatValveContainer.invokeValves(TomcatValveContainer.java:47)
>     at
> org.wso2.carbon.tomcat.ext.valves.CompositeValve.invoke(CompositeValve.java:141)
>     at
> org.wso2.carbon.tomcat.ext.valves.CarbonStuckThreadDetectionValve.invoke(CarbonStuckThreadDetectionValve.java:156)
>     at
> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:936)
>     at
> org.wso2.carbon.tomcat.ext.valves.CarbonContextCreatorValve.invoke(CarbonContextCreatorValve.java:52)
>     at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
>     at
> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
>     at
> org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1004)
>     at
> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
>     at
> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1653)
>     at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
>     at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
>     at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.axis2.AxisFault: Mapping qname not fond for the
> package: org.apache.stratos.common.beans
>     at
> org.apache.axis2.databinding.utils.BeanUtil.getPropertyQnameList(BeanUtil.java:143)
>     ... 54 more
>
> On Fri, Jan 2, 2015 at 2:09 AM, Imesh Gunaratne <imesh@apache.org> wrote:
>
>> IMO this is a fundamental design issue which has not been addressed when
>> designing Autoscaler/Cloud Controller communication. This problem does not
>> affect the above Kubernetes workflow in the base-case scenario. It only
>> affects if the member did not start properly. The main problems we have now
>> in the base-case scenario are as follows:
>>
>> 1. Python agent does not send health statistics to CEP.
>> 2. Autoscaler invokes CloudController.terminateMember() service method
>> (in fault/obsolete member handling logic) twice with the same member id. As
>> a result the second call fails.
>>
>> Will start a separate thread to discuss the above issue. I think the
>> priority now should be to make the base-case scenario working.
>>
>> Thanks
>> ​
>>
>>
>> On Thu, Jan 1, 2015 at 11:30 PM, Rajkumar Rajaratnam <rajkumarr@wso2.com>
>> wrote:
>>
>>> Hi,
>>>
>>> We can narrow down the problem with the following conclusions.
>>>
>>>    - if AS has a member in any of the list, then this member should be
>>>    in the topology - if not, system is not in a consistent state
>>>    - so the 1st thing CC should do when receiving an instance start up
>>>    call is to add the member to the topology, send an event (a new event,
>>>    InstanceReadyToSpawnEvent) to indicate this action and then proceed with *other
>>>    things* (this "*other things*" like IP allocation, Volume allocation
>>>    may fail)
>>>    - if we can decide that something went wrong when proceeding with "*other
>>>    things*", CC can terminate the instance and send the member
>>>    terminated event.
>>>    - if everything went fine, CC can send the instance spawned event
>>>
>>> wdyt?
>>>
>>> Thanks.
>>>
>>> On Thu, Jan 1, 2015 at 10:26 PM, Rajkumar Rajaratnam <rajkumarr@wso2.com
>>> > wrote:
>>>
>>>> Hi,
>>>>
>>>> If instance spawned event adds the member to the topology, then there
>>>> is a serious problem here.
>>>>
>>>> Say IP allocation is failing. We will not add the member to the
>>>> topology and we will not send instance spawned event.
>>>>
>>>> This member will get timeout in AS and moved to obsolete list.
>>>>
>>>> In next obsolete member evaluation iteration, AS will ask CC to
>>>> terminate the instance. Now what will happen? CC can't send the member
>>>> terminated event, because member is not in the topology. So AS will not
>>>> remove member from obsolete list. This member will be there in the obsolete
>>>> list forever. So AS is gonna continuously ask CC to terminate this
>>>> instance.
>>>>
>>>> Thanks.
>>>>
>>>> On Thu, Jan 1, 2015 at 10:19 PM, Imesh Gunaratne <imesh@apache.org>
>>>> wrote:
>>>>
>>>>> Instance spawned event adds the member to the topology.
>>>>>
>>>>> On Thu, Jan 1, 2015 at 10:14 PM, Rajkumar Rajaratnam <
>>>>> rajkumarr@wso2.com> wrote:
>>>>>
>>>>>>
>>>>>>
>>>>>> On Thu, Jan 1, 2015 at 10:11 PM, Imesh Gunaratne <imesh@apache.org>
>>>>>> wrote:
>>>>>>
>>>>>>> No, the current workflow is as follows:
>>>>>>>
>>>>>>> - AS talks to CC to start an instance
>>>>>>> - CC creates a new member context with a unique member Id, start a
>>>>>>> new thread to execute the actions, returns the call to AS.
>>>>>>> - The above thread runs and try to start the instance, allocate IP
>>>>>>> addresses, assign storage, etc
>>>>>>> - If everything successfully completes, CC will send the Instance
>>>>>>> Spawened event.
>>>>>>> - If one of the actions fails, CC will raise an error, it will not
>>>>>>> terminate the instance since member context has been already returned to AS.
>>>>>>> - AS will terminate the instance on the next obsolete member
>>>>>>> evaluation iteration.
>>>>>>>
>>>>>>
>>>>>> Thanks Imesh. So when we are adding the member to the topology?
>>>>>>
>>>>>> Thanks.
>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Thu, Jan 1, 2015 at 9:44 PM, Rajkumar Rajaratnam <
>>>>>>> rajkumarr@wso2.com> wrote:
>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Thu, Jan 1, 2015 at 9:42 PM, Rajkumar Rajaratnam <
>>>>>>>> rajkumarr@wso2.com> wrote:
>>>>>>>>
>>>>>>>>> Hi Imesh,
>>>>>>>>>
>>>>>>>>> May be I didn't understand your solution completely, correct me if
>>>>>>>>> I am wrong.
>>>>>>>>>
>>>>>>>>>    - adding the member to the topology as soon as instance is
>>>>>>>>>    created (just spawned)
>>>>>>>>>
>>>>>>>>> This should be "adding the member context to the data holder as
>>>>>>>> soon as instance is created (just spawned). Sorry for the confusion :)
>>>>>>>>
>>>>>>>>>
>>>>>>>>>    - sending instance spawned event if everything else configured
>>>>>>>>>    correctly (IP, Volume etc)
>>>>>>>>>    - terminating the instance and sending instance terminated
>>>>>>>>>    event if IP allocation fails or Volume allocation fails
>>>>>>>>>
>>>>>>>>> Am I correct?
>>>>>>>>>
>>>>>>>>> If correct, I would like to know when we will be adding the member
>>>>>>>>> to the topology? If we adding the member to the topology after sending
>>>>>>>>> instance spawned event, then there is a problem. Even if IP allocation goes
>>>>>>>>> wrong, we will not be able to send the member terminated event, because we
>>>>>>>>> can't send events for the members which are not in the topology.
>>>>>>>>>
>>>>>>>>> That's why, IMO, we should add the member to the topology as soon
>>>>>>>>> as we get the instance start up call and we should send a new event (before
>>>>>>>>> instance spawned event) so that other components will be aware that a
>>>>>>>>> member is added to the topology. This way we can send member terminated
>>>>>>>>> event at the point where IP allocation goes wrong. This will be efficient
>>>>>>>>> and I guess it is not that complicated to implement.
>>>>>>>>>
>>>>>>>>> wdyt?
>>>>>>>>>
>>>>>>>>> Thanks.
>>>>>>>>>
>>>>>>>>> On Thu, Jan 1, 2015 at 9:15 PM, Imesh Gunaratne <imesh@apache.org>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> IMO we shouldn't make things much complicated.
>>>>>>>>>>
>>>>>>>>>> If we can wait until the point where IP addresses are allocated
>>>>>>>>>> to send the Instance Spawned event, may be that's much simpler than the
>>>>>>>>>> above suggestion.
>>>>>>>>>>
>>>>>>>>>> On Thu, Jan 1, 2015 at 8:12 PM, Rajkumar Rajaratnam <
>>>>>>>>>> rajkumarr@wso2.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi,
>>>>>>>>>>>
>>>>>>>>>>> I am quoting what we agreed from some other mail thread.
>>>>>>>>>>>
>>>>>>>>>>> *Correct approach would be to introduce a new topology event to
>>>>>>>>>>> fill the blind area between real instance creation via CC and member
>>>>>>>>>>> spawned event. So, as soon as CC receives a instance start up call, CC
>>>>>>>>>>> would add the member to topology and will send a new event with a new state
>>>>>>>>>>> possibly.*
>>>>>>>>>>>
>>>>>>>>>>> Thanks.
>>>>>>>>>>>
>>>>>>>>>>> On Thu, Jan 1, 2015 at 7:33 PM, Rajkumar Rajaratnam <
>>>>>>>>>>> rajkumarr@wso2.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> s/if anything goes like IP allocation/if anything goes *wrong*
>>>>>>>>>>>> like IP allocation
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>
>>>>>>>>>>>> On Thu, Jan 1, 2015 at 7:20 PM, Rajkumar Rajaratnam <
>>>>>>>>>>>> rajkumarr@wso2.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi Imesh,
>>>>>>>>>>>>>
>>>>>>>>>>>>> Yes, we can either do it as you mentioned, or we can send the
>>>>>>>>>>>>> member terminated event so that the other components will be aware of this
>>>>>>>>>>>>> instance termination. I guess the later one would the efficient solution as
>>>>>>>>>>>>> it AS will take 15 min (pending member timeout) to terminate such
>>>>>>>>>>>>> instances. Even in container case, we can do this.
>>>>>>>>>>>>>
>>>>>>>>>>>>> If we know that the instance will never be activated in
>>>>>>>>>>>>> advance, we can terminate the instance in CC and send the member terminated
>>>>>>>>>>>>> event. We don't need to wait 15 min.
>>>>>>>>>>>>>
>>>>>>>>>>>>> I can recall that we agreed to add the member to the topology
>>>>>>>>>>>>> as soon as member is spawned and send the member terminated event if
>>>>>>>>>>>>> anything goes like IP allocation. It is discussed here,
>>>>>>>>>>>>> If floating IP allocation goes wrong, we are not terminating
>>>>>>>>>>>>> the instances at that point?
>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Thu, Jan 1, 2015 at 6:34 PM, Imesh Gunaratne <
>>>>>>>>>>>>> imesh@apache.org> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> As I see we have the same logic for VMs which terminate the
>>>>>>>>>>>>>> instance if it could not allocate IP addresses:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> https://github.com/apache/stratos/blob/master/components/org.apache.stratos.cloud.controller/src/main/java/org/apache/stratos/cloud/controller/iaases/JcloudsIaas.java
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> String msg = "Error occurred while allocating predefined
>>>>>>>>>>>>>> floating ip address: " + preDefinedIp +
>>>>>>>>>>>>>>                                     " / allocated ip:" + ip +
>>>>>>>>>>>>>>                                     " - terminating node:" +
>>>>>>>>>>>>>> memberContext.toString();
>>>>>>>>>>>>>>                             log.error(msg);
>>>>>>>>>>>>>>                             // terminate instance
>>>>>>>>>>>>>>                             destroyNode(nodeMetadata.getId(),
>>>>>>>>>>>>>> memberContext);
>>>>>>>>>>>>>>                             throw new
>>>>>>>>>>>>>> CloudControllerException(msg);
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> We might need to change this logic to log the error message
>>>>>>>>>>>>>> and wait until the Autoscaler terminate the instance.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Thu, Jan 1, 2015 at 12:01 PM, Imesh Gunaratne <
>>>>>>>>>>>>>> imesh@apache.org> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> A good point Raj, yes, it is not consistent to let the cloud
>>>>>>>>>>>>>>> controller handle this logic as it is already done by the Autoscaler. I
>>>>>>>>>>>>>>> will fix this.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Wed, Dec 31, 2014 at 8:51 PM, Rajkumar Rajaratnam <
>>>>>>>>>>>>>>> rajkumarr@wso2.com> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Currently pods' status are monitored by CC. If pods are not
>>>>>>>>>>>>>>>> getting "Running" status within a time period(default to 120s), replication
>>>>>>>>>>>>>>>> controllers and pods are deleted by CC and nothing happens after that.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> I faced some problems due to this. My pods and replication
>>>>>>>>>>>>>>>> controller were deleted by CC, because pods didn't come to "Running" status.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> ERROR
>>>>>>>>>>>>>>>> {org.apache.stratos.cloud.controller.iaases.kubernetes.KubernetesIaas} -
>>>>>>>>>>>>>>>> Pod status did not change to running within 120 sec, hence removing
>>>>>>>>>>>>>>>> replication controller and pod: [cluster-id] php.php.domain [member-id]
>>>>>>>>>>>>>>>> php.php.domaine9f27b1c-6694-4b70-b939-f80b2ad74168
>>>>>>>>>>>>>>>> [replication-controller-id]
>>>>>>>>>>>>>>>> php-php-domaine9f27b1c-6694-4b70-b939-f80b2ad74168 [pod-id]
>>>>>>>>>>>>>>>> php-php-domaine9f27b1c-6694-4b70-b939-f80b2ad74168
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> But AS doesn't know about this. Later AS moved these
>>>>>>>>>>>>>>>> members to obsolete list. When AS asks CC to terminate these pods, CC
>>>>>>>>>>>>>>>> throws exception saying member context not found.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> *rajkumar@rajkumar-Latitude-E6540:/opt/stratos-packs/apache-stratos-4.1.0-SNAPSHOT/bin$
>>>>>>>>>>>>>>>> [2014-12-31 20:02:16,728]  INFO
>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.context.partition.ClusterLevelPartitionContext}
>>>>>>>>>>>>>>>> -  Pending state of member:
>>>>>>>>>>>>>>>> php.php.domaine9f27b1c-6694-4b70-b939-f80b2ad74168 is expired. Adding as an
>>>>>>>>>>>>>>>> obsoleted member.[2014-12-31 20:03:31,788]  INFO
>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.client.CloudControllerClient} -  Terminating
>>>>>>>>>>>>>>>> instance via cloud controller: [member]
>>>>>>>>>>>>>>>> php.php.domaine9f27b1c-6694-4b70-b939-f80b2ad74168[2014-12-31 20:03:31,798]
>>>>>>>>>>>>>>>> ERROR
>>>>>>>>>>>>>>>> {org.apache.stratos.cloud.controller.services.impl.CloudControllerServiceImpl}
>>>>>>>>>>>>>>>> -  Member termination failed, member context not found: [member-id]
>>>>>>>>>>>>>>>> php.php.domaine9f27b1c-6694-4b70-b939-f80b2ad74168[2014-12-31 20:03:31,799]
>>>>>>>>>>>>>>>> ERROR {org.apache.axis2.rpc.receivers.RPCInOnlyMessageReceiver} -  Member
>>>>>>>>>>>>>>>> termination failed, member context not found: [member-id]
>>>>>>>>>>>>>>>> php.php.domaine9f27b1c-6694-4b70-b939-f80b2ad74168org.apache.stratos.cloud.controller.exception.InvalidMemberException:
>>>>>>>>>>>>>>>> Member termination failed, member context not found: [member-id]
>>>>>>>>>>>>>>>> php.php.domaine9f27b1c-6694-4b70-b939-f80b2ad74168*
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Is this a correct flow?
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> IMO, we don't need to monitor the pods' status at CC side.
>>>>>>>>>>>>>>>> Rather, AS will move these pods to obsolete list once the pending time is
>>>>>>>>>>>>>>>> expired. Then AS will ask CC to delete these pods. This is how VM scenario
>>>>>>>>>>>>>>>> works now. Otherwise, CC and AS will not be in same state. For example, AS
>>>>>>>>>>>>>>>> will ask to terminate a member which CC does not have.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> One more thing I noticed that member context is added to
>>>>>>>>>>>>>>>> CC's data holder only after pods are coming to "Running" status. IMO, we
>>>>>>>>>>>>>>>> need to add the member context as soon as pods are created. This ensures
>>>>>>>>>>>>>>>> that when AS asks a member to terminate, CC will always have it.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> wdyt?
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On Wed, Dec 31, 2014 at 7:47 PM, Rajkumar Rajaratnam <
>>>>>>>>>>>>>>>> rajkumarr@wso2.com> wrote:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Thanks Dakshika,
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Yes my stratos-installer was outdated. Its working fine
>>>>>>>>>>>>>>>>> now.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> On Tue, Dec 30, 2014 at 11:35 AM, Dakshika Jayathilaka <
>>>>>>>>>>>>>>>>> dakshika@wso2.com> wrote:
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Hi Raj,
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> seems you  missed below DB sqls,  reside on
>>>>>>>>>>>>>>>>>> *tools/stratos-**installer/resources*.
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> application-mysql.sql
>>>>>>>>>>>>>>>>>> security-mysql.sql
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> execute both and retry..
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Thank you,
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> *Dakshika Jayathilaka*
>>>>>>>>>>>>>>>>>> Software Engineer
>>>>>>>>>>>>>>>>>> WSO2, Inc.
>>>>>>>>>>>>>>>>>> lean.enterprise.middleware
>>>>>>>>>>>>>>>>>> 0771100911
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> On Tue, Dec 30, 2014 at 9:07 AM, Rajkumar Rajaratnam <
>>>>>>>>>>>>>>>>>> rajkumarr@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> I am trying our kubernetes. I am getting the following
>>>>>>>>>>>>>>>>>>> exception while deploying an application.
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> [2014-12-30 09:02:14,414]  INFO
>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.api.AutoScalerServiceImpl} -  Adding
>>>>>>>>>>>>>>>>>>> application: [application-id] single-cartridge-app
>>>>>>>>>>>>>>>>>>> [2014-12-30 09:02:14,482]  INFO
>>>>>>>>>>>>>>>>>>> {org.wso2.carbon.core.services.util.CarbonAuthenticationUtil} -
>>>>>>>>>>>>>>>>>>> 'admin@carbon.super [-1234]' logged in at [2014-12-30
>>>>>>>>>>>>>>>>>>> 09:02:14,482+0530]
>>>>>>>>>>>>>>>>>>> [2014-12-30 09:02:14,492] ERROR
>>>>>>>>>>>>>>>>>>> {org.wso2.carbon.identity.oauth.dao.OAuthAppDAO} -  Error when executing
>>>>>>>>>>>>>>>>>>> the SQL : SELECT * FROM IDN_OAUTH_CONSUMER_APPS WHERE USERNAME=? AND
>>>>>>>>>>>>>>>>>>> TENANT_ID=? AND APP_NAME=?
>>>>>>>>>>>>>>>>>>> [2014-12-30 09:02:14,493] ERROR
>>>>>>>>>>>>>>>>>>> {org.wso2.carbon.identity.oauth.dao.OAuthAppDAO} -  Table
>>>>>>>>>>>>>>>>>>> 'userstore.IDN_OAUTH_CONSUMER_APPS' doesn't exist
>>>>>>>>>>>>>>>>>>> com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException:
>>>>>>>>>>>>>>>>>>> Table 'userstore.IDN_OAUTH_CONSUMER_APPS' doesn't exist
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> java.lang.reflect.Constructor.newInstance(Constructor.java:513)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
>>>>>>>>>>>>>>>>>>>     at com.mysql.jdbc.Util.getInstance(Util.java:386)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1054)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4237)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4169)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2617)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2778)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2834)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2156)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:2313)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.identity.oauth.dao.OAuthAppDAO.isDuplicateApplication(OAuthAppDAO.java:372)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.identity.oauth.dao.OAuthAppDAO.addOAuthApplication(OAuthAppDAO.java:67)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.identity.oauth.OAuthAdminService.registerOAuthApplicationData(OAuthAdminService.java:228)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>>>>>>>>>>>>>>>     at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.rpc.receivers.RPCUtil.invokeServiceClass(RPCUtil.java:212)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.rpc.receivers.RPCInOnlyMessageReceiver.invokeBusinessLogic(RPCInOnlyMessageReceiver.java:66)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.receivers.AbstractMessageReceiver.receive(AbstractMessageReceiver.java:110)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.transport.http.HTTPTransportUtils.processHTTPPostRequest(HTTPTransportUtils.java:172)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.transport.http.AxisServlet.doPost(AxisServlet.java:146)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.core.transports.CarbonServlet.doPost(CarbonServlet.java:231)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:755)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:68)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service(DelegationServlet.java:68)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter.doFilter(CharacterSetFilter.java:61)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CompositeValve.continueInvocation(CompositeValve.java:178)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CarbonTomcatValve$1.invoke(CarbonTomcatValve.java:47)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.webapp.mgt.TenantLazyLoaderValve.invoke(TenantLazyLoaderValve.java:56)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.TomcatValveContainer.invokeValves(TomcatValveContainer.java:47)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CompositeValve.invoke(CompositeValve.java:141)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CarbonStuckThreadDetectionValve.invoke(CarbonStuckThreadDetectionValve.java:156)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:936)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CarbonContextCreatorValve.invoke(CarbonContextCreatorValve.java:52)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1004)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1653)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
>>>>>>>>>>>>>>>>>>>     at java.lang.Thread.run(Thread.java:662)
>>>>>>>>>>>>>>>>>>> [2014-12-30 09:02:14,496] ERROR
>>>>>>>>>>>>>>>>>>> {org.apache.axis2.rpc.receivers.RPCInOnlyMessageReceiver} -  Error when
>>>>>>>>>>>>>>>>>>> reading the application information from the persistence store.
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.identity.oauth.IdentityOAuthAdminException:
>>>>>>>>>>>>>>>>>>> Error when reading the application information from the persistence store.
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.identity.oauth.dao.OAuthAppDAO.isDuplicateApplication(OAuthAppDAO.java:383)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.identity.oauth.dao.OAuthAppDAO.addOAuthApplication(OAuthAppDAO.java:67)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.identity.oauth.OAuthAdminService.registerOAuthApplicationData(OAuthAdminService.java:228)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>>>>>>>>>>>>>>>     at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.rpc.receivers.RPCUtil.invokeServiceClass(RPCUtil.java:212)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.rpc.receivers.RPCInOnlyMessageReceiver.invokeBusinessLogic(RPCInOnlyMessageReceiver.java:66)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.receivers.AbstractMessageReceiver.receive(AbstractMessageReceiver.java:110)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.transport.http.HTTPTransportUtils.processHTTPPostRequest(HTTPTransportUtils.java:172)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.transport.http.AxisServlet.doPost(AxisServlet.java:146)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.core.transports.CarbonServlet.doPost(CarbonServlet.java:231)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:755)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:68)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service(DelegationServlet.java:68)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter.doFilter(CharacterSetFilter.java:61)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CompositeValve.continueInvocation(CompositeValve.java:178)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CarbonTomcatValve$1.invoke(CarbonTomcatValve.java:47)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.webapp.mgt.TenantLazyLoaderValve.invoke(TenantLazyLoaderValve.java:56)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.TomcatValveContainer.invokeValves(TomcatValveContainer.java:47)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CompositeValve.invoke(CompositeValve.java:141)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CarbonStuckThreadDetectionValve.invoke(CarbonStuckThreadDetectionValve.java:156)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:936)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CarbonContextCreatorValve.invoke(CarbonContextCreatorValve.java:52)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1004)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1653)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
>>>>>>>>>>>>>>>>>>>     at java.lang.Thread.run(Thread.java:662)
>>>>>>>>>>>>>>>>>>> [2014-12-30 09:02:14,511] ERROR
>>>>>>>>>>>>>>>>>>> {org.apache.axis2.rpc.receivers.RPCInOnlyMessageReceiver} -
>>>>>>>>>>>>>>>>>>> org.apache.axis2.AxisFault: Error when reading the application information
>>>>>>>>>>>>>>>>>>> from the persistence store.
>>>>>>>>>>>>>>>>>>> org.apache.stratos.autoscaler.exception.AutoScalerException:
>>>>>>>>>>>>>>>>>>> org.apache.axis2.AxisFault: Error when reading the application information
>>>>>>>>>>>>>>>>>>> from the persistence store.
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.stratos.autoscaler.applications.parser.DefaultApplicationParser.createToken(DefaultApplicationParser.java:714)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.stratos.autoscaler.applications.parser.DefaultApplicationParser.parse(DefaultApplicationParser.java:109)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.stratos.autoscaler.api.AutoScalerServiceImpl.addApplication(AutoScalerServiceImpl.java:173)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>>>>>>>>>>>>>>>     at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.rpc.receivers.RPCUtil.invokeServiceClass(RPCUtil.java:212)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.rpc.receivers.RPCInOnlyMessageReceiver.invokeBusinessLogic(RPCInOnlyMessageReceiver.java:66)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.receivers.AbstractMessageReceiver.receive(AbstractMessageReceiver.java:110)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.transport.http.HTTPTransportUtils.processHTTPPostRequest(HTTPTransportUtils.java:172)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.transport.http.AxisServlet.doPost(AxisServlet.java:146)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.core.transports.CarbonServlet.doPost(CarbonServlet.java:231)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:755)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:68)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service(DelegationServlet.java:68)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter.doFilter(CharacterSetFilter.java:61)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CompositeValve.continueInvocation(CompositeValve.java:178)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CarbonTomcatValve$1.invoke(CarbonTomcatValve.java:47)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.webapp.mgt.TenantLazyLoaderValve.invoke(TenantLazyLoaderValve.java:56)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.TomcatValveContainer.invokeValves(TomcatValveContainer.java:47)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CompositeValve.invoke(CompositeValve.java:141)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CarbonStuckThreadDetectionValve.invoke(CarbonStuckThreadDetectionValve.java:156)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:936)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CarbonContextCreatorValve.invoke(CarbonContextCreatorValve.java:52)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1004)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1653)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
>>>>>>>>>>>>>>>>>>>     at java.lang.Thread.run(Thread.java:662)
>>>>>>>>>>>>>>>>>>> Caused by: org.apache.axis2.AxisFault: Error when
>>>>>>>>>>>>>>>>>>> reading the application information from the persistence store.
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.util.Utils.getInboundFaultFromMessageContext(Utils.java:531)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.description.RobustOutOnlyAxisOperation$RobustOutOnlyOperationClient.handleResponse(RobustOutOnlyAxisOperation.java:91)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:445)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.client.OperationClient.execute(OperationClient.java:149)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.identity.oauth.stub.OAuthAdminServiceStub.registerOAuthApplicationData(OAuthAdminServiceStub.java:323)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.stratos.autoscaler.client.oAuthAdminServiceClient.registerOauthApplication(oAuthAdminServiceClient.java:97)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.stratos.autoscaler.applications.parser.DefaultApplicationParser.createToken(DefaultApplicationParser.java:712)
>>>>>>>>>>>>>>>>>>>     ... 46 more
>>>>>>>>>>>>>>>>>>> [2014-12-30 09:02:14,521] ERROR
>>>>>>>>>>>>>>>>>>> {org.apache.stratos.rest.endpoint.handlers.CustomExceptionMapper} -  Error
>>>>>>>>>>>>>>>>>>> while fulfilling the request
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> org.apache.stratos.rest.endpoint.exception.RestAPIException
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.stratos.rest.endpoint.api.StratosApiV41Utils.addApplication(StratosApiV41Utils.java:974)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.stratos.rest.endpoint.api.StratosApiV41.addApplication(StratosApiV41.java:354)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>>>>>>>>>>>>>>>>>>     at java.lang.reflect.Method.invoke(Method.java:597)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:180)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:194)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:100)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:57)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:93)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:271)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:239)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:223)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:203)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:137)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:159)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:286)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:206)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:755)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:262)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CompositeValve.continueInvocation(CompositeValve.java:178)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CarbonTomcatValve$1.invoke(CarbonTomcatValve.java:47)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.webapp.mgt.TenantLazyLoaderValve.invoke(TenantLazyLoaderValve.java:56)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.TomcatValveContainer.invokeValves(TomcatValveContainer.java:47)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CompositeValve.invoke(CompositeValve.java:141)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CarbonStuckThreadDetectionValve.invoke(CarbonStuckThreadDetectionValve.java:156)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:936)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.wso2.carbon.tomcat.ext.valves.CarbonContextCreatorValve.invoke(CarbonContextCreatorValve.java:52)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1004)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1653)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
>>>>>>>>>>>>>>>>>>>     at java.lang.Thread.run(Thread.java:662)
>>>>>>>>>>>>>>>>>>> Caused by: org.apache.axis2.AxisFault:
>>>>>>>>>>>>>>>>>>> org.apache.axis2.AxisFault: Error when reading the application information
>>>>>>>>>>>>>>>>>>> from the persistence store.
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.util.Utils.getInboundFaultFromMessageContext(Utils.java:531)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.description.RobustOutOnlyAxisOperation$RobustOutOnlyOperationClient.handleResponse(RobustOutOnlyAxisOperation.java:91)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:445)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.axis2.client.OperationClient.execute(OperationClient.java:149)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.stratos.autoscaler.stub.AutoScalerServiceStub.addApplication(AutoScalerServiceStub.java:3223)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.stratos.manager.client.AutoscalerServiceClient.addApplication(AutoscalerServiceClient.java:122)
>>>>>>>>>>>>>>>>>>>     at
>>>>>>>>>>>>>>>>>>> org.apache.stratos.rest.endpoint.api.StratosApiV41Utils.addApplication(StratosApiV41Utils.java:970)
>>>>>>>>>>>>>>>>>>>     ...
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> Any idea?
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> On Mon, Dec 29, 2014 at 4:06 PM, Imesh Gunaratne <
>>>>>>>>>>>>>>>>>>> imesh@apache.org> wrote:
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> I did an improvement in the container startup logic to
>>>>>>>>>>>>>>>>>>>> wait until the pod status changes to Runnning state. Here cloud controller
>>>>>>>>>>>>>>>>>>>> will wait until two minutes to a pod to become active. if not the call will
>>>>>>>>>>>>>>>>>>>> be rolled back. Pod activation timeout can be configured using the system
>>>>>>>>>>>>>>>>>>>> property: stratos.pod.activation.timeout.
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> Once pod changes to Running state, IP addresses will be
>>>>>>>>>>>>>>>>>>>> updated as follows:
>>>>>>>>>>>>>>>>>>>> - Member's default private IP: Pod's IP address
>>>>>>>>>>>>>>>>>>>> - Member's default public IP: Pod's host IP address
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> A sample log:
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> [2014-12-29 15:43:02,419]  INFO Starting container:
>>>>>>>>>>>>>>>>>>>> [cartridge-type] php
>>>>>>>>>>>>>>>>>>>> [2014-12-29 15:43:02,454]  INFO Creating replication
>>>>>>>>>>>>>>>>>>>> controller: [replication-controller-id]
>>>>>>>>>>>>>>>>>>>> php-php-domainfc7e626a-e1e0-456d-8528-744f256c1f7a [name]
>>>>>>>>>>>>>>>>>>>> php-php-domainfc7e626a-e1e0-456d-8528-744f256c1f7a [docker-image]
>>>>>>>>>>>>>>>>>>>> stratos/php:4.1.0-alpha [container-ports] [80] [replicas] 1
>>>>>>>>>>>>>>>>>>>> [2014-12-29 15:43:02,559]  INFO Replication controller
>>>>>>>>>>>>>>>>>>>> created successfully: [replication-controller-id]
>>>>>>>>>>>>>>>>>>>> php-php-domainfc7e626a-e1e0-456d-8528-744f256c1f7a [name]
>>>>>>>>>>>>>>>>>>>> php-php-domainfc7e626a-e1e0-456d-8528-744f256c1f7a [docker-image]
>>>>>>>>>>>>>>>>>>>> stratos/php:4.1.0-alpha [container-port] [80] [replicas] 1
>>>>>>>>>>>>>>>>>>>> [2014-12-29 15:43:02,560]  INFO Creating service:
>>>>>>>>>>>>>>>>>>>> [service-id] php-php-domain-http-80 [service-name] php-php-domain-http-80
>>>>>>>>>>>>>>>>>>>> [service-port] 4500 [container-port] 80, [public-ip] 172.17.8.100
>>>>>>>>>>>>>>>>>>>> [2014-12-29 15:43:02,598]  INFO Service created
>>>>>>>>>>>>>>>>>>>> successfully: [service-id] php-php-domain-http-80 [service-name]
>>>>>>>>>>>>>>>>>>>> php-php-domain-http-80 [service-port] 4500 [container-port] 80, [public-ip]
>>>>>>>>>>>>>>>>>>>> 172.17.8.100
>>>>>>>>>>>>>>>>>>>> [2014-12-29 15:43:07,412]  *INFO Waiting pod status to
>>>>>>>>>>>>>>>>>>>> be changed to running*: [member-id]
>>>>>>>>>>>>>>>>>>>> php.php.domainfc7e626a-e1e0-456d-8528-744f256c1f7a [pod-id]
>>>>>>>>>>>>>>>>>>>> 440b7235-8f43-11e4-b193-080027f35f1b [current-pod-status] waiting
>>>>>>>>>>>>>>>>>>>> [2014-12-29 15:43:18,459]  *INFO Waiting pod status to
>>>>>>>>>>>>>>>>>>>> be changed to running*: [member-id]
>>>>>>>>>>>>>>>>>>>> php.php.domainfc7e626a-e1e0-456d-8528-744f256c1f7a [pod-id]
>>>>>>>>>>>>>>>>>>>> 440b7235-8f43-11e4-b193-080027f35f1b [current-pod-status] waiting
>>>>>>>>>>>>>>>>>>>> [2014-12-29 15:43:29,509]  *INFO Pod status changed to
>>>>>>>>>>>>>>>>>>>> running*: [member-id]
>>>>>>>>>>>>>>>>>>>> php.php.domainfc7e626a-e1e0-456d-8528-744f256c1f7a [pod-id]
>>>>>>>>>>>>>>>>>>>> 440b7235-8f43-11e4-b193-080027f35f1b
>>>>>>>>>>>>>>>>>>>> [2014-12-29 15:43:33,595]  INFO Instance started
>>>>>>>>>>>>>>>>>>>> successfully: [cartridge-type] php [cluster-id] php.php.domain
>>>>>>>>>>>>>>>>>>>> [instance-id] 440b7235-8f43-11e4-b193-080027f35f1b [default-private-ip]
>>>>>>>>>>>>>>>>>>>> 10.100.37.4 [default-public-ip] 172.17.8.100
>>>>>>>>>>>>>>>>>>>> [2014-12-29 15:43:33,601]  INFO Publishing instance
>>>>>>>>>>>>>>>>>>>> spawned event: [service-name] php [cluster-id] php.php.domain
>>>>>>>>>>>>>>>>>>>> [cluster-instance-id] single-cartridge-app-1 [member-id]
>>>>>>>>>>>>>>>>>>>> php.php.domainfc7e626a-e1e0-456d-8528-744f256c1f7a [instance-id]
>>>>>>>>>>>>>>>>>>>> 440b7235-8f43-11e4-b193-080027f35f1b [network-partition-id] network-p1
>>>>>>>>>>>>>>>>>>>> [partition-id] p1 [lb-cluster-id] null
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> On Sun, Dec 28, 2014 at 7:40 PM, Imesh Gunaratne <
>>>>>>>>>>>>>>>>>>>> imesh@apache.org> wrote:
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> Thanks Lakmal!
>>>>>>>>>>>>>>>>>>>>> After the application becomes active I can see that
>>>>>>>>>>>>>>>>>>>>> Autoscaler is detecting a fauly member:
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> [2014-12-28 19:12:14,016]  INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.cep.extension.FaultHandlingWindowProcessor} -  Faulty
>>>>>>>>>>>>>>>>>>>>> member detected [member-id]
>>>>>>>>>>>>>>>>>>>>> php.php.domaincc7fb2e4-ea96-4b70-8706-353e4225f170 with [last time-stamp]
>>>>>>>>>>>>>>>>>>>>> 1419774066943 [time-out] 60000 milliseconds
>>>>>>>>>>>>>>>>>>>>> [2014-12-28 19:12:14,025]  INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.cep.extension.FaultHandlingWindowProcessor} -
>>>>>>>>>>>>>>>>>>>>>  Publishing member fault event for [member-id]
>>>>>>>>>>>>>>>>>>>>> php.php.domaincc7fb2e4-ea96-4b70-8706-353e4225f170
>>>>>>>>>>>>>>>>>>>>> [2014-12-28 19:12:14,036]  INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.status.processor.cluster.ClusterStatusInactiveProcessor}
>>>>>>>>>>>>>>>>>>>>> -  Publishing Cluster inactivate event for [application]:
>>>>>>>>>>>>>>>>>>>>> single-cartridge-app [cluster]: php.php.domain
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> I'm currently investigating the reason for this.
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 7:09 PM, Lakmal Warusawithana
>>>>>>>>>>>>>>>>>>>>> <lakmal@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> thanks Imesh, will give a try.
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 6:35 PM, Imesh Gunaratne <
>>>>>>>>>>>>>>>>>>>>>> imesh@apache.org> wrote:
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> After fixing the above issue, the application is
>>>>>>>>>>>>>>>>>>>>>>> getting active! :-) I used a single cartridge application for this test.
>>>>>>>>>>>>>>>>>>>>>>> Now we can create a more complex application and see how it works.
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> I have written a small guide on describing all steps
>>>>>>>>>>>>>>>>>>>>>>> for trying out Kubernetes workflow, please try out:
>>>>>>>>>>>>>>>>>>>>>>> https://gist.github.com/imesh/b8f81fac8de39183a504
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 5:25 PM, Imesh Gunaratne <
>>>>>>>>>>>>>>>>>>>>>>> imesh@apache.org> wrote:
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> I think it should be as follows:
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> Member private IP => container IP
>>>>>>>>>>>>>>>>>>>>>>>> Member default private IP => container IP
>>>>>>>>>>>>>>>>>>>>>>>> Member public IPs = > service proxy IPs
>>>>>>>>>>>>>>>>>>>>>>>> Member default public IP => kubernetes master/host
>>>>>>>>>>>>>>>>>>>>>>>> IP
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> If public IP assignment is not enabled service
>>>>>>>>>>>>>>>>>>>>>>>> proxies are not created, I can recall that Lakmal suggested this.
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 5:10 PM, Imesh Gunaratne <
>>>>>>>>>>>>>>>>>>>>>>>> imesh@apache.org> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>> I fixed the above issue by setting the private and
>>>>>>>>>>>>>>>>>>>>>>>>> public IPs to Kubernetes Master IP, we will need to review few things here:
>>>>>>>>>>>>>>>>>>>>>>>>> - Private IP address of a member needs to be the
>>>>>>>>>>>>>>>>>>>>>>>>> service proxy IP address
>>>>>>>>>>>>>>>>>>>>>>>>> - However each service proxy will have a unique IP
>>>>>>>>>>>>>>>>>>>>>>>>> address (each transport of the server)
>>>>>>>>>>>>>>>>>>>>>>>>> - Which means there will be a private IP for each
>>>>>>>>>>>>>>>>>>>>>>>>> transport
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>> Will discuss this and see how we can resolve this
>>>>>>>>>>>>>>>>>>>>>>>>> problem later on. For the moment setting the Kubernetes Master IP is
>>>>>>>>>>>>>>>>>>>>>>>>> sufficient IMO.
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>> After fixing the above issue, now I see the below
>>>>>>>>>>>>>>>>>>>>>>>>> error:
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>> [2014-12-26 17:05:30,547] ERROR
>>>>>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.event.receiver.topology.AutoscalerTopologyEventReceiver}
>>>>>>>>>>>>>>>>>>>>>>>>> -  Error processing event null
>>>>>>>>>>>>>>>>>>>>>>>>> java.lang.NullPointerException
>>>>>>>>>>>>>>>>>>>>>>>>> at
>>>>>>>>>>>>>>>>>>>>>>>>> org.apache.stratos.autoscaler.monitor.cluster.ClusterMonitor.getClusterInstanceContext(ClusterMonitor.java:1116)
>>>>>>>>>>>>>>>>>>>>>>>>> at
>>>>>>>>>>>>>>>>>>>>>>>>> org.apache.stratos.autoscaler.monitor.cluster.ClusterMonitor.handleMemberActivatedEvent(ClusterMonitor.java:875)
>>>>>>>>>>>>>>>>>>>>>>>>> at
>>>>>>>>>>>>>>>>>>>>>>>>> org.apache.stratos.autoscaler.event.receiver.topology.AutoscalerTopologyEventReceiver$12.onEvent(AutoscalerTopologyEventReceiver.java:393)
>>>>>>>>>>>>>>>>>>>>>>>>> at
>>>>>>>>>>>>>>>>>>>>>>>>> org.apache.stratos.messaging.listener.EventListener.update(EventListener.java:42)
>>>>>>>>>>>>>>>>>>>>>>>>> at
>>>>>>>>>>>>>>>>>>>>>>>>> java.util.Observable.notifyObservers(Observable.java:159)
>>>>>>>>>>>>>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 4:56 PM, Rajkumar
>>>>>>>>>>>>>>>>>>>>>>>>> Rajaratnam <rajkumarr@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 4:34 PM, Imesh Gunaratne
>>>>>>>>>>>>>>>>>>>>>>>>>> <imesh@apache.org> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Lakmal,
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>> I added these to Kubernetes Cluster definition
>>>>>>>>>>>>>>>>>>>>>>>>>>> for the time being since I'm finding/fixing many issues in agent and docker
>>>>>>>>>>>>>>>>>>>>>>>>>>> base image, will discuss and move them to a proper location later on. WDYT?
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>> {
>>>>>>>>>>>>>>>>>>>>>>>>>>>       "clusterId": "kubernetes-cluster-1",
>>>>>>>>>>>>>>>>>>>>>>>>>>>       "description": "Kubernetes CoreOS cluster",
>>>>>>>>>>>>>>>>>>>>>>>>>>>       ...
>>>>>>>>>>>>>>>>>>>>>>>>>>>     "property":[
>>>>>>>>>>>>>>>>>>>>>>>>>>>        {
>>>>>>>>>>>>>>>>>>>>>>>>>>>           "name":"payload_parameter.MB_IP",
>>>>>>>>>>>>>>>>>>>>>>>>>>>           "value":"192.168.59.3"
>>>>>>>>>>>>>>>>>>>>>>>>>>>        },
>>>>>>>>>>>>>>>>>>>>>>>>>>>        {
>>>>>>>>>>>>>>>>>>>>>>>>>>>           "name":"payload_parameter.MB_PORT",
>>>>>>>>>>>>>>>>>>>>>>>>>>>           "value":"1883"
>>>>>>>>>>>>>>>>>>>>>>>>>>>        },
>>>>>>>>>>>>>>>>>>>>>>>>>>>        {
>>>>>>>>>>>>>>>>>>>>>>>>>>>           "name":"payload_parameter.CEP_IP",
>>>>>>>>>>>>>>>>>>>>>>>>>>>           "value":"192.168.59.3"
>>>>>>>>>>>>>>>>>>>>>>>>>>>        },
>>>>>>>>>>>>>>>>>>>>>>>>>>>        {
>>>>>>>>>>>>>>>>>>>>>>>>>>>           "name":"payload_parameter.CEP_PORT",
>>>>>>>>>>>>>>>>>>>>>>>>>>>           "value":"7711"
>>>>>>>>>>>>>>>>>>>>>>>>>>>        },
>>>>>>>>>>>>>>>>>>>>>>>>>>>        {
>>>>>>>>>>>>>>>>>>>>>>>>>>>           "name":"payload_parameter.LOG_LEVEL",
>>>>>>>>>>>>>>>>>>>>>>>>>>>           "value":"DEBUG"
>>>>>>>>>>>>>>>>>>>>>>>>>>>        }
>>>>>>>>>>>>>>>>>>>>>>>>>>>     ]
>>>>>>>>>>>>>>>>>>>>>>>>>>> }
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>> After the above fix I'm now seeing the below
>>>>>>>>>>>>>>>>>>>>>>>>>>> error in cloud controller. Seems like we do not send the ip address in the
>>>>>>>>>>>>>>>>>>>>>>>>>>> member activated event. Need to check agent logic again:
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>> [2014-12-26 16:28:06,218]  INFO
>>>>>>>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.manager.listener.InstanceStatusListener} -  Instance
>>>>>>>>>>>>>>>>>>>>>>>>>>> status message received
>>>>>>>>>>>>>>>>>>>>>>>>>>> [2014-12-26 16:28:06,218]  INFO
>>>>>>>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.manager.listener.InstanceStatusListener} -  Event class
>>>>>>>>>>>>>>>>>>>>>>>>>>> name:
>>>>>>>>>>>>>>>>>>>>>>>>>>> org.apache.stratos.messaging.event.instance.status.InstanceActivatedEvent
>>>>>>>>>>>>>>>>>>>>>>>>>>> [2014-12-26 16:28:06,219]  INFO
>>>>>>>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.cloud.controller.messaging.topology.TopologyBuilder} -
>>>>>>>>>>>>>>>>>>>>>>>>>>>  member started event adding status activated
>>>>>>>>>>>>>>>>>>>>>>>>>>> [2014-12-26 16:28:06,225]  INFO
>>>>>>>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.cloud.controller.messaging.publisher.TopologyEventPublisher}
>>>>>>>>>>>>>>>>>>>>>>>>>>> -  Publishing member activated event: [service-name] php [cluster-id]
>>>>>>>>>>>>>>>>>>>>>>>>>>> php.php.domain [cluster-instance-id] single-cartridge-app-1 [member-id]
>>>>>>>>>>>>>>>>>>>>>>>>>>> php.php.domaind7655e6f-f962-425b-b93b-2bf7333dc37d [network-partition-id]
>>>>>>>>>>>>>>>>>>>>>>>>>>>  [partition-id]
>>>>>>>>>>>>>>>>>>>>>>>>>>> [2014-12-26 16:28:06,244] ERROR
>>>>>>>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.messaging.message.receiver.topology.TopologyEventMessageDelegator}
>>>>>>>>>>>>>>>>>>>>>>>>>>> -  Failed to retrieve topology event message
>>>>>>>>>>>>>>>>>>>>>>>>>>> java.lang.RuntimeException: *No ip address
>>>>>>>>>>>>>>>>>>>>>>>>>>> found in member activated event: *[service] php
>>>>>>>>>>>>>>>>>>>>>>>>>>> [cluster] php.php.domain [member]
>>>>>>>>>>>>>>>>>>>>>>>>>>> php.php.domaind7655e6f-f962-425b-b93b-2bf7333dc37d
>>>>>>>>>>>>>>>>>>>>>>>>>>> at
>>>>>>>>>>>>>>>>>>>>>>>>>>> org.apache.stratos.messaging.message.processor.topology.MemberActivatedMessageProcessor.doProcess(MemberActivatedMessageProcessor.java:102)
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> I guess spawned containers doesn't have IP
>>>>>>>>>>>>>>>>>>>>>>>>>> addresses. How we are getting IP address for a container is like this.
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> // PodActivationWatcher.java
>>>>>>>>>>>>>>>>>>>>>>>>>> String hostIP = pod.getCurrentState().getHost();
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> This is returning null or empty, so member
>>>>>>>>>>>>>>>>>>>>>>>>>> activated event is not having an IP.
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 3:49 PM, Lakmal
>>>>>>>>>>>>>>>>>>>>>>>>>>> Warusawithana <lakmal@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>> Shall we used metadata service to publish all
>>>>>>>>>>>>>>>>>>>>>>>>>>>> these generic information?
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 3:40 PM, Imesh
>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gunaratne <imesh@apache.org> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> As I can see in the agent.conf some
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> configuration parameters are missing:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> These parameters are not sent in Kuberbenetes
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> workflow, we might need to think how to send them. ASFAIK in VM workflow
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> most of these missing parameters are sent by puppet master.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> ​
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 3:18 PM, Imesh
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gunaratne <imesh@apache.org> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Seems like we have a string formatting issue
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> in agent:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> http://stackoverflow.com/questions/18053500/typeerror-not-all-arguments-converted-during-string-formatting-python
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 3:11 PM, Imesh
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gunaratne <imesh@apache.org> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> I fixed the above issue with INTERNAL
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> parameter and now I'm seeing the following error:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> [2014-12-26 09:37:27,321] INFO
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> {cartridgeagentconfiguration.py:__init__} - Cartridge agent configuration
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> initialized
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Traceback (most recent call last):
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 850, in emit
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     msg = self.format(record)
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 723, in format
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     return fmt.format(record)
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 464, in format
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     record.message = record.getMessage()
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 328, in getMessage
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     msg = msg % self.args
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> TypeError: not all arguments converted
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> during string formatting
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Logged from file agent.py, line 331
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Traceback (most recent call last):
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 850, in emit
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     msg = self.format(record)
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 723, in format
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     return fmt.format(record)
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 464, in format
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     record.message = record.getMessage()
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 328, in getMessage
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     msg = msg % self.args
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> TypeError: not all arguments converted
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> during string formatting
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Logged from file agent.py, line 331
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Traceback (most recent call last):
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 850, in emit
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     msg = self.format(record)
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 723, in format
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     return fmt.format(record)
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 464, in format
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     record.message = record.getMessage()
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 328, in getMessage
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     msg = msg % self.args
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> TypeError: not all arguments converted
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> during string formatting
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Logged from file agent.py, line 331
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 3:03 PM, Imesh
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gunaratne <imesh@apache.org> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> As I found there was an issue in agent
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> code, it was using PROVIDER constant to fetch the INTERNAL parameter. I
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> cannot see PROVIDER parameter being using in the agent.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 2:32 PM, Gayan
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gunarathne <gayang@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Imesh,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Attachment is the sample launch_params
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> that I have tested.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gayan
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 2:22 PM, Gayan
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gunarathne <gayang@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Imesh,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Is that launch_params contains
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> the PROVIDER parameter? I guess this comes when the provider is not
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> available in the payload. Seems like we are showing wrong error message.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gayan
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 2:05 PM, Imesh
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gunaratne <imesh@apache.org> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks Gayan, yes it was not there in
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> launch_params, I just fixed it and seeing the below error:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> [2014-12-26 08:31:17,311] INFO
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> {cartridgeagentconfiguration.py:__init__} -  INTERNAL payload parameter is
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> not found
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> [2014-12-26 08:31:17,311] INFO
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> {cartridgeagentconfiguration.py:__init__} - Cartridge agent configuration
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> initialized
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Traceback (most recent call last):
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 850, in emit
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     msg = self.format(record)
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 723, in format
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     return fmt.format(record)
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 464, in format
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     record.message = record.getMessage()
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/usr/lib/python2.7/logging/__init__.py", line 328, in getMessage
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     msg = msg % self.args
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> TypeError: not all arguments converted
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> during string formatting
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 1:49 PM, Gayan
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gunarathne <gayang@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Imesh,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> This is happen when CLUSTER_INSTANCE_ID
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> not contain as the payload parameter of the cartridge agent.I think we can
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> first check the agent payload and see CLUSTER_INSTANCE_ID
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> is there in the agent payload.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gayan
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 1:39 PM, Imesh
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gunaratne <imesh@apache.org> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> I fixed the above issue in cartridge
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> agent and re-created the base image, now I'm seeing another error:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> root@e82ebdc6-8cd5-11e4-85d5-080027f35f1b:~#
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> cat /tmp/agent.screen.log
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Traceback (most recent call last):
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File "agent.py", line 32, in <module>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     from modules.extensions import
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> defaultextensionhandler
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/mnt/apache-stratos-python-cartridge-agent-4.1.0-SNAPSHOT/modules/extensions/defaultextensionhandler.py",
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> line 22, in <module>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     from ..util import extensionutils,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> cartridgeagentutils
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/mnt/apache-stratos-python-cartridge-agent-4.1.0-SNAPSHOT/modules/util/extensionutils.py",
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> line 29, in <module>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     cartridge_agent_config =
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> cartridgeagentconfiguration.CartridgeAgentConfiguration()
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/mnt/apache-stratos-python-cartridge-agent-4.1.0-SNAPSHOT/modules/config/cartridgeagentconfiguration.py",
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> line 349, in __init__
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> CartridgeAgentConfiguration.instance =
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> CartridgeAgentConfiguration.__CartridgeAgentConfiguration()
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> "/mnt/apache-stratos-python-cartridge-agent-4.1.0-SNAPSHOT/modules/config/cartridgeagentconfiguration.py",
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> line 226, in __init__
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     raise RuntimeError(ex)
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> RuntimeError: Cannot find the value of
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> required parameter: 'CLUSTER_INSTANCE_ID'
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> I can see CLUSTER_INSTANCE_ID being
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> passed to the container, may be there is something wrong in the agent code,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> will investigate.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> On Fri, Dec 26, 2014 at 2:40 AM, Imesh
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gunaratne <imesh@apache.org> wrote:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Hi Devs,
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> I fixed some of the issues in
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Kubernetes Iaas and tested the Kubernetes workflow with sample php docker
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> image. Now replication controllers, services and containers get created
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> without a problem. We can also access the php server in the container.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> However I noticed that agent does not
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> send the instance started event to CEP. Following error was found in agent
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> screen log:
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Traceback (most recent call last):
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>   File "agent.py", line 21, in
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> <module>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>     from
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> cartridgeagent.cartridgeagent.modules import eventsubscriber
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> ImportError: No module named
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> cartridgeagent.cartridgeagent.modules
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> May be agent was not updated in the
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> php docker image. Will check this tomorrow.
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Thanks
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gayan Gunarathne
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Technical Lead
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> WSO2 Inc. (http://wso2.com)
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> email  : gayang@wso2.com  | mobile : +94
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 766819985
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gayan Gunarathne
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Technical Lead
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> WSO2 Inc. (http://wso2.com)
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> email  : gayang@wso2.com  | mobile : +94
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 766819985
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Gayan Gunarathne
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Technical Lead
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> WSO2 Inc. (http://wso2.com)
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> email  : gayang@wso2.com  | mobile : +94
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> 766819985
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>>>>>>> Lakmal Warusawithana
>>>>>>>>>>>>>>>>>>>>>>>>>>>> Vice President, Apache Stratos
>>>>>>>>>>>>>>>>>>>>>>>>>>>> Director - Cloud Architecture; WSO2 Inc.
>>>>>>>>>>>>>>>>>>>>>>>>>>>> Mobile : +94714289692
>>>>>>>>>>>>>>>>>>>>>>>>>>>> Blog : http://lakmalsview.blogspot.com/
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>>>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>>>>> Rajkumar Rajaratnam
>>>>>>>>>>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>>>>>>>>>>> Software Engineer, WSO2
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>> Mobile : +94777568639
>>>>>>>>>>>>>>>>>>>>>>>>>> Blog : rajkumarr.com
>>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>>> Lakmal Warusawithana
>>>>>>>>>>>>>>>>>>>>>> Vice President, Apache Stratos
>>>>>>>>>>>>>>>>>>>>>> Director - Cloud Architecture; WSO2 Inc.
>>>>>>>>>>>>>>>>>>>>>> Mobile : +94714289692
>>>>>>>>>>>>>>>>>>>>>> Blog : http://lakmalsview.blogspot.com/
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>> Rajkumar Rajaratnam
>>>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>>>> Software Engineer, WSO2
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> Mobile : +94777568639
>>>>>>>>>>>>>>>>>>> Blog : rajkumarr.com
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>> Rajkumar Rajaratnam
>>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>>> Software Engineer, WSO2
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Mobile : +94777568639
>>>>>>>>>>>>>>>>> Blog : rajkumarr.com
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>> Rajkumar Rajaratnam
>>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>> Software Engineer, WSO2
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Mobile : +94777568639
>>>>>>>>>>>>>>>> Blog : rajkumarr.com
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> --
>>>>>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Rajkumar Rajaratnam
>>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>>> Software Engineer, WSO2
>>>>>>>>>>>>>
>>>>>>>>>>>>> Mobile : +94777568639
>>>>>>>>>>>>> Blog : rajkumarr.com
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Rajkumar Rajaratnam
>>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>>> Software Engineer, WSO2
>>>>>>>>>>>>
>>>>>>>>>>>> Mobile : +94777568639
>>>>>>>>>>>> Blog : rajkumarr.com
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Rajkumar Rajaratnam
>>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>> Software Engineer, WSO2
>>>>>>>>>>>
>>>>>>>>>>> Mobile : +94777568639
>>>>>>>>>>> Blog : rajkumarr.com
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>
>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Rajkumar Rajaratnam
>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>> Software Engineer, WSO2
>>>>>>>>>
>>>>>>>>> Mobile : +94777568639
>>>>>>>>> Blog : rajkumarr.com
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Rajkumar Rajaratnam
>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>> Software Engineer, WSO2
>>>>>>>>
>>>>>>>> Mobile : +94777568639
>>>>>>>> Blog : rajkumarr.com
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Imesh Gunaratne
>>>>>>>
>>>>>>> Technical Lead, WSO2
>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Rajkumar Rajaratnam
>>>>>> Committer & PMC Member, Apache Stratos
>>>>>> Software Engineer, WSO2
>>>>>>
>>>>>> Mobile : +94777568639
>>>>>> Blog : rajkumarr.com
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Imesh Gunaratne
>>>>>
>>>>> Technical Lead, WSO2
>>>>> Committer & PMC Member, Apache Stratos
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Rajkumar Rajaratnam
>>>> Committer & PMC Member, Apache Stratos
>>>> Software Engineer, WSO2
>>>>
>>>> Mobile : +94777568639
>>>> Blog : rajkumarr.com
>>>>
>>>
>>>
>>>
>>> --
>>> Rajkumar Rajaratnam
>>> Committer & PMC Member, Apache Stratos
>>> Software Engineer, WSO2
>>>
>>> Mobile : +94777568639
>>> Blog : rajkumarr.com
>>>
>>
>>
>>
>> --
>> Imesh Gunaratne
>>
>> Technical Lead, WSO2
>> Committer & PMC Member, Apache Stratos
>>
>
>
>
> --
> Rajkumar Rajaratnam
> Committer & PMC Member, Apache Stratos
> Software Engineer, WSO2
>
> Mobile : +94777568639
> Blog : rajkumarr.com
>



-- 
Imesh Gunaratne

Technical Lead, WSO2
Committer & PMC Member, Apache Stratos

Mime
View raw message