stratos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Swapnil Patil <swapnil.r...@gmail.com>
Subject Re: AWS Load Balancing Support - Member gets terminated immediately
Date Fri, 17 Jul 2015 08:58:25 GMT
Thanks Rajkumar. It worked.

Regards,
Swapnil

On Fri, Jul 17, 2015 at 8:34 AM, Swapnil Patil <swapnil.rp15@gmail.com>
wrote:

> Thanks!
>
> Regards,
> Swapnil
>
> On Fri, Jul 17, 2015 at 8:32 AM, Rajkumar Rajaratnam <rajkumarr@wso2.com>
> wrote:
>
>> You don't need to restart puppet master. You can use the same base image.
>>
>> Thanks.
>>
>> On Fri, Jul 17, 2015 at 2:00 PM, Swapnil Patil <swapnil.rp15@gmail.com>
>> wrote:
>>
>>> Thanks Rajkumar!
>>>
>>> I am not using external CEP. So I will just set Stratos IP in base.pp.
>>>
>>> After this, do I need to restart puppet master and this change will
>>> automatically reflected in a newly spawned cartridge instance (using old
>>> cartridge image) ?
>>>
>>> I hope I don't need to create a new cartridge base image
>>>
>>> Sorry for a lot of questions.
>>>
>>> Thanks,
>>> Swapnil
>>>
>>> On Fri, Jul 17, 2015 at 8:06 AM, Rajkumar Rajaratnam <rajkumarr@wso2.com
>>> > wrote:
>>>
>>>>
>>>>
>>>> On Fri, Jul 17, 2015 at 1:27 PM, Swapnil Patil <swapnil.rp15@gmail.com>
>>>> wrote:
>>>>
>>>>> Thanks Rajkumar!
>>>>>
>>>>> Do I need to set it in
>>>>> ​​
>>>>> thrift-client-config.xml file in repository/conf folder?
>>>>>
>>>>
>>>> ​If you are using external CEP, you need to specify CEP IP in ​
>>>>
>>>> ​​$STRATOS_HOME/repository/conf/thrift-client-config.xml and you need
>>>> to set the CEP IP in base.pp in your puppet master. If you are not using
>>>> external CEP, you do not need to do any changes to thrift-client-config
>>>> .xml*, *but still you need to set the CEP IP to Stratos machine IP in
>>>> base.pp in your puppet master.
>>>>
>>>> Thanks.​
>>>>
>>>>>
>>>>> Regards,
>>>>> Swapnil
>>>>>
>>>>> On Fri, Jul 17, 2015 at 7:27 AM, Rajkumar Rajaratnam <
>>>>> rajkumarr@wso2.com> wrote:
>>>>>
>>>>>> If you are not using external CEP, then yes CEP IP should be same
as
>>>>>> Stratos IP.
>>>>>>
>>>>>> On Fri, Jul 17, 2015 at 12:28 PM, Swapnil Patil <
>>>>>> swapnil.rp15@gmail.com> wrote:
>>>>>>
>>>>>>> I checked Stratos log and I did find member fault event.
>>>>>>>
>>>>>>> TID: [0] [STRATOS] [2015-07-17 06:41:32,767]  INFO
>>>>>>> {org.apache.stratos.cep.extension.FaultHandlingWindowProcessor}
-  Faulty
>>>>>>> member detected [member-id]
>>>>>>> single-cartridge-app.my-php.php.domain57018954-d22e-4b53-a4c3-2faf6da35da3
>>>>>>> with [last time-stamp] 1437115228159 [time-out] 60000 milliseconds
>>>>>>> TID: [0] [STRATOS] [2015-07-17 06:41:32,767]  INFO
>>>>>>> {org.apache.stratos.cep.extension.FaultHandlingWindowProcessor}
-
>>>>>>>  Publishing member fault event for [member-id]
>>>>>>> single-cartridge-app.my-php.php.domain57018954-d22e-4b53-a4c3-2faf6da35da3
>>>>>>>
>>>>>>> A part of cartridge agent log related to CEP is below. Should
this
>>>>>>> thrift.receiver.ip have been set to Stratos machine IP?
>>>>>>>
>>>>>>> 2015-07-17 06:44:33,144:DEBUG:Reading property:
>>>>>>> cep.stats.publisher.enabled = true
>>>>>>> 2015-07-17 06:44:33,144:INFO:CEP Publisher enabled
>>>>>>> 2015-07-17 06:44:33,144:DEBUG:Reading property: *thrift.receiver.ip
>>>>>>> = 127.0.0.1*
>>>>>>> 2015-07-17 06:44:33,144:DEBUG:Reading property: *thrift.receiver.port
>>>>>>> = 7711*
>>>>>>> 2015-07-17 06:44:33,144:DEBUG:Reading property:
>>>>>>> thrift.server.admin.username = admin
>>>>>>> 2015-07-17 06:44:33,144:DEBUG:Reading property:
>>>>>>> thrift.server.admin.password = admin
>>>>>>> 2015-07-17 06:44:33,145:DEBUG:Message received:
>>>>>>> instance/status/InstanceActivatedEvent:
>>>>>>> {
>>>>>>>     "clusterId": "single-cartridge-app.my-php.php.domain",
>>>>>>>     "clusterInstanceId": "single-cartridge-app-2",
>>>>>>>     "instanceId": null,
>>>>>>>     "memberId":
>>>>>>> "single-cartridge-app.my-php.php.domain66e0b348-205d-4492-8de1-b29db08c8bb3",
>>>>>>>     "networkPartitionId": "network-partition-1",
>>>>>>>     "partitionId": "partition-1",
>>>>>>>     "serviceName": "php"
>>>>>>> }
>>>>>>> 2015-07-17 06:44:33,145:INFO:CEP Publisher configuration initialized
>>>>>>> 2015-07-17 06:44:33,145:DEBUG:Reading property: port.check.timeout
=
>>>>>>> 600000
>>>>>>> 2015-07-17 06:44:33,146:DEBUG:Port check timeout: 600000
>>>>>>> 2015-07-17 06:44:33,146:INFO:Waiting for ports to be active:
[ip]
>>>>>>> '127.0.0.1' [ports] ['7711']
>>>>>>> 2015-07-17 06:44:33,146:DEBUG:Port '7711' is not active
>>>>>>> 2015-07-17 06:44:33,159:DEBUG:Message received:
>>>>>>> topology/MemberActivatedEvent:
>>>>>>>
>>>>>>> {"serviceName":"php","clusterId":"single-cartridge-app.my-php.php.domain","clusterInstanceId":"single-cartridge-app-2","memberId":"single-cartridge-app.my-php.php.domain66e0b348-205d-4492-8de1-b29db08c8bb3","networkPartitionId":"network-partition-1","partitionId":"partition-1","portMap":{"8280":{"protocol":"http","value":80,"proxy":8280}},"memberPrivateIPs":["172.31.17.77"],"defaultPrivateIP":"172.31.17.77","memberPublicIPs":["54.169.207.111"],"defaultPublicIP":"54.169.207.111"}
>>>>>>> 2015-07-17 06:44:33,159:DEBUG:Executing handler for event
>>>>>>> 'MemberActivatedEvent'
>>>>>>> 2015-07-17 06:44:33,159:DEBUG:Member activated event received:
>>>>>>> '{"serviceName":"php","clusterId":"single-cartridge-app.my-php.php.domain","clusterInstanceId":"single-cartridge-app-2","memberId":"single-cartridge-app.my-php.php.domain66e0b348-205d-4492-8de1-b29db08c8bb3","networkPartitionId":"network-partition-1","partitionId":"partition-1","portMap":{"8280":{"protocol":"http","value":80,"proxy":8280}},"memberPrivateIPs":["172.31.17.77"],"defaultPrivateIP":"172.31.17.77","memberPublicIPs":["54.169.207.111"],"defaultPublicIP":"54.169.207.111"}'
>>>>>>> 2015-07-17 06:44:33,160:INFO:Processing Member activated event:
>>>>>>> [service] u'php' [cluster] u'single-cartridge-app.my-php.php.domain'
>>>>>>> [member]
>>>>>>> u'single-cartridge-app.my-php.php.domain66e0b348-205d-4492-8de1-b29db08c8bb3'
>>>>>>> 2015-07-17 06:44:33,160:DEBUG:Reading property: param.file.path
=
>>>>>>> /mnt/apache-stratos-python-cartridge-agent-4.1.0-SNAPSHOT/payload/launch-params
>>>>>>> 2015-07-17 06:44:33,160:DEBUG:Executing extension for event
>>>>>>> [MemberActivatedEvent]
>>>>>>> 2015-07-17 06:44:33,160:DEBUG:Running extension for
>>>>>>> MemberActivatedEvent
>>>>>>> 2015-07-17 06:44:33,172:DEBUG:Running extension for
>>>>>>> MemberActivatedEvent
>>>>>>> 2015-07-17 06:44:33,185:DEBUG:Message received:
>>>>>>> topology/ClusterInstanceActivatedEvent:
>>>>>>>
>>>>>>> {"serviceName":"php","clusterId":"single-cartridge-app.my-php.php.domain","appId":"single-cartridge-app","instanceId":"single-cartridge-app-2"}
>>>>>>> 2015-07-17 06:44:33,228:INFO:MemberActivatedEvent Extension
>>>>>>> executed. [output]: Fri Jul 17 06:44:33 UTC 2015: Member Activated
Event:
>>>>>>> MEMBER_ID:
>>>>>>> single-cartridge-app.my-php.php.domain66e0b348-205d-4492-8de1-b29db08c8bb3,
>>>>>>> MEMBER_IP: , CLUSTER_ID: single-cartridge-app.my-php.php.domain,
>>>>>>> LB_CLUSTER_ID: , NETWORK_PARTITION_ID: network-partition-1, SERVICE_NAME:
>>>>>>> php, PORTS: 80, STRATOS_LB_IP: , STRATOS_LB_PUBLIC_IP: , APPLICATION_PATH:
>>>>>>> , STRATOS_PARAM_FILE_PATH:
>>>>>>> /mnt/apache-stratos-python-cartridge-agent-4.1.0-SNAPSHOT/payload/launch-params
>>>>>>> Member List:
>>>>>>> Topology:
>>>>>>> ---------------
>>>>>>>
>>>>>>> 2015-07-17 06:44:33,233:INFO:MemberActivatedEvent Extension
>>>>>>> executed. [output]: Fri Jul 17 06:44:33 UTC 2015: Member Activated
Event:
>>>>>>> MEMBER_ID:
>>>>>>> single-cartridge-app.my-php.php.domain66e0b348-205d-4492-8de1-b29db08c8bb3,
>>>>>>> MEMBER_IP: , CLUSTER_ID: single-cartridge-app.my-php.php.domain,
>>>>>>> LB_CLUSTER_ID: , NETWORK_PARTITION_ID: network-partition-1, SERVICE_NAME:
>>>>>>> php, PORTS: 80, STRATOS_LB_IP: , STRATOS_LB_PUBLIC_IP: , APPLICATION_PATH:
>>>>>>> , STRATOS_PARAM_FILE_PATH:
>>>>>>> /mnt/apache-stratos-python-cartridge-agent-4.1.0-SNAPSHOT/payload/launch-params
>>>>>>> Member List:
>>>>>>> Topology:
>>>>>>> ---------------
>>>>>>>
>>>>>>> 2015-07-17 06:44:33,234:DEBUG:No plugins registered for event
>>>>>>> MemberActivatedEvent
>>>>>>> 2015-07-17 06:44:33,234:DEBUG:Event handler not found for event
:
>>>>>>> 'ClusterInstanceActivatedEvent'
>>>>>>> 2015-07-17 06:44:38,151:INFO:Waiting for ports to be active:
[ip]
>>>>>>> '127.0.0.1' [ports] ['7711']
>>>>>>> 2015-07-17 06:44:38,155:DEBUG:Port '7711' is not active
>>>>>>> 2015-07-17 06:44:43,159:INFO:Waiting for ports to be active:
[ip]
>>>>>>> '127.0.0.1' [ports] ['7711']
>>>>>>> 2015-07-17 06:44:43,160:DEBUG:Port '7711' is not active
>>>>>>> 2015-07-17 06:44:48,163:INFO:Waiting for ports to be active:
[ip]
>>>>>>> '127.0.0.1' [ports] ['7711']
>>>>>>> 2015-07-17 06:44:48,164:DEBUG:Port '7711' is not active
>>>>>>> 2015-07-17 06:44:53,169:INFO:Waiting for ports to be active:
[ip]
>>>>>>> '127.0.0.1' [ports] ['7711']
>>>>>>> 2015-07-17 06:44:53,170:DEBUG:Port '7711' is not active
>>>>>>> 2015-07-17 06:44:58,175:INFO:Waiting for ports to be active:
[ip]
>>>>>>> '127.0.0.1' [ports] ['7711']
>>>>>>> 2015-07-17 06:44:58,175:DEBUG:Port '7711' is not active
>>>>>>> 2015-07-17 06:45:03,181:INFO:Waiting for ports to be active:
[ip]
>>>>>>> '127.0.0.1' [ports] ['7711']
>>>>>>> 2015-07-17 06:45:03,181:DEBUG:Port '7711' is not active
>>>>>>> 2015-07-17 06:45:08,187:INFO:Waiting for ports to be active:
[ip]
>>>>>>> '127.0.0.1' [ports] ['7711']
>>>>>>> 2015-07-17 06:45:08,188:DEBUG:Port '7711' is not active
>>>>>>> 2015-07-17 06:45:13,202:INFO:Waiting for ports to be active:
[ip]
>>>>>>> '127.0.0.1' [ports] ['7711']
>>>>>>> 2015-07-17 06:45:13,202:DEBUG:Port '7711' is not active
>>>>>>>
>>>>>>>
>>>>>>> Thanks and Regards,
>>>>>>> Swapnil
>>>>>>>
>>>>>>>
>>>>>>> On Fri, Jul 17, 2015 at 6:08 AM, Swapnil Patil <
>>>>>>> swapnil.rp15@gmail.com> wrote:
>>>>>>>
>>>>>>>> Thanks Rajkumar for the suggestion!
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Swapnil
>>>>>>>>
>>>>>>>> On Fri, Jul 17, 2015 at 6:05 AM, Rajkumar Rajaratnam <
>>>>>>>> rajkumarr@wso2.com> wrote:
>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Fri, Jul 17, 2015 at 11:31 AM, Swapnil Patil <
>>>>>>>>> swapnil.rp15@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Thanks Akila and Udara!
>>>>>>>>>>
>>>>>>>>>> I will check Stratos logs.
>>>>>>>>>>
>>>>>>>>>> I need to be very quick to check cartridge agent
log because I
>>>>>>>>>> cannot restart the instance once it gets terminated.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ​You can shutdown the stratos once the instance is
activated -
>>>>>>>>> then the instance will not be terminated.
>>>>>>>>>
>>>>>>>>> Thanks.​
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Thanks and Regards,
>>>>>>>>>> Swapnil
>>>>>>>>>>
>>>>>>>>>> On Fri, Jul 17, 2015 at 5:51 AM, Udara Liyanage <udara@wso2.com>
>>>>>>>>>> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Swapnil,
>>>>>>>>>>>
>>>>>>>>>>> You might get a clue if you have a look at cartridge
agent's log
>>>>>>>>>>> file.
>>>>>>>>>>> Could you please check your Stratos logs to see
if there is a
>>>>>>>>>>> member fault event after the member activated.
>>>>>>>>>>>
>>>>>>>>>>> On Fri, Jul 17, 2015 at 11:14 AM, Akila Ravihansa
Perera <
>>>>>>>>>>> ravihansa@wso2.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> This is probably because instances that were
spawned got
>>>>>>>>>>>> activated but failed to publish health stats
to CEP. Check whether CEP IP
>>>>>>>>>>>> and port are correctly set in the cartridge
definition. Did you check
>>>>>>>>>>>> Stratos logs for possible causes?
>>>>>>>>>>>>
>>>>>>>>>>>> On Fri, Jul 17, 2015 at 10:42 AM, Swapnil
Patil <
>>>>>>>>>>>> swapnil.rp15@gmail.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi All,
>>>>>>>>>>>>>
>>>>>>>>>>>>> I am testing the AWS load balancer extension
using sample ec2
>>>>>>>>>>>>> scripts.
>>>>>>>>>>>>>
>>>>>>>>>>>>> I am using simple application scripts
for deployment.
>>>>>>>>>>>>> Application gets deployed successfully
but the instance that got created
>>>>>>>>>>>>> gets terminated immediately (in around
2 minutes) and a new one is started.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Just wondering if this is the expected
behaviour? If yes can I
>>>>>>>>>>>>> increase the time after which the instance
will be terminated?
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thanks and Regards,
>>>>>>>>>>>>> Swapnil
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Akila Ravihansa Perera
>>>>>>>>>>>> Software Engineer, WSO2
>>>>>>>>>>>>
>>>>>>>>>>>> Blog: http://ravihansa3000.blogspot.com
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>>
>>>>>>>>>>> Udara Liyanage
>>>>>>>>>>> Software Engineer
>>>>>>>>>>> WSO2, Inc.: http://wso2.com
>>>>>>>>>>> lean. enterprise. middleware
>>>>>>>>>>>
>>>>>>>>>>> web: http://udaraliyanage.wordpress.com
>>>>>>>>>>> phone: +94 71 443 6897
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Rajkumar Rajaratnam
>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>> Software Engineer, WSO2
>>>>>>>>>
>>>>>>>>> Mobile : +94777568639
>>>>>>>>> Blog : rajkumarr.com
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Rajkumar Rajaratnam
>>>>>> Committer & PMC Member, Apache Stratos
>>>>>> Software Engineer, WSO2
>>>>>>
>>>>>> Mobile : +94777568639
>>>>>> Blog : rajkumarr.com
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Rajkumar Rajaratnam
>>>> Committer & PMC Member, Apache Stratos
>>>> Software Engineer, WSO2
>>>>
>>>> Mobile : +94777568639
>>>> Blog : rajkumarr.com
>>>>
>>>
>>>
>>
>>
>> --
>> Rajkumar Rajaratnam
>> Committer & PMC Member, Apache Stratos
>> Software Engineer, WSO2
>>
>> Mobile : +94777568639
>> Blog : rajkumarr.com
>>
>
>

Mime
View raw message