stratos-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gayan Gunarathne <gay...@wso2.com>
Subject Re: Stratos Python Cartridge Agent
Date Thu, 28 Aug 2014 08:51:51 GMT
For windows also they have included the building procedure in their read-me
file.

Thanks,
Gayan


On Thu, Aug 28, 2014 at 2:17 PM, Gayan Gunarathne <gayang@wso2.com> wrote:

> Yeah Chris.It is the command set for the fedora as mention in their
> read-me file.
>
> For Ubuntu we can use the following command sets.
>
> # required dependencies
> sudo apt-get install gcc cmake uuid-dev
>
> # dependencies needed for ssl support
> sudo apt-get install libssl-dev
>
> # dependencies needed for bindings
> sudo apt-get install swig python-dev ruby-dev php5-dev libperl-dev
>
> sudo apt-get install oracle-java8-installer
>
> sudo apt-get install python-epydoc
>
> Thanks,
> Gayan
>
>
>
>
>
> On Thu, Aug 28, 2014 at 12:53 PM, chris snow <chsnow123@gmail.com> wrote:
>
>> On Wed, Aug 27, 2014 at 6:26 AM, Gayan Gunarathne <gayang@wso2.com>
>> wrote:
>> > Hi Akila,
>> >
>> > When we tried with the Apache Qpid Proton-C library we did the following
>> > prerequisites.
>> >
>> >     # required dependencies
>> >     yum install gcc cmake libuuid-devel
>> >
>> >     # dependencies needed for ssl support
>> >     yum install openssl-devel
>> >
>> >     # dependencies needed for bindings
>> >     yum install swig python-devel ruby-devel php-devel perl-devel
>> >
>> >     yum install java-1.8.0-openjdk-devel
>> >
>> >     yum install epydoc
>> >
>> >
>> > After that only we were able to build in the Ubuntu and run the python
>> > client with proton support.I guess for every platform we need to do the
>> same
>> > and have to maintain different settings for different platform.WDYT?
>> >
>> Did you mean to say Ubuntu here? The commands above aren't for Ubuntu.
>> >
>> > When it comes to the large number of instance, we need to do load
>> testing
>> > with the STOMP protocol.Thanks for pointing out this.
>> >
>> >
>> >
>> > Thanks,
>> >
>> > Gayan
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > On Wed, Aug 27, 2014 at 10:33 AM, Akila Ravihansa Perera
>> > <ravihansa@wso2.com> wrote:
>> >>
>> >> Hi Gayan,
>> >>
>> >> What are the concerns/blockers for using Apache Qpid Proton-C library
>> >> [1] with Python binding?
>> >>
>> >> As I understood, this is cross-platform compatible (Linux/Windows) and
>> >> you do not need Java. However, there is a pure Java implementation but
>> >> we can use C/Python binding. We will have to investigate this further
>> >> though.
>> >>
>> >> Have we made an analysis of using STOMP vs AMQP as the communication
>> >> protocol with MB for cartridge agent? We might have to consider this
>> >> because with the upcoming Docker support there can be about 1000+
>> >> instances communicating with the MB.
>> >>
>> >> [1] https://github.com/apache/qpid-proton
>> >>
>> >> On Tue, Aug 26, 2014 at 4:28 PM, Gayan Gunarathne <gayang@wso2.com>
>> wrote:
>> >> > Hi Chris,
>> >> >
>> >> > Thanks for adding the JIRA for ActiveMQ. Yeah It will be a worth
>> >> > addition.
>> >> >
>> >> >
>> >> > Thanks,
>> >> > Gayan
>> >> >
>> >> >
>> >> > On Tue, Aug 26, 2014 at 4:14 PM, chris snow <chsnow123@gmail.com>
>> wrote:
>> >> >>
>> >> >> I guess the agent will need to be configurable to support STOMP
for
>> >> >> ActiveMQ installations or AMQP for WSO2MB installations.
>> >> >>
>> >> >> Also, I raised this JIRA:
>> >> >> https://issues.apache.org/jira/browse/AMQ-5332 - it won't happen
in
>> >> >> our timescales, but I thought it was worth adding as it seems a
lot
>> of
>> >> >> people hit issues with ActiveMQ only supporting AMQP 1.0.
>> >> >>
>> >> >>
>> >> >> On Tue, Aug 26, 2014 at 8:22 AM, Gayan Gunarathne <gayang@wso2.com>
>> >> >> wrote:
>> >> >> > Yeah Chris.
>> >> >> >
>> >> >> > Exactly the problem we have.Currently lot of python amqp agents
>> for
>> >> >> > RabbitMQ
>> >> >> > which supports AMQP 0-9.[1].
>> >> >> >
>> >> >> > [1] https://www.rabbitmq.com/specification.html
>> >> >> >
>> >> >> > Thanks,
>> >> >> > Gayan
>> >> >> >
>> >> >> >
>> >> >> >
>> >> >> >
>> >> >> > On Tue, Aug 26, 2014 at 12:25 PM, chris snow <chsnow123@gmail.com
>> >
>> >> >> > wrote:
>> >> >> >>
>> >> >> >> Thanks Gayan!
>> >> >> >>
>> >> >> >> What errors were you hitting?  The few clients I tried
give me
>> the
>> >> >> >> error
>> >> >> >> [1].
>> >> >> >>
>> >> >> >> It seems some of f the python amqp libraries don't support
>> version
>> >> >> >> 1.0
>> >> >> >> of
>> >> >> >> AMQP?
>> >> >> >>
>> >> >> >> ---
>> >> >> >> [1]
>> >> >> >>
>> >> >> >>
>> >> >> >>
>> http://activemq.2283324.n4.nabble.com/AMQP-version-AMQP-header-mismatch-value-0-expecting-1-td4663920.html
>> >> >> >>
>> >> >> >> On Tue, Aug 26, 2014 at 6:03 AM, Gayan Gunarathne <
>> gayang@wso2.com>
>> >> >> >> wrote:
>> >> >> >> > Hi Chirs,
>> >> >> >> >
>> >> >> >> > Please find the python client library samples which
we are
>> tested.
>> >> >> >> > https://github.com/gayangunarathne/amqp_python_libraries
>> >> >> >> >
>> >> >> >> > Thanks,
>> >> >> >> > Gayan
>> >> >> >> >
>> >> >> >> >
>> >> >> >> > On Tue, Aug 26, 2014 at 9:56 AM, Gayan Gunarathne
>> >> >> >> > <gayang@wso2.com>
>> >> >> >> > wrote:
>> >> >> >> >>
>> >> >> >> >> Hi Chris,
>> >> >> >> >>
>> >> >> >> >> Yeah. We looked that qpid messaging as well.For
that we need
>> that
>> >> >> >> >> qpid
>> >> >> >> >> proton library .Is n't?
>> >> >> >> >> AFAIR it is based on CMake and It requires java
also[1].
>> >> >> >> >>
>> >> >> >> >> Also we will share with you the samples we try
with the amqp
>> >> >> >> >> clients.
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >> >> [1]http://svn.apache.org/repos/asf/qpid/proton/trunk/README
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >> >> Thanks,
>> >> >> >> >> Gayan
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >> >> On Mon, Aug 25, 2014 at 7:33 PM, chris snow <
>> chsnow123@gmail.com>
>> >> >> >> >> wrote:
>> >> >> >> >>>
>> >> >> >> >>> hi Gayan,
>> >> >> >> >>>
>> >> >> >> >>> What are the issues that you received from
the various AMQP
>> >> >> >> >>> libraries?
>> >> >> >> >>> Do you have a code repo that I can take a
look at to try and
>> >> >> >> >>> replicate
>> >> >> >> >>> the errors?
>> >> >> >> >>> Did you investigate qpid [1]?
>> >> >> >> >>>
>> >> >> >> >>> Many thanks
>> >> >> >> >>>
>> >> >> >> >>> Chris
>> >> >> >> >>>
>> >> >> >> >>> ---
>> >> >> >> >>> [1]
>> >> >> >> >>>
>> >> >> >> >>>
>> >> >> >> >>>
>> >> >> >> >>>
>> http://qpid.apache.org/releases/qpid-0.28/messaging-api/python/examples/hello.html
>> >> >> >> >>>
>> >> >> >> >>> On Mon, Aug 25, 2014 at 2:16 PM, Gayan Gunarathne
>> >> >> >> >>> <gayang@wso2.com>
>> >> >> >> >>> wrote:
>> >> >> >> >>> > Hi Chris,
>> >> >> >> >>> >
>> >> >> >> >>> > We try to replace our java cartridge
agent with the python
>> as
>> >> >> >> >>> > after
>> >> >> >> >>> > that we
>> >> >> >> >>> > can remove the java dependency from
the cartridge itself.I
>> >> >> >> >>> > guess
>> >> >> >> >>> > this
>> >> >> >> >>> > is
>> >> >> >> >>> > also vital for the Docker support too.
>> >> >> >> >>> >
>> >> >> >> >>> > In Apache ActiveMQ site also AMQP support
is based on the
>> >> >> >> >>> > JMS/AMQP[1].
>> >> >> >> >>> > I
>> >> >> >> >>> > guess message broker implementation
will be different from
>> one
>> >> >> >> >>> > MQ
>> >> >> >> >>> > to
>> >> >> >> >>> > other
>> >> >> >> >>> > as some python client which able to
connect with RabbitMQ
>> >> >> >> >>> > successfully
>> >> >> >> >>> > ,still fails with the ActiveMQ.
>> >> >> >> >>> >
>> >> >> >> >>> > [1] http://activemq.apache.org/amqp.html
>> >> >> >> >>> >
>> >> >> >> >>> > Thanks,
>> >> >> >> >>> > Gayan
>> >> >> >> >>> >
>> >> >> >> >>> >
>> >> >> >> >>> > On Mon, Aug 25, 2014 at 5:55 PM, chris
snow
>> >> >> >> >>> > <chsnow123@gmail.com>
>> >> >> >> >>> > wrote:
>> >> >> >> >>> >>
>> >> >> >> >>> >> Is the issue because we currently
have a mix of
>> >> >> >> >>> >> JMS/AMQP/Jndi?
>> >> >> >> >>> >> If
>> >> >> >> >>> >> we
>> >> >> >> >>> >> had a
>> >> >> >> >>> >> pure AMQP approach would these problems
go away?  AFAIK,
>> one
>> >> >> >> >>> >> of
>> >> >> >> >>> >> the
>> >> >> >> >>> >> drivers
>> >> >> >> >>> >> for AMQP was interoperability with
all languages, rather
>> than
>> >> >> >> >>> >> jms
>> >> >> >> >>> >> which is
>> >> >> >> >>> >> focused on Java.
>> >> >> >> >>> >>
>> >> >> >> >>> >> On 25 Aug 2014 12:49, "Gayan Gunarathne"
<gayang@wso2.com
>> >
>> >> >> >> >>> >> wrote:
>> >> >> >> >>> >>>
>> >> >> >> >>> >>> Hi All,
>> >> >> >> >>> >>>
>> >> >> >> >>> >>> With related to the python cartridge
agent , Dinesh and
>> >> >> >> >>> >>> myself
>> >> >> >> >>> >>> do
>> >> >> >> >>> >>> some
>> >> >> >> >>> >>> research related to the Apache
ActiveMQ connectivity
>> using
>> >> >> >> >>> >>> the
>> >> >> >> >>> >>> python
>> >> >> >> >>> >>> client.
>> >> >> >> >>> >>>
>> >> >> >> >>> >>> Following our findings on this.
>> >> >> >> >>> >>>
>> >> >> >> >>> >>> AMQP
>> >> >> >> >>> >>>
>> >> >> >> >>> >>> AFAWU we need to have  pyactivemq
, which is a Python
>> >> >> >> >>> >>> wrapper
>> >> >> >> >>> >>> for
>> >> >> >> >>> >>> the
>> >> >> >> >>> >>> ActiveMQ C++ Library,[1] But
we won't be able to use this
>> >> >> >> >>> >>> module
>> >> >> >> >>> >>> as
>> >> >> >> >>> >>> it is
>> >> >> >> >>> >>> platform dependent.
>> >> >> >> >>> >>> Also we checked the following
client libraries as
>> well(those
>> >> >> >> >>> >>> are
>> >> >> >> >>> >>> recommended with the RabbitMQ)
>> >> >> >> >>> >>> [3] py-amqplib
>> >> >> >> >>> >>> [4] txAMQP
>> >> >> >> >>> >>> [5] pika
>> >> >> >> >>> >>> [6] Carrot (has copy right licence)
>> >> >> >> >>> >>>
>> >> >> >> >>> >>> But we were unable to connect
Apache ActiveMQ with those
>> as
>> >> >> >> >>> >>> well.(Even
>> >> >> >> >>> >>> through we can connect those
with the RabbitMQ)
>> >> >> >> >>> >>>
>> >> >> >> >>> >>> STOMP[2]
>> >> >> >> >>> >>>
>> >> >> >> >>> >>> With the STOMP protocol , We
were able to connect Apache
>> >> >> >> >>> >>> ActiveMQ
>> >> >> >> >>> >>> by
>> >> >> >> >>> >>> using the stomp module.[7]
>> >> >> >> >>> >>>
>> >> >> >> >>> >>>
>> >> >> >> >>> >>> As a summary,
>> >> >> >> >>> >>> It seems like we need to use
STOMP to connect ActiveMQ.
>> But
>> >> >> >> >>> >>> still,
>> >> >> >> >>> >>> WSO2
>> >> >> >> >>> >>> message broker is not supporting
STOMP protocol.
>> >> >> >> >>> >>> IMO Shall we used the hybrid
model for connect to the
>> >> >> >> >>> >>> message
>> >> >> >> >>> >>> queues.
>> >> >> >> >>> >>> Such that , we can use STOMP
to connect the ActiveMQ and
>> >> >> >> >>> >>> AMQP
>> >> >> >> >>> >>> to
>> >> >> >> >>> >>> connect
>> >> >> >> >>> >>> WSO2 MB. WDYT?
>> >> >> >> >>> >>> With txAMQP[4] we were able
to connect WSO2 MB using the
>> >> >> >> >>> >>> qpid
>> >> >> >> >>> >>> amqp
>> >> >> >> >>> >>> specifications.
>> >> >> >> >>> >>> Please share your suggestions
and thoughts on this.
>> >> >> >> >>> >>>
>> >> >> >> >>> >>>
>> >> >> >> >>> >>> [1] http://activemq.apache.org/python.html
>> >> >> >> >>> >>> [2] http://activemq.apache.org/stomp.html
>> >> >> >> >>> >>> [3] http://barryp.org/software/py-amqplib/
>> >> >> >> >>> >>> [4] https://launchpad.net/txamqp
>> >> >> >> >>> >>> [5] https://github.com/pika/pika
>> >> >> >> >>> >>> [6] https://pypi.python.org/pypi/carrot/
>> >> >> >> >>> >>> [7] https://github.com/jasonrbriggs/stomp.py
>> >> >> >> >>> >>>
>> >> >> >> >>> >>> @Dinesh , Please add If I missed
anything here.
>> >> >> >> >>> >>>
>> >> >> >> >>> >>>
>> >> >> >> >>> >>>
>> >> >> >> >>> >>> Thanks,
>> >> >> >> >>> >>> Gayan
>> >> >> >> >>> >>>
>> >> >> >> >>> >>>
>> >> >> >> >>> >>> --
>> >> >> >> >>> >>>
>> >> >> >> >>> >>>
>> >> >> >> >>> >>> Gayan Gunarathne
>> >> >> >> >>> >>> Technical Lead
>> >> >> >> >>> >>> WSO2 Inc. (http://wso2.com)
>> >> >> >> >>> >>> email  : gayang@wso2.com  |
mobile : +94 766819985
>> >> >> >> >>> >>>
>> >> >> >> >>> >
>> >> >> >> >>> >
>> >> >> >> >>> >
>> >> >> >> >>> >
>> >> >> >> >>> > --
>> >> >> >> >>> > Best Regards,
>> >> >> >> >>> >
>> >> >> >> >>> > Gayan Gunarathne
>> >> >> >> >>> > Technical Lead
>> >> >> >> >>> > WSO2 Inc. (http://wso2.com)
>> >> >> >> >>> > email  : gayang@wso2.com  | mobile :
+94 766819985
>> >> >> >> >>> >
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >> >>
>> >> >> >> >> --
>> >> >> >> >> Best Regards,
>> >> >> >> >>
>> >> >> >> >> Gayan Gunarathne
>> >> >> >> >> Technical Lead
>> >> >> >> >> WSO2 Inc. (http://wso2.com)
>> >> >> >> >> email  : gayang@wso2.com  | mobile : +94 766819985
>> >> >> >> >>
>> >> >> >> >
>> >> >> >> >
>> >> >> >> >
>> >> >> >> >
>> >> >> >> > --
>> >> >> >> > Best Regards,
>> >> >> >> >
>> >> >> >> > Gayan Gunarathne
>> >> >> >> > Technical Lead
>> >> >> >> > WSO2 Inc. (http://wso2.com)
>> >> >> >> > email  : gayang@wso2.com  | mobile : +94 766819985
>> >> >> >> >
>> >> >> >
>> >> >> >
>> >> >> >
>> >> >> >
>> >> >> > --
>> >> >> > Best Regards,
>> >> >> >
>> >> >> > Gayan Gunarathne
>> >> >> > Technical Lead
>> >> >> > WSO2 Inc. (http://wso2.com)
>> >> >> > email  : gayang@wso2.com  | mobile : +94 766819985
>> >> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > Best Regards,
>> >> >
>> >> > Gayan Gunarathne
>> >> > Technical Lead
>> >> > WSO2 Inc. (http://wso2.com)
>> >> > email  : gayang@wso2.com  | mobile : +94 766819985
>> >> >
>> >>
>> >>
>> >>
>> >> --
>> >> Akila Ravihansa Perera
>> >> WSO2 Inc
>> >>
>> >> Blog: http://ravihansa3000.blogspot.com
>> >
>> >
>> >
>> >
>> > --
>> > Best Regards,
>> >
>> > Gayan Gunarathne
>> > Technical Lead
>> > WSO2 Inc. (http://wso2.com)
>> > email  : gayang@wso2.com  | mobile : +94 766819985
>> >
>>
>
>
>
> --
> Best Regards,
>
> Gayan Gunarathne
> Technical Lead
> WSO2 Inc. (http://wso2.com)
> email  : gayang@wso2.com  | mobile : +94 766819985
>
>



-- 
Best Regards,

Gayan Gunarathne
Technical Lead
WSO2 Inc. (http://wso2.com)
email  : gayang@wso2.com  | mobile : +94 766819985

Mime
View raw message