Mailing-List: contact users-help@qpid.apache.org; run by ezmlm
Precedence: bulk
Reply-To: users@qpid.apache.org
Received-SPF: pass (athena.apache.org: domain of
 philharveyonline@googlemail.com designates 209.85.212.42 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CANGgF+8LVH8jsZ02wABCfRM5tDyGMAKsov0JdWM8tOLEQ9Higg@mail.gmail.com>
References: 
 <CANGgF+8LVH8jsZ02wABCfRM5tDyGMAKsov0JdWM8tOLEQ9Higg@mail.gmail.com>
Date: Wed, 5 Sep 2012 22:33:50 +0100
Message-ID: 
 <CAG44Fj3TDNgVZpGijT+CZpGLyLLgtqDUbJKWK6Lf55b7247jAQ@mail.gmail.com>
Subject: Re: Looking for feedback on a design, based on Qpid
From: Phil Harvey <philharveyonline@googlemail.com>
To: users@qpid.apache.org
Content-Type: multipart/alternative; boundary=20cf30780b1e7043bb04c8fb21d6

--20cf30780b1e7043bb04c8fb21d6
Content-Type: text/plain; charset=ISO-8859-1

Hi Sajith,

Apart from the fact that you have ~1000 nodes, what other non-functional
requirements do you have?  For example:

- What is the acceptable time lag between the application being deployed
and a node receiving notification?
- What frequency of application deployments do you expect?
- Which of the following notification semantics do you require:
exactly-once / at-least-once / at-most-once ?
- Do you need to handle message "conflation" addressed by last-value queues
(https://cwiki.apache.org/qpid/use-last-value-queues-lvq.html)?
- How are your nodes distributed, e.g. is each nodes a separate process?

On the technical side, have you already made any decisions?  For example:

- Are you planning to use the Java or C++ Qpid broker?
- What platform/language do your nodes use?

Most of my experience with the Java broker, which dedicates a thread to
each connection.  I don't expect a few thousand connections would cause
problems but I believe others on this list have more experience of testing
the broker's upper limits.


Phil


On 5 September 2012 21:41, Sajith Kariyawasam <sajhak@gmail.com> wrote:

> Hi all,
>
> This time its more like a design/architectural query I have to make, that
> it, we are going to implement a notifier functionality in our app
> deployment.
>
> when an application is deployed to the central server it needs to notify a
> collection of nodes that an application is uploaded/updated.
>
> There can be thousands of nodes of different types based on the type of
> application they are interested about.
>
> Here, node is the receiver and what is the best way to implement
> receiver functionality?
>     1. Should we make each and every node continuously listening to a queue
> of his type of application ?
>     2. Should the node make a call to a queue periodically and check
> whether any messages are there?
>
> In 1 advantage is that, the moment application gets uploaded relevent nodes
> gets the notification, but concerns about the performance.
>
> If solution 1 is followed, there will be thousands of active connections to
> the broker, is that manageable ? How many number of active connections Qpid
> broker can handle at large ?
>
> --
> Best Regards
> Sajith
>

--20cf30780b1e7043bb04c8fb21d6--