Return-Path: X-Original-To: apmail-camel-dev-archive@www.apache.org Delivered-To: apmail-camel-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 90CB7D0AC for ; Fri, 31 Aug 2012 07:17:13 +0000 (UTC) Received: (qmail 57308 invoked by uid 500); 31 Aug 2012 07:17:13 -0000 Delivered-To: apmail-camel-dev-archive@camel.apache.org Received: (qmail 56876 invoked by uid 500); 31 Aug 2012 07:17:05 -0000 Mailing-List: contact dev-help@camel.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@camel.apache.org Delivered-To: mailing list dev@camel.apache.org Received: (qmail 56814 invoked by uid 99); 31 Aug 2012 07:17:03 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 31 Aug 2012 07:17:03 +0000 X-ASF-Spam-Status: No, hits=2.0 required=5.0 tests=SPF_NEUTRAL,URI_HEX X-Spam-Check-By: apache.org Received-SPF: neutral (nike.apache.org: 216.139.236.26 is neither permitted nor denied by domain of asankha.public@gmail.com) Received: from [216.139.236.26] (HELO sam.nabble.com) (216.139.236.26) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 31 Aug 2012 07:16:57 +0000 Received: from [192.168.236.26] (helo=sam.nabble.com) by sam.nabble.com with esmtp (Exim 4.72) (envelope-from ) id 1T7LT2-0002LM-Mo for dev@camel.apache.org; Fri, 31 Aug 2012 00:16:36 -0700 Date: Fri, 31 Aug 2012 00:16:36 -0700 (PDT) From: asankha To: dev@camel.apache.org Message-ID: <1346397396700-5718459.post@n5.nabble.com> In-Reply-To: References: Subject: Re: ESB Performance Testing - Round 6 MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Hi Christian, Dan and Claus >And the fact that they use SMX 4.3.0 which is an old release (4.3.0/03-Mar-2011 13:25) >Since SMX 4.4.0, 4.4.1, and 4.4.2 has been released. First of all I must apologize for this.. But I visited the ServiceMix http://servicemix.apache.org/download.html download page just now, and it still tells me "The latest release is the ServiceMix 4.3.0 Release. We strongly encourage all users to use this Release" - so I'm sure something needs to be corrected somewhere.. We would really like to work with you all to define how the test suite should be extended - like Dan said, we made some enhancements this round, and expect to bring in JSON/REST test cases. Other transports such as File/JMS etc would be more difficult to test - especially for performance - but if you could propose clever ways of doing it, we'd certainly like to include them. The only reason we do not test large messages for all scenarios, and large numbers of messages for high concurrency levels etc, is just to make the total test run within a decent time across all ESBs As for the updates submitted by Christian, we will run them ASAP - and get back to you. This was our original objective as well when we http://www.prweb.com/releases/2012/6/prweb9651239.htm announced Round 6 and asked for updates from any vendors or contributors, and a chance to optimize and fine tune the configurations before the final tests were run We did work cooperatively with those who replied to us, and wanted to ensure a fair benchmark that was also transparent - thus we accepted almost all of the suggestions and enhancements that came in - and I'm sure participating in the round helped those ESBs find out some areas where they could improve as well, which is good. Again, I'd like to commit that we'd like to cooperate with you on this, and work together - to make a better, fair and transparent benchmark for ESBs! regards asankha AdroitLogic Private Ltd http://www.adroitlogic.org -- View this message in context: http://camel.465427.n5.nabble.com/ESB-Performance-Testing-Round-6-tp5718215p5718459.html Sent from the Camel Development mailing list archive at Nabble.com.