Return-Path: Delivered-To: apmail-openjpa-users-archive@minotaur.apache.org Received: (qmail 32033 invoked from network); 11 Nov 2010 02:16:05 -0000 Received: from unknown (HELO mail.apache.org) (140.211.11.3) by 140.211.11.9 with SMTP; 11 Nov 2010 02:16:05 -0000 Received: (qmail 80220 invoked by uid 500); 11 Nov 2010 02:16:36 -0000 Delivered-To: apmail-openjpa-users-archive@openjpa.apache.org Received: (qmail 80193 invoked by uid 500); 11 Nov 2010 02:16:36 -0000 Mailing-List: contact users-help@openjpa.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: users@openjpa.apache.org Delivered-To: mailing list users@openjpa.apache.org Received: (qmail 80183 invoked by uid 99); 11 Nov 2010 02:16:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Nov 2010 02:16:36 +0000 X-ASF-Spam-Status: No, hits=2.0 required=10.0 tests=SPF_HELO_PASS,SPF_NEUTRAL,URI_HEX X-Spam-Check-By: apache.org Received-SPF: neutral (athena.apache.org: 216.139.236.158 is neither permitted nor denied by domain of kirsh@objectdb.com) Received: from [216.139.236.158] (HELO kuber.nabble.com) (216.139.236.158) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 11 Nov 2010 02:16:31 +0000 Received: from jim.nabble.com ([192.168.236.80]) by kuber.nabble.com with esmtp (Exim 4.63) (envelope-from ) id 1PGMhu-0005mz-28 for users@openjpa.apache.org; Wed, 10 Nov 2010 18:16:10 -0800 Date: Wed, 10 Nov 2010 18:16:10 -0800 (PST) From: Ilan Kirsh To: users@openjpa.apache.org Message-ID: <1289441770028-5727348.post@n2.nabble.com> In-Reply-To: References: <1288606493590-5693298.post@n2.nabble.com> <1288801456667-5702044.post@n2.nabble.com> <1289161933725-5715056.post@n2.nabble.com> <1289224638694-5716932.post@n2.nabble.com> <1289245977375-5718395.post@n2.nabble.com> <4CD8636E.7010108@oles.biz> <1289376291736-5723794.post@n2.nabble.com> Subject: Re: JPAB results MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Hi Mike, Automatic schema generation is used by all the tested JPA implementations - in order to simplify the benchmark. I agree, however, that it should be excluded from time measurement because it is not a real factor in production. I will try to explain what I did and I will be glad to get your opinion. The time of every test run is divided into 2 phases. The first phase is always excluded from time measurement. Only the performance in the second phase is taken into account. This way, initialization operations including class loading, enhancement by the Java Agent enhancer, JIT compilation, JVM tuning (inlining and other optimizations) and schema generation - are all excluded from time measurement. Connecting to the database (invocation of createEntityManager) is also completed before starting to measure time to avoid the influence of connection pools. Given the above, do you still think that the SynchronizeMappings property might affect the results. If so, how? If necessary I may generate 2 persistence units for every test (per ORM/DBMS) - one for initialization (including schema generation) and the other for the time measurement. But I want to keep the benchmark simple as possible, so I will do that only if it is really necessary. Best regards, Ilan -- View this message in context: http://openjpa.208410.n2.nabble.com/JPAB-results-tp5693298p5727348.html Sent from the OpenJPA Users mailing list archive at Nabble.com.