Return-Path: X-Original-To: apmail-jackrabbit-oak-dev-archive@minotaur.apache.org Delivered-To: apmail-jackrabbit-oak-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BA14E10B68 for ; Tue, 22 Oct 2013 17:34:23 +0000 (UTC) Received: (qmail 50984 invoked by uid 500); 22 Oct 2013 17:34:23 -0000 Delivered-To: apmail-jackrabbit-oak-dev-archive@jackrabbit.apache.org Received: (qmail 50816 invoked by uid 500); 22 Oct 2013 17:34:19 -0000 Mailing-List: contact oak-dev-help@jackrabbit.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: oak-dev@jackrabbit.apache.org Delivered-To: mailing list oak-dev@jackrabbit.apache.org Received: (qmail 50454 invoked by uid 99); 22 Oct 2013 17:34:16 -0000 Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Oct 2013 17:34:16 +0000 Received: from localhost (HELO mail-ie0-f175.google.com) (127.0.0.1) (smtp-auth username tripod, mechanism plain) by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Tue, 22 Oct 2013 17:34:16 +0000 Received: by mail-ie0-f175.google.com with SMTP id aq17so2243975iec.6 for ; Tue, 22 Oct 2013 10:34:15 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to :content-type; bh=Ie2XyJTR7NqImVs5hB/vUedAvjJMOr8FSQGzOK54+FI=; b=OyT/YQctVag1qzKWYH0uoA2G0CQhbumjHACzBcTldRsqInCKhZMnHdxvA8gl+y+Osx CxIem2wYryJC0m3+z+mSyXor6GhpnF+3EuBVr+7h0clmu4TFGgZlsexfCptGG4Zgxvcj gkX3feDuiSXK7tjCCr4SyqYCyzrbUUNYLDUTIAwyrox2Jdxq5G0TqbteOXixIEuRYwxO s8ikbgJlbA5l+L3uoUx6JGdE0GuVSzmGMS/lVNufOZozgS74u1JxIrKFJBbJwPxZ2wuy ItXJwoymiNnLhPTaTdIG+vk9xWBNDwEKq2NItkv9jUA4DNEL+rgkQxPDYFZ30y+uLl3/ xNWg== X-Gm-Message-State: ALoCoQkxVzlwco6u9EzBJ0br/5/9PuT4CqCd1fb7aguM6cCuFyZTdlFZkPV3Ti/HQJv4SdNWLjxS MIME-Version: 1.0 X-Received: by 10.50.39.13 with SMTP id l13mr10269627igk.10.1382463255595; Tue, 22 Oct 2013 10:34:15 -0700 (PDT) Received: by 10.64.239.208 with HTTP; Tue, 22 Oct 2013 10:34:15 -0700 (PDT) Date: Tue, 22 Oct 2013 10:34:15 -0700 Message-ID: Subject: Improving the benchmark suite From: Tobias Bocanegra To: oak-dev@jackrabbit.apache.org Content-Type: text/plain; charset=UTF-8 Hi, I'd like to make the following changes to the way how the benchmarks work: 1. add support for executing several benchmarks within the same suite. currently each benchmark has it's own 'setUp()' code that might be expensive to execute. e.g. import a large structure, create nodes, etc. 2. move the concurrency control into the 'suite' as well. so that we can execute the same tests with different concurrency levels. like above, this helps with tests that are expensive to set up. WDYT? Regards, Toby