Return-Path: X-Original-To: apmail-accumulo-dev-archive@www.apache.org Delivered-To: apmail-accumulo-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 15C6310334 for ; Mon, 7 Oct 2013 15:10:07 +0000 (UTC) Received: (qmail 73032 invoked by uid 500); 7 Oct 2013 15:10:06 -0000 Delivered-To: apmail-accumulo-dev-archive@accumulo.apache.org Received: (qmail 73006 invoked by uid 500); 7 Oct 2013 15:10:05 -0000 Mailing-List: contact dev-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@accumulo.apache.org Delivered-To: mailing list dev@accumulo.apache.org Received: (qmail 72998 invoked by uid 99); 7 Oct 2013 15:10:04 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Oct 2013 15:10:04 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy includes SPF record at spf.trusted-forwarder.org) Received: from [209.85.214.171] (HELO mail-ob0-f171.google.com) (209.85.214.171) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Oct 2013 15:09:58 +0000 Received: by mail-ob0-f171.google.com with SMTP id uy5so1389333obc.30 for ; Mon, 07 Oct 2013 08:09:36 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=/ELXrERXtcvHhzfpKiMZKZxnQSm+geIGi2nZniblXW8=; b=l9NoGyCJw/4NKuthxYpZNvBVF+HnlEOdiKhxo3dlaJ0Fn7qtyGCpBqWnMog4F4OfeL fp4UB8bK8myg1iyPlYo8c3I8RjUqdlMpLWfTakg9kDqI0RTuGAHcDdqrpZYfqEmBqUON WNaNHRzSmzV7212Yk7N/0or0g8cJJXtHsEAF2jQPBjcELlcUOrrzWQRmrc6CyHcio5ac WhpzhK9yxXo2RgxZmxllpYCBJQqmjC1XKFgpoGxTNOL9Ep3/nl4ole5N9SHYZCJKH+5l zwF+6jNWVExJrpzBfCqxwv+2RvLfSqPA2idu1PPfonrjpo1QSvUPvesP+LMP0vLojgGl 7yrg== X-Gm-Message-State: ALoCoQmmCR+woneXl4m6YXthYccPp443npZweTlL5K76mbZb+uhAbk/k0vbvlwJm5jVXr0u1oGnT X-Received: by 10.60.145.241 with SMTP id sx17mr849932oeb.57.1381158576425; Mon, 07 Oct 2013 08:09:36 -0700 (PDT) MIME-Version: 1.0 Received: by 10.76.93.10 with HTTP; Mon, 7 Oct 2013 08:09:16 -0700 (PDT) In-Reply-To: References: From: Michael Berman Date: Mon, 7 Oct 2013 11:09:16 -0400 Message-ID: Subject: Re: integration tests To: dev Content-Type: multipart/alternative; boundary=047d7b5d474a539a2a04e8280a3c X-Virus-Checked: Checked by ClamAV on apache.org --047d7b5d474a539a2a04e8280a3c Content-Type: text/plain; charset=ISO-8859-1 This is awesome; thanks Eric! Should we set perCoreThreadCount for failsafe so people can take advantage of the parallel speedup without having to remember to set accumulo.it.forkCount manually? If we set it to something relatively small, it shouldn't break things on slow VMs, but would still benefit devs with beefier machines. Also, any reason not to set reuseForks? Running from an IDE always reuses the VM, and seems to work just fine. This would also let us keep recycling the same static minicluster between testclasses, which is no longer happening in maven (although still happens in eclipse). On Sun, Oct 6, 2013 at 12:25 AM, Christopher wrote: > That doesn't work well with plugins that aren't all thread safe, and > may have other side-effects. Feel free to try it, if you like, but I > think it's sufficient to focus on optimizing the unit tests and > integration tests, because that's where it really matters. > > -- > Christopher L Tubbs II > http://gravatar.com/ctubbsii > > > On Fri, Sep 27, 2013 at 5:53 PM, Mike Drob wrote: > > Maven already provides a -T option for multithreaded runs, and can even > > take a core multiplied factor. It would be nice to integrate with that in > > some way > > That's much better. It took me a few iterations to get down to an > > appropriate number of threads where it wouldn't fail, but being able to > do > > it in 20 minutes blows 1+ hours out of the water > > > > > > On Fri, Sep 27, 2013 at 2:55 PM, Eric Newton > wrote: > > > >> I've stabilized the integration tests. They run in a slow virtual > machine, > >> and they run on my desktop. You can use multiple forks to run the tests > >> more quickly: > >> > >> $ mvn clean verify -Pnative -Daccumulo.it.forkCount=12 > >> > >> That takes ~15 minutes. My desktop has 8 cores and 30G of RAM. > >> > >> Please take the time to run the integration tests, and please open > tickets > >> if you find them failing. > >> > >> I'm not going to turn these tests on for our Jenkin's build because they > >> will still timeout. > >> > >> -Eric > >> > --047d7b5d474a539a2a04e8280a3c--