Return-Path: X-Original-To: apmail-accumulo-dev-archive@www.apache.org Delivered-To: apmail-accumulo-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 56D5C1038D for ; Mon, 7 Oct 2013 15:17:39 +0000 (UTC) Received: (qmail 97982 invoked by uid 500); 7 Oct 2013 15:17:38 -0000 Delivered-To: apmail-accumulo-dev-archive@accumulo.apache.org Received: (qmail 97743 invoked by uid 500); 7 Oct 2013 15:17:37 -0000 Mailing-List: contact dev-help@accumulo.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@accumulo.apache.org Delivered-To: mailing list dev@accumulo.apache.org Received: (qmail 97733 invoked by uid 99); 7 Oct 2013 15:17:36 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Oct 2013 15:17:36 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of eric.newton@gmail.com designates 74.125.82.53 as permitted sender) Received: from [74.125.82.53] (HELO mail-wg0-f53.google.com) (74.125.82.53) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 07 Oct 2013 15:17:32 +0000 Received: by mail-wg0-f53.google.com with SMTP id x12so7442659wgg.20 for ; Mon, 07 Oct 2013 08:17:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=wjmm6uy/Fz5o6csYx2n5tk6mIcemgiWSuh/NILnyMuA=; b=exWtFU2Lkl3broTq3ZvmPUG4qRzrJahOss+H8yjH2kywhGCBRACRBrrQOWQn4y3fWf Pp4RGF4uxCGc1m4EZ/iIvj5JOWjsyOaFFMA5/hCRFGpmHHn0lAUCZFYsMmNbjyGJQ+nQ qZum9xAjCV8tqOfl+0O7UaWZfJRXwM4WQAb3KrsLfBaMs8BqH9hf4+9nV2zNFiWcGE+Y ZSShHHSuMCmZsEwv2nWFOh0TzznJalc/hRahcT62M/bQxIjk6KH3K1R5gY23bauGTc8Z QryyTbZSGTVWoGeOQgUh3whEfW5202PO2IkjYMzpfAVMFPkJ3Jf9aei3w8qZOJcSdYbD F/Fw== MIME-Version: 1.0 X-Received: by 10.180.210.231 with SMTP id mx7mr19966819wic.5.1381159031273; Mon, 07 Oct 2013 08:17:11 -0700 (PDT) Received: by 10.216.85.138 with HTTP; Mon, 7 Oct 2013 08:17:11 -0700 (PDT) In-Reply-To: References: Date: Mon, 7 Oct 2013 11:17:11 -0400 Message-ID: Subject: Re: integration tests From: Eric Newton To: dev@accumulo.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org If a couple people try it and it works for them, then sure! Does it work for you? -Eric On Mon, Oct 7, 2013 at 11:09 AM, Michael Berman wrote: > This is awesome; thanks Eric! > > Should we set perCoreThreadCount for failsafe so people can take advantage > of the parallel speedup without having to remember to set accumulo.it.forkCount > manually? If we set it to something relatively small, it shouldn't break > things on slow VMs, but would still benefit devs with beefier machines. > > Also, any reason not to set reuseForks? Running from an IDE always reuses > the VM, and seems to work just fine. This would also let us keep recycling > the same static minicluster between testclasses, which is no longer > happening in maven (although still happens in eclipse). > > > On Sun, Oct 6, 2013 at 12:25 AM, Christopher wrote: > >> That doesn't work well with plugins that aren't all thread safe, and >> may have other side-effects. Feel free to try it, if you like, but I >> think it's sufficient to focus on optimizing the unit tests and >> integration tests, because that's where it really matters. >> >> -- >> Christopher L Tubbs II >> http://gravatar.com/ctubbsii >> >> >> On Fri, Sep 27, 2013 at 5:53 PM, Mike Drob wrote: >> > Maven already provides a -T option for multithreaded runs, and can even >> > take a core multiplied factor. It would be nice to integrate with that in >> > some way >> > That's much better. It took me a few iterations to get down to an >> > appropriate number of threads where it wouldn't fail, but being able to >> do >> > it in 20 minutes blows 1+ hours out of the water >> > >> > >> > On Fri, Sep 27, 2013 at 2:55 PM, Eric Newton >> wrote: >> > >> >> I've stabilized the integration tests. They run in a slow virtual >> machine, >> >> and they run on my desktop. You can use multiple forks to run the tests >> >> more quickly: >> >> >> >> $ mvn clean verify -Pnative -Daccumulo.it.forkCount=12 >> >> >> >> That takes ~15 minutes. My desktop has 8 cores and 30G of RAM. >> >> >> >> Please take the time to run the integration tests, and please open >> tickets >> >> if you find them failing. >> >> >> >> I'm not going to turn these tests on for our Jenkin's build because they >> >> will still timeout. >> >> >> >> -Eric >> >> >>