Return-Path: X-Original-To: apmail-mahout-dev-archive@www.apache.org Delivered-To: apmail-mahout-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A17679B4B for ; Thu, 8 Dec 2011 19:23:22 +0000 (UTC) Received: (qmail 34667 invoked by uid 500); 8 Dec 2011 19:23:22 -0000 Delivered-To: apmail-mahout-dev-archive@mahout.apache.org Received: (qmail 34628 invoked by uid 500); 8 Dec 2011 19:23:22 -0000 Mailing-List: contact dev-help@mahout.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@mahout.apache.org Delivered-To: mailing list dev@mahout.apache.org Received: (qmail 34620 invoked by uid 99); 8 Dec 2011 19:23:22 -0000 Received: from minotaur.apache.org (HELO minotaur.apache.org) (140.211.11.9) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Dec 2011 19:23:22 +0000 Received: from localhost (HELO [172.19.131.99]) (127.0.0.1) (smtp-auth username gsingers, mechanism plain) by minotaur.apache.org (qpsmtpd/0.29) with ESMTP; Thu, 08 Dec 2011 19:23:21 +0000 Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Apple Message framework v1251.1) Subject: Re: Tests running time From: Grant Ingersoll In-Reply-To: Date: Thu, 8 Dec 2011 14:23:18 -0500 Content-Transfer-Encoding: quoted-printable Message-Id: <789FF4C7-0D4E-4A6E-AF48-B82F72E2AF4C@apache.org> References:

To: dev@mahout.apache.org X-Mailer: Apple Mail (2.1251.1) If I add parallel, fork always to the main surefire config, I get = failures all over the place for things like: Failed tests: = testHebbianSolver(org.apache.mahout.math.decomposer.hebbian.TestHebbianSol= ver): Error: {0.06146049974880152 too high! (for eigen 3) consistency(org.apache.mahout.math.jet.random.NormalTest): = offset=3D0.000 scale=3D1.000 Z =3D 8.2 consistency(org.apache.mahout.math.jet.random.ExponentialTest): = offset=3D0.000 scale=3D100.000 Z =3D 8.7 All of these pass individually and when not in parallel for me. Here's my config: org.apache.maven.plugins maven-surefire-plugin 2.11 classes always true Anyone else seeing that? On Dec 8, 2011, at 1:53 PM, Dmitriy Lyubimov wrote: > SSVD actually runs a rather small test but it is a MR job in local > mode, there's nothing to cut down there in terms of size (not much > anyway). It's just what it takes to initialize and run all jobs (and > since it is local, it is also single threaded, so it actually runs V > and U jobs sequentially instead of parallel so it's even longer > because of that (4 jobs stringed all in all). >=20 > But i will take a look, although even if i reduce solution size, it > will still likely not reduce running time by more than 20%. >=20 > On Thu, Dec 8, 2011 at 5:42 AM, David Murgatroyd = wrote: >>=20 >>=20 >>=20 >>=20 >> On Dec 8, 2011, at 8:36 AM, Grant Ingersoll = wrote: >>=20 >>> MAHOUT-916 and 917 are attempts to address the running time of our = tests. As Sean rightfully pointed out, there are probably opportunities = to simply cut down the sizes of some of these tests w/o effecting there = correctness. To that end, if people can take a look at: >>> https://builds.apache.org/job/Mahout-Quality/1237/testReport/junit/ >>>=20 >>> You can get a sense as to which tests are taking a long time. The = main culprits are: >>> 1. Vectorizer >>> 2. SSVD >>> 3. K-Means >>> 4. taste.hadoop.item >>> 5. taste.hadoop.als >>> 6. PFPGrowth >>>=20 >>>=20 >>> -Grant >>>=20 >>> -------------------------------------------- >>> Grant Ingersoll >>> http://www.lucidimagination.com >>>=20 >>>=20 >>>=20 -------------------------------------------- Grant Ingersoll http://www.lucidimagination.com