Return-Path: X-Original-To: apmail-mahout-dev-archive@www.apache.org Delivered-To: apmail-mahout-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id AF017440F for ; Thu, 30 Jun 2011 01:40:56 +0000 (UTC) Received: (qmail 81590 invoked by uid 500); 30 Jun 2011 01:40:55 -0000 Delivered-To: apmail-mahout-dev-archive@mahout.apache.org Received: (qmail 81498 invoked by uid 500); 30 Jun 2011 01:40:54 -0000 Mailing-List: contact dev-help@mahout.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@mahout.apache.org Delivered-To: mailing list dev@mahout.apache.org Received: (qmail 81480 invoked by uid 99); 30 Jun 2011 01:40:54 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 30 Jun 2011 01:40:54 +0000 X-ASF-Spam-Status: No, hits=-0.6 required=5.0 tests=FREEMAIL_ENVFROM_END_DIGIT,FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of guxiaobo1982@gmail.com designates 209.85.161.170 as permitted sender) Received: from [209.85.161.170] (HELO mail-gx0-f170.google.com) (209.85.161.170) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 30 Jun 2011 01:40:49 +0000 Received: by gxk27 with SMTP id 27so1247213gxk.1 for ; Wed, 29 Jun 2011 18:40:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=bPqCZ6fWpL5STGIFXazojgWpEJSy7XSYKX2c+431hzE=; b=KgpbnclYEoT0jE7yJzpbNYru0QqzzHRMAVCwze2AbIKKL9WbcRoLDi7pirAKQUZamL hTLBl2xjSq0lPiDDznGehyXtpWkI9BhCdmW7NDi7TF86o6PtiY6R9hrJildT/CXZe4Qd utOnFRy7JBvjG8gAoQnFCmTgdtWkLZIjQThQo= MIME-Version: 1.0 Received: by 10.236.19.226 with SMTP id n62mr1708514yhn.203.1309398028510; Wed, 29 Jun 2011 18:40:28 -0700 (PDT) Received: by 10.236.199.105 with HTTP; Wed, 29 Jun 2011 18:40:28 -0700 (PDT) In-Reply-To: References:

Date: Thu, 30 Jun 2011 09:40:28 +0800 Message-ID: Subject: Re: L2 seems does not work From: Xiaobo Gu To: dev@mahout.apache.org Cc: user@mahout.apache.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Can the author of L2 and AdaptiveLogisticRegression help with this? Regards, Xiaobo Gu On Thu, Jun 30, 2011 at 1:39 AM, Hector Yee wrote: > The nans in logistic regression usually occur at the Math.exp. > > Try adding a breakpoint or assert not nan there to see what the input is. > > If its an overflow you can fix it by clamping. The argument to exp maxes = out > around 50 for floats before NaN ing. > > On Wed, Jun 29, 2011 at 9:38 AM, Xiaobo Gu wrote= : > >> You will get this using the following command, with the latest 696 >> patch https://issues.apache.org/jira/browse/MAHOUT-696 >> >> mahout trainAdaptiveLogistic --input donut.csv --output d:\\model1 >> --target color --categories 2 --predictors x y --types numeric >> --threads 8 --passes 1000 --showperf --features 100 --skipperfnum 399 >> --prior L2 >> >> >> >> 2011/6/30 Xiaobo Gu : >> > Hi, >> > >> > I am testing AdaptiveLogisticRegression with L2, but the result seems >> > L2 cause the whole training process useless, the result is as >> > following: >> > With prior =3D =A0L2 then >> > >> > =A0 =A0 =A0 400 =A00 AdaptiveLogisticRegression has not found a good m= odel ...... >> > 800 =A0 =A0 NaN =A0 =A0 0.00 >> > 1200 =A0 =A0NaN =A0 =A0 0.00 >> > ...... >> > >> > 40000 =A0 NaN =A0 =A0 0.00 >> > 100 >> > color ~ NaN*x + NaN*y >> > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 x NaN >> > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 y NaN >> > =A0 =A0 =A0 =A0 =A0 =A0NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0= =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN = =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 = =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 = =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0= =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 = =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0 =A0NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0= =A0 =A0 =A0 =A0 =A0 NaN >> > NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 = =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 = =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0= =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 = =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0 =A0NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0= =A0 =A0 =A0 =A0 =A0 NaN >> > NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 = =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 = =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0= =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 = =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0 =A0NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0= =A0 =A0 =A0 =A0 =A0 NaN >> > NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 = =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 = =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0= =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 = =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN >> > =A0 =A0NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0= =A0 =A0 =A0 =A0 =A0 NaN >> > NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 =A0 =A0 =A0 =A0 NaN =A0 =A0 = =A0 =A0 =A0 =A0 NaN >> > >> > Regards, >> > >> > Xiaobo Gu >> > >> > > > > -- > Yee Yang Li Hector > http://hectorgon.blogspot.com/ (tech + travel) > http://hectorgon.com (book reviews) >