Return-Path: X-Original-To: apmail-commons-dev-archive@www.apache.org Delivered-To: apmail-commons-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3A8206472 for ; Tue, 12 Jul 2011 14:43:48 +0000 (UTC) Received: (qmail 74944 invoked by uid 500); 12 Jul 2011 14:43:47 -0000 Delivered-To: apmail-commons-dev-archive@commons.apache.org Received: (qmail 74787 invoked by uid 500); 12 Jul 2011 14:43:47 -0000 Mailing-List: contact dev-help@commons.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: "Commons Developers List" Delivered-To: mailing list dev@commons.apache.org Received: (qmail 74773 invoked by uid 99); 12 Jul 2011 14:43:46 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Jul 2011 14:43:46 +0000 X-ASF-Spam-Status: No, hits=4.0 required=5.0 tests=FREEMAIL_FROM,FREEMAIL_REPLY,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of gsterijevski@gmail.com designates 209.85.212.43 as permitted sender) Received: from [209.85.212.43] (HELO mail-vw0-f43.google.com) (209.85.212.43) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 12 Jul 2011 14:43:41 +0000 Received: by vws10 with SMTP id 10so4252781vws.30 for ; Tue, 12 Jul 2011 07:43:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=hO7/ntw4pOy9ApD2KFvDeqT1g7E2FM3x23j6w4sPNuo=; b=jGKypEJhk1hr6WAcNPphKtcix2aW/RFArugVHM+RR+61825UFIu7Ev1fI8RBJR7Ml5 7pOxAVhvN/40J+gntJMiZxmOi2Yw4iLzpEw2GYynQ3PFdOPitlpvOVtEHDJJgapdLG9K Wa0KxLJc6Aebuk8I0anZUcnffdLXXDnagprJI= MIME-Version: 1.0 Received: by 10.52.32.68 with SMTP id g4mr21139vdi.216.1310481800635; Tue, 12 Jul 2011 07:43:20 -0700 (PDT) Received: by 10.220.105.137 with HTTP; Tue, 12 Jul 2011 07:43:20 -0700 (PDT) In-Reply-To: <4E1BE13B.2030405@gmail.com> References: <4E1BE13B.2030405@gmail.com> Date: Tue, 12 Jul 2011 09:43:20 -0500 Message-ID: Subject: Re: [math] Re: Longley Data From: Greg Sterijevski To: Commons Developers List Content-Type: multipart/alternative; boundary=bcaec51d224036239104a7e05229 --bcaec51d224036239104a7e05229 Content-Type: text/plain; charset=ISO-8859-1 I will run against R. Here is the official repository @ NIST for Wampler/Longley/Filippelli data.. http://www.itl.nist.gov/div898/strd/lls/lls.shtml If you follow the link, the ASCII data files also have the certified results. Would you like me to add these tests to the unit test for OLSMultipleLinearRegression? On Tue, Jul 12, 2011 at 12:52 AM, Phil Steitz wrote: > On 7/11/11 9:34 PM, Greg Sterijevski wrote: > > I also ran the filipelli data through both the regression technique that > I > > am working on, and the current multiple regression package. My work in > > progress gets estimates which though not great are close to the certified > > values. OLSMultipleLinearRegression exceptions out, complaining about a > > singular matrix. > > I assume the design matrix is near-singular, correct? Where did the > certified values come from? If you have access to R, it would be > good to compare results against R as well. There is R code in > src/test/R set up to compare results against [math]. > > > > On Mon, Jul 11, 2011 at 11:07 PM, Greg Sterijevski > > wrote: > > > >> Yes, my apologies. I am a bit new to this. > >> > >> > >> > >> On Mon, Jul 11, 2011 at 10:59 PM, Henri Yandell >wrote: > >> > >>> I'm assuming this is Commons Math. I've added a [math] so it catches > >>> the interest of those involved. > >>> > >>> > >>> On Mon, Jul 11, 2011 at 8:52 PM, Greg Sterijevski > >>> wrote: > >>>> Additionally, I pass all of the Wampler beta estimates. > >>>> > >>>> On Mon, Jul 11, 2011 at 10:40 PM, Greg Sterijevski > >>>> wrote: > >>>> > >>>>> Hello All, > >>>>> > >>>>> I am testing the first 'updating' ols regression algorithm. I ran it > >>>>> through the Wampler1 data. It gets 1.0s for all of the beta > estimates. > >>> I > >>>>> next ran the Longley dataset. I match, but with a tolerance of > 1.0e-6. > >>> This > >>>>> is a bit less than two orders of magnitude worse than the current > >>> incore > >>>>> estimator( 2.0e-8). My question to the list, is how important is this > >>> diff? > >>>>> Is it worth tearing things apart to figure out where the error is > >>>>> accumulating? > >>>>> > >>>>> Thanks, > >>>>> > >>>>> -Greg > >>>>> > >>> --------------------------------------------------------------------- > >>> To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org > >>> For additional commands, e-mail: dev-help@commons.apache.org > >>> > >>> > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscribe@commons.apache.org > For additional commands, e-mail: dev-help@commons.apache.org > > --bcaec51d224036239104a7e05229--