Mailing-List: contact dev-help@mahout.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@mahout.apache.org
Received-SPF: pass (athena.apache.org: domain of jake.mannix@gmail.com
 designates 209.85.160.170 as permitted sender)
DomainKey-Signature: a=rsa-sha1; c=nofws;
        d=gmail.com; s=gamma;
        h=mime-version:in-reply-to:references:from:date:message-id:subject:to
         :content-type;
        b=VVG37yTph9Fi1IIGKc7flCnFLucSReocN5AlNT3fRDZj71dk6W8q68acsVCWY3qMSS
         xi826rqpbPWzupedY/0dzVyVqzHjPULBoQ5O3XjHE6pu1/N81L0MUjXDsKbUZMCFOzrx
         4amgXVrgJz/ozh2v5BU0U3xhYfnFN83NA4a+M=
MIME-Version: 1.0
In-Reply-To: <BANLkTik3J=+DP-M1hxhu4mSF=brip-S9WA@mail.gmail.com>
References: 
 <1884938315.21467.1304511423317.JavaMail.tomcat@hel.zones.apache.org>
 <BANLkTik3J=+DP-M1hxhu4mSF=brip-S9WA@mail.gmail.com>
From: Jake Mannix <jake.mannix@gmail.com>
Date: Wed, 4 May 2011 10:04:36 -0700
Message-ID: <BANLkTin7tZS7ZaPwK+Vi7G9ErEvHq+LniA@mail.gmail.com>
Subject: Re: [jira] [Commented] (MAHOUT-319) SVD solvers should be gracefully
 stoppable/restartable
To: dev@mahout.apache.org
Content-Type: multipart/alternative; boundary=20cf303f6d9645a18704a276595a

--20cf303f6d9645a18704a276595a
Content-Type: text/plain; charset=ISO-8859-1

I've merged Jon's stuff onto one of my github branches, and am cleaning
some
stuff up today and tomorrow.

The restartable SVD / LanczosState stuff is actually ready to go (modulo
fixing some
overzealous tests, also working on that today), but the LinearOperator
branch
may indeed wait for 0.6 - although it needs to get in before 1.0, as it's a
pretty
serious interface change.

  -jake

On Wed, May 4, 2011 at 9:33 AM, Jonathan Traupman <jon.traupman@gmail.com>wrote:

> Jake should probably make the call regarding the actual restartable SVD
> (e.g. the LanczosState and related stuff). As for the LinearOperator stuff
> I've been working on, it touches a lot of stuff in mahout-math so I think
> waiting for 0.6 would be more appropriate than rushing it into 0.5.
>
> -Jon
>
>
> On Wed, May 4, 2011 at 5:17 AM, Sean Owen (JIRA) <jira@apache.org> wrote:
>
> >
> >    [
> >
> https://issues.apache.org/jira/browse/MAHOUT-319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13028724#comment-13028724
> ]
> >
> > Sean Owen commented on MAHOUT-319:
> > ----------------------------------
> >
> > It sounds like this is still in progress -- may we move to 0.6? I didn't
> > push it myself since there has at least been some noise in the last 2
> weeks,
> > and some patch up.
> >
> > > SVD solvers should be gracefully stoppable/restartable
> > > ------------------------------------------------------
> > >
> > >                 Key: MAHOUT-319
> > >                 URL: https://issues.apache.org/jira/browse/MAHOUT-319
> > >             Project: Mahout
> > >          Issue Type: Improvement
> > >          Components: Math
> > >    Affects Versions: 0.3
> > >            Reporter: Jake Mannix
> > >            Assignee: Jake Mannix
> > >             Fix For: 0.5
> > >
> > >         Attachments: MAHOUT-319.diff, MAHOUT-319.patch
> > >
> > >
> > > LanczosSolver, DistributedLanczosSolver, and HebbianSolver all keep
> > copious amounts of memory-resident data which is lost if the app crashes
> or
> > is killed (OOM, forgetting to run in a screen session, and losing net
> > connectivity to the server running it, etc...).
> > > These algorithms (and many other Mahout processes!) should enable a
> > pluggable "persist state" mechanism (to HDFS, RDBMS, local disk,
> key-value
> > store, etc), and similarly, a way to pick up and start from such a state.
> >
> > --
> > This message is automatically generated by JIRA.
> > For more information on JIRA, see:
> http://www.atlassian.com/software/jira
> >
>

--20cf303f6d9645a18704a276595a--