Mailing-List: contact user-help@mahout.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@mahout.apache.org
Received-SPF: pass (athena.apache.org: domain of ciric.marko@gmail.com
 designates 209.85.214.170 as permitted sender)
MIME-Version: 1.0
In-Reply-To: 
 <CAEccTywj4WHSR2RxsuKiipAV=uWezhpqio+6NjyiAU81wxhywQ@mail.gmail.com>
References: 
 <CAG_0v84aH48tmuLFLJ9uer92pAmDKXAKV7wi_AGO4=fhA3cx7Q@mail.gmail.com>
	<CAEccTyx2+xoimcUJ4q_yOU==ur20sFa-gGt6ECyy7M8gwcEFvw@mail.gmail.com>
	<CAG_0v86U6KzoseHftYjZc-kU3aQQXg1B0LXhLqSNydL3fP3htg@mail.gmail.com>
	<CAG_0v842KRBJpd93KqZBayw7npFtGb4LkxZqk+su4sZfuC1NPQ@mail.gmail.com>
	<CAEccTyx_QyOOO2cR4L8TThCWE6+ZnP3QyM3vkRiAp7gkM7Ms3Q@mail.gmail.com>
	<CALis8xoXO+PdsVrj0shCwObt3Oj6DByOXA6Z8yC0OzbGMSW6qA@mail.gmail.com>
	<CAEccTyzOLBKRsG0BdA1vuBnYaykFo3i04t7FnfSz_5183KXMtQ@mail.gmail.com>
	<CAG_0v87zdecV_kbZLHFyKMKBp7cRUbwK8vvB2t1ttqArjGz1Kg@mail.gmail.com>
	<CAEccTyxQVdVGiYf6jTZ5pJuqgjQqXLk2516myWQ=9pHc3u5uig@mail.gmail.com>
	<CAG_0v87SZzLizCrY7OQAP5YfbYeD7MpH_00R15rurmDPaexegg@mail.gmail.com>
	<CAEccTywj4WHSR2RxsuKiipAV=uWezhpqio+6NjyiAU81wxhywQ@mail.gmail.com>
Date: Thu, 21 Jul 2011 14:40:25 +0200
Message-ID: 
 <CAFz6wdeyvXJv1o_2265zJWprzLKx=aFRxVReiVc2vsBVRRvAKA@mail.gmail.com>
Subject: Re: Connection Pooling
From: Marko Ciric <ciric.marko@gmail.com>
To: user@mahout.apache.org
Content-Type: multipart/alternative; boundary=000e0cd32a9a37590e04a893a75e

--000e0cd32a9a37590e04a893a75e
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Actually, as GenericDataModel class works very well as a super class of you=
r
desired data model. This way everything is cached into memory and boosts
performance a lot. The reloading is actually easy to be implemented with th=
e
refresh mechanism (Taste objects implement Refreshable interface). You can
also try RefreshHelper.

On 13 July 2011 20:58, Sean Owen <srowen@gmail.com> wrote:

> I was mixing this up with another class. It doesn't reload itself. You ca=
n
> call refresh() to do so.
>
> On Wed, Jul 13, 2011 at 7:34 PM, Salil Apte <salil@offlinelabs.com> wrote=
:
>
> > Where can the interval be configured? BTW, ReloadFromJDBCDataModel
> > works like a dream so far :)
> >
> > On Wed, Jul 13, 2011 at 10:58 AM, Sean Owen <srowen@gmail.com> wrote:
> > > Yes it reloads after a configurable interval, or on demand.
> > >
> > > Clearing the cache for a user ID only means that user's data is
> > recomputed.
> > > It's not bad to call this frequently per se... I suppose you want to
> let
> > it
> > > cache as much and for as long as is valid and acceptable to your app.
> > >
> > > Your bottleneck is no longer reading from the DB if you're having it
> load
> > > into memory.
> > >
> > > On Wed, Jul 13, 2011 at 6:19 PM, Salil Apte <salil@offlinelabs.com>
> > wrote:
> > >
> > >> Awesome, I will give ReloadFromJDBCDataModel a try. How does this
> > >> particular data model update itself on database changes? Does it jus=
t
> > >> happen periodically and if so, can this rate be change easily?
> > >>
> > >> Lastly, will calling clear(userId) on a recommender frequently be ba=
d
> > >> for performance? I'm assuming with such small data amounts that the
> > >> actual recommendation algorithm is quite speedy and that the DB is
> > >> really the big bottleneck?
> > >>
> > >> On Wed, Jul 13, 2011 at 2:11 AM, Sean Owen <srowen@gmail.com> wrote:
> > >> > That's all correct, it reads a lot. But you can avoid a lot of it =
by
> > >> using
> > >> > caching wrappers.
> > >> > You also don't need to dump to a file. Use ReloadFromJDBCDataModel=
.
> > >> >
> > >> > On Wed, Jul 13, 2011 at 9:57 AM, Vitali Mogilevsky
> > >> > <vitali@playedonline.com>wrote:
> > >> >
> > >> >> Hey,
> > >> >> I got the same problem, of slowness while using MYSQL data model,
> > after
> > >> a
> > >> >> small research and looking into mysql's query log, revealed that
> user
> > -
> > >> >> user
> > >> >> recommendation just floods the database with thousands and
> thousands
> > of
> > >> >> requests.
> > >> >> and thats on small database.
> > >> >> for now Im dumbping the database into file, and using filedata
> model
> > >> which
> > >> >> works much faster
> > >> >>
> > >> >>
> > >> >
> > >>
> > >
> >
>


--=20
--
Marko =C4=86iri=C4=87
ciric.marko@gmail.com

--000e0cd32a9a37590e04a893a75e--