Mailing-List: contact user-help@mahout.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@mahout.apache.org
Received-SPF: pass (nike.apache.org: local policy)
Content-Type: text/plain; charset=iso-8859-1
Mime-Version: 1.0 (Apple Message framework v1084)
Subject: Re: AW: Incremental clustering
From: David Saile <david@uni-koblenz.de>
In-Reply-To: <7448A03F137F364F84197FC6FA27CFB17097B3D9@VICO-SBS01.vico.local>
Date: Thu, 12 May 2011 10:53:39 +0200
Content-Transfer-Encoding: quoted-printable
Message-Id: <8854AF18-E59C-4FA0-8F8D-925E9BF4BD13@uni-koblenz.de>
References: <6E645A37-B7E4-4556-B9C5-1754DFD8E32C@uni-koblenz.de>
 <7448A03F137F364F84197FC6FA27CFB17097B3D9@VICO-SBS01.vico.local>
To: user@mahout.apache.org

I am still stuck at this problem.

Can anyone give me a heads-up on how existing systems handle this?=20
If a collection of documents is modified, is the clustering recomputed =
from scratch each time?=20
Or is there in fact any incremental way to handle an evolving set of =
documents?

I would really appreciate any hint!

Thanks,
David


Am 09.05.2011 um 12:45 schrieb Ulrich Poppendieck:

> Not an answer, but a follow-up question:=20
> I would be interested in the very same thing, but with the possibility =
to assign new sites to existing clusters OR to new ones.
>=20
> Thanks in advance,
> Ulrich
>=20
> -----Urspr=FCngliche Nachricht-----
> Von: David Saile [mailto:david@uni-koblenz.de]=20
> Gesendet: Montag, 9. Mai 2011 11:53
> An: user@mahout.apache.org
> Betreff: Incremental clustering
>=20
> Hi list,
>=20
> I am completely new to Mahout, so please forgive me if the answer to =
my question is too obvious.
>=20
> For a case study, I am working on a simple incremental web crawler =
(much like Nutch) and I want to include a very simple indexing step that =
incorporates clustering of documents.
>=20
> I was hoping to use some kind of incremental clustering algorithm, in =
order to make use of the incremental way the crawler is supposed to work =
(i.e. continuously adding and updating websites).
>=20
> Is there some way to achieve the following: =09
> 	1) initial clustering of the first web-crawl
> 	2) assigning new sites to existing clusters
> 	3) possibly moving modified sites between clusters
>=20
> I would really appreciate any help!
>=20
> Thanks,
> David