Mailing-List: contact user-help@mahout.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@mahout.apache.org
Received-SPF: pass (athena.apache.org: domain of weidezhang2007@gmail.com
 designates 209.85.160.170 as permitted sender)
MIME-Version: 1.0
Date: Sun, 2 Oct 2011 20:52:58 -0700
Message-ID: 
 <CAMvZ5=7ZcT-u0pKksr7sCdrji8-h4uK+mw3NjFdbCMMt1aY+uw@mail.gmail.com>
Subject: question about clustering
From: Walter Chang <weidezhang2007@gmail.com>
To: user <user@mahout.apache.org>
Content-Type: multipart/alternative; boundary=000e0cd6acc61dfde304ae5ce9f9

--000e0cd6acc61dfde304ae5ce9f9
Content-Type: text/plain; charset=ISO-8859-1

Hi ,

i have used mahout to produce kmeans  clustering for my tf-idf result. I use
the mahout command line to produce the clusters and it seems it successfully
completes.

$MAHOUT_HOME/bin/mahout kmeans  -i ./tfidf-vectors -c ./initialclusters -o
./kmeans-clusters  -cd 1.0 -k 3 -x 1000

It seems there are two clusters directory generated.(cluster-1 and
cluster-2)  , when i use clusterdump on each of them, it seems to me that
the clustered top terms are the same. Any idea why ?

Also, how can i see which documents have been assigned to each cluster.
Right now, i can see the number of documents assigned but not the complete
list.

Most importantly, for production purposes, i assume it makes sense for
kmeans always runs on hadoop to generate the clustering file. But how do i
consume these during serving ? Ideally, serving should have the doc id or
query passed as a query, and the server should return the top document
ranked by the score within the same cluster back. How do I do it in code ?
Any good examples ?

Thanks a lot,

Weide

--000e0cd6acc61dfde304ae5ce9f9--