Return-Path: X-Original-To: apmail-incubator-hama-user-archive@minotaur.apache.org Delivered-To: apmail-incubator-hama-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 4146241D7 for ; Mon, 23 May 2011 06:34:29 +0000 (UTC) Received: (qmail 4060 invoked by uid 500); 23 May 2011 06:34:28 -0000 Delivered-To: apmail-incubator-hama-user-archive@incubator.apache.org Received: (qmail 3997 invoked by uid 500); 23 May 2011 06:34:28 -0000 Mailing-List: contact hama-user-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hama-user@incubator.apache.org Delivered-To: mailing list hama-user@incubator.apache.org Received: (qmail 3989 invoked by uid 99); 23 May 2011 06:34:26 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 23 May 2011 06:34:26 +0000 X-ASF-Spam-Status: No, hits=2.2 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_NONE,RFC_ABUSE_POST,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: local policy) Received: from [98.139.213.165] (HELO nm20-vm0.bullet.mail.bf1.yahoo.com) (98.139.213.165) by apache.org (qpsmtpd/0.29) with SMTP; Mon, 23 May 2011 06:34:17 +0000 Received: from [98.139.212.152] by nm20.bullet.mail.bf1.yahoo.com with NNFMP; 23 May 2011 06:33:56 -0000 Received: from [98.139.212.215] by tm9.bullet.mail.bf1.yahoo.com with NNFMP; 23 May 2011 06:33:56 -0000 Received: from [127.0.0.1] by omp1024.mail.bf1.yahoo.com with NNFMP; 23 May 2011 06:33:56 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 58316.29715.bm@omp1024.mail.bf1.yahoo.com Received: (qmail 19339 invoked by uid 60001); 23 May 2011 06:33:55 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1306132435; bh=Dm+h1U1rrlyAFnnF/8k5ZBhYSVBLpS3K5MD/Gc5nAJM=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=NaB06UU8VoKZqdowfES33YqBgG4ezmqAVw9XfmugdoLjZtLBZ4P9pQSpKtmVDG3GEzfzdVwxVNNoC3Iob7TeikgRlYAhpuNscjAkPpX+Ut2Cz3HZYn0ZTxmxLdX7dqUi03RSje/sVeVGszKzC7glxRDkKQOV1l4zHKnefUbGtJA= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=yxfN72+qFMJ6Z2/G19fB/+1549GV2s23MahrSHhPO9cIYsxwDGBG1g4jdDvShSulW3OCSv90qrV6b2Y7PS8T2eR4JOJKtslxO3KClXkdTD+zllTnXOS1KJ4ZY5RZj5B8Lus8LTWDiHKzlRnr3Fdim/ajnd+KnY3VwGn1Jr2Qe/s=; Message-ID: <354672.11905.qm@web31805.mail.mud.yahoo.com> X-YMail-OSG: pDAD_yMVM1lAl6ev2j4yjMV5141._.nDgzRCfOjZSBLMlAe hS_TI6sh8iLsFsrBXnBKyTPur75_3upKZLjOow5ARIye1cCVvjriYs14GqHk iuvlcx952YGO8NiTRAuS6ZvU1323jw91Ghxm0d6sMWnUcYIWgJbqNQYTjKox mTkwAdaZYqDHYZbHjtCuJ4KboxUB3aTdR0EQ6xsaRZD3bmfMvOX7EfrRmoK3 GtRFlqaW8HDFXlbrKRrtjVVVxfdokUc.TlrUD.O7MaLel7Y66prXBHgSOvea F1DQCMqGL8O9QASKaKtkKiFsXs5CTFua2amG8jHKk08GnQLlklbBTlBPntDg z5RJhaoYW5bew_W0l6fqJjiSKasJDmGeLay5kQXS..kdNmzfMj4RNFdp8w4C dYePMqIgrM81T6aruVKgFlUClwOzsnsm9gKdm8pYXsZdZvGVG_B.84jZhV60 luUVkgPvNkog6XfafhFig2Ucxg8zYvreb_ScXmIBH2ymUhKIFugbkhrDb9Bg A8wxLq25s2.3AR1E7kCUf0Mz1mdzOYIVo4SwE4zSC Received: from [193.40.12.44] by web31805.mail.mud.yahoo.com via HTTP; Sun, 22 May 2011 23:33:55 PDT X-Mailer: YahooMailWebService/0.8.111.304355 References: <667365.30097.qm@web31812.mail.mud.yahoo.com> Date: Sun, 22 May 2011 23:33:55 -0700 (PDT) From: Chris Willmore Reply-To: Chris Willmore Subject: Re: Fixed: hama-0.2 Job blocking after all tasks completed To: "hama-user@incubator.apache.org" In-Reply-To: MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="0-1855787095-1306132435=:11905" X-Virus-Checked: Checked by ClamAV on apache.org --0-1855787095-1306132435=:11905 Content-Type: text/plain; charset=us-ascii Hi Edward, Unfortunately I don't know what the problem. If you are curious enough to reproduce, you may checkout my project from github at this commit: https://github.com/willmore/hama-kmeans/commit/5d629fbd998e86116890234fdf5ee2b95451dec4 The project is built with maven, so it should be quick to build and deploy. Arguments to the main method are: where num_clusters must <= number of grooms. -Chris ________________________________ From: Edward J. Yoon To: hama-user@incubator.apache.org; Chris Willmore Sent: Monday, May 23, 2011 3:21 AM Subject: Re: Fixed: hama-0.2 Job blocking after all tasks completed That's great. By the way, what was problem? On Mon, May 23, 2011 at 3:51 AM, Chris Willmore wrote: > Hi All, > > I simplified my algorithm and the issue has disappeared. > > Regards, > Chris > > > > ________________________________ > From: Chris Willmore > To: "hama-user@incubator.apache.org" > Sent: Sunday, May 22, 2011 5:17 PM > Subject: hama-0.2 Job blocking after all tasks completed > > > Hi Folks, > > I am running hama-0.2 with 3 groomservers, on 3 hosts. I submit the job via the hama command interface, and it seems to execute perfectly. Tailing of the groom server logs shows succesfull completion. The forked GroomServer.Child processes shutdown, but the job never fully completes. > On the BSPMaster, running jstack on the hama.util.RunJar process shows the main thread still blocked on BSPJob.waitForCompletion(true). > > I've looked through the logs of master, zookeeper, and grooms and everything looks good afaik. > > Here is the source of my program: > https://github.com/willmore/hama-kmeans/blob/master/src/main/java/ee/ut/cs/willmore/KMeansCluster.java > > > Any pointers would be greatly appreciated. > > Cheers, > Chris -- Best Regards, Edward J. Yoon @eddieyoon --0-1855787095-1306132435=:11905--