Return-Path: Delivered-To: apmail-hadoop-common-user-archive@www.apache.org Received: (qmail 33968 invoked from network); 29 Mar 2011 20:09:19 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 29 Mar 2011 20:09:19 -0000 Received: (qmail 72991 invoked by uid 500); 29 Mar 2011 20:09:17 -0000 Delivered-To: apmail-hadoop-common-user-archive@hadoop.apache.org Received: (qmail 72950 invoked by uid 500); 29 Mar 2011 20:09:17 -0000 Mailing-List: contact common-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-user@hadoop.apache.org Delivered-To: mailing list common-user@hadoop.apache.org Received: (qmail 72942 invoked by uid 99); 29 Mar 2011 20:09:17 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Mar 2011 20:09:17 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of jshrinivas@gmail.com designates 209.85.210.48 as permitted sender) Received: from [209.85.210.48] (HELO mail-pz0-f48.google.com) (209.85.210.48) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 29 Mar 2011 20:09:10 +0000 Received: by pzk10 with SMTP id 10so125260pzk.35 for ; Tue, 29 Mar 2011 13:08:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:date:message-id:subject:from:to :content-type; bh=/zcswZmDtQ5EsiT03uJmRFiVazzDxmXe9pGBCv1fwIU=; b=Ec0ipRbY/Zu6QZyFJbs6nisYJngNM9le5sIhxvtqOSqwdIAVRopn4oJypgQiJHPE7+ Tw7ZEkR/Yw8PgM2wuE4rqqCg+hIHzQu0etdabyG3x7r5rmIlGYrPY3S9t19XITLeLFTu TsA50LGDE7/HZtEtRkH0jlxRyqQFcDj63ncZM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=GtORVCApkWCUyx2DFrvkbZMIDIcDdeL9ClvAoOrxsyipBOFikUBDiIOJiAjjxj6o2m zf+fyrEdoU0yK6KyDo2MmE4J046U/7vHOjcp4qU0rphYtKAiXJwj3atcs8yB3i8k1EM+ fxvBwyhw+dvpSYj3uc6RDVTuGQu+0x7r16duI= MIME-Version: 1.0 Received: by 10.142.122.8 with SMTP id u8mr166786wfc.283.1301429329886; Tue, 29 Mar 2011 13:08:49 -0700 (PDT) Received: by 10.142.158.1 with HTTP; Tue, 29 Mar 2011 13:08:49 -0700 (PDT) Date: Tue, 29 Mar 2011 15:08:49 -0500 Message-ID: Subject: map JVMs do not cease to exist From: Shrinivas Joshi To: common-user@hadoop.apache.org Content-Type: multipart/alternative; boundary=001636e0a66fe87d36049fa4a0f4 --001636e0a66fe87d36049fa4a0f4 Content-Type: text/plain; charset=ISO-8859-1 Noticed this on a TeraSort run - map JVM processes do not exit/cease to exist even after a long while from successful execution of all map tasks. Resources consumed by these JVM processes do not seem to be relinquished either and that causes poor performance in the rest of the reduce phase which continues execution after map phase is done. Do you see this as an issue? If so, is it a known issue? Thanks, -Shrinivas --001636e0a66fe87d36049fa4a0f4--