Return-Path: Delivered-To: apmail-hadoop-core-user-archive@www.apache.org Received: (qmail 14750 invoked from network); 19 Aug 2008 23:13:33 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.2) by minotaur.apache.org with SMTP; 19 Aug 2008 23:13:33 -0000 Received: (qmail 12820 invoked by uid 500); 19 Aug 2008 23:13:27 -0000 Delivered-To: apmail-hadoop-core-user-archive@hadoop.apache.org Received: (qmail 12768 invoked by uid 500); 19 Aug 2008 23:13:27 -0000 Mailing-List: contact core-user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: core-user@hadoop.apache.org Delivered-To: mailing list core-user@hadoop.apache.org Received: (qmail 12757 invoked by uid 99); 19 Aug 2008 23:13:27 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 19 Aug 2008 16:13:27 -0700 X-ASF-Spam-Status: No, hits=-4.0 required=10.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (athena.apache.org: domain of steph@conviva.com designates 216.82.249.51 as permitted sender) Received: from [216.82.249.51] (HELO mail190.messagelabs.com) (216.82.249.51) by apache.org (qpsmtpd/0.29) with SMTP; Tue, 19 Aug 2008 23:12:30 +0000 X-VirusChecked: Checked X-Env-Sender: steph@conviva.com X-Msg-Ref: server-6.tower-190.messagelabs.com!1219187577!46133352!1 X-StarScan-Version: 5.5.12.14.2; banners=-,-,- X-Originating-IP: [216.38.138.37] Received: (qmail 7606 invoked from network); 19 Aug 2008 23:12:57 -0000 Received: from sam1mtai101.rinera.com (HELO mtai102.west.rinera.com) (216.38.138.37) by server-6.tower-190.messagelabs.com with SMTP; 19 Aug 2008 23:12:57 -0000 Received: from localhost (localhost.localdomain [127.0.0.1]) by mtai102.west.rinera.com (Postfix) with ESMTP id D0106670049 for ; Tue, 19 Aug 2008 16:12:57 -0700 (PDT) X-Virus-Scanned: amavisd-new at X-Spam-Score: -2.454 X-Spam-Level: Received: from mtai102.west.rinera.com ([127.0.0.1]) by localhost (mtai102.west.rinera.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id unAypyE1rSSS for ; Tue, 19 Aug 2008 16:12:57 -0700 (PDT) Received: from [172.16.9.250] (unknown [172.16.9.250]) by mtai102.west.rinera.com (Postfix) with ESMTP id 861A5670046 for ; Tue, 19 Aug 2008 16:12:57 -0700 (PDT) Message-Id: From: steph To: core-user@hadoop.apache.org Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v926) Subject: possible memory leak in ZlibCompressor ? Date: Tue, 19 Aug 2008 16:12:57 -0700 X-Mailer: Apple Mail (2.926) X-Virus-Checked: Checked by ClamAV on apache.org X-Old-Spam-Flag: NO X-Old-Spam-Status: No, score=-2.454 tagged_above=-10 required=6.6 tests=[AWL=0.045, BAYES_00=-2.599, RDNS_NONE=0.1] Hi, I am running some code using ZLibCompressor to write into HDFS-- hadoop.16.0.3. I keep running into OutOfmemoryError: 1219111710769 SEVERE [Service.uncaughtException got an exception : Thread[Thread-1,5,-ThreadGrp] got exception java.lang.OutOfMemoryError 1219111710770 SEVERE [Service.uncaughtException - org.apache.hadoop.io.compress.zlib.ZlibCompressor.init(Native Method) 1219111710770 SEVERE [Service.uncaughtException - org .apache .hadoop.io.compress.zlib.ZlibCompressor.(ZlibCompressor.java:198) 1219111710770 SEVERE [Service.uncaughtException - com .service.LogRangeManagerHadoop.openChannel(LogRangeManagerHadoop.java: 249) ... Is there such a know issue. Thanks, S.