From common-commits-return-19308-apmail-hadoop-common-commits-archive=hadoop.apache.org@hadoop.apache.org Wed Oct 3 04:59:28 2012 Return-Path: X-Original-To: apmail-hadoop-common-commits-archive@www.apache.org Delivered-To: apmail-hadoop-common-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 085D7D196 for ; Wed, 3 Oct 2012 04:59:28 +0000 (UTC) Received: (qmail 53176 invoked by uid 500); 3 Oct 2012 04:59:27 -0000 Delivered-To: apmail-hadoop-common-commits-archive@hadoop.apache.org Received: (qmail 52666 invoked by uid 500); 3 Oct 2012 04:59:23 -0000 Mailing-List: contact common-commits-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-dev@hadoop.apache.org Delivered-To: mailing list common-commits@hadoop.apache.org Received: (qmail 52625 invoked by uid 99); 3 Oct 2012 04:59:21 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Oct 2012 04:59:21 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO eris.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 03 Oct 2012 04:59:19 +0000 Received: from eris.apache.org (localhost [127.0.0.1]) by eris.apache.org (Postfix) with ESMTP id EDD8323888FE for ; Wed, 3 Oct 2012 04:58:34 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r1393290 - in /hadoop/common/branches/branch-1.0: CHANGES.txt src/docs/releasenotes.html Date: Wed, 03 Oct 2012 04:58:34 -0000 To: common-commits@hadoop.apache.org From: mattf@apache.org X-Mailer: svnmailer-1.0.8-patched Message-Id: <20121003045834.EDD8323888FE@eris.apache.org> Author: mattf Date: Wed Oct 3 04:58:34 2012 New Revision: 1393290 URL: http://svn.apache.org/viewvc?rev=1393290&view=rev Log: prepare for 1.0.4 release Modified: hadoop/common/branches/branch-1.0/CHANGES.txt hadoop/common/branches/branch-1.0/src/docs/releasenotes.html Modified: hadoop/common/branches/branch-1.0/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-1.0/CHANGES.txt?rev=1393290&r1=1393289&r2=1393290&view=diff ============================================================================== --- hadoop/common/branches/branch-1.0/CHANGES.txt (original) +++ hadoop/common/branches/branch-1.0/CHANGES.txt Wed Oct 3 04:58:34 2012 @@ -1,6 +1,6 @@ Hadoop Change Log -Release 1.0.4 - Unreleased +Release 1.0.4 - 2012.10.02 NEW FEATURES Modified: hadoop/common/branches/branch-1.0/src/docs/releasenotes.html URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-1.0/src/docs/releasenotes.html?rev=1393290&r1=1393289&r2=1393290&view=diff ============================================================================== --- hadoop/common/branches/branch-1.0/src/docs/releasenotes.html (original) +++ hadoop/common/branches/branch-1.0/src/docs/releasenotes.html Wed Oct 3 04:58:34 2012 @@ -2,7 +2,7 @@ -Hadoop 1.0.3 Release Notes +Hadoop 1.0.4 Release Notes -

Hadoop 1.0.3 Release Notes

+

Hadoop 1.0.4 Release Notes

These release notes include new developer and user-facing incompatibilities, features, and major improvements. +

Changes since Hadoop 1.0.3

+ +

Jiras with Release Notes (describe major or incompatible changes)

+
    + +
+ + +

Other Jiras (describe bug fixes and minor changes)

+
    + +
  • HADOOP-7154. + Minor improvement reported by tlipcon and fixed by tlipcon (scripts)
    + Should set MALLOC_ARENA_MAX in hadoop-config.sh
    +
    New versions of glibc present in RHEL6 include a new arena allocator design. In several clusters we've seen this new allocator cause huge amounts of virtual memory to be used, since when multiple threads perform allocations, they each get their own memory arena. On a 64-bit system, these arenas are 64M mappings, and the maximum number of arenas is 8 times the number of cores. We've observed a DN process using 14GB of vmem for only 300M of resident set. This causes all kinds of nasty issues fo...
  • + +
  • HDFS-3652. + Blocker bug reported by tlipcon and fixed by tlipcon (name-node)
    + 1.x: FSEditLog failure removes the wrong edit stream when storage dirs have same name
    +
    In {{FSEditLog.removeEditsForStorageDir}}, we iterate over the edits streams trying to find the stream corresponding to a given dir. To check equality, we currently use the following condition:
    {code}
    File parentDir = getStorageDirForStream(idx);
    if (parentDir.getName().equals(sd.getRoot().getName())) {
    {code}
    ... which is horribly incorrect. If two or more storage dirs happen to have the same terminal path component (eg /data/1/nn and /data/2/nn) then it will pick the wrong strea...
  • + +
  • MAPREDUCE-4399. + Major bug reported by vicaya and fixed by vicaya (performance, tasktracker)
    + Fix performance regression in shuffle
    +
    There is a significant (up to 3x) performance regression in shuffle (vs 0.20.2) in the Hadoop 1.x series. Most noticeable with high-end switches.
  • + + +
+ +

Changes since Hadoop 1.0.2

Jiras with Release Notes (describe major or incompatible changes)