Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 7A2192004F5 for ; Fri, 1 Sep 2017 22:01:02 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 787DE16D05D; Fri, 1 Sep 2017 20:01:02 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 972DF16BE4D for ; Fri, 1 Sep 2017 22:01:00 +0200 (CEST) Received: (qmail 22483 invoked by uid 500); 1 Sep 2017 20:00:52 -0000 Mailing-List: contact common-commits-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list common-commits@hadoop.apache.org Received: (qmail 19937 invoked by uid 99); 1 Sep 2017 20:00:50 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Sep 2017 20:00:50 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 2E66FF5639; Fri, 1 Sep 2017 20:00:50 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit From: aengineer@apache.org To: common-commits@hadoop.apache.org Date: Fri, 01 Sep 2017 20:01:07 -0000 Message-Id: <9544c272ea554ab58ad13f9d591138a1@git.apache.org> In-Reply-To: <20fd9b3290104dfda8af410f6d60d213@git.apache.org> References: <20fd9b3290104dfda8af410f6d60d213@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [19/74] [abbrv] [partial] hadoop git commit: HADOOP-14364. refresh changelog/release notes with newer Apache Yetus build archived-at: Fri, 01 Sep 2017 20:01:02 -0000 http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/CHANGES.1.1.0.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/CHANGES.1.1.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/CHANGES.1.1.0.md index a475bb3..db317ba 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/CHANGES.1.1.0.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/CHANGES.1.1.0.md @@ -24,176 +24,170 @@ | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-8552](https://issues.apache.org/jira/browse/HADOOP-8552) | Conflict: Same security.log.file for multiple users. | Major | conf, security | Karthik Kambatla | Karthik Kambatla | -| [HADOOP-8365](https://issues.apache.org/jira/browse/HADOOP-8365) | Add flag to disable durable sync | Blocker | . | Eli Collins | Eli Collins | +| [HADOOP-5464](https://issues.apache.org/jira/browse/HADOOP-5464) | DFSClient does not treat write timeout of 0 properly | Major | . | Raghu Angadi | Raghu Angadi | +| [HDFS-3044](https://issues.apache.org/jira/browse/HDFS-3044) | fsck move should be non-destructive by default | Major | namenode | Eli Collins | Colin P. McCabe | +| [HADOOP-8154](https://issues.apache.org/jira/browse/HADOOP-8154) | DNS#getIPs shouldn't silently return the local host IP for bogus interface names | Major | conf | Eli Collins | Eli Collins | | [HADOOP-8314](https://issues.apache.org/jira/browse/HADOOP-8314) | HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated | Major | security | Alejandro Abdelnur | Alejandro Abdelnur | | [HADOOP-8230](https://issues.apache.org/jira/browse/HADOOP-8230) | Enable sync by default and disable append | Major | . | Eli Collins | Eli Collins | -| [HADOOP-8154](https://issues.apache.org/jira/browse/HADOOP-8154) | DNS#getIPs shouldn't silently return the local host IP for bogus interface names | Major | conf | Eli Collins | Eli Collins | -| [HADOOP-5464](https://issues.apache.org/jira/browse/HADOOP-5464) | DFSClient does not treat write timeout of 0 properly | Major | . | Raghu Angadi | Raghu Angadi | | [HDFS-3522](https://issues.apache.org/jira/browse/HDFS-3522) | If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations | Major | namenode | Brandon Li | Brandon Li | -| [HDFS-3044](https://issues.apache.org/jira/browse/HDFS-3044) | fsck move should be non-destructive by default | Major | namenode | Eli Collins | Colin Patrick McCabe | +| [HADOOP-8365](https://issues.apache.org/jira/browse/HADOOP-8365) | Add flag to disable durable sync | Blocker | . | Eli Collins | Eli Collins | +| [HADOOP-8552](https://issues.apache.org/jira/browse/HADOOP-8552) | Conflict: Same security.log.file for multiple users. | Major | conf, security | Karthik Kambatla | Karthik Kambatla | | [HDFS-2617](https://issues.apache.org/jira/browse/HDFS-2617) | Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution | Major | security | Jakob Homan | Jakob Homan | -### IMPORTANT ISSUES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - ### NEW FEATURES: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-7823](https://issues.apache.org/jira/browse/HADOOP-7823) | port HADOOP-4012 to branch-1 (splitting support for bzip2) | Major | . | Tim Broberg | Andrew Purtell | +| [MAPREDUCE-3118](https://issues.apache.org/jira/browse/MAPREDUCE-3118) | Backport Gridmix and Rumen features from trunk to Hadoop 0.20 security branch | Major | contrib/gridmix, tools/rumen | Ravi Gummadi | Ravi Gummadi | | [HADOOP-7806](https://issues.apache.org/jira/browse/HADOOP-7806) | Support binding to sub-interfaces | Major | util | Harsh J | Harsh J | -| [HDFS-3150](https://issues.apache.org/jira/browse/HDFS-3150) | Add option for clients to contact DNs via hostname | Major | datanode, hdfs-client | Eli Collins | Eli Collins | | [HDFS-3148](https://issues.apache.org/jira/browse/HDFS-3148) | The client should be able to use multiple local interfaces for data transfer | Major | hdfs-client, performance | Eli Collins | Eli Collins | -| [HDFS-3055](https://issues.apache.org/jira/browse/HDFS-3055) | Implement recovery mode for branch-1 | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe | +| [HDFS-3055](https://issues.apache.org/jira/browse/HDFS-3055) | Implement recovery mode for branch-1 | Minor | . | Colin P. McCabe | Colin P. McCabe | | [MAPREDUCE-3837](https://issues.apache.org/jira/browse/MAPREDUCE-3837) | Job tracker is not able to recover job in case of crash and after that no user can submit job. | Major | . | Mayank Bansal | Mayank Bansal | -| [MAPREDUCE-3118](https://issues.apache.org/jira/browse/MAPREDUCE-3118) | Backport Gridmix and Rumen features from trunk to Hadoop 0.20 security branch | Major | contrib/gridmix, tools/rumen | Ravi Gummadi | Ravi Gummadi | +| [HADOOP-7823](https://issues.apache.org/jira/browse/HADOOP-7823) | port HADOOP-4012 to branch-1 (splitting support for bzip2) | Major | . | Tim Broberg | Andrew Purtell | +| [HDFS-3150](https://issues.apache.org/jira/browse/HDFS-3150) | Add option for clients to contact DNs via hostname | Major | datanode, hdfs-client | Eli Collins | Eli Collins | ### IMPROVEMENTS: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-8748](https://issues.apache.org/jira/browse/HADOOP-8748) | Move dfsclient retry to a util class | Minor | io | Arun C Murthy | Arun C Murthy | -| [HADOOP-8656](https://issues.apache.org/jira/browse/HADOOP-8656) | backport forced daemon shutdown of HADOOP-8353 into branch-1 | Minor | bin | Steve Loughran | Roman Shaposhnik | -| [HADOOP-8430](https://issues.apache.org/jira/browse/HADOOP-8430) | Backport new FileSystem methods introduced by HADOOP-8014 to branch-1 | Major | . | Eli Collins | Eli Collins | -| [HADOOP-8209](https://issues.apache.org/jira/browse/HADOOP-8209) | Add option to relax build-version check for branch-1 | Major | . | Eli Collins | Eli Collins | -| [HADOOP-7509](https://issues.apache.org/jira/browse/HADOOP-7509) | Improve message when Authentication is required | Trivial | . | Ravi Prakash | Ravi Prakash | +| [MAPREDUCE-782](https://issues.apache.org/jira/browse/MAPREDUCE-782) | Use PureJavaCrc32 in mapreduce spills | Minor | performance | Todd Lipcon | Todd Lipcon | +| [HDFS-496](https://issues.apache.org/jira/browse/HDFS-496) | Use PureJavaCrc32 in HDFS | Minor | datanode, hdfs-client, performance | Todd Lipcon | Todd Lipcon | +| [MAPREDUCE-1906](https://issues.apache.org/jira/browse/MAPREDUCE-1906) | Lower default minimum heartbeat interval for tasktracker \> Jobtracker | Major | jobtracker, performance, tasktracker | Scott Carey | Todd Lipcon | | [HADOOP-6995](https://issues.apache.org/jira/browse/HADOOP-6995) | Allow wildcards to be used in ProxyUsers configurations | Minor | security | Todd Lipcon | Todd Lipcon | -| [HDFS-3871](https://issues.apache.org/jira/browse/HDFS-3871) | Change NameNodeProxies to use HADOOP-8748 | Minor | hdfs-client | Arun C Murthy | Arun C Murthy | -| [HDFS-3814](https://issues.apache.org/jira/browse/HDFS-3814) | Make the replication monitor multipliers configurable in 1.x | Major | namenode | Suresh Srinivas | Jing Zhao | -| [HDFS-3703](https://issues.apache.org/jira/browse/HDFS-3703) | Decrease the datanode failure detection time | Major | datanode, namenode | Nicolas Liochon | Jing Zhao | -| [HDFS-3667](https://issues.apache.org/jira/browse/HDFS-3667) | Add retry support to WebHdfsFileSystem | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | -| [HDFS-3617](https://issues.apache.org/jira/browse/HDFS-3617) | Port HDFS-96 to branch-1 (support blocks greater than 2GB) | Major | . | Matt Foley | Harsh J | -| [HDFS-3596](https://issues.apache.org/jira/browse/HDFS-3596) | Improve FSEditLog pre-allocation in branch-1 | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe | -| [HDFS-3516](https://issues.apache.org/jira/browse/HDFS-3516) | Check content-type in WebHdfsFileSystem | Major | hdfs-client, webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | -| [HDFS-3504](https://issues.apache.org/jira/browse/HDFS-3504) | Configurable retry in DFSClient | Major | hdfs-client | Siddharth Seth | Tsz Wo Nicholas Sze | -| [HDFS-3131](https://issues.apache.org/jira/browse/HDFS-3131) | Improve TestStorageRestore | Minor | . | Tsz Wo Nicholas Sze | Brandon Li | -| [HDFS-3094](https://issues.apache.org/jira/browse/HDFS-3094) | add -nonInteractive and -force option to namenode -format command | Major | . | Arpit Gupta | Arpit Gupta | -| [HDFS-2872](https://issues.apache.org/jira/browse/HDFS-2872) | Add sanity checks during edits loading that generation stamps are non-decreasing | Major | namenode | Todd Lipcon | Colin Patrick McCabe | -| [HDFS-2654](https://issues.apache.org/jira/browse/HDFS-2654) | Make BlockReaderLocal not extend RemoteBlockReader2 | Major | datanode | Eli Collins | Eli Collins | -| [HDFS-2653](https://issues.apache.org/jira/browse/HDFS-2653) | DFSClient should cache whether addrs are non-local when short-circuiting is enabled | Major | datanode | Eli Collins | Eli Collins | -| [HDFS-2638](https://issues.apache.org/jira/browse/HDFS-2638) | Improve a block recovery log | Minor | namenode | Eli Collins | Eli Collins | +| [MAPREDUCE-2103](https://issues.apache.org/jira/browse/MAPREDUCE-2103) | task-controller shouldn't require o-r permissions | Trivial | task-controller | Todd Lipcon | Todd Lipcon | +| [MAPREDUCE-2836](https://issues.apache.org/jira/browse/MAPREDUCE-2836) | Provide option to fail jobs when submitted to non-existent pools. | Minor | contrib/fair-share | Jeff Bean | Ahmed Radwan | +| [HADOOP-7509](https://issues.apache.org/jira/browse/HADOOP-7509) | Improve message when Authentication is required | Trivial | . | Ravi Prakash | Ravi Prakash | | [HDFS-2465](https://issues.apache.org/jira/browse/HDFS-2465) | Add HDFS support for fadvise readahead and drop-behind | Major | datanode, performance | Todd Lipcon | Todd Lipcon | -| [HDFS-1378](https://issues.apache.org/jira/browse/HDFS-1378) | Edit log replay should track and report file offsets in case of errors | Major | namenode | Todd Lipcon | Colin Patrick McCabe | -| [HDFS-496](https://issues.apache.org/jira/browse/HDFS-496) | Use PureJavaCrc32 in HDFS | Minor | datanode, hdfs-client, performance | Todd Lipcon | Todd Lipcon | -| [MAPREDUCE-4603](https://issues.apache.org/jira/browse/MAPREDUCE-4603) | Allow JobClient to retry job-submission when JT is in safemode | Major | . | Arun C Murthy | Arun C Murthy | -| [MAPREDUCE-4511](https://issues.apache.org/jira/browse/MAPREDUCE-4511) | Add IFile readahead | Major | mrv1, mrv2, performance | Ahmed Radwan | Ahmed Radwan | -| [MAPREDUCE-4328](https://issues.apache.org/jira/browse/MAPREDUCE-4328) | Add the option to quiesce the JobTracker | Major | mrv1 | Arun C Murthy | Arun C Murthy | -| [MAPREDUCE-4001](https://issues.apache.org/jira/browse/MAPREDUCE-4001) | Improve MAPREDUCE-3789's fix logic by looking at job's slot demands instead | Minor | capacity-sched | Harsh J | Harsh J | -| [MAPREDUCE-3597](https://issues.apache.org/jira/browse/MAPREDUCE-3597) | Provide a way to access other info of history file from Rumentool | Major | tools/rumen | Ravi Gummadi | Ravi Gummadi | +| [MAPREDUCE-3278](https://issues.apache.org/jira/browse/MAPREDUCE-3278) | 0.20: avoid a busy-loop in ReduceTask scheduling | Major | mrv1, performance, task | Todd Lipcon | Todd Lipcon | +| [MAPREDUCE-3365](https://issues.apache.org/jira/browse/MAPREDUCE-3365) | Uncomment eventlog settings from the documentation | Trivial | contrib/fair-share | Sho Shimauchi | Sho Shimauchi | | [MAPREDUCE-3395](https://issues.apache.org/jira/browse/MAPREDUCE-3395) | Add mapred.disk.healthChecker.interval to mapred-default.xml | Trivial | documentation | Eli Collins | Eli Collins | | [MAPREDUCE-3394](https://issues.apache.org/jira/browse/MAPREDUCE-3394) | Add log guard for a debug message in ReduceTask | Trivial | task | Todd Lipcon | Todd Lipcon | -| [MAPREDUCE-3365](https://issues.apache.org/jira/browse/MAPREDUCE-3365) | Uncomment eventlog settings from the documentation | Trivial | contrib/fair-share | Sho Shimauchi | Sho Shimauchi | -| [MAPREDUCE-3289](https://issues.apache.org/jira/browse/MAPREDUCE-3289) | Make use of fadvise in the NM's shuffle handler | Major | mrv2, nodemanager, performance | Todd Lipcon | Todd Lipcon | -| [MAPREDUCE-3278](https://issues.apache.org/jira/browse/MAPREDUCE-3278) | 0.20: avoid a busy-loop in ReduceTask scheduling | Major | mrv1, performance, task | Todd Lipcon | Todd Lipcon | +| [HDFS-2638](https://issues.apache.org/jira/browse/HDFS-2638) | Improve a block recovery log | Minor | namenode | Eli Collins | Eli Collins | +| [HDFS-2653](https://issues.apache.org/jira/browse/HDFS-2653) | DFSClient should cache whether addrs are non-local when short-circuiting is enabled | Major | datanode | Eli Collins | Eli Collins | +| [HDFS-2654](https://issues.apache.org/jira/browse/HDFS-2654) | Make BlockReaderLocal not extend RemoteBlockReader2 | Major | datanode | Eli Collins | Eli Collins | +| [MAPREDUCE-3597](https://issues.apache.org/jira/browse/MAPREDUCE-3597) | Provide a way to access other info of history file from Rumentool | Major | tools/rumen | Ravi Gummadi | Ravi Gummadi | | [MAPREDUCE-2919](https://issues.apache.org/jira/browse/MAPREDUCE-2919) | The JT web UI should show job start times | Minor | jobtracker | Eli Collins | Harsh J | -| [MAPREDUCE-2836](https://issues.apache.org/jira/browse/MAPREDUCE-2836) | Provide option to fail jobs when submitted to non-existent pools. | Minor | contrib/fair-share | Jeff Bean | Ahmed Radwan | +| [HDFS-2872](https://issues.apache.org/jira/browse/HDFS-2872) | Add sanity checks during edits loading that generation stamps are non-decreasing | Major | namenode | Todd Lipcon | Colin P. McCabe | +| [MAPREDUCE-4001](https://issues.apache.org/jira/browse/MAPREDUCE-4001) | Improve MAPREDUCE-3789's fix logic by looking at job's slot demands instead | Minor | capacity-sched | Harsh J | Harsh J | | [MAPREDUCE-2835](https://issues.apache.org/jira/browse/MAPREDUCE-2835) | Make per-job counter limits configurable | Major | . | Tom White | Tom White | -| [MAPREDUCE-2103](https://issues.apache.org/jira/browse/MAPREDUCE-2103) | task-controller shouldn't require o-r permissions | Trivial | task-controller | Todd Lipcon | Todd Lipcon | -| [MAPREDUCE-1906](https://issues.apache.org/jira/browse/MAPREDUCE-1906) | Lower default minimum heartbeat interval for tasktracker \> Jobtracker | Major | jobtracker, performance, tasktracker | Scott Carey | Todd Lipcon | -| [MAPREDUCE-782](https://issues.apache.org/jira/browse/MAPREDUCE-782) | Use PureJavaCrc32 in mapreduce spills | Minor | performance | Todd Lipcon | Todd Lipcon | +| [HDFS-3131](https://issues.apache.org/jira/browse/HDFS-3131) | Improve TestStorageRestore | Minor | . | Tsz Wo Nicholas Sze | Brandon Li | +| [HDFS-1378](https://issues.apache.org/jira/browse/HDFS-1378) | Edit log replay should track and report file offsets in case of errors | Major | namenode | Todd Lipcon | Colin P. McCabe | +| [HADOOP-8209](https://issues.apache.org/jira/browse/HADOOP-8209) | Add option to relax build-version check for branch-1 | Major | . | Eli Collins | Eli Collins | +| [HDFS-3094](https://issues.apache.org/jira/browse/HDFS-3094) | add -nonInteractive and -force option to namenode -format command | Major | . | Arpit Gupta | Arpit Gupta | +| [HADOOP-8430](https://issues.apache.org/jira/browse/HADOOP-8430) | Backport new FileSystem methods introduced by HADOOP-8014 to branch-1 | Major | . | Eli Collins | Eli Collins | +| [HDFS-3504](https://issues.apache.org/jira/browse/HDFS-3504) | Configurable retry in DFSClient | Major | hdfs-client | Siddharth Seth | Tsz Wo Nicholas Sze | +| [HDFS-3516](https://issues.apache.org/jira/browse/HDFS-3516) | Check content-type in WebHdfsFileSystem | Major | hdfs-client, webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | +| [HDFS-3596](https://issues.apache.org/jira/browse/HDFS-3596) | Improve FSEditLog pre-allocation in branch-1 | Minor | . | Colin P. McCabe | Colin P. McCabe | +| [HDFS-3617](https://issues.apache.org/jira/browse/HDFS-3617) | Port HDFS-96 to branch-1 (support blocks greater than 2GB) | Major | . | Matt Foley | Harsh J | +| [HDFS-3667](https://issues.apache.org/jira/browse/HDFS-3667) | Add retry support to WebHdfsFileSystem | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | +| [MAPREDUCE-3289](https://issues.apache.org/jira/browse/MAPREDUCE-3289) | Make use of fadvise in the NM's shuffle handler | Major | mrv2, nodemanager, performance | Todd Lipcon | Todd Lipcon | +| [HADOOP-8656](https://issues.apache.org/jira/browse/HADOOP-8656) | backport forced daemon shutdown of HADOOP-8353 into branch-1 | Minor | bin | Steve Loughran | Roman Shaposhnik | +| [MAPREDUCE-4511](https://issues.apache.org/jira/browse/MAPREDUCE-4511) | Add IFile readahead | Major | mrv1, mrv2, performance | Ahmed Radwan | Ahmed Radwan | +| [HDFS-3814](https://issues.apache.org/jira/browse/HDFS-3814) | Make the replication monitor multipliers configurable in 1.x | Major | namenode | Suresh Srinivas | Jing Zhao | +| [MAPREDUCE-4328](https://issues.apache.org/jira/browse/MAPREDUCE-4328) | Add the option to quiesce the JobTracker | Major | mrv1 | Arun C Murthy | Arun C Murthy | +| [HADOOP-8748](https://issues.apache.org/jira/browse/HADOOP-8748) | Move dfsclient retry to a util class | Minor | io | Arun C Murthy | Arun C Murthy | +| [HDFS-3871](https://issues.apache.org/jira/browse/HDFS-3871) | Change NameNodeProxies to use HADOOP-8748 | Minor | hdfs-client | Arun C Murthy | Arun C Murthy | +| [HDFS-3703](https://issues.apache.org/jira/browse/HDFS-3703) | Decrease the datanode failure detection time | Major | datanode, namenode | Nicolas Liochon | Jing Zhao | +| [MAPREDUCE-4603](https://issues.apache.org/jira/browse/MAPREDUCE-4603) | Allow JobClient to retry job-submission when JT is in safemode | Major | . | Arun C Murthy | Arun C Murthy | ### BUG FIXES: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-8617](https://issues.apache.org/jira/browse/HADOOP-8617) | backport pure Java CRC32 calculator changes to branch-1 | Major | performance | Brandon Li | Brandon Li | -| [HADOOP-8445](https://issues.apache.org/jira/browse/HADOOP-8445) | Token should not print the password in toString | Major | security | Ravi Prakash | Ravi Prakash | -| [HADOOP-8417](https://issues.apache.org/jira/browse/HADOOP-8417) | HADOOP-6963 didn't update hadoop-core-pom-template.xml | Major | . | Ted Yu | Ted Yu | -| [HADOOP-8399](https://issues.apache.org/jira/browse/HADOOP-8399) | Remove JDK5 dependency from Hadoop 1.0+ line | Major | build | Konstantin Boudnik | Konstantin Boudnik | -| [HADOOP-8329](https://issues.apache.org/jira/browse/HADOOP-8329) | Build fails with Java 7 | Major | build | Kumar Ravi | Eli Collins | -| [HADOOP-8269](https://issues.apache.org/jira/browse/HADOOP-8269) | Fix some javadoc warnings on branch-1 | Trivial | documentation | Eli Collins | Eli Collins | -| [HADOOP-8159](https://issues.apache.org/jira/browse/HADOOP-8159) | NetworkTopology: getLeaf should check for invalid topologies | Major | . | Colin Patrick McCabe | Colin Patrick McCabe | -| [HADOOP-7988](https://issues.apache.org/jira/browse/HADOOP-7988) | Upper case in hostname part of the principals doesn't work with kerberos. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | -| [HADOOP-7982](https://issues.apache.org/jira/browse/HADOOP-7982) | UserGroupInformation fails to login if thread's context classloader can't load HadoopLoginModule | Major | security | Todd Lipcon | Todd Lipcon | -| [HADOOP-7908](https://issues.apache.org/jira/browse/HADOOP-7908) | Fix three javadoc warnings on branch-1 | Trivial | documentation | Eli Collins | Eli Collins | -| [HADOOP-7898](https://issues.apache.org/jira/browse/HADOOP-7898) | Fix javadoc warnings in AuthenticationToken.java | Minor | security | Suresh Srinivas | Suresh Srinivas | -| [HADOOP-7879](https://issues.apache.org/jira/browse/HADOOP-7879) | DistributedFileSystem#createNonRecursive should also incrementWriteOps statistics. | Trivial | . | Jonathan Hsieh | Jonathan Hsieh | -| [HADOOP-7870](https://issues.apache.org/jira/browse/HADOOP-7870) | fix SequenceFile#createWriter with boolean createParent arg to respect createParent. | Major | . | Jonathan Hsieh | Jonathan Hsieh | -| [HADOOP-7745](https://issues.apache.org/jira/browse/HADOOP-7745) | I switched variable names in HADOOP-7509 | Major | . | Ravi Prakash | Ravi Prakash | -| [HADOOP-7666](https://issues.apache.org/jira/browse/HADOOP-7666) | branch-0.20-security doesn't include o.a.h.security.TestAuthenticationFilter | Major | security | Aaron T. Myers | Aaron T. Myers | -| [HADOOP-7665](https://issues.apache.org/jira/browse/HADOOP-7665) | branch-0.20-security doesn't include SPNEGO settings in core-default.xml | Major | security | Aaron T. Myers | Aaron T. Myers | -| [HADOOP-7653](https://issues.apache.org/jira/browse/HADOOP-7653) | tarball doesn't include .eclipse.templates | Minor | build | Jonathan Natkins | Jonathan Natkins | -| [HADOOP-7634](https://issues.apache.org/jira/browse/HADOOP-7634) | Cluster setup docs specify wrong owner for task-controller.cfg | Minor | documentation, security | Eli Collins | Eli Collins | +| [HADOOP-5836](https://issues.apache.org/jira/browse/HADOOP-5836) | Bug in S3N handling of directory markers using an object with a trailing "/" causes jobs to fail | Major | fs/s3 | Ian Nowland | Ian Nowland | +| [HADOOP-6546](https://issues.apache.org/jira/browse/HADOOP-6546) | BloomMapFile can return false negatives | Major | io | Clark Jefcoat | Clark Jefcoat | +| [HADOOP-6947](https://issues.apache.org/jira/browse/HADOOP-6947) | Kerberos relogin should set refreshKrb5Config to true | Major | security | Todd Lipcon | Todd Lipcon | +| [HDFS-2305](https://issues.apache.org/jira/browse/HDFS-2305) | Running multiple 2NNs can result in corrupt file system | Major | namenode | Aaron T. Myers | Aaron T. Myers | | [HADOOP-7629](https://issues.apache.org/jira/browse/HADOOP-7629) | regression with MAPREDUCE-2289 - setPermission passed immutable FsPermission (rpc failure) | Major | . | Patrick Hunt | Todd Lipcon | +| [HADOOP-7634](https://issues.apache.org/jira/browse/HADOOP-7634) | Cluster setup docs specify wrong owner for task-controller.cfg | Minor | documentation, security | Eli Collins | Eli Collins | +| [HADOOP-7665](https://issues.apache.org/jira/browse/HADOOP-7665) | branch-0.20-security doesn't include SPNEGO settings in core-default.xml | Major | security | Aaron T. Myers | Aaron T. Myers | +| [HADOOP-7666](https://issues.apache.org/jira/browse/HADOOP-7666) | branch-0.20-security doesn't include o.a.h.security.TestAuthenticationFilter | Major | security | Aaron T. Myers | Aaron T. Myers | | [HADOOP-7621](https://issues.apache.org/jira/browse/HADOOP-7621) | alfredo config should be in a file not readable by users | Critical | security | Alejandro Abdelnur | Aaron T. Myers | +| [HADOOP-7653](https://issues.apache.org/jira/browse/HADOOP-7653) | tarball doesn't include .eclipse.templates | Minor | build | Jonathan Natkins | Jonathan Natkins | +| [MAPREDUCE-2932](https://issues.apache.org/jira/browse/MAPREDUCE-2932) | Missing instrumentation plugin class shouldn't crash the TT startup per design | Trivial | tasktracker | Harsh J | Harsh J | +| [HADOOP-7745](https://issues.apache.org/jira/browse/HADOOP-7745) | I switched variable names in HADOOP-7509 | Major | . | Ravi Prakash | Ravi Prakash | +| [MAPREDUCE-3405](https://issues.apache.org/jira/browse/MAPREDUCE-3405) | MAPREDUCE-3015 broke compilation of contrib scheduler tests | Critical | capacity-sched, contrib/fair-share | Todd Lipcon | Todd Lipcon | +| [MAPREDUCE-3419](https://issues.apache.org/jira/browse/MAPREDUCE-3419) | Don't mark exited TT threads as dead in MiniMRCluster | Major | tasktracker, test | Eli Collins | Eli Collins | | [HADOOP-7297](https://issues.apache.org/jira/browse/HADOOP-7297) | Error in the documentation regarding Checkpoint/Backup Node | Trivial | documentation | arnaud p | Harsh J | -| [HADOOP-6947](https://issues.apache.org/jira/browse/HADOOP-6947) | Kerberos relogin should set refreshKrb5Config to true | Major | security | Todd Lipcon | Todd Lipcon | -| [HADOOP-6546](https://issues.apache.org/jira/browse/HADOOP-6546) | BloomMapFile can return false negatives | Major | io | Clark Jefcoat | Clark Jefcoat | -| [HADOOP-6527](https://issues.apache.org/jira/browse/HADOOP-6527) | UserGroupInformation::createUserForTesting clobbers already defined group mappings | Major | security | Jakob Homan | Ivan Mitic | -| [HADOOP-5836](https://issues.apache.org/jira/browse/HADOOP-5836) | Bug in S3N handling of directory markers using an object with a trailing "/" causes jobs to fail | Major | fs/s3 | Ian Nowland | Ian Nowland | -| [HDFS-3966](https://issues.apache.org/jira/browse/HDFS-3966) | For branch-1, TestFileCreation should use JUnit4 to make assumeTrue work | Minor | . | Jing Zhao | Jing Zhao | -| [HDFS-3701](https://issues.apache.org/jira/browse/HDFS-3701) | HDFS may miss the final block when reading a file opened for writing if one of the datanode is dead | Critical | hdfs-client | Nicolas Liochon | Nicolas Liochon | -| [HDFS-3698](https://issues.apache.org/jira/browse/HDFS-3698) | TestHftpFileSystem is failing in branch-1 due to changed default secure port | Major | security | Aaron T. Myers | Aaron T. Myers | -| [HDFS-3696](https://issues.apache.org/jira/browse/HDFS-3696) | Create files with WebHdfsFileSystem goes OOM when file size is big | Critical | webhdfs | Kihwal Lee | Tsz Wo Nicholas Sze | -| [HDFS-3551](https://issues.apache.org/jira/browse/HDFS-3551) | WebHDFS CREATE does not use client location for redirection | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | -| [HDFS-3518](https://issues.apache.org/jira/browse/HDFS-3518) | Provide API to check HDFS operational state | Major | hdfs-client | Bikas Saha | Tsz Wo Nicholas Sze | -| [HDFS-3466](https://issues.apache.org/jira/browse/HDFS-3466) | The SPNEGO filter for the NameNode should come out of the web keytab file | Major | namenode, security | Owen O'Malley | Owen O'Malley | -| [HDFS-3461](https://issues.apache.org/jira/browse/HDFS-3461) | HFTP should use the same port & protocol for getting the delegation token | Major | . | Owen O'Malley | Owen O'Malley | -| [HDFS-3453](https://issues.apache.org/jira/browse/HDFS-3453) | HDFS does not use ClientProtocol in a backward-compatible way | Major | hdfs-client | Kihwal Lee | Kihwal Lee | -| [HDFS-3330](https://issues.apache.org/jira/browse/HDFS-3330) | If GetImageServlet throws an Error or RTE, response has HTTP "OK" status | Critical | namenode | Todd Lipcon | Todd Lipcon | -| [HDFS-3176](https://issues.apache.org/jira/browse/HDFS-3176) | JsonUtil should not parse the MD5MD5CRC32FileChecksum bytes on its own. | Major | hdfs-client | Kihwal Lee | Kihwal Lee | -| [HDFS-3078](https://issues.apache.org/jira/browse/HDFS-3078) | 2NN https port setting is broken | Major | . | Eli Collins | Eli Collins | -| [HDFS-3008](https://issues.apache.org/jira/browse/HDFS-3008) | Negative caching of local addrs doesn't work | Major | hdfs-client | Eli Collins | Eli Collins | -| [HDFS-2877](https://issues.apache.org/jira/browse/HDFS-2877) | If locking of a storage dir fails, it will remove the other NN's lock file on exit | Major | namenode | Todd Lipcon | Todd Lipcon | -| [HDFS-2869](https://issues.apache.org/jira/browse/HDFS-2869) | Error in Webhdfs documentation for mkdir | Minor | webhdfs | Harsh J | Harsh J | -| [HDFS-2790](https://issues.apache.org/jira/browse/HDFS-2790) | FSNamesystem.setTimes throws exception with wrong configuration name in the message | Minor | . | Arpit Gupta | Arpit Gupta | -| [HDFS-2751](https://issues.apache.org/jira/browse/HDFS-2751) | Datanode drops OS cache behind reads even for short reads | Major | datanode | Todd Lipcon | Todd Lipcon | -| [HDFS-2741](https://issues.apache.org/jira/browse/HDFS-2741) | dfs.datanode.max.xcievers missing in 0.20.205.0 | Minor | . | Markus Jelsma | | -| [HDFS-2728](https://issues.apache.org/jira/browse/HDFS-2728) | Remove dfsadmin -printTopology from branch-1 docs since it does not exist | Minor | namenode | Harsh J | Harsh J | +| [HDFS-2541](https://issues.apache.org/jira/browse/HDFS-2541) | For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. | Major | datanode | Harsh J | Harsh J | +| [MAPREDUCE-2905](https://issues.apache.org/jira/browse/MAPREDUCE-2905) | CapBasedLoadManager incorrectly allows assignment when assignMultiple is true (was: assignmultiple per job) | Major | contrib/fair-share | Jeff Bean | Jeff Bean | +| [MAPREDUCE-2806](https://issues.apache.org/jira/browse/MAPREDUCE-2806) | [Gridmix] Load job fails with timeout errors when resource emulation is turned on | Major | contrib/gridmix | Amar Kamat | Amar Kamat | +| [HADOOP-7870](https://issues.apache.org/jira/browse/HADOOP-7870) | fix SequenceFile#createWriter with boolean createParent arg to respect createParent. | Major | . | Jonathan Hsieh | Jonathan Hsieh | +| [HADOOP-7879](https://issues.apache.org/jira/browse/HADOOP-7879) | DistributedFileSystem#createNonRecursive should also incrementWriteOps statistics. | Trivial | . | Jonathan Hsieh | Jonathan Hsieh | | [HDFS-2637](https://issues.apache.org/jira/browse/HDFS-2637) | The rpc timeout for block recovery is too low | Major | hdfs-client | Eli Collins | Eli Collins | +| [HADOOP-7898](https://issues.apache.org/jira/browse/HADOOP-7898) | Fix javadoc warnings in AuthenticationToken.java | Minor | security | Suresh Srinivas | Suresh Srinivas | +| [HADOOP-7908](https://issues.apache.org/jira/browse/HADOOP-7908) | Fix three javadoc warnings on branch-1 | Trivial | documentation | Eli Collins | Eli Collins | | [HDFS-2547](https://issues.apache.org/jira/browse/HDFS-2547) | ReplicationTargetChooser has incorrect block placement comments | Trivial | namenode | Harsh J | Harsh J | -| [HDFS-2541](https://issues.apache.org/jira/browse/HDFS-2541) | For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. | Major | datanode | Harsh J | Harsh J | -| [HDFS-2305](https://issues.apache.org/jira/browse/HDFS-2305) | Running multiple 2NNs can result in corrupt file system | Major | namenode | Aaron T. Myers | Aaron T. Myers | +| [HDFS-2728](https://issues.apache.org/jira/browse/HDFS-2728) | Remove dfsadmin -printTopology from branch-1 docs since it does not exist | Minor | namenode | Harsh J | Harsh J | +| [HDFS-2741](https://issues.apache.org/jira/browse/HDFS-2741) | dfs.datanode.max.xcievers missing in 0.20.205.0 | Minor | . | Markus Jelsma | | | [HDFS-1910](https://issues.apache.org/jira/browse/HDFS-1910) | when dfs.name.dir and dfs.name.edits.dir are same fsimage will be saved twice every time | Minor | namenode | Gokul | | -| [MAPREDUCE-4698](https://issues.apache.org/jira/browse/MAPREDUCE-4698) | TestJobHistoryConfig throws Exception in testJobHistoryLogging | Minor | . | Gopal V | Gopal V | -| [MAPREDUCE-4675](https://issues.apache.org/jira/browse/MAPREDUCE-4675) | TestKillSubProcesses fails as the process is still alive after the job is done | Major | test | Arpit Gupta | Bikas Saha | -| [MAPREDUCE-4673](https://issues.apache.org/jira/browse/MAPREDUCE-4673) | make TestRawHistoryFile and TestJobHistoryServer more robust | Major | test | Arpit Gupta | Arpit Gupta | -| [MAPREDUCE-4558](https://issues.apache.org/jira/browse/MAPREDUCE-4558) | TestJobTrackerSafeMode is failing | Major | . | Siddharth Seth | Siddharth Seth | -| [MAPREDUCE-4400](https://issues.apache.org/jira/browse/MAPREDUCE-4400) | Fix performance regression for small jobs/workflows | Major | performance, task | Luke Lu | Luke Lu | -| [MAPREDUCE-4241](https://issues.apache.org/jira/browse/MAPREDUCE-4241) | Pipes examples do not compile on Ubuntu 12.04 | Major | build, examples | Andrew Bayer | Andrew Bayer | -| [MAPREDUCE-4095](https://issues.apache.org/jira/browse/MAPREDUCE-4095) | TestJobInProgress#testLocality uses a bogus topology | Major | . | Eli Collins | Colin Patrick McCabe | -| [MAPREDUCE-4088](https://issues.apache.org/jira/browse/MAPREDUCE-4088) | Task stuck in JobLocalizer prevented other tasks on the same node from committing | Critical | mrv1 | Ravi Prakash | Ravi Prakash | -| [MAPREDUCE-4087](https://issues.apache.org/jira/browse/MAPREDUCE-4087) | [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases | Major | . | Ravi Gummadi | Ravi Gummadi | +| [HDFS-2790](https://issues.apache.org/jira/browse/HDFS-2790) | FSNamesystem.setTimes throws exception with wrong configuration name in the message | Minor | . | Arpit Gupta | Arpit Gupta | +| [HADOOP-7982](https://issues.apache.org/jira/browse/HADOOP-7982) | UserGroupInformation fails to login if thread's context classloader can't load HadoopLoginModule | Major | security | Todd Lipcon | Todd Lipcon | +| [HDFS-2751](https://issues.apache.org/jira/browse/HDFS-2751) | Datanode drops OS cache behind reads even for short reads | Major | datanode | Todd Lipcon | Todd Lipcon | +| [HADOOP-7988](https://issues.apache.org/jira/browse/HADOOP-7988) | Upper case in hostname part of the principals doesn't work with kerberos. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | +| [HDFS-2877](https://issues.apache.org/jira/browse/HDFS-2877) | If locking of a storage dir fails, it will remove the other NN's lock file on exit | Major | namenode | Todd Lipcon | Todd Lipcon | | [MAPREDUCE-3789](https://issues.apache.org/jira/browse/MAPREDUCE-3789) | CapacityTaskScheduler may perform unnecessary reservations in heterogenous tracker environments | Critical | capacity-sched, scheduler | Harsh J | Harsh J | +| [HDFS-2869](https://issues.apache.org/jira/browse/HDFS-2869) | Error in Webhdfs documentation for mkdir | Minor | webhdfs | Harsh J | Harsh J | +| [HDFS-3008](https://issues.apache.org/jira/browse/HDFS-3008) | Negative caching of local addrs doesn't work | Major | hdfs-client | Eli Collins | Eli Collins | +| [HDFS-3078](https://issues.apache.org/jira/browse/HDFS-3078) | 2NN https port setting is broken | Major | . | Eli Collins | Eli Collins | +| [MAPREDUCE-1740](https://issues.apache.org/jira/browse/MAPREDUCE-1740) | NPE in getMatchingLevelForNodes when node locations are variable depth | Major | jobtracker | Todd Lipcon | Ahmed Radwan | +| [HADOOP-8159](https://issues.apache.org/jira/browse/HADOOP-8159) | NetworkTopology: getLeaf should check for invalid topologies | Major | . | Colin P. McCabe | Colin P. McCabe | +| [MAPREDUCE-4087](https://issues.apache.org/jira/browse/MAPREDUCE-4087) | [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases | Major | . | Ravi Gummadi | Ravi Gummadi | +| [MAPREDUCE-4095](https://issues.apache.org/jira/browse/MAPREDUCE-4095) | TestJobInProgress#testLocality uses a bogus topology | Major | . | Eli Collins | Colin P. McCabe | +| [HDFS-3176](https://issues.apache.org/jira/browse/HDFS-3176) | JsonUtil should not parse the MD5MD5CRC32FileChecksum bytes on its own. | Major | hdfs-client | Kihwal Lee | Kihwal Lee | +| [HADOOP-8269](https://issues.apache.org/jira/browse/HADOOP-8269) | Fix some javadoc warnings on branch-1 | Trivial | documentation | Eli Collins | Eli Collins | | [MAPREDUCE-3674](https://issues.apache.org/jira/browse/MAPREDUCE-3674) | If invoked with no queueName request param, jobqueue\_details.jsp injects a null queue name into schedulers. | Critical | jobtracker | Harsh J | Harsh J | -| [MAPREDUCE-3419](https://issues.apache.org/jira/browse/MAPREDUCE-3419) | Don't mark exited TT threads as dead in MiniMRCluster | Major | tasktracker, test | Eli Collins | Eli Collins | -| [MAPREDUCE-3405](https://issues.apache.org/jira/browse/MAPREDUCE-3405) | MAPREDUCE-3015 broke compilation of contrib scheduler tests | Critical | capacity-sched, contrib/fair-share | Todd Lipcon | Todd Lipcon | -| [MAPREDUCE-2932](https://issues.apache.org/jira/browse/MAPREDUCE-2932) | Missing instrumentation plugin class shouldn't crash the TT startup per design | Trivial | tasktracker | Harsh J | Harsh J | -| [MAPREDUCE-2905](https://issues.apache.org/jira/browse/MAPREDUCE-2905) | CapBasedLoadManager incorrectly allows assignment when assignMultiple is true (was: assignmultiple per job) | Major | contrib/fair-share | Jeff Bean | Jeff Bean | -| [MAPREDUCE-2903](https://issues.apache.org/jira/browse/MAPREDUCE-2903) | Map Tasks graph is throwing XML Parse error when Job is executed with 0 maps | Major | jobtracker | Devaraj K | Devaraj K | -| [MAPREDUCE-2806](https://issues.apache.org/jira/browse/MAPREDUCE-2806) | [Gridmix] Load job fails with timeout errors when resource emulation is turned on | Major | contrib/gridmix | Amar Kamat | Amar Kamat | -| [MAPREDUCE-2377](https://issues.apache.org/jira/browse/MAPREDUCE-2377) | task-controller fails to parse configuration if it doesn't end in \n | Major | task-controller | Todd Lipcon | Benoy Antony | +| [MAPREDUCE-4088](https://issues.apache.org/jira/browse/MAPREDUCE-4088) | Task stuck in JobLocalizer prevented other tasks on the same node from committing | Critical | mrv1 | Ravi Prakash | Ravi Prakash | +| [MAPREDUCE-4241](https://issues.apache.org/jira/browse/MAPREDUCE-4241) | Pipes examples do not compile on Ubuntu 12.04 | Major | build, examples | Andrew Bayer | Andrew Bayer | +| [HDFS-3330](https://issues.apache.org/jira/browse/HDFS-3330) | If GetImageServlet throws an Error or RTE, response has HTTP "OK" status | Critical | namenode | Todd Lipcon | Todd Lipcon | +| [HADOOP-8329](https://issues.apache.org/jira/browse/HADOOP-8329) | Build fails with Java 7 | Major | build | Kumar Ravi | Eli Collins | +| [HDFS-3453](https://issues.apache.org/jira/browse/HDFS-3453) | HDFS does not use ClientProtocol in a backward-compatible way | Major | hdfs-client | Kihwal Lee | Kihwal Lee | +| [HADOOP-8445](https://issues.apache.org/jira/browse/HADOOP-8445) | Token should not print the password in toString | Major | security | Ravi Prakash | Ravi Prakash | +| [MAPREDUCE-2377](https://issues.apache.org/jira/browse/MAPREDUCE-2377) | task-controller fails to parse configuration if it doesn't end in \\n | Major | task-controller | Todd Lipcon | Benoy Antony | +| [HDFS-3518](https://issues.apache.org/jira/browse/HDFS-3518) | Provide API to check HDFS operational state | Major | hdfs-client | Bikas Saha | Tsz Wo Nicholas Sze | +| [HDFS-3551](https://issues.apache.org/jira/browse/HDFS-3551) | WebHDFS CREATE does not use client location for redirection | Major | webhdfs | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | +| [HADOOP-6527](https://issues.apache.org/jira/browse/HADOOP-6527) | UserGroupInformation::createUserForTesting clobbers already defined group mappings | Major | security | Jakob Homan | Ivan Mitic | | [MAPREDUCE-2129](https://issues.apache.org/jira/browse/MAPREDUCE-2129) | Job may hang if mapreduce.job.committer.setup.cleanup.needed=false and mapreduce.map/reduce.failures.maxpercent\>0 | Major | jobtracker | Kang Xiao | Subroto Sanyal | -| [MAPREDUCE-1740](https://issues.apache.org/jira/browse/MAPREDUCE-1740) | NPE in getMatchingLevelForNodes when node locations are variable depth | Major | jobtracker | Todd Lipcon | Ahmed Radwan | +| [HADOOP-8417](https://issues.apache.org/jira/browse/HADOOP-8417) | HADOOP-6963 didn't update hadoop-core-pom-template.xml | Major | . | Ted Yu | Ted Yu | +| [HADOOP-8399](https://issues.apache.org/jira/browse/HADOOP-8399) | Remove JDK5 dependency from Hadoop 1.0+ line | Major | build | Konstantin Boudnik | Konstantin Boudnik | +| [MAPREDUCE-2903](https://issues.apache.org/jira/browse/MAPREDUCE-2903) | Map Tasks graph is throwing XML Parse error when Job is executed with 0 maps | Major | jobtracker | Devaraj K | Devaraj K | +| [HADOOP-8617](https://issues.apache.org/jira/browse/HADOOP-8617) | backport pure Java CRC32 calculator changes to branch-1 | Major | performance | Brandon Li | Brandon Li | +| [MAPREDUCE-4400](https://issues.apache.org/jira/browse/MAPREDUCE-4400) | Fix performance regression for small jobs/workflows | Major | performance, task | Luke Lu | Luke Lu | +| [HDFS-3696](https://issues.apache.org/jira/browse/HDFS-3696) | Create files with WebHdfsFileSystem goes OOM when file size is big | Critical | webhdfs | Kihwal Lee | Tsz Wo Nicholas Sze | +| [MAPREDUCE-4558](https://issues.apache.org/jira/browse/MAPREDUCE-4558) | TestJobTrackerSafeMode is failing | Major | . | Siddharth Seth | Siddharth Seth | +| [HDFS-3466](https://issues.apache.org/jira/browse/HDFS-3466) | The SPNEGO filter for the NameNode should come out of the web keytab file | Major | namenode, security | Owen O'Malley | Owen O'Malley | +| [HDFS-3966](https://issues.apache.org/jira/browse/HDFS-3966) | For branch-1, TestFileCreation should use JUnit4 to make assumeTrue work | Minor | . | Jing Zhao | Jing Zhao | +| [HDFS-3698](https://issues.apache.org/jira/browse/HDFS-3698) | TestHftpFileSystem is failing in branch-1 due to changed default secure port | Major | security | Aaron T. Myers | Aaron T. Myers | +| [MAPREDUCE-4673](https://issues.apache.org/jira/browse/MAPREDUCE-4673) | make TestRawHistoryFile and TestJobHistoryServer more robust | Major | test | Arpit Gupta | Arpit Gupta | +| [MAPREDUCE-4675](https://issues.apache.org/jira/browse/MAPREDUCE-4675) | TestKillSubProcesses fails as the process is still alive after the job is done | Major | test | Arpit Gupta | Bikas Saha | +| [HDFS-3701](https://issues.apache.org/jira/browse/HDFS-3701) | HDFS may miss the final block when reading a file opened for writing if one of the datanode is dead | Critical | hdfs-client | Nicolas Liochon | Nicolas Liochon | +| [MAPREDUCE-4698](https://issues.apache.org/jira/browse/MAPREDUCE-4698) | TestJobHistoryConfig throws Exception in testJobHistoryLogging | Minor | . | Gopal V | Gopal V | +| [HDFS-3461](https://issues.apache.org/jira/browse/HDFS-3461) | HFTP should use the same port & protocol for getting the delegation token | Major | . | Owen O'Malley | Owen O'Malley | ### TESTS: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-7942](https://issues.apache.org/jira/browse/HADOOP-7942) | enabling clover coverage reports fails hadoop unit test compilation | Major | . | Giridharan Kesavan | Jitendra Nath Pandey | -| [HDFS-3129](https://issues.apache.org/jira/browse/HDFS-3129) | NetworkTopology: add test that getLeaf should check for invalid topologies | Minor | . | Colin Patrick McCabe | Colin Patrick McCabe | -| [HDFS-2332](https://issues.apache.org/jira/browse/HDFS-2332) | Add test for HADOOP-7629: using an immutable FsPermission as an IPC parameter | Major | test | Todd Lipcon | Todd Lipcon | | [MAPREDUCE-2073](https://issues.apache.org/jira/browse/MAPREDUCE-2073) | TestTrackerDistributedCacheManager should be up-front about requirements on build environment | Trivial | distributed-cache, test | Todd Lipcon | Todd Lipcon | +| [HDFS-2332](https://issues.apache.org/jira/browse/HDFS-2332) | Add test for HADOOP-7629: using an immutable FsPermission as an IPC parameter | Major | test | Todd Lipcon | Todd Lipcon | +| [HDFS-3129](https://issues.apache.org/jira/browse/HDFS-3129) | NetworkTopology: add test that getLeaf should check for invalid topologies | Minor | . | Colin P. McCabe | Colin P. McCabe | +| [HADOOP-7942](https://issues.apache.org/jira/browse/HADOOP-7942) | enabling clover coverage reports fails hadoop unit test compilation | Major | . | Giridharan Kesavan | Jitendra Nath Pandey | ### SUB-TASKS: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-7753](https://issues.apache.org/jira/browse/HADOOP-7753) | Support fadvise and sync\_data\_range in NativeIO, add ReadaheadPool class | Major | io, native, performance | Todd Lipcon | Todd Lipcon | -| [MAPREDUCE-3424](https://issues.apache.org/jira/browse/MAPREDUCE-3424) | Some LinuxTaskController cleanup | Minor | tasktracker | Eli Collins | Eli Collins | -| [MAPREDUCE-3015](https://issues.apache.org/jira/browse/MAPREDUCE-3015) | Add local dir failure info to metrics and the web UI | Major | tasktracker | Eli Collins | Eli Collins | | [MAPREDUCE-3008](https://issues.apache.org/jira/browse/MAPREDUCE-3008) | [Gridmix] Improve cumulative CPU usage emulation for short running tasks | Major | contrib/gridmix | Amar Kamat | Amar Kamat | | [MAPREDUCE-2957](https://issues.apache.org/jira/browse/MAPREDUCE-2957) | The TT should not re-init if it has no good local dirs | Major | tasktracker | Eli Collins | Eli Collins | +| [HADOOP-7753](https://issues.apache.org/jira/browse/HADOOP-7753) | Support fadvise and sync\_data\_range in NativeIO, add ReadaheadPool class | Major | io, native, performance | Todd Lipcon | Todd Lipcon | | [MAPREDUCE-2850](https://issues.apache.org/jira/browse/MAPREDUCE-2850) | Add test for TaskTracker disk failure handling (MR-2413) | Major | tasktracker | Eli Collins | Ravi Gummadi | +| [MAPREDUCE-3015](https://issues.apache.org/jira/browse/MAPREDUCE-3015) | Add local dir failure info to metrics and the web UI | Major | tasktracker | Eli Collins | Eli Collins | +| [MAPREDUCE-3424](https://issues.apache.org/jira/browse/MAPREDUCE-3424) | Some LinuxTaskController cleanup | Minor | tasktracker | Eli Collins | Eli Collins | ### OTHER: http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/RELEASENOTES.1.1.0.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/RELEASENOTES.1.1.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/RELEASENOTES.1.1.0.md index 53c7939..3298d25 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/RELEASENOTES.1.1.0.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.0/RELEASENOTES.1.1.0.md @@ -23,92 +23,90 @@ These release notes cover new developer and user-facing incompatibilities, impor --- -* [HADOOP-8552](https://issues.apache.org/jira/browse/HADOOP-8552) | *Major* | **Conflict: Same security.log.file for multiple users.** +* [HADOOP-5464](https://issues.apache.org/jira/browse/HADOOP-5464) | *Major* | **DFSClient does not treat write timeout of 0 properly** -**WARNING: No release note provided for this incompatible change.** +Zero values for dfs.socket.timeout and dfs.datanode.socket.write.timeout are now respected. Previously zero values for these parameters resulted in a 5 second timeout. --- -* [HADOOP-8365](https://issues.apache.org/jira/browse/HADOOP-8365) | *Blocker* | **Add flag to disable durable sync** +* [MAPREDUCE-1906](https://issues.apache.org/jira/browse/MAPREDUCE-1906) | *Major* | **Lower default minimum heartbeat interval for tasktracker \> Jobtracker** -This patch enables durable sync by default. Installation where HBase was not used, that used to run without setting "dfs.support.append" or setting it to false explicitly in the configuration, must add a new flag "dfs.durable.sync" and set it to false to preserve the previous semantics. +The default minimum heartbeat interval has been dropped from 3 seconds to 300ms to increase scheduling throughput on small clusters. Users may tune mapreduce.jobtracker.heartbeats.in.second to adjust this value. --- -* [HADOOP-8314](https://issues.apache.org/jira/browse/HADOOP-8314) | *Major* | **HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated** +* [HADOOP-6995](https://issues.apache.org/jira/browse/HADOOP-6995) | *Minor* | **Allow wildcards to be used in ProxyUsers configurations** -**WARNING: No release note provided for this incompatible change.** +When configuring proxy users and hosts, the special wildcard value "\*" may be specified to match any host or any user. --- -* [HADOOP-8230](https://issues.apache.org/jira/browse/HADOOP-8230) | *Major* | **Enable sync by default and disable append** +* [MAPREDUCE-2517](https://issues.apache.org/jira/browse/MAPREDUCE-2517) | *Major* | **Porting Gridmix v3 system tests into trunk branch.** -Append is not supported in Hadoop 1.x. Please upgrade to 2.x if you need append. If you enabled dfs.support.append for HBase, you're OK, as durable sync (why HBase required dfs.support.append) is now enabled by default. If you really need the previous functionality, to turn on the append functionality set the flag "dfs.support.broken.append" to true. +Adds system tests to Gridmix. These system tests cover various features like job types (load and sleep), user resolvers (round-robin, submitter-user, echo) and submission modes (stress, replay and serial). --- -* [HADOOP-8154](https://issues.apache.org/jira/browse/HADOOP-8154) | *Major* | **DNS#getIPs shouldn't silently return the local host IP for bogus interface names** +* [MAPREDUCE-3008](https://issues.apache.org/jira/browse/MAPREDUCE-3008) | *Major* | **[Gridmix] Improve cumulative CPU usage emulation for short running tasks** -**WARNING: No release note provided for this incompatible change.** +Improves cumulative CPU emulation for short running tasks. --- -* [HADOOP-6995](https://issues.apache.org/jira/browse/HADOOP-6995) | *Minor* | **Allow wildcards to be used in ProxyUsers configurations** +* [MAPREDUCE-3118](https://issues.apache.org/jira/browse/MAPREDUCE-3118) | *Major* | **Backport Gridmix and Rumen features from trunk to Hadoop 0.20 security branch** -When configuring proxy users and hosts, the special wildcard value "\*" may be specified to match any host or any user. +Backports latest features from trunk to 0.20.206 branch. --- -* [HADOOP-5464](https://issues.apache.org/jira/browse/HADOOP-5464) | *Major* | **DFSClient does not treat write timeout of 0 properly** +* [HDFS-2465](https://issues.apache.org/jira/browse/HDFS-2465) | *Major* | **Add HDFS support for fadvise readahead and drop-behind** -Zero values for dfs.socket.timeout and dfs.datanode.socket.write.timeout are now respected. Previously zero values for these parameters resulted in a 5 second timeout. +HDFS now has the ability to use posix\_fadvise and sync\_data\_range syscalls to manage the OS buffer cache. This support is currently considered experimental, and may be enabled by configuring the following keys: +dfs.datanode.drop.cache.behind.writes - set to true to drop data out of the buffer cache after writing +dfs.datanode.drop.cache.behind.reads - set to true to drop data out of the buffer cache when performing sequential reads +dfs.datanode.sync.behind.writes - set to true to trigger dirty page writeback immediately after writing data +dfs.datanode.readahead.bytes - set to a non-zero value to trigger readahead for sequential reads --- -* [HDFS-3814](https://issues.apache.org/jira/browse/HDFS-3814) | *Major* | **Make the replication monitor multipliers configurable in 1.x** - -This change adds two new configuration parameters. -# {{dfs.namenode.invalidate.work.pct.per.iteration}} for controlling deletion rate of blocks. -# {{dfs.namenode.replication.work.multiplier.per.iteration}} for controlling replication rate. This in turn allows controlling the time it takes for decommissioning. +* [MAPREDUCE-3597](https://issues.apache.org/jira/browse/MAPREDUCE-3597) | *Major* | **Provide a way to access other info of history file from Rumentool** -Please see hdfs-default.xml for detailed description. +Rumen now provides {{Parsed\*}} objects. These objects provide extra information that are not provided by {{Logged\*}} objects. --- -* [HDFS-3703](https://issues.apache.org/jira/browse/HDFS-3703) | *Major* | **Decrease the datanode failure detection time** - -This jira adds a new DataNode state called "stale" at the NameNode. DataNodes are marked as stale if it does not send heartbeat message to NameNode within the timeout configured using the configuration parameter "dfs.namenode.stale.datanode.interval" in seconds (default value is 30 seconds). NameNode picks a stale datanode as the last target to read from when returning block locations for reads. +* [HDFS-2741](https://issues.apache.org/jira/browse/HDFS-2741) | *Minor* | **dfs.datanode.max.xcievers missing in 0.20.205.0** -This feature is by default turned \* off \*. To turn on the feature, set the HDFS configuration "dfs.namenode.check.stale.datanode" to true. +Document and raise the maximum allowed transfer threads on a DataNode to 4096. This helps Apache HBase in particular. --- -* [HDFS-3522](https://issues.apache.org/jira/browse/HDFS-3522) | *Major* | **If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations** +* [HDFS-3044](https://issues.apache.org/jira/browse/HDFS-3044) | *Major* | **fsck move should be non-destructive by default** -getBlockLocations(), and hence open() for read, will now throw SafeModeException if the NameNode is still in safe mode and there are no replicas reported yet for one of the blocks in the file. +The fsck "move" option is no longer destructive. It copies the accessible blocks of corrupt files to lost and found as before, but no longer deletes the corrupt files after copying the blocks. The original, destructive behavior can be enabled by specifying both the "move" and "delete" options. --- -* [HDFS-3518](https://issues.apache.org/jira/browse/HDFS-3518) | *Major* | **Provide API to check HDFS operational state** +* [HADOOP-8154](https://issues.apache.org/jira/browse/HADOOP-8154) | *Major* | **DNS#getIPs shouldn't silently return the local host IP for bogus interface names** -Add a utility method HdfsUtils.isHealthy(uri) for checking if the given HDFS is healthy. +**WARNING: No release note provided for this change.** --- -* [HDFS-3094](https://issues.apache.org/jira/browse/HDFS-3094) | *Major* | **add -nonInteractive and -force option to namenode -format command** +* [MAPREDUCE-4087](https://issues.apache.org/jira/browse/MAPREDUCE-4087) | *Major* | **[Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases** -The 'namenode -format' command now supports the flags '-nonInteractive' and '-force' to improve usefulness without user input. +Fixes the issue of GenerateDistCacheData job slowness. --- @@ -120,97 +118,99 @@ This is a new feature. It is documented in hdfs\_user\_guide.xml. --- -* [HDFS-3044](https://issues.apache.org/jira/browse/HDFS-3044) | *Major* | **fsck move should be non-destructive by default** +* [HDFS-3094](https://issues.apache.org/jira/browse/HDFS-3094) | *Major* | **add -nonInteractive and -force option to namenode -format command** -The fsck "move" option is no longer destructive. It copies the accessible blocks of corrupt files to lost and found as before, but no longer deletes the corrupt files after copying the blocks. The original, destructive behavior can be enabled by specifying both the "move" and "delete" options. +The 'namenode -format' command now supports the flags '-nonInteractive' and '-force' to improve usefulness without user input. --- -* [HDFS-2741](https://issues.apache.org/jira/browse/HDFS-2741) | *Minor* | **dfs.datanode.max.xcievers missing in 0.20.205.0** +* [HADOOP-8314](https://issues.apache.org/jira/browse/HADOOP-8314) | *Major* | **HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated** -Document and raise the maximum allowed transfer threads on a DataNode to 4096. This helps Apache HBase in particular. +**WARNING: No release note provided for this change.** --- -* [HDFS-2617](https://issues.apache.org/jira/browse/HDFS-2617) | *Major* | **Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution** +* [HADOOP-8230](https://issues.apache.org/jira/browse/HADOOP-8230) | *Major* | **Enable sync by default and disable append** -Due to the requirement that KSSL use weak encryption types for Kerberos tickets, HTTP authentication to the NameNode will now use SPNEGO by default. This will require users of previous branch-1 releases with security enabled to modify their configurations and create new Kerberos principals in order to use SPNEGO. The old behavior of using KSSL can optionally be enabled by setting the configuration option "hadoop.security.use-weak-http-crypto" to "true". +Append is not supported in Hadoop 1.x. Please upgrade to 2.x if you need append. If you enabled dfs.support.append for HBase, you're OK, as durable sync (why HBase required dfs.support.append) is now enabled by default. If you really need the previous functionality, to turn on the append functionality set the flag "dfs.support.broken.append" to true. --- -* [HDFS-2465](https://issues.apache.org/jira/browse/HDFS-2465) | *Major* | **Add HDFS support for fadvise readahead and drop-behind** +* [HDFS-3522](https://issues.apache.org/jira/browse/HDFS-3522) | *Major* | **If NN is in safemode, it should throw SafeModeException when getBlockLocations has zero locations** -HDFS now has the ability to use posix\_fadvise and sync\_data\_range syscalls to manage the OS buffer cache. This support is currently considered experimental, and may be enabled by configuring the following keys: -dfs.datanode.drop.cache.behind.writes - set to true to drop data out of the buffer cache after writing -dfs.datanode.drop.cache.behind.reads - set to true to drop data out of the buffer cache when performing sequential reads -dfs.datanode.sync.behind.writes - set to true to trigger dirty page writeback immediately after writing data -dfs.datanode.readahead.bytes - set to a non-zero value to trigger readahead for sequential reads +getBlockLocations(), and hence open() for read, will now throw SafeModeException if the NameNode is still in safe mode and there are no replicas reported yet for one of the blocks in the file. --- -* [MAPREDUCE-4698](https://issues.apache.org/jira/browse/MAPREDUCE-4698) | *Minor* | **TestJobHistoryConfig throws Exception in testJobHistoryLogging** +* [HDFS-3518](https://issues.apache.org/jira/browse/HDFS-3518) | *Major* | **Provide API to check HDFS operational state** -Optionally call initialize/initializeFileSystem in JobTracker::startTracker() to allow for proper initialization when offerService is not being called. +Add a utility method HdfsUtils.isHealthy(uri) for checking if the given HDFS is healthy. --- -* [MAPREDUCE-4675](https://issues.apache.org/jira/browse/MAPREDUCE-4675) | *Major* | **TestKillSubProcesses fails as the process is still alive after the job is done** +* [HADOOP-8365](https://issues.apache.org/jira/browse/HADOOP-8365) | *Blocker* | **Add flag to disable durable sync** -Fixed a race condition caused in TestKillSubProcesses caused due to a recent commit. +This patch enables durable sync by default. Installation where HBase was not used, that used to run without setting "dfs.support.append" or setting it to false explicitly in the configuration, must add a new flag "dfs.durable.sync" and set it to false to preserve the previous semantics. --- -* [MAPREDUCE-4673](https://issues.apache.org/jira/browse/MAPREDUCE-4673) | *Major* | **make TestRawHistoryFile and TestJobHistoryServer more robust** +* [HADOOP-8552](https://issues.apache.org/jira/browse/HADOOP-8552) | *Major* | **Conflict: Same security.log.file for multiple users.** -Fixed TestRawHistoryFile and TestJobHistoryServer to not write to /tmp. +**WARNING: No release note provided for this change.** --- -* [MAPREDUCE-4087](https://issues.apache.org/jira/browse/MAPREDUCE-4087) | *Major* | **[Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases** +* [HDFS-2617](https://issues.apache.org/jira/browse/HDFS-2617) | *Major* | **Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution** -Fixes the issue of GenerateDistCacheData job slowness. +Due to the requirement that KSSL use weak encryption types for Kerberos tickets, HTTP authentication to the NameNode will now use SPNEGO by default. This will require users of previous branch-1 releases with security enabled to modify their configurations and create new Kerberos principals in order to use SPNEGO. The old behavior of using KSSL can optionally be enabled by setting the configuration option "hadoop.security.use-weak-http-crypto" to "true". --- -* [MAPREDUCE-3597](https://issues.apache.org/jira/browse/MAPREDUCE-3597) | *Major* | **Provide a way to access other info of history file from Rumentool** +* [HDFS-3814](https://issues.apache.org/jira/browse/HDFS-3814) | *Major* | **Make the replication monitor multipliers configurable in 1.x** -Rumen now provides {{Parsed\*}} objects. These objects provide extra information that are not provided by {{Logged\*}} objects. +This change adds two new configuration parameters. +# {{dfs.namenode.invalidate.work.pct.per.iteration}} for controlling deletion rate of blocks. +# {{dfs.namenode.replication.work.multiplier.per.iteration}} for controlling replication rate. This in turn allows controlling the time it takes for decommissioning. + +Please see hdfs-default.xml for detailed description. --- -* [MAPREDUCE-3118](https://issues.apache.org/jira/browse/MAPREDUCE-3118) | *Major* | **Backport Gridmix and Rumen features from trunk to Hadoop 0.20 security branch** +* [HDFS-3703](https://issues.apache.org/jira/browse/HDFS-3703) | *Major* | **Decrease the datanode failure detection time** -Backports latest features from trunk to 0.20.206 branch. +This jira adds a new DataNode state called "stale" at the NameNode. DataNodes are marked as stale if it does not send heartbeat message to NameNode within the timeout configured using the configuration parameter "dfs.namenode.stale.datanode.interval" in seconds (default value is 30 seconds). NameNode picks a stale datanode as the last target to read from when returning block locations for reads. + +This feature is by default turned \* off \*. To turn on the feature, set the HDFS configuration "dfs.namenode.check.stale.datanode" to true. --- -* [MAPREDUCE-3008](https://issues.apache.org/jira/browse/MAPREDUCE-3008) | *Major* | **[Gridmix] Improve cumulative CPU usage emulation for short running tasks** +* [MAPREDUCE-4673](https://issues.apache.org/jira/browse/MAPREDUCE-4673) | *Major* | **make TestRawHistoryFile and TestJobHistoryServer more robust** -Improves cumulative CPU emulation for short running tasks. +Fixed TestRawHistoryFile and TestJobHistoryServer to not write to /tmp. --- -* [MAPREDUCE-2517](https://issues.apache.org/jira/browse/MAPREDUCE-2517) | *Major* | **Porting Gridmix v3 system tests into trunk branch.** +* [MAPREDUCE-4675](https://issues.apache.org/jira/browse/MAPREDUCE-4675) | *Major* | **TestKillSubProcesses fails as the process is still alive after the job is done** -Adds system tests to Gridmix. These system tests cover various features like job types (load and sleep), user resolvers (round-robin, submitter-user, echo) and submission modes (stress, replay and serial). +Fixed a race condition caused in TestKillSubProcesses caused due to a recent commit. --- -* [MAPREDUCE-1906](https://issues.apache.org/jira/browse/MAPREDUCE-1906) | *Major* | **Lower default minimum heartbeat interval for tasktracker \> Jobtracker** +* [MAPREDUCE-4698](https://issues.apache.org/jira/browse/MAPREDUCE-4698) | *Minor* | **TestJobHistoryConfig throws Exception in testJobHistoryLogging** -The default minimum heartbeat interval has been dropped from 3 seconds to 300ms to increase scheduling throughput on small clusters. Users may tune mapreduce.jobtracker.heartbeats.in.second to adjust this value. +Optionally call initialize/initializeFileSystem in JobTracker::startTracker() to allow for proper initialization when offerService is not being called. http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.1/CHANGES.1.1.1.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.1/CHANGES.1.1.1.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.1/CHANGES.1.1.1.md index 315a43a..7460505 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.1/CHANGES.1.1.1.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.1/CHANGES.1.1.1.md @@ -20,16 +20,6 @@ ## Release 1.1.1 - 2012-11-27 -### INCOMPATIBLE CHANGES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - -### IMPORTANT ISSUES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | ### NEW FEATURES: @@ -43,36 +33,30 @@ | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | +| [HDFS-1539](https://issues.apache.org/jira/browse/HDFS-1539) | prevent data loss when a cluster suffers a power loss | Major | datanode, hdfs-client, namenode | dhruba borthakur | dhruba borthakur | | [HADOOP-8823](https://issues.apache.org/jira/browse/HADOOP-8823) | ant package target should not depend on cn-docs | Major | build | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | | [HDFS-4174](https://issues.apache.org/jira/browse/HDFS-4174) | Backport HDFS-1031 to branch-1: to list a few of the corrupted files in WebUI | Major | . | Jing Zhao | Jing Zhao | -| [HDFS-1539](https://issues.apache.org/jira/browse/HDFS-1539) | prevent data loss when a cluster suffers a power loss | Major | datanode, hdfs-client, namenode | dhruba borthakur | dhruba borthakur | ### BUG FIXES: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-9017](https://issues.apache.org/jira/browse/HADOOP-9017) | fix hadoop-client-pom-template.xml and hadoop-client-pom-template.xml for version | Major | build | Giridharan Kesavan | Giridharan Kesavan | -| [HADOOP-8995](https://issues.apache.org/jira/browse/HADOOP-8995) | Remove unnecessary bogus exception log from Configuration | Minor | . | Jing Zhao | Jing Zhao | -| [HADOOP-8882](https://issues.apache.org/jira/browse/HADOOP-8882) | uppercase namenode host name causes fsck to fail when useKsslAuth is on | Major | . | Arpit Gupta | Arpit Gupta | -| [HADOOP-8878](https://issues.apache.org/jira/browse/HADOOP-8878) | uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on | Major | . | Arpit Gupta | Arpit Gupta | -| [HADOOP-8745](https://issues.apache.org/jira/browse/HADOOP-8745) | Incorrect version numbers in hadoop-core POM | Minor | . | Matthias Friedrich | Matthias Friedrich | -| [HDFS-4161](https://issues.apache.org/jira/browse/HDFS-4161) | HDFS keeps a thread open for every file writer | Major | hdfs-client | Suresh Srinivas | Tsz Wo Nicholas Sze | -| [HDFS-4134](https://issues.apache.org/jira/browse/HDFS-4134) | hadoop namenode & datanode entry points should return negative exit code on bad arguments | Minor | namenode | Steve Loughran | | -| [HDFS-4105](https://issues.apache.org/jira/browse/HDFS-4105) | the SPNEGO user for secondary namenode should use the web keytab | Major | . | Arpit Gupta | Arpit Gupta | +| [HDFS-3658](https://issues.apache.org/jira/browse/HDFS-3658) | TestDFSClientRetries#testNamenodeRestart failed | Major | . | Eli Collins | Tsz Wo Nicholas Sze | | [HDFS-3846](https://issues.apache.org/jira/browse/HDFS-3846) | Namenode deadlock in branch-1 | Major | namenode | Tsz Wo Nicholas Sze | Brandon Li | | [HDFS-3791](https://issues.apache.org/jira/browse/HDFS-3791) | Backport HDFS-173 to Branch-1 : Recursively deleting a directory with millions of files makes NameNode unresponsive for other commands until the deletion completes | Major | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | -| [HDFS-3658](https://issues.apache.org/jira/browse/HDFS-3658) | TestDFSClientRetries#testNamenodeRestart failed | Major | . | Eli Collins | Tsz Wo Nicholas Sze | | [HDFS-2815](https://issues.apache.org/jira/browse/HDFS-2815) | Namenode is not coming out of safemode when we perform ( NN crash + restart ) . Also FSCK report shows blocks missed. | Critical | namenode | Uma Maheswara Rao G | Uma Maheswara Rao G | -| [MAPREDUCE-4792](https://issues.apache.org/jira/browse/MAPREDUCE-4792) | Unit Test TestJobTrackerRestartWithLostTracker fails with ant-1.8.4 | Major | test | Amir Sanjar | Amir Sanjar | +| [HADOOP-8745](https://issues.apache.org/jira/browse/HADOOP-8745) | Incorrect version numbers in hadoop-core POM | Minor | . | Matthias Friedrich | Matthias Friedrich | +| [HADOOP-8878](https://issues.apache.org/jira/browse/HADOOP-8878) | uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on | Major | . | Arpit Gupta | Arpit Gupta | +| [HADOOP-8882](https://issues.apache.org/jira/browse/HADOOP-8882) | uppercase namenode host name causes fsck to fail when useKsslAuth is on | Major | . | Arpit Gupta | Arpit Gupta | +| [HADOOP-8995](https://issues.apache.org/jira/browse/HADOOP-8995) | Remove unnecessary bogus exception log from Configuration | Minor | . | Jing Zhao | Jing Zhao | +| [HDFS-4134](https://issues.apache.org/jira/browse/HDFS-4134) | hadoop namenode & datanode entry points should return negative exit code on bad arguments | Minor | namenode | Steve Loughran | | | [MAPREDUCE-4782](https://issues.apache.org/jira/browse/MAPREDUCE-4782) | NLineInputFormat skips first line of last InputSplit | Blocker | client | Mark Fuhs | Mark Fuhs | +| [HDFS-4161](https://issues.apache.org/jira/browse/HDFS-4161) | HDFS keeps a thread open for every file writer | Major | hdfs-client | Suresh Srinivas | Tsz Wo Nicholas Sze | | [MAPREDUCE-4749](https://issues.apache.org/jira/browse/MAPREDUCE-4749) | Killing multiple attempts of a task taker longer as more attempts are killed | Major | . | Arpit Gupta | Arpit Gupta | - - -### TESTS: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-9017](https://issues.apache.org/jira/browse/HADOOP-9017) | fix hadoop-client-pom-template.xml and hadoop-client-pom-template.xml for version | Major | build | Giridharan Kesavan | Giridharan Kesavan | +| [HDFS-4105](https://issues.apache.org/jira/browse/HDFS-4105) | the SPNEGO user for secondary namenode should use the web keytab | Major | . | Arpit Gupta | Arpit Gupta | +| [MAPREDUCE-4792](https://issues.apache.org/jira/browse/MAPREDUCE-4792) | Unit Test TestJobTrackerRestartWithLostTracker fails with ant-1.8.4 | Major | test | Amir Sanjar | Amir Sanjar | ### SUB-TASKS: @@ -82,9 +66,3 @@ | [HDFS-1108](https://issues.apache.org/jira/browse/HDFS-1108) | Log newly allocated blocks | Major | ha, namenode | dhruba borthakur | Todd Lipcon | -### OTHER: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/CHANGES.1.1.2.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/CHANGES.1.1.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/CHANGES.1.1.2.md index 100f23a..20a8885 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/CHANGES.1.1.2.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/CHANGES.1.1.2.md @@ -20,16 +20,6 @@ ## Release 1.1.2 - 2013-02-15 -### INCOMPATIBLE CHANGES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - -### IMPORTANT ISSUES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | ### NEW FEATURES: @@ -43,9 +33,9 @@ | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | +| [HDFS-4252](https://issues.apache.org/jira/browse/HDFS-4252) | Improve confusing log message that prints exception when editlog read is completed | Major | namenode | Suresh Srinivas | Jing Zhao | | [HADOOP-9111](https://issues.apache.org/jira/browse/HADOOP-9111) | Fix failed testcases with @ignore annotation In branch-1 | Minor | test | Jing Zhao | Jing Zhao | | [HADOOP-8561](https://issues.apache.org/jira/browse/HADOOP-8561) | Introduce HADOOP\_PROXY\_USER for secure impersonation in child hadoop client processes | Major | security | Luke Lu | Yu Gao | -| [HDFS-4252](https://issues.apache.org/jira/browse/HDFS-4252) | Improve confusing log message that prints exception when editlog read is completed | Major | namenode | Suresh Srinivas | Jing Zhao | | [MAPREDUCE-4397](https://issues.apache.org/jira/browse/MAPREDUCE-4397) | Introduce HADOOP\_SECURITY\_CONF\_DIR for task-controller | Major | task-controller | Luke Lu | Yu Gao | @@ -53,25 +43,25 @@ | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-9115](https://issues.apache.org/jira/browse/HADOOP-9115) | Deadlock in configuration when writing configuration to hdfs | Blocker | . | Arpit Gupta | Jing Zhao | +| [MAPREDUCE-2374](https://issues.apache.org/jira/browse/MAPREDUCE-2374) | "Text File Busy" errors launching MR tasks | Major | . | Todd Lipcon | Andy Isaacson | | [HADOOP-8880](https://issues.apache.org/jira/browse/HADOOP-8880) | Missing jersey jars as dependency in the pom causes hive tests to fail | Major | . | Giridharan Kesavan | Giridharan Kesavan | -| [HADOOP-8419](https://issues.apache.org/jira/browse/HADOOP-8419) | GzipCodec NPE upon reset with IBM JDK | Major | io | Luke Lu | Yu Li | -| [HADOOP-8418](https://issues.apache.org/jira/browse/HADOOP-8418) | Fix UGI for IBM JDK running on Windows | Major | security | Luke Lu | Yu Gao | -| [HDFS-5996](https://issues.apache.org/jira/browse/HDFS-5996) | hadoop 1.1.2. hdfs write bug | Major | fuse-dfs | WangMeng | | -| [HDFS-4423](https://issues.apache.org/jira/browse/HDFS-4423) | Checkpoint exception causes fatal damage to fsimage. | Blocker | namenode | ChenFolin | Chris Nauroth | | [HDFS-4208](https://issues.apache.org/jira/browse/HDFS-4208) | NameNode could be stuck in SafeMode due to never-created blocks | Critical | namenode | Brandon Li | Brandon Li | | [HDFS-3727](https://issues.apache.org/jira/browse/HDFS-3727) | When using SPNEGO, NN should not try to log in using KSSL principal | Major | namenode | Aaron T. Myers | Aaron T. Myers | -| [MAPREDUCE-4888](https://issues.apache.org/jira/browse/MAPREDUCE-4888) | NLineInputFormat drops data in 1.1 and beyond | Blocker | mrv1 | Robert Joseph Evans | Vinod Kumar Vavilapalli | -| [MAPREDUCE-4859](https://issues.apache.org/jira/browse/MAPREDUCE-4859) | TestRecoveryManager fails on branch-1 | Major | . | Arun C Murthy | Arun C Murthy | -| [MAPREDUCE-4858](https://issues.apache.org/jira/browse/MAPREDUCE-4858) | TestWebUIAuthorization fails on branch-1 | Major | . | Arun C Murthy | Arun C Murthy | +| [MAPREDUCE-4478](https://issues.apache.org/jira/browse/MAPREDUCE-4478) | TaskTracker's heartbeat is out of control | Major | . | Liyin Liang | Liyin Liang | | [MAPREDUCE-4798](https://issues.apache.org/jira/browse/MAPREDUCE-4798) | TestJobHistoryServer fails some times with 'java.lang.AssertionError: Address already in use' | Minor | jobhistoryserver, test | sam liu | sam liu | -| [MAPREDUCE-4699](https://issues.apache.org/jira/browse/MAPREDUCE-4699) | TestFairScheduler & TestCapacityScheduler fails due to JobHistory exception | Minor | . | Gopal V | Gopal V | -| [MAPREDUCE-4697](https://issues.apache.org/jira/browse/MAPREDUCE-4697) | TestMapredHeartbeat fails assertion on HeartbeatInterval | Minor | . | Gopal V | Gopal V | +| [HADOOP-9115](https://issues.apache.org/jira/browse/HADOOP-9115) | Deadlock in configuration when writing configuration to hdfs | Blocker | . | Arpit Gupta | Jing Zhao | | [MAPREDUCE-4696](https://issues.apache.org/jira/browse/MAPREDUCE-4696) | TestMRServerPorts throws NullReferenceException | Minor | . | Gopal V | Gopal V | -| [MAPREDUCE-4478](https://issues.apache.org/jira/browse/MAPREDUCE-4478) | TaskTracker's heartbeat is out of control | Major | . | Liyin Liang | Liyin Liang | +| [MAPREDUCE-4697](https://issues.apache.org/jira/browse/MAPREDUCE-4697) | TestMapredHeartbeat fails assertion on HeartbeatInterval | Minor | . | Gopal V | Gopal V | +| [MAPREDUCE-4699](https://issues.apache.org/jira/browse/MAPREDUCE-4699) | TestFairScheduler & TestCapacityScheduler fails due to JobHistory exception | Minor | . | Gopal V | Gopal V | +| [MAPREDUCE-4858](https://issues.apache.org/jira/browse/MAPREDUCE-4858) | TestWebUIAuthorization fails on branch-1 | Major | . | Arun C Murthy | Arun C Murthy | +| [MAPREDUCE-4859](https://issues.apache.org/jira/browse/MAPREDUCE-4859) | TestRecoveryManager fails on branch-1 | Major | . | Arun C Murthy | Arun C Murthy | | [MAPREDUCE-4396](https://issues.apache.org/jira/browse/MAPREDUCE-4396) | Make LocalJobRunner work with private distributed cache | Minor | client | Luke Lu | Yu Gao | +| [MAPREDUCE-4888](https://issues.apache.org/jira/browse/MAPREDUCE-4888) | NLineInputFormat drops data in 1.1 and beyond | Blocker | mrv1 | Robert Joseph Evans | Vinod Kumar Vavilapalli | | [MAPREDUCE-4272](https://issues.apache.org/jira/browse/MAPREDUCE-4272) | SortedRanges.Range#compareTo is not spec compliant | Major | task | Luke Lu | Yu Gao | -| [MAPREDUCE-2374](https://issues.apache.org/jira/browse/MAPREDUCE-2374) | "Text File Busy" errors launching MR tasks | Major | . | Todd Lipcon | Andy Isaacson | +| [HDFS-4423](https://issues.apache.org/jira/browse/HDFS-4423) | Checkpoint exception causes fatal damage to fsimage. | Blocker | namenode | ChenFolin | Chris Nauroth | +| [HADOOP-8418](https://issues.apache.org/jira/browse/HADOOP-8418) | Fix UGI for IBM JDK running on Windows | Major | security | Luke Lu | Yu Gao | +| [HADOOP-8419](https://issues.apache.org/jira/browse/HADOOP-8419) | GzipCodec NPE upon reset with IBM JDK | Major | io | Luke Lu | Yu Li | +| [HDFS-5996](https://issues.apache.org/jira/browse/HDFS-5996) | hadoop 1.1.2. hdfs write bug | Major | fuse-dfs | WangMeng | | ### TESTS: @@ -81,15 +71,3 @@ | [HADOOP-9051](https://issues.apache.org/jira/browse/HADOOP-9051) | “ant test” will build failed for trying to delete a file | Minor | test | meng gong | Luke Lu | -### SUB-TASKS: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - -### OTHER: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/RELEASENOTES.1.1.2.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/RELEASENOTES.1.1.2.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/RELEASENOTES.1.1.2.md index b55f17d..d3a97b3 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/RELEASENOTES.1.1.2.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.2/RELEASENOTES.1.1.2.md @@ -23,13 +23,6 @@ These release notes cover new developer and user-facing incompatibilities, impor --- -* [HADOOP-9115](https://issues.apache.org/jira/browse/HADOOP-9115) | *Blocker* | **Deadlock in configuration when writing configuration to hdfs** - -This fixes a bug where Hive could trigger a deadlock condition in the Hadoop configuration management code. - - ---- - * [HADOOP-8567](https://issues.apache.org/jira/browse/HADOOP-8567) | *Major* | **Port conf servlet to dump running configuration to branch 1.x** Users can use the conf servlet to get the server-side configuration. Users can @@ -40,16 +33,23 @@ Users can use the conf servlet to get the server-side configuration. Users can --- -* [HDFS-5996](https://issues.apache.org/jira/browse/HDFS-5996) | *Major* | **hadoop 1.1.2. hdfs write bug** +* [MAPREDUCE-4478](https://issues.apache.org/jira/browse/MAPREDUCE-4478) | *Major* | **TaskTracker's heartbeat is out of control** -someone has discovered this bug and it has been resolved +Fixed a bug in TaskTracker's heartbeat to keep it under control. --- -* [MAPREDUCE-4478](https://issues.apache.org/jira/browse/MAPREDUCE-4478) | *Major* | **TaskTracker's heartbeat is out of control** +* [HADOOP-9115](https://issues.apache.org/jira/browse/HADOOP-9115) | *Blocker* | **Deadlock in configuration when writing configuration to hdfs** -Fixed a bug in TaskTracker's heartbeat to keep it under control. +This fixes a bug where Hive could trigger a deadlock condition in the Hadoop configuration management code. + + +--- + +* [HDFS-5996](https://issues.apache.org/jira/browse/HDFS-5996) | *Major* | **hadoop 1.1.2. hdfs write bug** + +someone has discovered this bug and it has been resolved http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.3/CHANGES.1.1.3.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.3/CHANGES.1.1.3.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.3/CHANGES.1.1.3.md index 86aeb5d..0944cef 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.3/CHANGES.1.1.3.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/1.1.3/CHANGES.1.1.3.md @@ -18,54 +18,14 @@ --> # Apache Hadoop Changelog -## Release 1.1.3 - Unreleased (as of 2016-03-04) +## Release 1.1.3 - Unreleased (as of 2017-08-28) -### INCOMPATIBLE CHANGES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - -### IMPORTANT ISSUES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - -### NEW FEATURES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - -### IMPROVEMENTS: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | ### BUG FIXES: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HDFS-5028](https://issues.apache.org/jira/browse/HDFS-5028) | LeaseRenewer throw java.util.ConcurrentModificationException when timeout | Major | . | zhaoyunjiong | zhaoyunjiong | - - -### TESTS: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - -### SUB-TASKS: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - -### OTHER: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | +| [HDFS-5028](https://issues.apache.org/jira/browse/HDFS-5028) | LeaseRenewer throw java.util.ConcurrentModificationException when timeout | Major | . | yunjiong zhao | yunjiong zhao | --------------------------------------------------------------------- To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org For additional commands, e-mail: common-commits-help@hadoop.apache.org