Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id A7795200CE6 for ; Fri, 1 Sep 2017 04:08:33 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id A5E5C16C4ED; Fri, 1 Sep 2017 02:08:33 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 561C516C4E6 for ; Fri, 1 Sep 2017 04:08:31 +0200 (CEST) Received: (qmail 62457 invoked by uid 500); 1 Sep 2017 02:08:25 -0000 Mailing-List: contact common-commits-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list common-commits@hadoop.apache.org Received: (qmail 58237 invoked by uid 99); 1 Sep 2017 02:08:21 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Sep 2017 02:08:21 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 2EAADF5623; Fri, 1 Sep 2017 02:08:18 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit From: aw@apache.org To: common-commits@hadoop.apache.org Date: Fri, 01 Sep 2017 02:08:39 -0000 Message-Id: In-Reply-To: <6570662a48be4457bf602e3a2e3e376d@git.apache.org> References: <6570662a48be4457bf602e3a2e3e376d@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [22/51] [partial] hadoop git commit: HADOOP-14364. refresh changelog/release notes with newer Apache Yetus build archived-at: Fri, 01 Sep 2017 02:08:33 -0000 http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/CHANGES.0.23.7.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/CHANGES.0.23.7.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/CHANGES.0.23.7.md index d67a6b7..17f5be0 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/CHANGES.0.23.7.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/CHANGES.0.23.7.md @@ -27,12 +27,6 @@ | [HDFS-395](https://issues.apache.org/jira/browse/HDFS-395) | DFS Scalability: Incremental block reports | Major | datanode, namenode | dhruba borthakur | Tomasz Nykiel | -### IMPORTANT ISSUES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - ### NEW FEATURES: | JIRA | Summary | Priority | Component | Reporter | Contributor | @@ -44,158 +38,152 @@ | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-9379](https://issues.apache.org/jira/browse/HADOOP-9379) | capture the ulimit info after printing the log to the console | Trivial | . | Arpit Gupta | Arpit Gupta | -| [HADOOP-9374](https://issues.apache.org/jira/browse/HADOOP-9374) | Add tokens from -tokenCacheFile into UGI | Major | security | Daryn Sharp | Daryn Sharp | -| [HADOOP-9352](https://issues.apache.org/jira/browse/HADOOP-9352) | Expose UGI.setLoginUser for tests | Major | security | Daryn Sharp | Daryn Sharp | -| [HADOOP-9336](https://issues.apache.org/jira/browse/HADOOP-9336) | Allow UGI of current connection to be queried | Critical | ipc | Daryn Sharp | Daryn Sharp | -| [HADOOP-9253](https://issues.apache.org/jira/browse/HADOOP-9253) | Capture ulimit info in the logs at service start time | Major | . | Arpit Gupta | Arpit Gupta | -| [HADOOP-9247](https://issues.apache.org/jira/browse/HADOOP-9247) | parametrize Clover "generateXxx" properties to make them re-definable via -D in mvn calls | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | -| [HADOOP-9216](https://issues.apache.org/jira/browse/HADOOP-9216) | CompressionCodecFactory#getCodecClasses should trim the result of parsing by Configuration. | Major | io | Tsuyoshi Ozawa | Tsuyoshi Ozawa | -| [HADOOP-9147](https://issues.apache.org/jira/browse/HADOOP-9147) | Add missing fields to FIleStatus.toString | Trivial | . | Jonathan Allen | Jonathan Allen | -| [HADOOP-8849](https://issues.apache.org/jira/browse/HADOOP-8849) | FileUtil#fullyDelete should grant the target directories +rwx permissions before trying to delete them | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | -| [HADOOP-8711](https://issues.apache.org/jira/browse/HADOOP-8711) | provide an option for IPC server users to avoid printing stack information for certain exceptions | Major | ipc | Brandon Li | Brandon Li | -| [HADOOP-8462](https://issues.apache.org/jira/browse/HADOOP-8462) | Native-code implementation of bzip2 codec | Major | io | Govind Kamat | Govind Kamat | -| [HADOOP-8214](https://issues.apache.org/jira/browse/HADOOP-8214) | make hadoop script recognize a full set of deprecated commands | Major | scripts | Roman Shaposhnik | Roman Shaposhnik | -| [HADOOP-8075](https://issues.apache.org/jira/browse/HADOOP-8075) | Lower native-hadoop library log from info to debug | Major | native | Eli Collins | Hızır Sefa İrken | -| [HADOOP-7886](https://issues.apache.org/jira/browse/HADOOP-7886) | Add toString to FileStatus | Minor | . | Jakob Homan | SreeHari | | [HADOOP-7358](https://issues.apache.org/jira/browse/HADOOP-7358) | Improve log levels when exceptions caught in RPC handler | Minor | ipc | Todd Lipcon | Todd Lipcon | +| [HADOOP-7886](https://issues.apache.org/jira/browse/HADOOP-7886) | Add toString to FileStatus | Minor | . | Jakob Homan | SreeHari | +| [HADOOP-8214](https://issues.apache.org/jira/browse/HADOOP-8214) | make hadoop script recognize a full set of deprecated commands | Major | scripts | Roman Shaposhnik | Roman Shaposhnik | +| [HADOOP-8711](https://issues.apache.org/jira/browse/HADOOP-8711) | provide an option for IPC server users to avoid printing stack information for certain exceptions | Major | ipc | Brandon Li | Brandon Li | | [HDFS-3817](https://issues.apache.org/jira/browse/HDFS-3817) | avoid printing stack information for SafeModeException | Major | namenode | Brandon Li | Brandon Li | -| [MAPREDUCE-5079](https://issues.apache.org/jira/browse/MAPREDUCE-5079) | Recovery should restore task state from job history info directly | Critical | mr-am | Jason Lowe | Jason Lowe | -| [MAPREDUCE-4990](https://issues.apache.org/jira/browse/MAPREDUCE-4990) | Construct debug strings conditionally in ShuffleHandler.Shuffle#sendMapOutput() | Trivial | . | Karthik Kambatla | Karthik Kambatla | -| [MAPREDUCE-4989](https://issues.apache.org/jira/browse/MAPREDUCE-4989) | JSONify DataTables input data for Attempts page | Major | jobhistoryserver, mr-am | Ravi Prakash | Ravi Prakash | -| [MAPREDUCE-4949](https://issues.apache.org/jira/browse/MAPREDUCE-4949) | Enable multiple pi jobs to run in parallel | Minor | examples | Sandy Ryza | Sandy Ryza | +| [HADOOP-8075](https://issues.apache.org/jira/browse/HADOOP-8075) | Lower native-hadoop library log from info to debug | Major | native | Eli Collins | Hızır Sefa İrken | +| [HADOOP-9147](https://issues.apache.org/jira/browse/HADOOP-9147) | Add missing fields to FIleStatus.toString | Trivial | . | Jonathan Allen | Jonathan Allen | | [MAPREDUCE-4907](https://issues.apache.org/jira/browse/MAPREDUCE-4907) | TrackerDistributedCacheManager issues too many getFileStatus calls | Major | mrv1, tasktracker | Sandy Ryza | Sandy Ryza | -| [MAPREDUCE-4822](https://issues.apache.org/jira/browse/MAPREDUCE-4822) | Unnecessary conversions in History Events | Trivial | jobhistoryserver | Robert Joseph Evans | Chu Tong | +| [HADOOP-9216](https://issues.apache.org/jira/browse/HADOOP-9216) | CompressionCodecFactory#getCodecClasses should trim the result of parsing by Configuration. | Major | io | Tsuyoshi Ozawa | Tsuyoshi Ozawa | +| [HADOOP-8849](https://issues.apache.org/jira/browse/HADOOP-8849) | FileUtil#fullyDelete should grant the target directories +rwx permissions before trying to delete them | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | | [MAPREDUCE-4458](https://issues.apache.org/jira/browse/MAPREDUCE-4458) | Warn if java.library.path is used for AM or Task | Major | mrv2 | Robert Joseph Evans | Robert Parker | -| [YARN-525](https://issues.apache.org/jira/browse/YARN-525) | make CS node-locality-delay refreshable | Major | capacityscheduler | Thomas Graves | Thomas Graves | -| [YARN-443](https://issues.apache.org/jira/browse/YARN-443) | allow OS scheduling priority of NM to be different than the containers it launches | Major | nodemanager | Thomas Graves | Thomas Graves | +| [MAPREDUCE-4949](https://issues.apache.org/jira/browse/MAPREDUCE-4949) | Enable multiple pi jobs to run in parallel | Minor | examples | Sandy Ryza | Sandy Ryza | +| [HADOOP-9247](https://issues.apache.org/jira/browse/HADOOP-9247) | parametrize Clover "generateXxx" properties to make them re-definable via -D in mvn calls | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | +| [MAPREDUCE-4822](https://issues.apache.org/jira/browse/MAPREDUCE-4822) | Unnecessary conversions in History Events | Trivial | jobhistoryserver | Robert Joseph Evans | Chu Tong | +| [MAPREDUCE-4989](https://issues.apache.org/jira/browse/MAPREDUCE-4989) | JSONify DataTables input data for Attempts page | Major | jobhistoryserver, mr-am | Ravi Prakash | Ravi Prakash | | [YARN-249](https://issues.apache.org/jira/browse/YARN-249) | Capacity Scheduler web page should show list of active users per queue like it used to (in 1.x) | Major | capacityscheduler | Ravi Prakash | Ravi Prakash | +| [HADOOP-9336](https://issues.apache.org/jira/browse/HADOOP-9336) | Allow UGI of current connection to be queried | Critical | ipc | Daryn Sharp | Daryn Sharp | +| [HADOOP-9352](https://issues.apache.org/jira/browse/HADOOP-9352) | Expose UGI.setLoginUser for tests | Major | security | Daryn Sharp | Daryn Sharp | +| [HADOOP-8462](https://issues.apache.org/jira/browse/HADOOP-8462) | Native-code implementation of bzip2 codec | Major | io | Govind Kamat | Govind Kamat | +| [HADOOP-9374](https://issues.apache.org/jira/browse/HADOOP-9374) | Add tokens from -tokenCacheFile into UGI | Major | security | Daryn Sharp | Daryn Sharp | +| [YARN-443](https://issues.apache.org/jira/browse/YARN-443) | allow OS scheduling priority of NM to be different than the containers it launches | Major | nodemanager | Thomas Graves | Thomas Graves | +| [HADOOP-9379](https://issues.apache.org/jira/browse/HADOOP-9379) | capture the ulimit info after printing the log to the console | Trivial | . | Arpit Gupta | Arpit Gupta | +| [MAPREDUCE-4990](https://issues.apache.org/jira/browse/MAPREDUCE-4990) | Construct debug strings conditionally in ShuffleHandler.Shuffle#sendMapOutput() | Trivial | . | Karthik Kambatla | Karthik Kambatla | +| [HADOOP-9253](https://issues.apache.org/jira/browse/HADOOP-9253) | Capture ulimit info in the logs at service start time | Major | . | Arpit Gupta | Arpit Gupta | +| [YARN-525](https://issues.apache.org/jira/browse/YARN-525) | make CS node-locality-delay refreshable | Major | capacityscheduler | Thomas Graves | Thomas Graves | +| [MAPREDUCE-5079](https://issues.apache.org/jira/browse/MAPREDUCE-5079) | Recovery should restore task state from job history info directly | Critical | mr-am | Jason Lowe | Jason Lowe | ### BUG FIXES: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-9406](https://issues.apache.org/jira/browse/HADOOP-9406) | hadoop-client leaks dependency on JDK tools jar | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | -| [HADOOP-9339](https://issues.apache.org/jira/browse/HADOOP-9339) | IPC.Server incorrectly sets UGI auth type | Major | ipc | Daryn Sharp | Daryn Sharp | -| [HADOOP-9303](https://issues.apache.org/jira/browse/HADOOP-9303) | command manual dfsadmin missing entry for restoreFailedStorage option | Major | . | Thomas Graves | Andy Isaacson | -| [HADOOP-9302](https://issues.apache.org/jira/browse/HADOOP-9302) | HDFS docs not linked from top level | Major | documentation | Thomas Graves | Andy Isaacson | -| [HADOOP-9289](https://issues.apache.org/jira/browse/HADOOP-9289) | FsShell rm -f fails for non-matching globs | Blocker | fs | Daryn Sharp | Daryn Sharp | -| [HADOOP-9278](https://issues.apache.org/jira/browse/HADOOP-9278) | HarFileSystem may leak file handle | Major | fs | Chris Nauroth | Chris Nauroth | -| [HADOOP-9231](https://issues.apache.org/jira/browse/HADOOP-9231) | Parametrize staging URL for the uniformity of distributionManagement | Major | build | Konstantin Boudnik | Konstantin Boudnik | -| [HADOOP-9221](https://issues.apache.org/jira/browse/HADOOP-9221) | Convert remaining xdocs to APT | Major | . | Andy Isaacson | Andy Isaacson | +| [MAPREDUCE-3952](https://issues.apache.org/jira/browse/MAPREDUCE-3952) | In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split. | Major | mrv2 | Zhenxiao Luo | Bhallamudi Venkata Siva Kamesh | +| [HDFS-1765](https://issues.apache.org/jira/browse/HDFS-1765) | Block Replication should respect under-replication block priority | Major | namenode | Hairong Kuang | Uma Maheswara Rao G | +| [MAPREDUCE-4007](https://issues.apache.org/jira/browse/MAPREDUCE-4007) | JobClient getJob(JobID) should return NULL if the job does not exist (for backwards compatibility) | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur | +| [HADOOP-6941](https://issues.apache.org/jira/browse/HADOOP-6941) | Support non-SUN JREs in UserGroupInformation | Major | . | Stephen Watt | Devaraj Das | +| [HADOOP-8251](https://issues.apache.org/jira/browse/HADOOP-8251) | SecurityUtil.fetchServiceTicket broken after HADOOP-6941 | Blocker | security | Todd Lipcon | Todd Lipcon | +| [HDFS-3119](https://issues.apache.org/jira/browse/HDFS-3119) | Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file | Minor | namenode | J.Andreina | Ashish Singhi | +| [HDFS-3256](https://issues.apache.org/jira/browse/HDFS-3256) | HDFS considers blocks under-replicated if topology script is configured with only 1 rack | Major | . | Aaron T. Myers | Aaron T. Myers | +| [HADOOP-8346](https://issues.apache.org/jira/browse/HADOOP-8346) | Changes to support Kerberos with non Sun JVM (HADOOP-6941) broke SPNEGO | Blocker | security | Alejandro Abdelnur | Devaraj Das | +| [MAPREDUCE-4470](https://issues.apache.org/jira/browse/MAPREDUCE-4470) | Fix TestCombineFileInputFormat.testForEmptyFile | Major | test | Kihwal Lee | Ilya Katsov | +| [YARN-83](https://issues.apache.org/jira/browse/YARN-83) | Change package of YarnClient to include apache | Major | client | Bikas Saha | Bikas Saha | +| [YARN-40](https://issues.apache.org/jira/browse/YARN-40) | Provide support for missing yarn commands | Major | client | Devaraj K | Devaraj K | +| [YARN-150](https://issues.apache.org/jira/browse/YARN-150) | AppRejectedTransition does not unregister app from master service and scheduler | Major | . | Bikas Saha | Bikas Saha | +| [HADOOP-8878](https://issues.apache.org/jira/browse/HADOOP-8878) | uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on | Major | . | Arpit Gupta | Arpit Gupta | +| [HDFS-4072](https://issues.apache.org/jira/browse/HDFS-4072) | On file deletion remove corresponding blocks pending replication | Minor | namenode | Jing Zhao | Jing Zhao | +| [HDFS-2434](https://issues.apache.org/jira/browse/HDFS-2434) | TestNameNodeMetrics.testCorruptBlock fails intermittently | Major | test | Uma Maheswara Rao G | Jing Zhao | +| [MAPREDUCE-4637](https://issues.apache.org/jira/browse/MAPREDUCE-4637) | Killing an unassigned task attempt causes the job to fail | Major | mrv2 | Tom White | Mayank Bansal | +| [MAPREDUCE-4278](https://issues.apache.org/jira/browse/MAPREDUCE-4278) | cannot run two local jobs in parallel from the same gateway. | Major | . | Araceli Henley | Sandy Ryza | +| [HADOOP-9155](https://issues.apache.org/jira/browse/HADOOP-9155) | FsPermission should have different default value, 777 for directory and 666 for file | Minor | . | Binglin Chang | Binglin Chang | +| [HADOOP-8816](https://issues.apache.org/jira/browse/HADOOP-8816) | HTTP Error 413 full HEAD if using kerberos authentication | Major | net | Moritz Moeller | Moritz Moeller | | [HADOOP-9212](https://issues.apache.org/jira/browse/HADOOP-9212) | Potential deadlock in FileSystem.Cache/IPC/UGI | Major | fs | Tom White | Tom White | | [HADOOP-9193](https://issues.apache.org/jira/browse/HADOOP-9193) | hadoop script can inadvertently expand wildcard arguments when delegating to hdfs script | Minor | scripts | Jason Lowe | Andy Isaacson | -| [HADOOP-9190](https://issues.apache.org/jira/browse/HADOOP-9190) | packaging docs is broken | Major | documentation | Thomas Graves | Andy Isaacson | -| [HADOOP-9155](https://issues.apache.org/jira/browse/HADOOP-9155) | FsPermission should have different default value, 777 for directory and 666 for file | Minor | . | Binglin Chang | Binglin Chang | -| [HADOOP-9154](https://issues.apache.org/jira/browse/HADOOP-9154) | SortedMapWritable#putAll() doesn't add key/value classes to the map | Major | io | Karthik Kambatla | Karthik Kambatla | -| [HADOOP-9124](https://issues.apache.org/jira/browse/HADOOP-9124) | SortedMapWritable violates contract of Map interface for equals() and hashCode() | Minor | io | Patrick Hunt | Surenkumar Nihalani | -| [HADOOP-8878](https://issues.apache.org/jira/browse/HADOOP-8878) | uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on | Major | . | Arpit Gupta | Arpit Gupta | +| [MAPREDUCE-4946](https://issues.apache.org/jira/browse/MAPREDUCE-4946) | Type conversion of map completion events leads to performance problems with large jobs | Critical | mr-am | Jason Lowe | Jason Lowe | +| [HADOOP-9231](https://issues.apache.org/jira/browse/HADOOP-9231) | Parametrize staging URL for the uniformity of distributionManagement | Major | build | Konstantin Boudnik | Konstantin Boudnik | +| [HDFS-4426](https://issues.apache.org/jira/browse/HDFS-4426) | Secondary namenode shuts down immediately after startup | Blocker | namenode | Jason Lowe | Arpit Agarwal | +| [YARN-354](https://issues.apache.org/jira/browse/YARN-354) | WebAppProxyServer exits immediately after startup | Blocker | . | Liang Xie | Liang Xie | | [HADOOP-8857](https://issues.apache.org/jira/browse/HADOOP-8857) | hadoop.http.authentication.signature.secret.file docs should not state that secret is randomly generated | Minor | security | Eli Collins | Alejandro Abdelnur | -| [HADOOP-8816](https://issues.apache.org/jira/browse/HADOOP-8816) | HTTP Error 413 full HEAD if using kerberos authentication | Major | net | Moritz Moeller | Moritz Moeller | -| [HADOOP-8346](https://issues.apache.org/jira/browse/HADOOP-8346) | Changes to support Kerberos with non Sun JVM (HADOOP-6941) broke SPNEGO | Blocker | security | Alejandro Abdelnur | Devaraj Das | -| [HADOOP-8251](https://issues.apache.org/jira/browse/HADOOP-8251) | SecurityUtil.fetchServiceTicket broken after HADOOP-6941 | Blocker | security | Todd Lipcon | Todd Lipcon | -| [HADOOP-6941](https://issues.apache.org/jira/browse/HADOOP-6941) | Support non-SUN JREs in UserGroupInformation | Major | . | Stephen Watt | Devaraj Das | -| [HDFS-4649](https://issues.apache.org/jira/browse/HDFS-4649) | Webhdfs cannot list large directories | Blocker | namenode, security, webhdfs | Daryn Sharp | Daryn Sharp | -| [HDFS-4581](https://issues.apache.org/jira/browse/HDFS-4581) | DataNode#checkDiskError should not be called on network errors | Major | datanode | Rohit Kochar | Rohit Kochar | -| [HDFS-4553](https://issues.apache.org/jira/browse/HDFS-4553) | Webhdfs will NPE on some unexpected response codes | Major | webhdfs | Daryn Sharp | Daryn Sharp | -| [HDFS-4544](https://issues.apache.org/jira/browse/HDFS-4544) | Error in deleting blocks should not do check disk, for all types of errors | Major | . | Amareshwari Sriramadasu | Arpit Agarwal | -| [HDFS-4532](https://issues.apache.org/jira/browse/HDFS-4532) | RPC call queue may fill due to current user lookup | Critical | namenode | Daryn Sharp | Daryn Sharp | -| [HDFS-4495](https://issues.apache.org/jira/browse/HDFS-4495) | Allow client-side lease renewal to be retried beyond soft-limit | Major | hdfs-client | Kihwal Lee | Kihwal Lee | -| [HDFS-4462](https://issues.apache.org/jira/browse/HDFS-4462) | 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS | Major | namenode | Aaron T. Myers | Aaron T. Myers | | [HDFS-4444](https://issues.apache.org/jira/browse/HDFS-4444) | Add space between total transaction time and number of transactions in FSEditLog#printStatistics | Trivial | . | Stephen Chu | Stephen Chu | -| [HDFS-4426](https://issues.apache.org/jira/browse/HDFS-4426) | Secondary namenode shuts down immediately after startup | Blocker | namenode | Jason Lowe | Arpit Agarwal | +| [YARN-133](https://issues.apache.org/jira/browse/YARN-133) | update web services docs for RM clusterMetrics | Major | resourcemanager | Thomas Graves | Ravi Prakash | +| [HADOOP-9190](https://issues.apache.org/jira/browse/HADOOP-9190) | packaging docs is broken | Major | documentation | Thomas Graves | Andy Isaacson | | [HDFS-4288](https://issues.apache.org/jira/browse/HDFS-4288) | NN accepts incremental BR as IBR in safemode | Critical | namenode | Daryn Sharp | Daryn Sharp | -| [HDFS-4222](https://issues.apache.org/jira/browse/HDFS-4222) | NN is unresponsive and loses heartbeats of DNs when Hadoop is configured to use LDAP and LDAP has issues | Minor | namenode | Xiaobo Peng | Xiaobo Peng | -| [HDFS-4128](https://issues.apache.org/jira/browse/HDFS-4128) | 2NN gets stuck in inconsistent state if edit log replay fails in the middle | Major | namenode | Todd Lipcon | Kihwal Lee | -| [HDFS-4072](https://issues.apache.org/jira/browse/HDFS-4072) | On file deletion remove corresponding blocks pending replication | Minor | namenode | Jing Zhao | Jing Zhao | -| [HDFS-3344](https://issues.apache.org/jira/browse/HDFS-3344) | Unreliable corrupt blocks counting in TestProcessCorruptBlocks | Major | namenode | Tsz Wo Nicholas Sze | Kihwal Lee | -| [HDFS-3256](https://issues.apache.org/jira/browse/HDFS-3256) | HDFS considers blocks under-replicated if topology script is configured with only 1 rack | Major | . | Aaron T. Myers | Aaron T. Myers | -| [HDFS-3119](https://issues.apache.org/jira/browse/HDFS-3119) | Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file | Minor | namenode | J.Andreina | Ashish Singhi | -| [HDFS-2434](https://issues.apache.org/jira/browse/HDFS-2434) | TestNameNodeMetrics.testCorruptBlock fails intermittently | Major | test | Uma Maheswara Rao G | Jing Zhao | -| [HDFS-1765](https://issues.apache.org/jira/browse/HDFS-1765) | Block Replication should respect under-replication block priority | Major | namenode | Hairong Kuang | Uma Maheswara Rao G | -| [MAPREDUCE-5137](https://issues.apache.org/jira/browse/MAPREDUCE-5137) | AM web UI: clicking on Map Task results in 500 error | Major | applicationmaster | Thomas Graves | Thomas Graves | -| [MAPREDUCE-5075](https://issues.apache.org/jira/browse/MAPREDUCE-5075) | DistCp leaks input file handles | Major | distcp | Chris Nauroth | Chris Nauroth | -| [MAPREDUCE-5060](https://issues.apache.org/jira/browse/MAPREDUCE-5060) | Fetch failures that time out only count against the first map task | Critical | . | Robert Joseph Evans | Robert Joseph Evans | -| [MAPREDUCE-5053](https://issues.apache.org/jira/browse/MAPREDUCE-5053) | java.lang.InternalError from decompression codec cause reducer to fail | Major | . | Robert Parker | Robert Parker | -| [MAPREDUCE-5043](https://issues.apache.org/jira/browse/MAPREDUCE-5043) | Fetch failure processing can cause AM event queue to backup and eventually OOM | Blocker | mr-am | Jason Lowe | Jason Lowe | -| [MAPREDUCE-5042](https://issues.apache.org/jira/browse/MAPREDUCE-5042) | Reducer unable to fetch for a map task that was recovered | Blocker | mr-am, security | Jason Lowe | Jason Lowe | -| [MAPREDUCE-5027](https://issues.apache.org/jira/browse/MAPREDUCE-5027) | Shuffle does not limit number of outstanding connections | Major | . | Jason Lowe | Robert Parker | -| [MAPREDUCE-5023](https://issues.apache.org/jira/browse/MAPREDUCE-5023) | History Server Web Services missing Job Counters | Critical | jobhistoryserver, webapps | Kendall Thrapp | Ravi Prakash | -| [MAPREDUCE-5009](https://issues.apache.org/jira/browse/MAPREDUCE-5009) | Killing the Task Attempt slated for commit does not clear the value from the Task commitAttempt member | Critical | mrv1 | Robert Parker | Robert Parker | -| [MAPREDUCE-5000](https://issues.apache.org/jira/browse/MAPREDUCE-5000) | TaskImpl.getCounters() can return the counters for the wrong task attempt when task is speculating | Critical | mr-am | Jason Lowe | Jason Lowe | -| [MAPREDUCE-4992](https://issues.apache.org/jira/browse/MAPREDUCE-4992) | AM hangs in RecoveryService when recovering tasks with speculative attempts | Critical | mr-am | Robert Parker | Robert Parker | -| [MAPREDUCE-4969](https://issues.apache.org/jira/browse/MAPREDUCE-4969) | TestKeyValueTextInputFormat test fails with Open JDK 7 | Major | test | Arpit Agarwal | Arpit Agarwal | -| [MAPREDUCE-4953](https://issues.apache.org/jira/browse/MAPREDUCE-4953) | HadoopPipes misuses fprintf | Major | pipes | Andy Isaacson | Andy Isaacson | -| [MAPREDUCE-4946](https://issues.apache.org/jira/browse/MAPREDUCE-4946) | Type conversion of map completion events leads to performance problems with large jobs | Critical | mr-am | Jason Lowe | Jason Lowe | +| [HADOOP-9221](https://issues.apache.org/jira/browse/HADOOP-9221) | Convert remaining xdocs to APT | Major | . | Andy Isaacson | Andy Isaacson | +| [YARN-343](https://issues.apache.org/jira/browse/YARN-343) | Capacity Scheduler maximum-capacity value -1 is invalid | Major | capacityscheduler | Thomas Graves | Xuan Gong | | [MAPREDUCE-4893](https://issues.apache.org/jira/browse/MAPREDUCE-4893) | MR AppMaster can do sub-optimal assignment of containers to map tasks leading to poor node locality | Major | applicationmaster | Bikas Saha | Bikas Saha | -| [MAPREDUCE-4871](https://issues.apache.org/jira/browse/MAPREDUCE-4871) | AM uses mapreduce.jobtracker.split.metainfo.maxsize but mapred-default has mapreduce.job.split.metainfo.maxsize | Major | mrv2 | Jason Lowe | Jason Lowe | -| [MAPREDUCE-4794](https://issues.apache.org/jira/browse/MAPREDUCE-4794) | DefaultSpeculator generates error messages on normal shutdown | Major | applicationmaster | Jason Lowe | Jason Lowe | -| [MAPREDUCE-4671](https://issues.apache.org/jira/browse/MAPREDUCE-4671) | AM does not tell the RM about container requests that are no longer needed | Major | . | Bikas Saha | Bikas Saha | -| [MAPREDUCE-4637](https://issues.apache.org/jira/browse/MAPREDUCE-4637) | Killing an unassigned task attempt causes the job to fail | Major | mrv2 | Tom White | Mayank Bansal | -| [MAPREDUCE-4470](https://issues.apache.org/jira/browse/MAPREDUCE-4470) | Fix TestCombineFileInputFormat.testForEmptyFile | Major | test | Kihwal Lee | Ilya Katsov | -| [MAPREDUCE-4278](https://issues.apache.org/jira/browse/MAPREDUCE-4278) | cannot run two local jobs in parallel from the same gateway. | Major | . | Araceli Henley | Sandy Ryza | -| [MAPREDUCE-4007](https://issues.apache.org/jira/browse/MAPREDUCE-4007) | JobClient getJob(JobID) should return NULL if the job does not exist (for backwards compatibility) | Major | mrv2 | Alejandro Abdelnur | Alejandro Abdelnur | -| [MAPREDUCE-3952](https://issues.apache.org/jira/browse/MAPREDUCE-3952) | In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split. | Major | mrv2 | Zhenxiao Luo | Bhallamudi Venkata Siva Kamesh | -| [MAPREDUCE-3685](https://issues.apache.org/jira/browse/MAPREDUCE-3685) | There are some bugs in implementation of MergeManager | Critical | mrv2 | anty.rao | anty | -| [YARN-460](https://issues.apache.org/jira/browse/YARN-460) | CS user left in list of active users for the queue even when application finished | Blocker | capacityscheduler | Thomas Graves | Thomas Graves | -| [YARN-448](https://issues.apache.org/jira/browse/YARN-448) | Remove unnecessary hflush from log aggregation | Major | nodemanager | Kihwal Lee | Kihwal Lee | -| [YARN-426](https://issues.apache.org/jira/browse/YARN-426) | Failure to download a public resource on a node prevents further downloads of the resource from that node | Critical | nodemanager | Jason Lowe | Jason Lowe | -| [YARN-410](https://issues.apache.org/jira/browse/YARN-410) | New lines in diagnostics for a failed app on the per-application page make it hard to read | Major | . | Vinod Kumar Vavilapalli | Omkar Vinit Joshi | -| [YARN-400](https://issues.apache.org/jira/browse/YARN-400) | RM can return null application resource usage report leading to NPE in client | Critical | resourcemanager | Jason Lowe | Jason Lowe | -| [YARN-376](https://issues.apache.org/jira/browse/YARN-376) | Apps that have completed can appear as RUNNING on the NM UI | Blocker | resourcemanager | Jason Lowe | Jason Lowe | +| [MAPREDUCE-4969](https://issues.apache.org/jira/browse/MAPREDUCE-4969) | TestKeyValueTextInputFormat test fails with Open JDK 7 | Major | test | Arpit Agarwal | Arpit Agarwal | | [YARN-364](https://issues.apache.org/jira/browse/YARN-364) | AggregatedLogDeletionService can take too long to delete logs | Major | . | Jason Lowe | Jason Lowe | -| [YARN-362](https://issues.apache.org/jira/browse/YARN-362) | Unexpected extra results when using webUI table search | Minor | . | Jason Lowe | Ravi Prakash | +| [HDFS-4462](https://issues.apache.org/jira/browse/HDFS-4462) | 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS | Major | namenode | Aaron T. Myers | Aaron T. Myers | | [YARN-360](https://issues.apache.org/jira/browse/YARN-360) | Allow apps to concurrently register tokens for renewal | Critical | . | Daryn Sharp | Daryn Sharp | +| [MAPREDUCE-4953](https://issues.apache.org/jira/browse/MAPREDUCE-4953) | HadoopPipes misuses fprintf | Major | pipes | Andy Isaacson | Andy Isaacson | +| [HADOOP-9278](https://issues.apache.org/jira/browse/HADOOP-9278) | HarFileSystem may leak file handle | Major | fs | Chris Nauroth | Chris Nauroth | | [YARN-357](https://issues.apache.org/jira/browse/YARN-357) | App submission should not be synchronized | Major | resourcemanager | Daryn Sharp | Daryn Sharp | | [YARN-355](https://issues.apache.org/jira/browse/YARN-355) | RM app submission jams under load | Blocker | resourcemanager | Daryn Sharp | Daryn Sharp | -| [YARN-354](https://issues.apache.org/jira/browse/YARN-354) | WebAppProxyServer exits immediately after startup | Blocker | . | Liang Xie | Liang Xie | -| [YARN-345](https://issues.apache.org/jira/browse/YARN-345) | Many InvalidStateTransitonException errors for ApplicationImpl in Node Manager | Critical | nodemanager | Devaraj K | Robert Parker | -| [YARN-343](https://issues.apache.org/jira/browse/YARN-343) | Capacity Scheduler maximum-capacity value -1 is invalid | Major | capacityscheduler | Thomas Graves | Xuan Gong | -| [YARN-269](https://issues.apache.org/jira/browse/YARN-269) | Resource Manager not logging the health\_check\_script result when taking it out | Major | resourcemanager | Thomas Graves | Jason Lowe | +| [HADOOP-9289](https://issues.apache.org/jira/browse/HADOOP-9289) | FsShell rm -f fails for non-matching globs | Blocker | fs | Daryn Sharp | Daryn Sharp | +| [MAPREDUCE-4671](https://issues.apache.org/jira/browse/MAPREDUCE-4671) | AM does not tell the RM about container requests that are no longer needed | Major | . | Bikas Saha | Bikas Saha | +| [HADOOP-9124](https://issues.apache.org/jira/browse/HADOOP-9124) | SortedMapWritable violates contract of Map interface for equals() and hashCode() | Minor | io | Patrick Hunt | Surenkumar Nihalani | +| [YARN-362](https://issues.apache.org/jira/browse/YARN-362) | Unexpected extra results when using webUI table search | Minor | . | Jason Lowe | Ravi Prakash | +| [HADOOP-9302](https://issues.apache.org/jira/browse/HADOOP-9302) | HDFS docs not linked from top level | Major | documentation | Thomas Graves | Andy Isaacson | +| [HADOOP-9303](https://issues.apache.org/jira/browse/HADOOP-9303) | command manual dfsadmin missing entry for restoreFailedStorage option | Major | . | Thomas Graves | Andy Isaacson | +| [MAPREDUCE-5000](https://issues.apache.org/jira/browse/MAPREDUCE-5000) | TaskImpl.getCounters() can return the counters for the wrong task attempt when task is speculating | Critical | mr-am | Jason Lowe | Jason Lowe | +| [HDFS-4495](https://issues.apache.org/jira/browse/HDFS-4495) | Allow client-side lease renewal to be retried beyond soft-limit | Major | hdfs-client | Kihwal Lee | Kihwal Lee | +| [HADOOP-9154](https://issues.apache.org/jira/browse/HADOOP-9154) | SortedMapWritable#putAll() doesn't add key/value classes to the map | Major | io | Karthik Kambatla | Karthik Kambatla | +| [MAPREDUCE-5009](https://issues.apache.org/jira/browse/MAPREDUCE-5009) | Killing the Task Attempt slated for commit does not clear the value from the Task commitAttempt member | Critical | mrv1 | Robert Parker | Robert Parker | +| [YARN-400](https://issues.apache.org/jira/browse/YARN-400) | RM can return null application resource usage report leading to NPE in client | Critical | resourcemanager | Jason Lowe | Jason Lowe | | [YARN-236](https://issues.apache.org/jira/browse/YARN-236) | RM should point tracking URL to RM web page when app fails to start | Major | resourcemanager | Jason Lowe | Jason Lowe | +| [HDFS-4222](https://issues.apache.org/jira/browse/HDFS-4222) | NN is unresponsive and loses heartbeats of DNs when Hadoop is configured to use LDAP and LDAP has issues | Minor | namenode | Xiaobo Peng | Xiaobo Peng | +| [YARN-426](https://issues.apache.org/jira/browse/YARN-426) | Failure to download a public resource on a node prevents further downloads of the resource from that node | Critical | nodemanager | Jason Lowe | Jason Lowe | +| [HADOOP-9339](https://issues.apache.org/jira/browse/HADOOP-9339) | IPC.Server incorrectly sets UGI auth type | Major | ipc | Daryn Sharp | Daryn Sharp | +| [MAPREDUCE-4871](https://issues.apache.org/jira/browse/MAPREDUCE-4871) | AM uses mapreduce.jobtracker.split.metainfo.maxsize but mapred-default has mapreduce.job.split.metainfo.maxsize | Major | mrv2 | Jason Lowe | Jason Lowe | +| [YARN-269](https://issues.apache.org/jira/browse/YARN-269) | Resource Manager not logging the health\_check\_script result when taking it out | Major | resourcemanager | Thomas Graves | Jason Lowe | +| [YARN-376](https://issues.apache.org/jira/browse/YARN-376) | Apps that have completed can appear as RUNNING on the NM UI | Blocker | resourcemanager | Jason Lowe | Jason Lowe | +| [YARN-410](https://issues.apache.org/jira/browse/YARN-410) | New lines in diagnostics for a failed app on the per-application page make it hard to read | Major | . | Vinod Kumar Vavilapalli | Omkar Vinit Joshi | +| [MAPREDUCE-4794](https://issues.apache.org/jira/browse/MAPREDUCE-4794) | DefaultSpeculator generates error messages on normal shutdown | Major | applicationmaster | Jason Lowe | Jason Lowe | +| [HDFS-4128](https://issues.apache.org/jira/browse/HDFS-4128) | 2NN gets stuck in inconsistent state if edit log replay fails in the middle | Major | namenode | Todd Lipcon | Kihwal Lee | +| [HDFS-4532](https://issues.apache.org/jira/browse/HDFS-4532) | RPC call queue may fill due to current user lookup | Critical | namenode | Daryn Sharp | Daryn Sharp | +| [YARN-448](https://issues.apache.org/jira/browse/YARN-448) | Remove unnecessary hflush from log aggregation | Major | nodemanager | Kihwal Lee | Kihwal Lee | +| [MAPREDUCE-5043](https://issues.apache.org/jira/browse/MAPREDUCE-5043) | Fetch failure processing can cause AM event queue to backup and eventually OOM | Blocker | mr-am | Jason Lowe | Jason Lowe | +| [YARN-345](https://issues.apache.org/jira/browse/YARN-345) | Many InvalidStateTransitonException errors for ApplicationImpl in Node Manager | Critical | nodemanager | Devaraj K | Robert Parker | +| [HDFS-4553](https://issues.apache.org/jira/browse/HDFS-4553) | Webhdfs will NPE on some unexpected response codes | Major | webhdfs | Daryn Sharp | Daryn Sharp | | [YARN-227](https://issues.apache.org/jira/browse/YARN-227) | Application expiration difficult to debug for end-users | Major | resourcemanager | Jason Lowe | Jason Lowe | -| [YARN-150](https://issues.apache.org/jira/browse/YARN-150) | AppRejectedTransition does not unregister app from master service and scheduler | Major | . | Bikas Saha | Bikas Saha | -| [YARN-133](https://issues.apache.org/jira/browse/YARN-133) | update web services docs for RM clusterMetrics | Major | resourcemanager | Thomas Graves | Ravi Prakash | +| [MAPREDUCE-5027](https://issues.apache.org/jira/browse/MAPREDUCE-5027) | Shuffle does not limit number of outstanding connections | Major | . | Jason Lowe | Robert Parker | +| [MAPREDUCE-3685](https://issues.apache.org/jira/browse/MAPREDUCE-3685) | There are some bugs in implementation of MergeManager | Critical | mrv2 | anty.rao | anty | +| [HDFS-4544](https://issues.apache.org/jira/browse/HDFS-4544) | Error in deleting blocks should not do check disk, for all types of errors | Major | . | Amareshwari Sriramadasu | Arpit Agarwal | +| [MAPREDUCE-5023](https://issues.apache.org/jira/browse/MAPREDUCE-5023) | History Server Web Services missing Job Counters | Critical | jobhistoryserver, webapps | Kendall Thrapp | Ravi Prakash | +| [MAPREDUCE-5060](https://issues.apache.org/jira/browse/MAPREDUCE-5060) | Fetch failures that time out only count against the first map task | Critical | . | Robert Joseph Evans | Robert Joseph Evans | +| [HDFS-3344](https://issues.apache.org/jira/browse/HDFS-3344) | Unreliable corrupt blocks counting in TestProcessCorruptBlocks | Major | namenode | Tsz Wo Nicholas Sze | Kihwal Lee | +| [HADOOP-9406](https://issues.apache.org/jira/browse/HADOOP-9406) | hadoop-client leaks dependency on JDK tools jar | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | +| [MAPREDUCE-5042](https://issues.apache.org/jira/browse/MAPREDUCE-5042) | Reducer unable to fetch for a map task that was recovered | Blocker | mr-am, security | Jason Lowe | Jason Lowe | +| [MAPREDUCE-5053](https://issues.apache.org/jira/browse/MAPREDUCE-5053) | java.lang.InternalError from decompression codec cause reducer to fail | Major | . | Robert Parker | Robert Parker | +| [MAPREDUCE-5075](https://issues.apache.org/jira/browse/MAPREDUCE-5075) | DistCp leaks input file handles | Major | distcp | Chris Nauroth | Chris Nauroth | | [YARN-109](https://issues.apache.org/jira/browse/YARN-109) | .tmp file is not deleted for localized archives | Major | nodemanager | Jason Lowe | Mayank Bansal | -| [YARN-83](https://issues.apache.org/jira/browse/YARN-83) | Change package of YarnClient to include apache | Major | client | Bikas Saha | Bikas Saha | -| [YARN-40](https://issues.apache.org/jira/browse/YARN-40) | Provide support for missing yarn commands | Major | client | Devaraj K | Devaraj K | +| [HDFS-4581](https://issues.apache.org/jira/browse/HDFS-4581) | DataNode#checkDiskError should not be called on network errors | Major | datanode | Rohit Kochar | Rohit Kochar | +| [YARN-460](https://issues.apache.org/jira/browse/YARN-460) | CS user left in list of active users for the queue even when application finished | Blocker | capacityscheduler | Thomas Graves | Thomas Graves | +| [MAPREDUCE-4992](https://issues.apache.org/jira/browse/MAPREDUCE-4992) | AM hangs in RecoveryService when recovering tasks with speculative attempts | Critical | mr-am | Robert Parker | Robert Parker | +| [HDFS-4649](https://issues.apache.org/jira/browse/HDFS-4649) | Webhdfs cannot list large directories | Blocker | namenode, security, webhdfs | Daryn Sharp | Daryn Sharp | +| [MAPREDUCE-5137](https://issues.apache.org/jira/browse/MAPREDUCE-5137) | AM web UI: clicking on Map Task results in 500 error | Major | applicationmaster | Thomas Graves | Thomas Graves | ### TESTS: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-9067](https://issues.apache.org/jira/browse/HADOOP-9067) | provide test for method org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, FSDataInputStream, long, FSDataInputStream, long) | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | | [HADOOP-8157](https://issues.apache.org/jira/browse/HADOOP-8157) | TestRPCCallBenchmark#testBenchmarkWithWritable fails with RTE | Major | . | Eli Collins | Todd Lipcon | -| [MAPREDUCE-5007](https://issues.apache.org/jira/browse/MAPREDUCE-5007) | fix coverage org.apache.hadoop.mapreduce.v2.hs | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | -| [MAPREDUCE-4991](https://issues.apache.org/jira/browse/MAPREDUCE-4991) | coverage for gridmix | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | -| [MAPREDUCE-4972](https://issues.apache.org/jira/browse/MAPREDUCE-4972) | Coverage fixing for org.apache.hadoop.mapreduce.jobhistory | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | +| [HADOOP-9067](https://issues.apache.org/jira/browse/HADOOP-9067) | provide test for method org.apache.hadoop.fs.LocalFileSystem.reportChecksumFailure(Path, FSDataInputStream, long, FSDataInputStream, long) | Minor | . | Ivan A. Veselovsky | Ivan A. Veselovsky | | [MAPREDUCE-4905](https://issues.apache.org/jira/browse/MAPREDUCE-4905) | test org.apache.hadoop.mapred.pipes | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | +| [MAPREDUCE-4972](https://issues.apache.org/jira/browse/MAPREDUCE-4972) | Coverage fixing for org.apache.hadoop.mapreduce.jobhistory | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | | [MAPREDUCE-4875](https://issues.apache.org/jira/browse/MAPREDUCE-4875) | coverage fixing for org.apache.hadoop.mapred | Major | test | Aleksey Gorshkov | Aleksey Gorshkov | +| [MAPREDUCE-4991](https://issues.apache.org/jira/browse/MAPREDUCE-4991) | coverage for gridmix | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | +| [MAPREDUCE-5007](https://issues.apache.org/jira/browse/MAPREDUCE-5007) | fix coverage org.apache.hadoop.mapreduce.v2.hs | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | ### SUB-TASKS: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HDFS-4577](https://issues.apache.org/jira/browse/HDFS-4577) | Webhdfs operations should declare if authentication is required | Major | webhdfs | Daryn Sharp | Daryn Sharp | -| [HDFS-4567](https://issues.apache.org/jira/browse/HDFS-4567) | Webhdfs does not need a token for token operations | Major | webhdfs | Daryn Sharp | Daryn Sharp | -| [HDFS-4566](https://issues.apache.org/jira/browse/HDFS-4566) | Webdhfs token cancelation should use authentication | Major | webhdfs | Daryn Sharp | Daryn Sharp | -| [HDFS-4560](https://issues.apache.org/jira/browse/HDFS-4560) | Webhdfs cannot use tokens obtained by another user | Major | webhdfs | Daryn Sharp | Daryn Sharp | -| [HDFS-4548](https://issues.apache.org/jira/browse/HDFS-4548) | Webhdfs doesn't renegotiate SPNEGO token | Blocker | . | Daryn Sharp | Daryn Sharp | -| [HDFS-4542](https://issues.apache.org/jira/browse/HDFS-4542) | Webhdfs doesn't support secure proxy users | Blocker | webhdfs | Daryn Sharp | Daryn Sharp | -| [HDFS-2495](https://issues.apache.org/jira/browse/HDFS-2495) | Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lock | Major | namenode | Tomasz Nykiel | Tomasz Nykiel | | [HDFS-2477](https://issues.apache.org/jira/browse/HDFS-2477) | Optimize computing the diff between a block report and the namenode state. | Major | namenode | Tomasz Nykiel | Tomasz Nykiel | +| [HDFS-2495](https://issues.apache.org/jira/browse/HDFS-2495) | Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lock | Major | namenode | Tomasz Nykiel | Tomasz Nykiel | | [HDFS-2476](https://issues.apache.org/jira/browse/HDFS-2476) | More CPU efficient data structure for under-replicated/over-replicated/invalidate blocks | Major | namenode | Tomasz Nykiel | Tomasz Nykiel | +| [YARN-29](https://issues.apache.org/jira/browse/YARN-29) | Add a yarn-client module | Major | client | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | +| [HDFS-4542](https://issues.apache.org/jira/browse/HDFS-4542) | Webhdfs doesn't support secure proxy users | Blocker | webhdfs | Daryn Sharp | Daryn Sharp | +| [HDFS-4560](https://issues.apache.org/jira/browse/HDFS-4560) | Webhdfs cannot use tokens obtained by another user | Major | webhdfs | Daryn Sharp | Daryn Sharp | +| [HDFS-4566](https://issues.apache.org/jira/browse/HDFS-4566) | Webdhfs token cancelation should use authentication | Major | webhdfs | Daryn Sharp | Daryn Sharp | +| [HDFS-4567](https://issues.apache.org/jira/browse/HDFS-4567) | Webhdfs does not need a token for token operations | Major | webhdfs | Daryn Sharp | Daryn Sharp | +| [HDFS-4577](https://issues.apache.org/jira/browse/HDFS-4577) | Webhdfs operations should declare if authentication is required | Major | webhdfs | Daryn Sharp | Daryn Sharp | | [YARN-468](https://issues.apache.org/jira/browse/YARN-468) | coverage fix for org.apache.hadoop.yarn.server.webproxy.amfilter | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | | [YARN-200](https://issues.apache.org/jira/browse/YARN-200) | yarn log does not output all needed information, and is in a binary format | Major | . | Robert Joseph Evans | Ravi Prakash | -| [YARN-29](https://issues.apache.org/jira/browse/YARN-29) | Add a yarn-client module | Major | client | Vinod Kumar Vavilapalli | Vinod Kumar Vavilapalli | - - -### OTHER: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | +| [HDFS-4548](https://issues.apache.org/jira/browse/HDFS-4548) | Webhdfs doesn't renegotiate SPNEGO token | Blocker | . | Daryn Sharp | Daryn Sharp | http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/RELEASENOTES.0.23.7.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/RELEASENOTES.0.23.7.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/RELEASENOTES.0.23.7.md index e367c5d..2a5b268 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/RELEASENOTES.0.23.7.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.7/RELEASENOTES.0.23.7.md @@ -23,23 +23,23 @@ These release notes cover new developer and user-facing incompatibilities, impor --- -* [HADOOP-9147](https://issues.apache.org/jira/browse/HADOOP-9147) | *Trivial* | **Add missing fields to FIleStatus.toString** +* [HDFS-395](https://issues.apache.org/jira/browse/HDFS-395) | *Major* | **DFS Scalability: Incremental block reports** -Update FileStatus.toString to include missing fields +**WARNING: No release note provided for this change.** --- -* [HDFS-395](https://issues.apache.org/jira/browse/HDFS-395) | *Major* | **DFS Scalability: Incremental block reports** +* [MAPREDUCE-4637](https://issues.apache.org/jira/browse/MAPREDUCE-4637) | *Major* | **Killing an unassigned task attempt causes the job to fail** -**WARNING: No release note provided for this incompatible change.** +Handle TaskAttempt diagnostic updates while in the NEW and UNASSIGNED states. --- -* [MAPREDUCE-4637](https://issues.apache.org/jira/browse/MAPREDUCE-4637) | *Major* | **Killing an unassigned task attempt causes the job to fail** +* [HADOOP-9147](https://issues.apache.org/jira/browse/HADOOP-9147) | *Trivial* | **Add missing fields to FIleStatus.toString** -Handle TaskAttempt diagnostic updates while in the NEW and UNASSIGNED states. +Update FileStatus.toString to include missing fields http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/CHANGES.0.23.8.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/CHANGES.0.23.8.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/CHANGES.0.23.8.md index 04e8036..0d043e6 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/CHANGES.0.23.8.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.8/CHANGES.0.23.8.md @@ -20,63 +20,41 @@ ## Release 0.23.8 - 2013-06-05 -### INCOMPATIBLE CHANGES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - -### IMPORTANT ISSUES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - -### NEW FEATURES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - -### IMPROVEMENTS: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | ### BUG FIXES: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-9614](https://issues.apache.org/jira/browse/HADOOP-9614) | smart-test-patch.sh hangs for new version of patch (2.7.1) | Major | . | Ravi Prakash | Ravi Prakash | -| [HADOOP-9504](https://issues.apache.org/jira/browse/HADOOP-9504) | MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo | Critical | metrics | Liang Xie | Liang Xie | +| [MAPREDUCE-4383](https://issues.apache.org/jira/browse/MAPREDUCE-4383) | HadoopPipes.cc needs to include unistd.h | Minor | pipes | Andy Isaacson | Andy Isaacson | +| [YARN-71](https://issues.apache.org/jira/browse/YARN-71) | Ensure/confirm that the NodeManager cleans up local-dirs on restart | Critical | nodemanager | Vinod Kumar Vavilapalli | Xuan Gong | +| [HDFS-4690](https://issues.apache.org/jira/browse/HDFS-4690) | Namenode exits if entering safemode while secret manager is edit logging | Critical | namenode, security | Daryn Sharp | Daryn Sharp | +| [MAPREDUCE-5065](https://issues.apache.org/jira/browse/MAPREDUCE-5065) | DistCp should skip checksum comparisons if block-sizes are different on source/target. | Major | distcp | Mithun Radhakrishnan | Mithun Radhakrishnan | +| [YARN-476](https://issues.apache.org/jira/browse/YARN-476) | ProcfsBasedProcessTree info message confuses users | Minor | . | Jason Lowe | Sandy Ryza | +| [HDFS-4699](https://issues.apache.org/jira/browse/HDFS-4699) | TestPipelinesFailover#testPipelineRecoveryStress fails sporadically | Major | test | Chris Nauroth | Chris Nauroth | +| [MAPREDUCE-5147](https://issues.apache.org/jira/browse/MAPREDUCE-5147) | Maven build should create hadoop-mapreduce-client-app-VERSION.jar directly | Major | mrv2 | Robert Parker | Robert Parker | | [HADOOP-9469](https://issues.apache.org/jira/browse/HADOOP-9469) | mapreduce/yarn source jars not included in dist tarball | Major | . | Thomas Graves | Robert Parker | +| [YARN-363](https://issues.apache.org/jira/browse/YARN-363) | yarn proxyserver fails to find webapps/proxy directory on startup | Major | . | Jason Lowe | Kenji Kikushima | +| [MAPREDUCE-5168](https://issues.apache.org/jira/browse/MAPREDUCE-5168) | Reducer can OOM during shuffle because on-disk output stream not released | Critical | mrv2 | Jason Lowe | Jason Lowe | +| [HDFS-4477](https://issues.apache.org/jira/browse/HDFS-4477) | Secondary namenode may retain old tokens | Critical | security | Kihwal Lee | Daryn Sharp | +| [YARN-690](https://issues.apache.org/jira/browse/YARN-690) | RM exits on token cancel/renew problems | Blocker | resourcemanager | Daryn Sharp | Daryn Sharp | +| [MAPREDUCE-4927](https://issues.apache.org/jira/browse/MAPREDUCE-4927) | Historyserver 500 error due to NPE when accessing specific counters page for failed job | Major | jobhistoryserver | Jason Lowe | Ashwin Shankar | | [HDFS-4835](https://issues.apache.org/jira/browse/HDFS-4835) | Port trunk WebHDFS changes to branch-0.23 | Critical | webhdfs | Robert Parker | Robert Parker | +| [HDFS-3875](https://issues.apache.org/jira/browse/HDFS-3875) | Issue handling checksum errors in write pipeline | Critical | datanode, hdfs-client | Todd Lipcon | Kihwal Lee | | [HDFS-4807](https://issues.apache.org/jira/browse/HDFS-4807) | DFSOutputStream.createSocketForPipeline() should not include timeout extension on connect | Major | . | Kihwal Lee | Cristina L. Abad | | [HDFS-4714](https://issues.apache.org/jira/browse/HDFS-4714) | Log short messages in Namenode RPC server for exceptions meant for clients | Major | namenode | Kihwal Lee | Kihwal Lee | -| [HDFS-4699](https://issues.apache.org/jira/browse/HDFS-4699) | TestPipelinesFailover#testPipelineRecoveryStress fails sporadically | Major | test | Chris Nauroth | Chris Nauroth | -| [HDFS-4690](https://issues.apache.org/jira/browse/HDFS-4690) | Namenode exits if entering safemode while secret manager is edit logging | Critical | namenode, security | Daryn Sharp | Daryn Sharp | -| [HDFS-4477](https://issues.apache.org/jira/browse/HDFS-4477) | Secondary namenode may retain old tokens | Critical | security | Kihwal Lee | Daryn Sharp | -| [HDFS-3875](https://issues.apache.org/jira/browse/HDFS-3875) | Issue handling checksum errors in write pipeline | Critical | datanode, hdfs-client | Todd Lipcon | Kihwal Lee | +| [HADOOP-9614](https://issues.apache.org/jira/browse/HADOOP-9614) | smart-test-patch.sh hangs for new version of patch (2.7.1) | Major | . | Ravi Prakash | Ravi Prakash | | [MAPREDUCE-5211](https://issues.apache.org/jira/browse/MAPREDUCE-5211) | Reducer intermediate files can collide during merge | Blocker | mrv2 | Jason Lowe | Jason Lowe | -| [MAPREDUCE-5168](https://issues.apache.org/jira/browse/MAPREDUCE-5168) | Reducer can OOM during shuffle because on-disk output stream not released | Critical | mrv2 | Jason Lowe | Jason Lowe | -| [MAPREDUCE-5147](https://issues.apache.org/jira/browse/MAPREDUCE-5147) | Maven build should create hadoop-mapreduce-client-app-VERSION.jar directly | Major | mrv2 | Robert Parker | Robert Parker | -| [MAPREDUCE-5065](https://issues.apache.org/jira/browse/MAPREDUCE-5065) | DistCp should skip checksum comparisons if block-sizes are different on source/target. | Major | distcp | Mithun Radhakrishnan | Mithun Radhakrishnan | +| [HADOOP-9504](https://issues.apache.org/jira/browse/HADOOP-9504) | MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo | Critical | metrics | Liang Xie | Liang Xie | | [MAPREDUCE-5059](https://issues.apache.org/jira/browse/MAPREDUCE-5059) | Job overview shows average merge time larger than for any reduce attempt | Major | jobhistoryserver, webapps | Jason Lowe | Omkar Vinit Joshi | -| [MAPREDUCE-4927](https://issues.apache.org/jira/browse/MAPREDUCE-4927) | Historyserver 500 error due to NPE when accessing specific counters page for failed job | Major | jobhistoryserver | Jason Lowe | Ashwin Shankar | -| [MAPREDUCE-4383](https://issues.apache.org/jira/browse/MAPREDUCE-4383) | HadoopPipes.cc needs to include unistd.h | Minor | pipes | Andy Isaacson | Andy Isaacson | -| [YARN-690](https://issues.apache.org/jira/browse/YARN-690) | RM exits on token cancel/renew problems | Blocker | resourcemanager | Daryn Sharp | Daryn Sharp | -| [YARN-476](https://issues.apache.org/jira/browse/YARN-476) | ProcfsBasedProcessTree info message confuses users | Minor | . | Jason Lowe | Sandy Ryza | -| [YARN-363](https://issues.apache.org/jira/browse/YARN-363) | yarn proxyserver fails to find webapps/proxy directory on startup | Major | . | Jason Lowe | Kenji Kikushima | -| [YARN-71](https://issues.apache.org/jira/browse/YARN-71) | Ensure/confirm that the NodeManager cleans up local-dirs on restart | Critical | nodemanager | Vinod Kumar Vavilapalli | Xuan Gong | ### TESTS: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-9233](https://issues.apache.org/jira/browse/HADOOP-9233) | Cover package org.apache.hadoop.io.compress.zlib with unit tests | Major | . | Vadim Bondarev | Vadim Bondarev | | [HADOOP-9222](https://issues.apache.org/jira/browse/HADOOP-9222) | Cover package with org.apache.hadoop.io.lz4 unit tests | Major | . | Vadim Bondarev | Vadim Bondarev | +| [HADOOP-9233](https://issues.apache.org/jira/browse/HADOOP-9233) | Cover package org.apache.hadoop.io.compress.zlib with unit tests | Major | . | Vadim Bondarev | Vadim Bondarev | | [MAPREDUCE-5015](https://issues.apache.org/jira/browse/MAPREDUCE-5015) | Coverage fix for org.apache.hadoop.mapreduce.tools.CLI | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | @@ -87,9 +65,3 @@ | [YARN-548](https://issues.apache.org/jira/browse/YARN-548) | Add tests for YarnUncaughtExceptionHandler | Major | . | Vadim Bondarev | Vadim Bondarev | -### OTHER: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/CHANGES.0.23.9.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/CHANGES.0.23.9.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/CHANGES.0.23.9.md index fed8832..238453c 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/CHANGES.0.23.9.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.23.9/CHANGES.0.23.9.md @@ -20,49 +20,33 @@ ## Release 0.23.9 - 2013-07-08 -### INCOMPATIBLE CHANGES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - -### IMPORTANT ISSUES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - -### NEW FEATURES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | ### IMPROVEMENTS: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [MAPREDUCE-5268](https://issues.apache.org/jira/browse/MAPREDUCE-5268) | Improve history server startup performance | Major | jobhistoryserver | Jason Lowe | Karthik Kambatla | | [YARN-169](https://issues.apache.org/jira/browse/YARN-169) | Update log4j.appender.EventCounter to use org.apache.hadoop.log.metrics.EventCounter | Minor | nodemanager | Anthony Rojas | Anthony Rojas | +| [MAPREDUCE-5268](https://issues.apache.org/jira/browse/MAPREDUCE-5268) | Improve history server startup performance | Major | jobhistoryserver | Jason Lowe | Karthik Kambatla | ### BUG FIXES: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-9582](https://issues.apache.org/jira/browse/HADOOP-9582) | Non-existent file to "hadoop fs -conf" doesn't throw error | Major | conf | Ashwin Shankar | Ashwin Shankar | -| [HADOOP-9581](https://issues.apache.org/jira/browse/HADOOP-9581) | hadoop --config non-existent directory should result in error | Major | scripts | Ashwin Shankar | Ashwin Shankar | -| [HDFS-4878](https://issues.apache.org/jira/browse/HDFS-4878) | On Remove Block, Block is not Removed from neededReplications queue | Major | namenode | Tao Luo | Tao Luo | +| [HDFS-4765](https://issues.apache.org/jira/browse/HDFS-4765) | Permission check of symlink deletion incorrectly throws UnresolvedLinkException | Major | namenode | Andrew Wang | Andrew Wang | +| [YARN-742](https://issues.apache.org/jira/browse/YARN-742) | Log aggregation causes a lot of redundant setPermission calls | Major | nodemanager | Kihwal Lee | Jason Lowe | | [HDFS-4867](https://issues.apache.org/jira/browse/HDFS-4867) | metaSave NPEs when there are invalid blocks in repl queue. | Major | namenode | Kihwal Lee | Plamen Jeliazkov | | [HDFS-4862](https://issues.apache.org/jira/browse/HDFS-4862) | SafeModeInfo.isManual() returns true when resources are low even if it wasn't entered into manually | Major | . | Ravi Prakash | Ravi Prakash | | [HDFS-4832](https://issues.apache.org/jira/browse/HDFS-4832) | Namenode doesn't change the number of missing blocks in safemode when DNs rejoin or leave | Critical | . | Ravi Prakash | Ravi Prakash | -| [HDFS-4765](https://issues.apache.org/jira/browse/HDFS-4765) | Permission check of symlink deletion incorrectly throws UnresolvedLinkException | Major | namenode | Andrew Wang | Andrew Wang | -| [HDFS-4205](https://issues.apache.org/jira/browse/HDFS-4205) | fsck fails with symlinks | Major | hdfs-client | Andy Isaacson | Jason Lowe | -| [MAPREDUCE-5316](https://issues.apache.org/jira/browse/MAPREDUCE-5316) | job -list-attempt-ids command does not handle illegal task-state | Major | client | Ashwin Shankar | Ashwin Shankar | -| [MAPREDUCE-5315](https://issues.apache.org/jira/browse/MAPREDUCE-5315) | DistCp reports success even on failure. | Critical | distcp | Mithun Radhakrishnan | Mithun Radhakrishnan | +| [HADOOP-9581](https://issues.apache.org/jira/browse/HADOOP-9581) | hadoop --config non-existent directory should result in error | Major | scripts | Ashwin Shankar | Ashwin Shankar | | [MAPREDUCE-5308](https://issues.apache.org/jira/browse/MAPREDUCE-5308) | Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs | Major | . | Nathan Roberts | Nathan Roberts | +| [MAPREDUCE-5315](https://issues.apache.org/jira/browse/MAPREDUCE-5315) | DistCp reports success even on failure. | Critical | distcp | Mithun Radhakrishnan | Mithun Radhakrishnan | +| [HDFS-4878](https://issues.apache.org/jira/browse/HDFS-4878) | On Remove Block, Block is not Removed from neededReplications queue | Major | namenode | Tao Luo | Tao Luo | | [MAPREDUCE-4019](https://issues.apache.org/jira/browse/MAPREDUCE-4019) | -list-attempt-ids is not working | Minor | client | B Anil Kumar | Ashwin Shankar | -| [YARN-742](https://issues.apache.org/jira/browse/YARN-742) | Log aggregation causes a lot of redundant setPermission calls | Major | nodemanager | Kihwal Lee | Jason Lowe | +| [MAPREDUCE-5316](https://issues.apache.org/jira/browse/MAPREDUCE-5316) | job -list-attempt-ids command does not handle illegal task-state | Major | client | Ashwin Shankar | Ashwin Shankar | +| [HADOOP-9582](https://issues.apache.org/jira/browse/HADOOP-9582) | Non-existent file to "hadoop fs -conf" doesn't throw error | Major | conf | Ashwin Shankar | Ashwin Shankar | +| [HDFS-4205](https://issues.apache.org/jira/browse/HDFS-4205) | fsck fails with symlinks | Major | hdfs-client | Andy Isaacson | Jason Lowe | ### TESTS: @@ -76,13 +60,7 @@ | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [YARN-478](https://issues.apache.org/jira/browse/YARN-478) | fix coverage org.apache.hadoop.yarn.webapp.log | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | | [YARN-427](https://issues.apache.org/jira/browse/YARN-427) | Coverage fix for org.apache.hadoop.yarn.server.api.\* | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | - - -### OTHER: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | +| [YARN-478](https://issues.apache.org/jira/browse/YARN-478) | fix coverage org.apache.hadoop.yarn.webapp.log | Major | . | Aleksey Gorshkov | Aleksey Gorshkov | http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/CHANGES.0.24.0.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/CHANGES.0.24.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/CHANGES.0.24.0.md index 919f4dd..a419c45 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/CHANGES.0.24.0.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/CHANGES.0.24.0.md @@ -18,7 +18,7 @@ --> # Apache Hadoop Changelog -## Release 0.24.0 - Unreleased (as of 2016-03-04) +## Release 0.24.0 - Unreleased (as of 2017-08-28) ### INCOMPATIBLE CHANGES: @@ -28,68 +28,56 @@ | [HADOOP-7507](https://issues.apache.org/jira/browse/HADOOP-7507) | jvm metrics all use the same namespace | Major | metrics | Jeff Bean | Alejandro Abdelnur | -### IMPORTANT ISSUES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - ### NEW FEATURES: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-7705](https://issues.apache.org/jira/browse/HADOOP-7705) | Add a log4j back end that can push out JSON data, one per line | Minor | util | Steve Loughran | Steve Loughran | | [HADOOP-7594](https://issues.apache.org/jira/browse/HADOOP-7594) | Support HTTP REST in HttpServer | Major | . | Tsz Wo Nicholas Sze | Tsz Wo Nicholas Sze | +| [HADOOP-7705](https://issues.apache.org/jira/browse/HADOOP-7705) | Add a log4j back end that can push out JSON data, one per line | Minor | util | Steve Loughran | Steve Loughran | ### IMPROVEMENTS: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-7772](https://issues.apache.org/jira/browse/HADOOP-7772) | javadoc the topology classes | Trivial | . | Steve Loughran | Steve Loughran | -| [HADOOP-7763](https://issues.apache.org/jira/browse/HADOOP-7763) | Add top-level navigation to APT docs | Major | documentation | Tom White | Tom White | -| [HADOOP-7743](https://issues.apache.org/jira/browse/HADOOP-7743) | Add Maven profile to create a full source tarball | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | -| [HADOOP-7737](https://issues.apache.org/jira/browse/HADOOP-7737) | normalize hadoop-mapreduce & hadoop-dist dist/tar build with common/hdfs | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | +| [HADOOP-7595](https://issues.apache.org/jira/browse/HADOOP-7595) | Upgrade dependency to Avro 1.5.3 | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | [HADOOP-7668](https://issues.apache.org/jira/browse/HADOOP-7668) | Add a NetUtils method that can tell if an InetAddress belongs to local host | Minor | util | Suresh Srinivas | Steve Loughran | | [HADOOP-7642](https://issues.apache.org/jira/browse/HADOOP-7642) | create hadoop-dist module where TAR stitching would happen | Major | build | Alejandro Abdelnur | Tom White | -| [HADOOP-7595](https://issues.apache.org/jira/browse/HADOOP-7595) | Upgrade dependency to Avro 1.5.3 | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | +| [HADOOP-7737](https://issues.apache.org/jira/browse/HADOOP-7737) | normalize hadoop-mapreduce & hadoop-dist dist/tar build with common/hdfs | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | +| [HADOOP-7743](https://issues.apache.org/jira/browse/HADOOP-7743) | Add Maven profile to create a full source tarball | Major | build | Alejandro Abdelnur | Alejandro Abdelnur | | [HADOOP-7509](https://issues.apache.org/jira/browse/HADOOP-7509) | Improve message when Authentication is required | Trivial | . | Ravi Prakash | Ravi Prakash | +| [HADOOP-7772](https://issues.apache.org/jira/browse/HADOOP-7772) | javadoc the topology classes | Trivial | . | Steve Loughran | Steve Loughran | | [HADOOP-7360](https://issues.apache.org/jira/browse/HADOOP-7360) | FsShell does not preserve relative paths with globs | Major | fs | Daryn Sharp | Kihwal Lee | +| [HADOOP-7763](https://issues.apache.org/jira/browse/HADOOP-7763) | Add top-level navigation to APT docs | Major | documentation | Tom White | Tom White | ### BUG FIXES: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-7782](https://issues.apache.org/jira/browse/HADOOP-7782) | Aggregate project javadocs | Critical | build | Arun C Murthy | Tom White | -| [HADOOP-7778](https://issues.apache.org/jira/browse/HADOOP-7778) | FindBugs warning in Token.getKind() | Major | . | Tom White | Tom White | -| [HADOOP-7771](https://issues.apache.org/jira/browse/HADOOP-7771) | NPE when running hdfs dfs -copyToLocal, -get etc | Blocker | . | John George | John George | -| [HADOOP-7766](https://issues.apache.org/jira/browse/HADOOP-7766) | The auth to local mappings are not being respected, with webhdfs and security enabled. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | -| [HADOOP-7745](https://issues.apache.org/jira/browse/HADOOP-7745) | I switched variable names in HADOOP-7509 | Major | . | Ravi Prakash | Ravi Prakash | -| [HADOOP-7728](https://issues.apache.org/jira/browse/HADOOP-7728) | hadoop-setup-conf.sh should be modified to enable task memory manager | Major | conf | Ramya Sunil | Ramya Sunil | -| [HADOOP-7721](https://issues.apache.org/jira/browse/HADOOP-7721) | dfs.web.authentication.kerberos.principal expects the full hostname and does not replace \_HOST with the hostname | Major | . | Arpit Gupta | Jitendra Nath Pandey | -| [HADOOP-7663](https://issues.apache.org/jira/browse/HADOOP-7663) | TestHDFSTrash failing on 22 | Major | test | Mayank Bansal | Mayank Bansal | -| [HADOOP-7608](https://issues.apache.org/jira/browse/HADOOP-7608) | SnappyCodec check for Hadoop native lib is wrong | Major | io | Alejandro Abdelnur | Alejandro Abdelnur | -| [HADOOP-7606](https://issues.apache.org/jira/browse/HADOOP-7606) | Upgrade Jackson to version 1.7.1 to match the version required by Jersey | Major | test | Aaron T. Myers | Alejandro Abdelnur | -| [HADOOP-7599](https://issues.apache.org/jira/browse/HADOOP-7599) | Improve hadoop setup conf script to setup secure Hadoop cluster | Major | scripts | Eric Yang | Eric Yang | -| [HADOOP-7593](https://issues.apache.org/jira/browse/HADOOP-7593) | AssertionError in TestHttpServer.testMaxThreads() | Major | test | Tsz Wo Nicholas Sze | Uma Maheswara Rao G | | [HADOOP-7589](https://issues.apache.org/jira/browse/HADOOP-7589) | Prefer mvn test -DskipTests over mvn compile in test-patch.sh | Major | build | Robert Joseph Evans | Robert Joseph Evans | | [HADOOP-7576](https://issues.apache.org/jira/browse/HADOOP-7576) | Fix findbugs warnings in Hadoop Auth (Alfredo) | Major | security | Tom White | Tsz Wo Nicholas Sze | +| [HADOOP-7593](https://issues.apache.org/jira/browse/HADOOP-7593) | AssertionError in TestHttpServer.testMaxThreads() | Major | test | Tsz Wo Nicholas Sze | Uma Maheswara Rao G | +| [HADOOP-7606](https://issues.apache.org/jira/browse/HADOOP-7606) | Upgrade Jackson to version 1.7.1 to match the version required by Jersey | Major | test | Aaron T. Myers | Alejandro Abdelnur | | [HADOOP-7568](https://issues.apache.org/jira/browse/HADOOP-7568) | SequenceFile should not print into stdout | Major | io | Konstantin Shvachko | Plamen Jeliazkov | - - -### TESTS: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-7599](https://issues.apache.org/jira/browse/HADOOP-7599) | Improve hadoop setup conf script to setup secure Hadoop cluster | Major | scripts | Eric Yang | Eric Yang | +| [HADOOP-7608](https://issues.apache.org/jira/browse/HADOOP-7608) | SnappyCodec check for Hadoop native lib is wrong | Major | io | Alejandro Abdelnur | Alejandro Abdelnur | +| [HADOOP-7663](https://issues.apache.org/jira/browse/HADOOP-7663) | TestHDFSTrash failing on 22 | Major | test | Mayank Bansal | Mayank Bansal | +| [HADOOP-7721](https://issues.apache.org/jira/browse/HADOOP-7721) | dfs.web.authentication.kerberos.principal expects the full hostname and does not replace \_HOST with the hostname | Major | . | Arpit Gupta | Jitendra Nath Pandey | +| [HADOOP-7745](https://issues.apache.org/jira/browse/HADOOP-7745) | I switched variable names in HADOOP-7509 | Major | . | Ravi Prakash | Ravi Prakash | +| [HADOOP-7766](https://issues.apache.org/jira/browse/HADOOP-7766) | The auth to local mappings are not being respected, with webhdfs and security enabled. | Major | . | Jitendra Nath Pandey | Jitendra Nath Pandey | +| [HADOOP-7728](https://issues.apache.org/jira/browse/HADOOP-7728) | hadoop-setup-conf.sh should be modified to enable task memory manager | Major | conf | Ramya Sunil | Ramya Sunil | +| [HADOOP-7778](https://issues.apache.org/jira/browse/HADOOP-7778) | FindBugs warning in Token.getKind() | Major | . | Tom White | Tom White | +| [HADOOP-7771](https://issues.apache.org/jira/browse/HADOOP-7771) | NPE when running hdfs dfs -copyToLocal, -get etc | Blocker | . | John George | John George | +| [HADOOP-7782](https://issues.apache.org/jira/browse/HADOOP-7782) | Aggregate project javadocs | Critical | build | Arun C Murthy | Tom White | ### SUB-TASKS: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-7564](https://issues.apache.org/jira/browse/HADOOP-7564) | Remove test-patch SVN externals | Major | . | Tom White | Tom White | | [HADOOP-7469](https://issues.apache.org/jira/browse/HADOOP-7469) | add a standard handler for socket connection problems which improves diagnostics | Minor | util | Steve Loughran | Steve Loughran | +| [HADOOP-7564](https://issues.apache.org/jira/browse/HADOOP-7564) | Remove test-patch SVN externals | Major | . | Tom White | Tom White | ### OTHER: http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/RELEASENOTES.0.24.0.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/RELEASENOTES.0.24.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/RELEASENOTES.0.24.0.md index 6c43809..58ed350 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/RELEASENOTES.0.24.0.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.24.0/RELEASENOTES.0.24.0.md @@ -23,30 +23,30 @@ These release notes cover new developer and user-facing incompatibilities, impor --- -* [HADOOP-7728](https://issues.apache.org/jira/browse/HADOOP-7728) | *Major* | **hadoop-setup-conf.sh should be modified to enable task memory manager** +* [HADOOP-7547](https://issues.apache.org/jira/browse/HADOOP-7547) | *Minor* | **Fix the warning in writable classes.[ WritableComparable is a raw type. References to generic type WritableComparable\ should be parameterized ]** -Enable task memory management to be configurable via hadoop config setup script. +**WARNING: No release note provided for this change.** --- -* [HADOOP-7668](https://issues.apache.org/jira/browse/HADOOP-7668) | *Minor* | **Add a NetUtils method that can tell if an InetAddress belongs to local host** +* [HADOOP-7507](https://issues.apache.org/jira/browse/HADOOP-7507) | *Major* | **jvm metrics all use the same namespace** -closing again +JVM metrics published to Ganglia now include the process name as part of the gmetric name. --- -* [HADOOP-7547](https://issues.apache.org/jira/browse/HADOOP-7547) | *Minor* | **Fix the warning in writable classes.[ WritableComparable is a raw type. References to generic type WritableComparable\ should be parameterized ]** +* [HADOOP-7668](https://issues.apache.org/jira/browse/HADOOP-7668) | *Minor* | **Add a NetUtils method that can tell if an InetAddress belongs to local host** -**WARNING: No release note provided for this incompatible change.** +closing again --- -* [HADOOP-7507](https://issues.apache.org/jira/browse/HADOOP-7507) | *Major* | **jvm metrics all use the same namespace** +* [HADOOP-7728](https://issues.apache.org/jira/browse/HADOOP-7728) | *Major* | **hadoop-setup-conf.sh should be modified to enable task memory manager** -JVM metrics published to Ganglia now include the process name as part of the gmetric name. +Enable task memory management to be configurable via hadoop config setup script. http://git-wip-us.apache.org/repos/asf/hadoop/blob/19041008/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/CHANGES.0.3.0.md ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/CHANGES.0.3.0.md b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/CHANGES.0.3.0.md index a2da3ed..98ba5fc 100644 --- a/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/CHANGES.0.3.0.md +++ b/hadoop-common-project/hadoop-common/src/site/markdown/release/0.3.0/CHANGES.0.3.0.md @@ -20,77 +20,61 @@ ## Release 0.3.0 - 2006-06-02 -### INCOMPATIBLE CHANGES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - -### IMPORTANT ISSUES: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | ### NEW FEATURES: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-256](https://issues.apache.org/jira/browse/HADOOP-256) | Implement a C api for hadoop dfs | Major | . | Arun C Murthy | Arun C Murthy | -| [HADOOP-233](https://issues.apache.org/jira/browse/HADOOP-233) | add a http status server for the task trackers | Major | . | Owen O'Malley | Owen O'Malley | -| [HADOOP-222](https://issues.apache.org/jira/browse/HADOOP-222) | Set replication from dfsshell | Trivial | . | Johan Oskarsson | Johan Oskarsson | | [HADOOP-209](https://issues.apache.org/jira/browse/HADOOP-209) | Add a program to recursively copy directories across file systems | Major | fs | Milind Bhandarkar | | | [HADOOP-115](https://issues.apache.org/jira/browse/HADOOP-115) | permit reduce input types to differ from reduce output types | Major | . | Runping Qi | Runping Qi | +| [HADOOP-233](https://issues.apache.org/jira/browse/HADOOP-233) | add a http status server for the task trackers | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-222](https://issues.apache.org/jira/browse/HADOOP-222) | Set replication from dfsshell | Trivial | . | Johan Oskarsson | Johan Oskarsson | +| [HADOOP-256](https://issues.apache.org/jira/browse/HADOOP-256) | Implement a C api for hadoop dfs | Major | . | Arun C Murthy | Arun C Murthy | ### IMPROVEMENTS: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-254](https://issues.apache.org/jira/browse/HADOOP-254) | use http to shuffle data between the maps and the reduces | Major | . | Owen O'Malley | Owen O'Malley | -| [HADOOP-218](https://issues.apache.org/jira/browse/HADOOP-218) | Inefficient calls to get configuration values in TaskInprogress | Minor | . | Mahadev konar | Mahadev konar | -| [HADOOP-216](https://issues.apache.org/jira/browse/HADOOP-216) | Task Detail web page missing progress | Trivial | . | Bryan Pendleton | Doug Cutting | -| [HADOOP-212](https://issues.apache.org/jira/browse/HADOOP-212) | allow changes to dfs block size | Critical | . | Owen O'Malley | Owen O'Malley | -| [HADOOP-211](https://issues.apache.org/jira/browse/HADOOP-211) | logging improvements for Hadoop | Minor | . | Sameer Paranjpye | Sameer Paranjpye | -| [HADOOP-208](https://issues.apache.org/jira/browse/HADOOP-208) | add failure page to webapp | Major | . | Owen O'Malley | Owen O'Malley | | [HADOOP-204](https://issues.apache.org/jira/browse/HADOOP-204) | Need to tweak a few things in the metrics package to support the Simon plugin | Major | metrics | David Bowen | David Bowen | +| [HADOOP-208](https://issues.apache.org/jira/browse/HADOOP-208) | add failure page to webapp | Major | . | Owen O'Malley | Owen O'Malley | | [HADOOP-202](https://issues.apache.org/jira/browse/HADOOP-202) | sort should use a smaller number of reduces | Trivial | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-212](https://issues.apache.org/jira/browse/HADOOP-212) | allow changes to dfs block size | Critical | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-218](https://issues.apache.org/jira/browse/HADOOP-218) | Inefficient calls to get configuration values in TaskInprogress | Minor | . | Mahadev konar | Mahadev konar | +| [HADOOP-216](https://issues.apache.org/jira/browse/HADOOP-216) | Task Detail web page missing progress | Trivial | . | Bryan Pendleton | Doug Cutting | | [HADOOP-195](https://issues.apache.org/jira/browse/HADOOP-195) | improve performance of map output transfers | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-254](https://issues.apache.org/jira/browse/HADOOP-254) | use http to shuffle data between the maps and the reduces | Major | . | Owen O'Malley | Owen O'Malley | | [HADOOP-75](https://issues.apache.org/jira/browse/HADOOP-75) | dfs should check full file availability only at close | Minor | . | Doug Cutting | Milind Bhandarkar | +| [HADOOP-211](https://issues.apache.org/jira/browse/HADOOP-211) | logging improvements for Hadoop | Minor | . | Sameer Paranjpye | Sameer Paranjpye | ### BUG FIXES: | JIRA | Summary | Priority | Component | Reporter | Contributor | |:---- |:---- | :--- |:---- |:---- |:---- | -| [HADOOP-270](https://issues.apache.org/jira/browse/HADOOP-270) | possible deadlock when shut down a datanode thread | Major | . | Hairong Kuang | Hairong Kuang | -| [HADOOP-265](https://issues.apache.org/jira/browse/HADOOP-265) | Abort tasktracker if it can not write to its local directories | Major | . | Hairong Kuang | Hairong Kuang | -| [HADOOP-264](https://issues.apache.org/jira/browse/HADOOP-264) | WritableFactory has no permissions to create DatanodeRegistration | Blocker | . | Owen O'Malley | Owen O'Malley | -| [HADOOP-259](https://issues.apache.org/jira/browse/HADOOP-259) | map output http client does not timeout | Major | . | Owen O'Malley | Owen O'Malley | -| [HADOOP-251](https://issues.apache.org/jira/browse/HADOOP-251) | progress report failures kill task | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-146](https://issues.apache.org/jira/browse/HADOOP-146) | potential conflict in block id's, leading to data corruption | Major | . | Yoram Arnon | Konstantin Shvachko | +| [HADOOP-180](https://issues.apache.org/jira/browse/HADOOP-180) | task tracker times out cleaning big job | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-200](https://issues.apache.org/jira/browse/HADOOP-200) | The map task names are sent to the reduces | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-219](https://issues.apache.org/jira/browse/HADOOP-219) | SequenceFile#handleChecksumException NPE | Trivial | io | stack | Doug Cutting | +| [HADOOP-179](https://issues.apache.org/jira/browse/HADOOP-179) | task tracker ghosts remain after 10 minutes | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-161](https://issues.apache.org/jira/browse/HADOOP-161) | dfs blocks define equal, but not hashcode | Major | . | Owen O'Malley | Milind Bhandarkar | +| [HADOOP-228](https://issues.apache.org/jira/browse/HADOOP-228) | hadoop cp should have a -config option | Minor | fs | Yoram Arnon | Milind Bhandarkar | +| [HADOOP-229](https://issues.apache.org/jira/browse/HADOOP-229) | hadoop cp should generate a better number of map tasks | Minor | fs | Yoram Arnon | Milind Bhandarkar | +| [HADOOP-238](https://issues.apache.org/jira/browse/HADOOP-238) | map outputs transfers fail with EOFException | Blocker | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-205](https://issues.apache.org/jira/browse/HADOOP-205) | the job tracker does not schedule enough map on the cluster | Major | . | Owen O'Malley | Mahadev konar | | [HADOOP-247](https://issues.apache.org/jira/browse/HADOOP-247) | The Reduce Task thread for reporting progress during the sort exits in case of any IOException | Critical | . | Mahadev konar | Mahadev konar | | [HADOOP-241](https://issues.apache.org/jira/browse/HADOOP-241) | TestCopyFiles fails under cygwin due to incorrect path | Minor | fs | Konstantin Shvachko | Milind Bhandarkar | -| [HADOOP-238](https://issues.apache.org/jira/browse/HADOOP-238) | map outputs transfers fail with EOFException | Blocker | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-251](https://issues.apache.org/jira/browse/HADOOP-251) | progress report failures kill task | Major | . | Owen O'Malley | Owen O'Malley | | [HADOOP-235](https://issues.apache.org/jira/browse/HADOOP-235) | LocalFileSystem.openRaw() throws the wrong string for FileNotFoundException | Major | . | Benjamin Reed | | -| [HADOOP-229](https://issues.apache.org/jira/browse/HADOOP-229) | hadoop cp should generate a better number of map tasks | Minor | fs | Yoram Arnon | Milind Bhandarkar | -| [HADOOP-228](https://issues.apache.org/jira/browse/HADOOP-228) | hadoop cp should have a -config option | Minor | fs | Yoram Arnon | Milind Bhandarkar | -| [HADOOP-219](https://issues.apache.org/jira/browse/HADOOP-219) | SequenceFile#handleChecksumException NPE | Trivial | io | stack | Doug Cutting | -| [HADOOP-217](https://issues.apache.org/jira/browse/HADOOP-217) | IllegalAcessException when creating a Block object via WritableFactories | Major | . | Hairong Kuang | Hairong Kuang | -| [HADOOP-205](https://issues.apache.org/jira/browse/HADOOP-205) | the job tracker does not schedule enough map on the cluster | Major | . | Owen O'Malley | Mahadev konar | -| [HADOOP-200](https://issues.apache.org/jira/browse/HADOOP-200) | The map task names are sent to the reduces | Major | . | Owen O'Malley | Owen O'Malley | -| [HADOOP-180](https://issues.apache.org/jira/browse/HADOOP-180) | task tracker times out cleaning big job | Major | . | Owen O'Malley | Owen O'Malley | -| [HADOOP-179](https://issues.apache.org/jira/browse/HADOOP-179) | task tracker ghosts remain after 10 minutes | Major | . | Owen O'Malley | Owen O'Malley | | [HADOOP-163](https://issues.apache.org/jira/browse/HADOOP-163) | If a DFS datanode cannot write onto its file system. it should tell the name node not to assign new blocks to it. | Major | . | Runping Qi | Hairong Kuang | -| [HADOOP-161](https://issues.apache.org/jira/browse/HADOOP-161) | dfs blocks define equal, but not hashcode | Major | . | Owen O'Malley | Milind Bhandarkar | -| [HADOOP-146](https://issues.apache.org/jira/browse/HADOOP-146) | potential conflict in block id's, leading to data corruption | Major | . | Yoram Arnon | Konstantin Shvachko | -| [HADOOP-141](https://issues.apache.org/jira/browse/HADOOP-141) | Disk thrashing / task timeouts during map output copy phase | Major | . | p sutter | Owen O'Malley | | [HADOOP-124](https://issues.apache.org/jira/browse/HADOOP-124) | don't permit two datanodes to run from same dfs.data.dir | Critical | . | Bryan Pendleton | Konstantin Shvachko | - - -### TESTS: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | +| [HADOOP-259](https://issues.apache.org/jira/browse/HADOOP-259) | map output http client does not timeout | Major | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-264](https://issues.apache.org/jira/browse/HADOOP-264) | WritableFactory has no permissions to create DatanodeRegistration | Blocker | . | Owen O'Malley | Owen O'Malley | +| [HADOOP-265](https://issues.apache.org/jira/browse/HADOOP-265) | Abort tasktracker if it can not write to its local directories | Major | . | Hairong Kuang | Hairong Kuang | +| [HADOOP-217](https://issues.apache.org/jira/browse/HADOOP-217) | IllegalAcessException when creating a Block object via WritableFactories | Major | . | Hairong Kuang | Hairong Kuang | +| [HADOOP-270](https://issues.apache.org/jira/browse/HADOOP-270) | possible deadlock when shut down a datanode thread | Major | . | Hairong Kuang | Hairong Kuang | +| [HADOOP-141](https://issues.apache.org/jira/browse/HADOOP-141) | Disk thrashing / task timeouts during map output copy phase | Major | . | p sutter | Owen O'Malley | ### SUB-TASKS: @@ -100,9 +84,3 @@ | [HADOOP-220](https://issues.apache.org/jira/browse/HADOOP-220) | Add -dfs and -jt command-line parameters to specify namenode and jobtracker. | Major | fs | Milind Bhandarkar | Milind Bhandarkar | -### OTHER: - -| JIRA | Summary | Priority | Component | Reporter | Contributor | -|:---- |:---- | :--- |:---- |:---- |:---- | - - --------------------------------------------------------------------- To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org For additional commands, e-mail: common-commits-help@hadoop.apache.org