Return-Path: X-Original-To: apmail-hadoop-hdfs-commits-archive@minotaur.apache.org Delivered-To: apmail-hadoop-hdfs-commits-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F3EA89A28 for ; Sun, 11 Mar 2012 18:12:08 +0000 (UTC) Received: (qmail 95993 invoked by uid 500); 11 Mar 2012 18:12:08 -0000 Delivered-To: apmail-hadoop-hdfs-commits-archive@hadoop.apache.org Received: (qmail 95868 invoked by uid 500); 11 Mar 2012 18:12:06 -0000 Mailing-List: contact hdfs-commits-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: hdfs-dev@hadoop.apache.org Delivered-To: mailing list hdfs-commits@hadoop.apache.org Received: (qmail 95853 invoked by uid 99); 11 Mar 2012 18:12:05 -0000 Received: from athena.apache.org (HELO athena.apache.org) (140.211.11.136) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 11 Mar 2012 18:12:05 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [140.211.11.4] (HELO eris.apache.org) (140.211.11.4) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 11 Mar 2012 18:12:03 +0000 Received: from eris.apache.org (localhost [127.0.0.1]) by eris.apache.org (Postfix) with ESMTP id AFB432388994; Sun, 11 Mar 2012 18:11:43 +0000 (UTC) Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: svn commit: r1299417 - /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt Date: Sun, 11 Mar 2012 18:11:43 -0000 To: hdfs-commits@hadoop.apache.org From: suresh@apache.org X-Mailer: svnmailer-1.0.8-patched Message-Id: <20120311181143.AFB432388994@eris.apache.org> X-Virus-Checked: Checked by ClamAV on apache.org Author: suresh Date: Sun Mar 11 18:11:43 2012 New Revision: 1299417 URL: http://svn.apache.org/viewvc?rev=1299417&view=rev Log: Moving HDFS-1623 and HADOOP-7454 to 0.23.3 section in CHANGES.txt files Modified: hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt Modified: hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt?rev=1299417&r1=1299416&r2=1299417&view=diff ============================================================================== --- hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt (original) +++ hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt Sun Mar 11 18:11:43 2012 @@ -11,11 +11,6 @@ Trunk (unreleased changes) HDFS-234. Integration with BookKeeper logging system. (Ivan Kelly via jitendra) - HDFS-1623. High Availability Framework for HDFS NN. Contributed by Todd - Lipcon, Aaron T. Myers, Eli Collins, Uma Maheswara Rao G, Bikas Saha, - Suresh Srinivas, Jitendra Nath Pandey, Hari Mankude, Brandon Li, Sanjay - Radia, Mingjie Lai, and Gregory Chanan - IMPROVEMENTS HDFS-1620. Rename HdfsConstants -> HdfsServerConstants, FSConstants -> @@ -94,6 +89,201 @@ Trunk (unreleased changes) HDFS-2966 TestNameNodeMetrics tests can fail under load. (stevel) +Release 0.23.3 - UNRELEASED + + INCOMPATIBLE CHANGES + + HDFS-2676. Remove Avro RPC. (suresh) + + NEW FEATURES + + HDFS-2978. The NameNode should expose name dir statuses via JMX. (atm) + + HDFS-395. DFS Scalability: Incremental block reports. (Tomasz Nykiel + via hairong) + + HDFS-2517. Add protobuf service for JounralProtocol. (suresh) + + HDFS-2518. Add protobuf service for NamenodeProtocol. (suresh) + + HDFS-2520. Add protobuf service for InterDatanodeProtocol. (suresh) + + HDFS-2519. Add protobuf service for DatanodeProtocol. (suresh) + + HDFS-2581. Implement protobuf service for JournalProtocol. (suresh) + + HDFS-2618. Implement protobuf service for NamenodeProtocol. (suresh) + + HDFS-2629. Implement protobuf service for InterDatanodeProtocol. (suresh) + + HDFS-2636. Implement protobuf service for ClientDatanodeProtocol. (suresh) + + HDFS-2642. Protobuf translators for DatanodeProtocol. (jitendra) + + HDFS-2647. Used protobuf based RPC for InterDatanodeProtocol, + ClientDatanodeProtocol, JournalProtocol, NamenodeProtocol. (suresh) + + HDFS-2661. Enable protobuf RPC for DatanodeProtocol. (jitendra) + + HDFS-2697. Move RefreshAuthPolicy, RefreshUserMappings, GetUserMappings + protocol to protocol buffers. (jitendra) + + HDFS-2880. Protobuf changes in DatanodeProtocol to add multiple storages. + (suresh) + + HDFS-2899. Service protocol changes in DatanodeProtocol to add multiple + storages. (suresh) + + HDFS-2430. The number of failed or low-resource volumes the NN can tolerate + should be configurable. (atm) + + HDFS-1623. High Availability Framework for HDFS NN. Contributed by Todd + Lipcon, Aaron T. Myers, Eli Collins, Uma Maheswara Rao G, Bikas Saha, + Suresh Srinivas, Jitendra Nath Pandey, Hari Mankude, Brandon Li, Sanjay + Radia, Mingjie Lai, and Gregory Chanan + + IMPROVEMENTS + + HDFS-2018. Move all journal stream management code into one place. + (Ivan Kelly via jitendra) + + HDFS-2223. Untangle depencencies between NN components (todd) + + HDFS-2351. Change Namenode and Datanode to register each of their protocols + seperately (sanjay) + + HDFS-2337. DFSClient shouldn't keep multiple RPC proxy references (atm) + + HDFS-2181. Separate HDFS Client wire protocol data types (sanjay) + + HDFS-2459. Separate datatypes for Journal Protocol. (suresh) + + HDFS-2480. Separate datatypes for NamenodeProtocol. (suresh) + + HDFS-2489. Move Finalize and Register to separate file out of + DatanodeCommand.java. (suresh) + + HDFS-2488. Separate datatypes for InterDatanodeProtocol. (suresh) + + HDFS-2496. Separate datatypes for DatanodeProtocol. (suresh) + + HDFS-2479. HDFS Client Data Types in Protocol Buffers (sanjay) + + HADOOP-7862. Hdfs changes to work with HADOOP-7862: Move the support for + multiple protocols to lower layer so that Writable, PB and Avro can all + use it. (sanjay) + + HDFS-2597. ClientNameNodeProtocol in Protocol Buffers. (sanjay) + + HDFS-2651. ClientNameNodeProtocol Translators for Protocol Buffers. (sanjay) + + HDFS-2650. Replace @inheritDoc with @Override. (Hari Mankude via suresh). + + HDFS-2669. Enable protobuf rpc for ClientNamenodeProtocol. (sanjay) + + HDFS-2801. Provide a method in client side translators to check for a + methods supported in underlying protocol. (jitendra) + + HDFS-2895. Remove Writable wire protocol types and translators to + complete transition to protocol buffers. (suresh) + + HDFS-2992. Edit log failure trace should include transaction ID of + error. (Colin Patrick McCabe via eli) + + HDFS-2507. Allow saveNamespace operations to be canceled. (todd) + + HDFS-2410. Further cleanup of hardcoded configuration keys and values. + (suresh) + + HDFS-208. name node should warn if only one dir is listed in dfs.name.dir. + (Uma Maheswara Rao G via eli) + + HDFS-3003. Remove getHostPortString() from NameNode, replace it with + NetUtils.getHostPortString(). (Brandon Li via atm) + + HDFS-3014. FSEditLogOp and its subclasses should have toString() method. + (Sho Shimauchi via atm) + + HDFS-3036. Remove unused method DFSUtil#isDefaultNamenodeAddress. (atm) + + HDFS-2158. Add JournalSet to manage the set of journals. (jitendra) + + HDFS-2334. Add Closeable to JournalManager. (Ivan Kelly via jitendra) + + HDFS-1580. Add interface for generic Write Ahead Logging mechanisms. + (Ivan Kelly via jitendra) + + HDFS-3060. Bump TestDistributedUpgrade#testDistributedUpgrade timeout (eli) + + HDFS-3021. Use generic type to declare FSDatasetInterface. (szetszwo) + + HDFS-3056. Add a new interface RollingLogs for DataBlockScanner logging. + (szetszwo) + + OPTIMIZATIONS + + HDFS-3024. Improve performance of stringification in addStoredBlock (todd) + + HDFS-2477. Optimize computing the diff between a block report and the + namenode state. (Tomasz Nykiel via hairong) + + HDFS-2495. Increase granularity of write operations in ReplicationMonitor + thus reducing contention for write lock. (Tomasz Nykiel via hairong) + + HDFS-2476. More CPU efficient data structure for under-replicated, + over-replicated, and invalidated blocks. (Tomasz Nykiel via todd) + + BUG FIXES + + HDFS-2481. Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol. + (sanjay) + + HDFS-2497. Fix TestBackupNode failure. (suresh) + + HDFS-2499. RPC client is created incorrectly introduced in HDFS-2459. + (suresh) + + HDFS-2526. (Client)NamenodeProtocolTranslatorR23 do not need to keep a + reference to rpcProxyWithoutRetry (atm) + + HDFS-2532. TestDfsOverAvroRpc timing out in trunk (Uma Maheswara Rao G + via todd) + + HDFS-2666. Fix TestBackupNode failure. (suresh) + + HDFS-2663. Optional protobuf parameters are not handled correctly. (suresh) + + HDFS-2694. Removal of Avro broke non-PB NN services. (atm) + + HDFS-2687. Tests failing with ClassCastException post protobuf RPC + changes. (suresh) + + HDFS-2700. Fix failing TestDataNodeMultipleRegistrations in trunk + (Uma Maheswara Rao G via todd) + + HDFS-2739. SecondaryNameNode doesn't start up. (jitendra) + + HDFS-2768. BackupNode stop can not close proxy connections because + it is not a proxy instance. (Uma Maheswara Rao G via eli) + + HDFS-2968. Protocol translator for BlockRecoveryCommand broken when + multiple blocks need recovery. (todd) + + HDFS-3020. Fix editlog to automatically sync when buffer is full. (todd) + + HDFS-3038. Add FSEditLog.metrics to findbugs exclude list. (todd via atm) + + HDFS-2285. BackupNode should reject requests to modify namespace. + (shv and Uma Maheswara Rao) + + HDFS-2764. TestBackupNode is racy. (atm) + + HDFS-2188. Make FSEditLog create its journals from a list of URIs rather + than NNStorage. (Ivan Kelly via jitendra) + + HDFS-1765. Block Replication should respect under-replication + block priority. (Uma Maheswara Rao G via eli) + BREAKDOWN OF HDFS-1623 SUBTASKS HDFS-2179. Add fencing framework and mechanisms for NameNode HA. (todd) @@ -410,196 +600,6 @@ Trunk (unreleased changes) HDFS-3039. Address findbugs and javadoc warnings on branch. (todd via atm) -Release 0.23.3 - UNRELEASED - - INCOMPATIBLE CHANGES - - HDFS-2676. Remove Avro RPC. (suresh) - - NEW FEATURES - - HDFS-2978. The NameNode should expose name dir statuses via JMX. (atm) - - HDFS-395. DFS Scalability: Incremental block reports. (Tomasz Nykiel - via hairong) - - HDFS-2517. Add protobuf service for JounralProtocol. (suresh) - - HDFS-2518. Add protobuf service for NamenodeProtocol. (suresh) - - HDFS-2520. Add protobuf service for InterDatanodeProtocol. (suresh) - - HDFS-2519. Add protobuf service for DatanodeProtocol. (suresh) - - HDFS-2581. Implement protobuf service for JournalProtocol. (suresh) - - HDFS-2618. Implement protobuf service for NamenodeProtocol. (suresh) - - HDFS-2629. Implement protobuf service for InterDatanodeProtocol. (suresh) - - HDFS-2636. Implement protobuf service for ClientDatanodeProtocol. (suresh) - - HDFS-2642. Protobuf translators for DatanodeProtocol. (jitendra) - - HDFS-2647. Used protobuf based RPC for InterDatanodeProtocol, - ClientDatanodeProtocol, JournalProtocol, NamenodeProtocol. (suresh) - - HDFS-2661. Enable protobuf RPC for DatanodeProtocol. (jitendra) - - HDFS-2697. Move RefreshAuthPolicy, RefreshUserMappings, GetUserMappings - protocol to protocol buffers. (jitendra) - - HDFS-2880. Protobuf changes in DatanodeProtocol to add multiple storages. - (suresh) - - HDFS-2899. Service protocol changes in DatanodeProtocol to add multiple - storages. (suresh) - - HDFS-2430. The number of failed or low-resource volumes the NN can tolerate - should be configurable. (atm) - - IMPROVEMENTS - - HDFS-2018. Move all journal stream management code into one place. - (Ivan Kelly via jitendra) - - HDFS-2223. Untangle depencencies between NN components (todd) - - HDFS-2351. Change Namenode and Datanode to register each of their protocols - seperately (sanjay) - - HDFS-2337. DFSClient shouldn't keep multiple RPC proxy references (atm) - - HDFS-2181. Separate HDFS Client wire protocol data types (sanjay) - - HDFS-2459. Separate datatypes for Journal Protocol. (suresh) - - HDFS-2480. Separate datatypes for NamenodeProtocol. (suresh) - - HDFS-2489. Move Finalize and Register to separate file out of - DatanodeCommand.java. (suresh) - - HDFS-2488. Separate datatypes for InterDatanodeProtocol. (suresh) - - HDFS-2496. Separate datatypes for DatanodeProtocol. (suresh) - - HDFS-2479. HDFS Client Data Types in Protocol Buffers (sanjay) - - HADOOP-7862. Hdfs changes to work with HADOOP-7862: Move the support for - multiple protocols to lower layer so that Writable, PB and Avro can all - use it. (sanjay) - - HDFS-2597. ClientNameNodeProtocol in Protocol Buffers. (sanjay) - - HDFS-2651. ClientNameNodeProtocol Translators for Protocol Buffers. (sanjay) - - HDFS-2650. Replace @inheritDoc with @Override. (Hari Mankude via suresh). - - HDFS-2669. Enable protobuf rpc for ClientNamenodeProtocol. (sanjay) - - HDFS-2801. Provide a method in client side translators to check for a - methods supported in underlying protocol. (jitendra) - - HDFS-2895. Remove Writable wire protocol types and translators to - complete transition to protocol buffers. (suresh) - - HDFS-2992. Edit log failure trace should include transaction ID of - error. (Colin Patrick McCabe via eli) - - HDFS-2507. Allow saveNamespace operations to be canceled. (todd) - - HDFS-2410. Further cleanup of hardcoded configuration keys and values. - (suresh) - - HDFS-208. name node should warn if only one dir is listed in dfs.name.dir. - (Uma Maheswara Rao G via eli) - - HDFS-3003. Remove getHostPortString() from NameNode, replace it with - NetUtils.getHostPortString(). (Brandon Li via atm) - - HDFS-3014. FSEditLogOp and its subclasses should have toString() method. - (Sho Shimauchi via atm) - - HDFS-3036. Remove unused method DFSUtil#isDefaultNamenodeAddress. (atm) - - HDFS-2158. Add JournalSet to manage the set of journals. (jitendra) - - HDFS-2334. Add Closeable to JournalManager. (Ivan Kelly via jitendra) - - HDFS-1580. Add interface for generic Write Ahead Logging mechanisms. - (Ivan Kelly via jitendra) - - HDFS-3060. Bump TestDistributedUpgrade#testDistributedUpgrade timeout (eli) - - HDFS-3021. Use generic type to declare FSDatasetInterface. (szetszwo) - - HDFS-3056. Add a new interface RollingLogs for DataBlockScanner logging. - (szetszwo) - - OPTIMIZATIONS - - HDFS-3024. Improve performance of stringification in addStoredBlock (todd) - - HDFS-2477. Optimize computing the diff between a block report and the - namenode state. (Tomasz Nykiel via hairong) - - HDFS-2495. Increase granularity of write operations in ReplicationMonitor - thus reducing contention for write lock. (Tomasz Nykiel via hairong) - - HDFS-2476. More CPU efficient data structure for under-replicated, - over-replicated, and invalidated blocks. (Tomasz Nykiel via todd) - - BUG FIXES - - HDFS-2481. Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol. - (sanjay) - - HDFS-2497. Fix TestBackupNode failure. (suresh) - - HDFS-2499. RPC client is created incorrectly introduced in HDFS-2459. - (suresh) - - HDFS-2526. (Client)NamenodeProtocolTranslatorR23 do not need to keep a - reference to rpcProxyWithoutRetry (atm) - - HDFS-2532. TestDfsOverAvroRpc timing out in trunk (Uma Maheswara Rao G - via todd) - - HDFS-2666. Fix TestBackupNode failure. (suresh) - - HDFS-2663. Optional protobuf parameters are not handled correctly. (suresh) - - HDFS-2694. Removal of Avro broke non-PB NN services. (atm) - - HDFS-2687. Tests failing with ClassCastException post protobuf RPC - changes. (suresh) - - HDFS-2700. Fix failing TestDataNodeMultipleRegistrations in trunk - (Uma Maheswara Rao G via todd) - - HDFS-2739. SecondaryNameNode doesn't start up. (jitendra) - - HDFS-2768. BackupNode stop can not close proxy connections because - it is not a proxy instance. (Uma Maheswara Rao G via eli) - - HDFS-2968. Protocol translator for BlockRecoveryCommand broken when - multiple blocks need recovery. (todd) - - HDFS-3020. Fix editlog to automatically sync when buffer is full. (todd) - - HDFS-3038. Add FSEditLog.metrics to findbugs exclude list. (todd via atm) - - HDFS-2285. BackupNode should reject requests to modify namespace. - (shv and Uma Maheswara Rao) - - HDFS-2764. TestBackupNode is racy. (atm) - - HDFS-2188. Make FSEditLog create its journals from a list of URIs rather - than NNStorage. (Ivan Kelly via jitendra) - - HDFS-1765. Block Replication should respect under-replication - block priority. (Uma Maheswara Rao G via eli) - Release 0.23.2 - UNRELEASED INCOMPATIBLE CHANGES