Author: omalley Date: Wed Feb 10 19:45:05 2010 New Revision: 908649 URL: http://svn.apache.org/viewvc?rev=908649&view=rev Log: Preparing for release 0.20.2 Modified: hadoop/common/branches/branch-0.20/CHANGES.txt hadoop/common/branches/branch-0.20/build.xml hadoop/common/branches/branch-0.20/src/docs/releasenotes.html Modified: hadoop/common/branches/branch-0.20/CHANGES.txt URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20/CHANGES.txt?rev=908649&r1=908648&r2=908649&view=diff ============================================================================== --- hadoop/common/branches/branch-0.20/CHANGES.txt (original) +++ hadoop/common/branches/branch-0.20/CHANGES.txt Wed Feb 10 19:45:05 2010 @@ -1,6 +1,6 @@ Hadoop Change Log -Release 0.20.2 - Unreleased +Release 0.20.2 - 2010-2-10 NEW FEATURES Modified: hadoop/common/branches/branch-0.20/build.xml URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20/build.xml?rev=908649&r1=908648&r2=908649&view=diff ============================================================================== --- hadoop/common/branches/branch-0.20/build.xml (original) +++ hadoop/common/branches/branch-0.20/build.xml Wed Feb 10 19:45:05 2010 @@ -27,7 +27,7 @@ - + Modified: hadoop/common/branches/branch-0.20/src/docs/releasenotes.html URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.20/src/docs/releasenotes.html?rev=908649&r1=908648&r2=908649&view=diff ============================================================================== --- hadoop/common/branches/branch-0.20/src/docs/releasenotes.html (original) +++ hadoop/common/branches/branch-0.20/src/docs/releasenotes.html Wed Feb 10 19:45:05 2010 @@ -2,7 +2,7 @@ -Hadoop 0.20.1 Release Notes +Hadoop 0.20.2 Release Notes -

Hadoop 0.20.1 Release Notes

+

Hadoop 0.20.2 Release Notes

These release notes include new developer and user-facing incompatibilities, features, and major improvements. The table below is sorted by Component. - + + +

Changes Since Hadoop 0.20.1

+ +

Common

+

Bug +

+
    +
  • [HADOOP-4802] - RPC Server send buffer retains size of largest response ever sent +
  • +
  • [HADOOP-5623] - Streaming: process provided status messages are overwritten every 10 seoncds +
  • +
  • [HADOOP-5759] - IllegalArgumentException when CombineFileInputFormat is used as job InputFormat +
  • +
  • [HADOOP-5997] - Many test jobs write to HDFS under / +
  • +
  • [HADOOP-6097] - Multiple bugs w/ Hadoop archives +
  • +
  • [HADOOP-6231] - Allow caching of filesystem instances to be disabled on a per-instance basis +
  • +
  • [HADOOP-6269] - Missing synchronization for defaultResources in Configuration.addResource +
  • +
  • [HADOOP-6315] - GzipCodec should not represent BuiltInZlibInflater as decompressorType +
  • +
  • [HADOOP-6386] - NameNode's HttpServer can't instantiate InetSocketAddress: IllegalArgumentException is thrown +
  • +
  • [HADOOP-6417] - Alternative Java Distributions in the Hadoop Documention +
  • +
  • [HADOOP-6428] - HttpServer sleeps with negative values +
  • +
  • [HADOOP-6453] - Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH +
  • +
  • [HADOOP-6460] - Namenode runs of out of memory due to memory leak in ipc Server +
  • +
  • [HADOOP-6498] - IPC client bug may cause rpc call hang +
  • +
  • [HADOOP-6502] - DistributedFileSystem#listStatus is very slow when listing a directory with a size of 1300 +
  • +
  • [HADOOP-6506] - Failing tests prevent the rest of test targets from execution. +
  • +
  • [HADOOP-6524] - Contrib tests are failing Clover'ed build +
  • +
+ +

Improvement +

+
    +
  • [HADOOP-3659] - Patch to allow hadoop native to compile on Mac OS X +
  • +
  • [HADOOP-6304] - Use java.io.File.set{Readable|Writable|Executable} where possible in RawLocalFileSystem +
  • +
  • [HADOOP-6376] - slaves file to have a header specifying the format of conf/slaves file +
  • +
  • [HADOOP-6475] - Improvements to the hadoop-config script +
  • +
  • [HADOOP-6542] - Add a -Dno-docs option to build.xml +
  • +
+ +

Task +

+
    +
  • [HADOOP-6328] - Hadoop 0.20 Docs - backport changes for streaming and m/r tutorial docs +
  • +
+ +

HDFS

+

Bug +

+
    +
  • [HDFS-101] - DFS write pipeline : DFSClient sometimes does not detect second datanode failure +
  • +
  • [HDFS-185] - Chown , chgrp , chmod operations allowed when namenode is in safemode . +
  • +
  • [HDFS-187] - TestStartup fails if hdfs is running in the same machine +
  • +
  • [HDFS-442] - dfsthroughput in test.jar throws NPE +
  • +
  • [HDFS-495] - Hadoop FSNamesystem startFileInternal() getLease() has bug +
  • +
  • [HDFS-579] - HADOOP-3792 update of DfsTask incomplete +
  • +
  • [HDFS-596] - Memory leak in libhdfs: hdfsFreeFileInfo() in libhdfs does not free memory for mOwner and mGroup +
  • +
  • [HDFS-645] - Namenode does not leave safe mode even if all blocks are available +
  • +
  • [HDFS-667] - test-contrib target fails on hdfsproxy tests +
  • +
  • [HDFS-677] - Rename failure due to quota results in deletion of src directory +
  • +
  • [HDFS-686] - NullPointerException is thrown while merging edit log and image +
  • +
  • [HDFS-723] - Deadlock in DFSClient#DFSOutputStream +
  • +
  • [HDFS-727] - bug setting block size hdfsOpenFile +
  • +
  • [HDFS-732] - HDFS files are ending up truncated +
  • +
  • [HDFS-734] - TestDatanodeBlockScanner times out in branch 0.20 +
  • +
  • [HDFS-745] - TestFsck timeout on 0.20. +
  • +
  • [HDFS-761] - Failure to process rename operation from edits log due to quota verification +
  • +
  • [HDFS-781] - Metrics PendingDeletionBlocks is not decremented +
  • +
  • [HDFS-793] - DataNode should first receive the whole packet ack message before it constructs and sends its own ack message for the packet +
  • +
  • [HDFS-795] - DFS Write pipeline does not detect defective datanode correctly in some cases (HADOOP-3339) +
  • +
  • [HDFS-846] - SetSpaceQuota of value 9223372036854775807 does not apply quota. +
  • +
  • [HDFS-872] - DFSClient 0.20.1 is incompatible with HDFS 0.20.2 +
  • +
  • [HDFS-886] - TestHDFSTrash fails on Windows +
  • +
  • [HDFS-920] - Incorrect metrics reporting of transcations metrics. +
  • +
  • [HDFS-927] - DFSInputStream retries too many times for new block locations +
  • +
  • [HDFS-937] - Port HDFS-101 to branch 0.20 +
  • +
  • [HDFS-961] - dfs_readdir incorrectly parses paths +
  • +
+ +

Improvement +

+
    +
  • [HDFS-959] - Performance improvements to DFSClient and DataNode for faster DFS write at replication factor of 1 +
  • +
+ +

Test +

+
    +
  • [HDFS-784] - TestFsck times out on branch 0.20.1 +
  • +
  • [HDFS-907] - Add tests for getBlockLocations and totalLoad metrics. +
  • +
  • [HDFS-919] - Create test to validate the BlocksVerified metric +
  • +
+ +

MapReduce

+ +

Bug +

+
    +
  • [MAPREDUCE-112] - Reduce Input Records and Reduce Output Records counters are not being set when using the new Mapreduce reducer API +
  • +
  • [MAPREDUCE-118] - Job.getJobID() will always return null +
  • +
  • [MAPREDUCE-433] - TestReduceFetch failed. +
  • +
  • [MAPREDUCE-806] - WordCount example does not compile given the current instructions +
  • +
  • [MAPREDUCE-826] - harchive doesn't use ToolRunner / harchive returns 0 even if the job fails with exception +
  • +
  • [MAPREDUCE-979] - JobConf.getMemoryFor{Map|Reduce}Task doesn't fallback to newer config knobs when mapred.taskmaxvmem is set to DISABLED_MEMORY_LIMIT of -1 +
  • +
  • [MAPREDUCE-1010] - Adding tests for changes in archives. +
  • +
  • [MAPREDUCE-1057] - java tasks are not honouring the value of mapred.userlog.limit.kb +
  • +
  • [MAPREDUCE-1068] - In hadoop-0.20.0 streaming job do not throw proper verbose error message if file is not present +
  • +
  • [MAPREDUCE-1070] - Deadlock in FairSchedulerServlet +
  • +
  • [MAPREDUCE-1088] - JobHistory files should have narrower 0600 perms +
  • +
  • [MAPREDUCE-1112] - Fix CombineFileInputFormat for hadoop 0.20 +
  • +
  • [MAPREDUCE-1147] - Map output records counter missing for map-only jobs in new API +
  • +
  • [MAPREDUCE-1157] - JT UI shows incorrect scheduling info for failed/killed retired jobs +
  • +
  • [MAPREDUCE-1163] - hdfsJniHelper.h: Yahoo! specific paths are encoded +
  • +
  • [MAPREDUCE-1182] - Reducers fail with OutOfMemoryError while copying Map outputs +
  • +
  • [MAPREDUCE-1262] - Eclipse Plugin does not build for Hadoop 0.20.1 +
  • +
  • [MAPREDUCE-1264] - Error Recovery failed, task will continue but run forever as new data only comes in very very slowly +
  • +
  • [MAPREDUCE-1321] - Spurios logs with org.apache.hadoop.util.DiskChecker$DiskErrorException in TaskTracker +
  • +
  • [MAPREDUCE-1328] - contrib/index - modify build / ivy files as appropriate +
  • +
  • [MAPREDUCE-1346] - TestStreamingExitStatus / TestStreamingKeyValue - correct text fixtures in place +
  • +
  • [MAPREDUCE-1381] - Incorrect values being displayed for blacklisted_maps and blacklisted_reduces +
  • +
  • [MAPREDUCE-1389] - TestDFSIO creates TestDFSIO_results.log file directly under hadoop.home +
  • +
  • [MAPREDUCE-1397] - NullPointerException observed during task failures +
  • +
+ +

Improvement +

+
    +
  • [MAPREDUCE-1315] - taskdetails.jsp and jobfailures.jsp should have consistent convention for machine names in case of lost task tracker +
  • +
  • [MAPREDUCE-1361] - In the pools with minimum slots, new job will always receive slots even if the minimum slots limit has been fulfilled +
  • +
+ +

New Feature +

+
    +
  • [MAPREDUCE-1145] - Multiple Outputs doesn't work with new API in 0.20 branch +
  • +
  • [MAPREDUCE-1170] - MultipleInputs doesn't work with new API in 0.20 branch +
  • +
+ +

Test +

+
    +
  • [MAPREDUCE-1336] - TestStreamingExitStatus - Fix deprecated use of StreamJob submission API +
  • +
+

Changes Since Hadoop 0.20.0

Common