This is an automated email from the ASF dual-hosted git repository.
bharat pushed a change to branch revert-510-HDDS-1141
in repository https://gitbox.apache.org/repos/asf/hadoop.git.
at 5f88fa6 Revert "HDDS-1141. Update DBCheckpointSnapshot to DBCheckpoint."
This branch includes the following new commits:
new 5128a9a HADOOP-4687 Moving src directories on branch
new c94ff0f HADOOP-4687 More moving around
new abe7be9 HADOOP-4687 Moving directories around
new cab0a4b HADOOP-4687 split the contrib dirs
new c967cef HADOOP-4687 move more src dirs
new 95a0db6 HADOOP-4687. move test dirs
new ac670cc Fixed basic hadoop core targets
new bd524bd move test and xml files
new a72da11 remove webapps
new 7e7fd2c fixed test test-core and test-contrib targets
new c984f6c Fix jdiff and javadoc target
new 01d81f4 To fix test targets
new bb957bd Fix test-patch.sh script for eclipse classpath verification
new 5c7b7ad HADOOP-4687. Fix some of the remaining javadoc warnings.
new 244380a Fix core test failrues
new 74a4cc5 HADOOP-4687 Fix svnignore for the project split
new bcd6432 Merged src/core, src/test/core, src/contrib/eclipse-plugin, and src/contrib/ec2 from trunk 776174:784663
new c2226e0 HADOOP-4687 Setup .gitignore and .eclipse.templates
new c2d07b4 HADOOP-4687. Updating CHANGES.txt
new b12d765 HADOOP-4687. Merge -r 784663:785643 from trunk to branch.
new fb6308f HADOOP-4687. More merges from trunk.
new ff11be5 HADOOP-4687 updating docs
new cfb9636 HADOOP-4687. Pulling trunk docs to branch
new 5139985 Moving HADOOP-4687 branch to new trunk.
new 2c372c7 HADOOP-5952. Change "-1 tests included" wording in test-patch.sh. Contributed by Gary Murry
new 84541f6 HADOOP-6096. Fix Eclipse project and classpath files following project split.
new 8246aa2 HADOOP-3315. Add a new, binary file foramt, TFile. Contributed by Hong Tang.
new b089f44 HADOOP-6106. Provides an option in ShellCommandExecutor to timeout commands that do not complete within a certain amount of time. Contributed by Sreekanth Ramakrishnan.
new efc6df7 HADOOP-5925. EC2 scripts should exit on error.
new 1d6d98c HADOOP-5897. Promote new name-node metrics to branch 0.20.
new e93ebea HADOOP-6109. Change Text to grow its internal buffer exponentially, rather than the max of the current length and the proposed length to improve performance reading large values. Contributed by thushara wijeratna
new 4824a54 HADOOP-6080. Introduce -skipTrash option to rm and rmr. Contributed by Jakob Homan.
new 80bc92a HADOOP-6080 is going to 0.20.
new a132379 HADOOP-2366. Support trimmed strings in Configuration. Contributed by Michele Catasta
new b8d9ca2 HADOOP-6122. The great than operator in test-patch.sh should be "-gt" but not ">".
new cf3d3a0 HADOOP-6114. Fix javadoc documentation for FileStatus.getLen. (Dmitry Rzhevskiy via dhruba)
new aa47115 Move eclipse-plugin from common to mapreduce
new 708f3fc HADOOP-5976. Add a new command, classpath, to the hadoop script. Contributed by Owen O'Malley and Gary Murry
new da8cf67 HADOOP-6131. A sysproperty should not be set unless the property is set on the ant command line in build.xml (hong tang via mahadev)
new 127254f HADOOP-6137. Fix project specific test-patch requirements
new 34d67b1 HADOOP-5170. Removed change log entry because HADOOP-5170 was reverted from mapreduce.
new c38c5a4 HADOOP-6099. The RPC module can be configured to not send period pings. The default behaviour remains unchanged. (dhruba)
new d074c68 HADOOP-6139. Fix the FsShell help messages for rm and rmr. Contributed by Jakob Homan
new c02527f Move HADOOP-3315 from 0.21 to 0.20.1
new 466f93c HADOOP-6145. Fix FsShell rm/rmr error messages when there is a FNFE. Contributed by Jakob Homan
new fc1bf70 HADOOP-6142. Update documentation and use of harchives for relative paths added in MAPREDUCE-739. Contributed by Mahadev Konar
new 8bd2486 HADOOP-6148. Implement a fast, pure Java CRC32 calculator which outperforms java.util.zip.CRC32. Contributed by Todd Lipcon and Scott Carey
new 5478e9a HADOOP-6146. Upgrade to JetS3t version 0.7.1.
new 391112f HADOOP-6138. Eliminate the depracate warnings introduced by H-5438. Contributed by He Yongqiang
new cd86632 HADOOP-5935. Fix the releaseaudit warning link with test-patch
new 3200b2e HADOOP-6161. Add get/setEnum methods to Configuration.
new 8296413 HADOOP-6120. Add support for Avro specific and reflect data. Contributed by sharad.
new 53c1270 HADOOP-6132. RPC client create an extra connection because of incorrect key for connection cache. (Kan Zhang via rangadi)
new e4450e5 HADOOP-6150. Users should be able to instantiate comparator using TFile API. (Hong Tang via rangadi)
new f4166dd move the last change long from trunk to 0.20.
new 6c12fd3 HADOOP-6160. Fix ant releaseaudit target to run on specific directories. (Contributed by Giridharan Kesavan)
new 638a211 HADOOP-6123. Add missing classpaths in hadoop-config.sh. Contributed by Sharad Agarwal
new e5ea0ce HADOOP-6172. Fix jar file names in hadoop-config.sh and include ${build.src} as a part of the source list in build.xml. Contributed by Hong Tang
new 7be6fc4 HADOOP-6169. Removing deprecated method calls in TFile. (hong tang via mahadev)
new ada9e3d JDiff output for release 0.19.2
new 5f53fd8 HADOOP-6124. Fix javac warning detection in test-patch.sh. Contributed by Giridharan Kesavan
new 09d826e HADOOP-6180. NameNode slowed down when many files with same filename were moved to Trash. Contributed by Boris Shkolnik.
new 5fe6906 HADOOP-6176. Add a couple package private methods to AccessTokenHandler for testing. Contributed by Kan Zhang
new d70dd1a HADOOP-6177. FSInputChecker.getPos() would return position greater than the file size. Contributed by Hong Tang.
new 38a84a6 HADOOP-6188. TestTrash uses java.io.File api but not hadoop FileSystem api. Contributed by Boris Shkolnik
new ec8208f HADOOP-6192. Fix Shell.getUlimitMemoryCommand to not rely on Map-Reduce specific configs.
new 2e34ced HADOOP-6182. Fix releaseaudit warnings by adding AL Headers.
new 43f95b5 HADOOP-6195. Fix checkstyle xml version tag. Contributed by Lee Tucker
new 7ffe5b7 Reverting HADOOP-6182 and HADOOP-6195
new a7303bd Delete the empty file src/core/org/apache/hadoop/fs/LengthFileChecksum.java which was removed by HADOOP-3981.
new 07b4346 HADOOP-6182. Fix ReleaseAudit warnings. Contributed by Giridharan Kesavan and Lee Tucker
new e5b7248 MAPREDUCE-711. Removed Distributed Cache from Common, to move it under Map/Reduce. Contributed by Vinod Kumar Vavilapalli.
new 1f33379 HADOOP-6173. Change src/native/packageNativeHadoop.sh to package all native library files. Contributed by Hong Tang
new 0a8e65c HADOOP-6103. Clones the classloader as part of Configuration clone. Contributed by Amareshwari Sriramadasu.
new 76a77ae HADOOP-6201. Change FileSystem::listStatus contract to throw FileNotFoundException if the directory does not exist, rather than letting this be implementation-specific. Contributed by Jakob Homan.
new 280ab0c HADOOP-6184. Provide an API to dump Configuration in a JSON format. Contributed by V.V.Chaitanya Krishna.
new a72edd2 HADOOP-6152. Fix classpath variables in bin/hadoop-config.sh and some other scripts. Contributed by Aaron Kimball
new 8621b83 HADOOP-6166. Further improve the performance of the pure-Java CRC32 implementation. Contributed by Tsz Wo (Nicholas), SZE
new aa10f30 HADOOP-6215. fix GenericOptionParser to deal with -D with '=' in the value. Contributed by Amar Kamat.
new 4c66882 HADOOP-6224. Adds methods to read strings safely, makes the Buffer class in DataOutputBuffer public, and introduces public constructors there. These changes are required for MAPREDUCE-318. Contributed by Jothi Padmanabhan and Arun Murthy.
new 75103dc HADOOP-6227. Fix Configuration to allow final parameters to be set to null and prevent them from being overridden. Contributed by Amareshwari Sriramadasu.
new 6145503 Revert HADOOP-6224
new faf9fe9 HADOOP-6199. Move io.map.skip.index property to core-default from mapred. Contributed by Amareshwari Sriramadasu
new 9ea11c5 HADOOP-6224. Add a method to WritableUtils supported a bounded read of an encoded String. Contributed by Jothi Padmanabhan
new a3c52b9 HADOOP-6226. Moves BoundedByteArrayOutputStream from the tfile package to the io package and makes it available to other users (MAPREDUCE-318). Contributed by Jothi Padmanabhan.
new 51d1c6f HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1
new 412efb8 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1
new e5fef21 HADOOP-4675 Current Ganglia metrics implementation is incompatible with Ganglia 3.1 -- reversing this patch
new d642858 HADOOP-6165. Add metadata to Serializations.
new 2aee3ed HADOOP-6231. Allow caching of filesystem instances to be disabled on a per-instance basis.
new e324c20 HADOOP-6230. Moved process tree and memory calculator related classes from Common to Map/Reduce. Contributed by Vinod Kumar Vavilapalli.
new e24071b HADOOP-6105. Adds support for automatically handling deprecation of configuration keys. Contributed by V.V.Chaitanya Krishna.
new 9b0b37e HADOOP-6229. Attempt to make a directory under an existing file on LocalFileSystem should throw an Exception. Contributed by Boris Shkolnik.
new f95ec3f HADOOP-6133. Add a caching layer to Configuration::getClassByName to alleviate a performance regression introduced in a compatibility layer. Contributed by Todd Lipcon
new d09ade4 HADOOP-6203. FsShell rm/rmr error message indicates exceeding Trash quota and suggests using -skpTrash, when moving to trash fails. Contributed by Boris Shkolnik.
new 4a4dd27 HADOOP-6243. Fix a NullPointerException in processing deprecated keys. Contributed by Sreekanth Ramakrishnan.
new 174b3e8 HADOOP-6009. S3N listStatus incorrectly returns null instead of empty array when called on empty root. Contributed by Ian Nowland.
new 3f384b4 HADOOP-6235. Adds new method to FileSystem for clients to get server defaults. Contributed by Kan Zhang.
new cdbb724 HADOOP-6234. Add new option dfs.umaskmode to set umask in configuration to use octal or symbolic instead of decimal. Contributed by Jakob Homan.
new d9e6a9b HADOOP-5073. Add annotation mechanism for interface classification. Contributed by Jakob Homan.
new efb3e17 HADOOP-6181. Fix .eclipse.templates/.classpath for avro and jets3t jar files. Contributed by Carlos Valiente
new 8672494 HADOOP-4012. Provide splitting support for bzip2 compressed files. Contributed by Abdul Qadeer
new ae6721a HADOOP-6252. Provide a method to determine if a deprecated key is set in config file. Contributed by Jakob Homan.
new c9cc61e HADOOP-6196. Fix a bug in SequenceFile.Reader where syncing within the header would cause the reader to read the sync marker as a record. Contributed by Jay Booth
new 3617ed0 HADOOP-6246. Add backward compatibility support to use deprecated decimal umask from old configuration. Contributed by Jakob Homan.
new 254afbf HADOOP-5879. Read compression level and strategy from Configuration for gzip compression. Contributed by He Yongqiang
new 2cf010b Jdiff output for release 0.20.1
new 7612b78 Reverted files from my last commit that should have just updated the jdiff for 0.20.1.
new 78cff65 HADOOP-6250. Modify test-patch to delete copied XML files before running patch build. Contributed by Rahul Kumar Singh.
new 9164c63 HADOOP-6216. Support comments in host files. Contributed by Ravi Phulari and Dmytro Molkov
new 7ee09e0 HADOOP-6257. Two TestFileSystem classes are confusing hadoop-hdfs-hdfwithmr. Contributed by Philip Zeyliger.
new 0294c49 HADOOP-4952. Add new improved file system interface FileContext for the application writer. Contributed by Sanjay Radia.
new bec1f27 HADOOP-6217. Update documentation for project split. (Corinne Chandel via omalley)
new 446309b HADOOP-6268. Add ivy jar to .gitignore. Contributed by Todd Lipcon
new 366b1b1 HADOOP-6151. Added a input filter to all of the http servlets that quotes html characters in the parameters, to prevent cross site scripting attacks. (omalley)
new ea50f15 HADOOP-6170. Add facility to tunnel Avro RPCs through Hadoop RPCs.
new 758f8a5 HADOOP-6270. Support deleteOnExit in FileContext. Contributed by Suresh Srinivas
new c722a45 HADOOP-6267. Permit building contrib modules located in external source trees. Contributed by Todd Lipcon.
new 1695ecd HADOOP-6240. Add new FileContext rename operation that posix compliant that allows overwriting existing destination. Contributed by Suresh Srinivas.
new fa48d9e HADOOP-6271. Add recursive and non recursive create and mkdir to FileContext. Contributed by Sanjay Radia.
new 6ef2552 HADOOP-6233. Rename configuration keys towards API standardization and backward compatibility. Contributed by Jithendra Pandey.
new 7cc6a8e HADOOP-6260. Add additional unit tests for FileContext util methods. Contributed by Gary Murray.
new 4342710 Branching for 0.21
new 277dd0e Fix up formatting of header after branch
new 373bf85 HADOOP-6274. Fix TestLocalFSFileContextMainOperations test failure. Contributed by Gary Murry.
new 0243cf3 HADOOP-6261. Add URI based tests for FileContext. Contributed by Ravi Pulari.
new 779e2a5 Add build.properties to svnignore and gitignore.
new 9de98c4 HADOOP-6281. Avoid null pointer exceptions when the jsps don't have paramaters (omalley)
new 2031231 HADOOP-6285. Fix the result type of the getParameterMap method in the HttpServer.QuotingInputFilter. (omalley)
new 59ab2c5 HADOOP-6284. Add a new parameter, HADOOP_JAVA_PLATFORM_OPTS, to hadoop-config.sh so that it allows setting java command options for JAVA_PLATFORM. Contributed by Koji Noguchi
new 64f537d HADOOP-6286. Fix bugs in related to URI handling in glob methods in FileContext. Contributed by Boris Shkolnik.
new 710d517 HADOOP-6283. Improve the exception messages thrown by FileUtil$HardLink.getLinkCount(..).
new b903b25 HADOOP-6279. Add Runtime::maxMemory to JVM metrics. Contributed by Todd Lipcon
new 780efea Eclipse .classpath template has outdated jar files and is missing some new ones. Contributed by Konstantin Boudnik
new d3c314e HADOOP-6305. Unify build property names to facilitate cross-projects modifications. Contributed by Konstantin Boudnik
new fed32af HADOOP-6218. Adds a feature where TFile can be split by Record Sequeunce number. Contributed by Hong Tang and Raghu Angadi.
new 512a392 HADOOP-6309. Change build.xml to run tests with java asserts. Contributed by Eli Collins
new 3e9ba35 HADOOP-6204. Implementing aspects development and fault injeciton framework for Hadoop. Contributed by Konstantin Boudnik
new c5bce7b HADOOP-6293. Fix FsShell -text to work on filesystems other than the default.
new 1ecee2e HADOOP-6312. Remove unnecessary debug logging in Configuration constructor. Contributed by Aaron Kimball
new 7313955 HADOOP-6097. Fix Path conversion in makeQualified and reset LineReader byte count at the start of each block in Hadoop archives. Contributed by Ben Slusky, Tom White, and Mahadev Konar
new 449ac4a HADOOP-6292. Update native libraries guide. Contributed by Corinne Chandel
new 22bb3c6 Remove entries moved to 0.20.2
new 19e8d6a HADOOP-6218. Moving the commit comment to 0.20.2.
new 4f4c74f HADOOP-6327. FileContext tests should not use /tmp and should clean up files. Contributed by Sanjay Radia
new 9b0a074 HADOOP-6329. Add build-fi directory to the ignore lists.
new d7a7f02 HADOOP-6326. Hundson runs should check for AspectJ warnings and report failure if any is present. Contributed by Konstantin Boudnik
new a13a0f3 HADOOP-6318. Upgrade to Avro 1.2.0.
new f9dee28 HADOOP-6318. Move CHANGES.txt message to 0.21 section.
new f0f3fdb HADOOP-5107. Use Maven ant tasks to publish the subproject jars. (Giridharan Kesavan via omalley)
new b828f4e HADOOP-5107. Remove generated files from subversion.
new a5427fc HADOOP-6334. Fix GenericOptionsParser and Path to have a better URI support. Contributed by Amareshwari Sriramadasu
new b5c31f4 HADOOP-6313. Implement Syncable interface in FSDataOutputStream to expose flush APIs to application users. Contributed by Hairong Kuang.
new 3f371a0 Hadoop-6223. Add new file system interface AbstractFileSystem with implementation of some file systems that delegate to old FileSystem. Contributed by Sanjay Radia.
new 382af3f HADOOP-6344. Fix rm and rmr immediately delete files rather than sending to trash, if a user is over-quota. Contributed by Jakob Homan.
new 4081179 HADOOP-6347. run-test-core-fault-inject runs a test case twice if -Dtestcase is set. Contributed by Konstantin Boudnik
new f5f95fe HADOOP-6343. Log unexpected throwable object caught in RPC. Contributed by Jitendra Nath Pandey
new af59233 HADOOP-6341. Fix test-patch.sh for checkTests function. ( gkesavan )
new ad88440 HADOOP-6337. Updates FilterInitializer class to be more visible, and the init of the class is made to take a Configuration argument. Contributed by Jakob Homan.
new 2eba597 HADOOP-6366. Reduce ivy console output to ovservable level. Contributed by Konstantin Boudnik.
new cdcb851 HADOOP-6314. Fix "fs -help" for the "-count" commond. Contributed by Ravi Phulari
new bd92322 HADOOP-6367. Removes Access Token implementation from common. Contributed by Kan Zhang.
new 09ec9c4 HADOOP-6269. Fix threading issue with defaultResource in Configuration. Contributed by Sreekanth Ramakrishnan
new f6990e0 HADOOP-6375. Sync documentation for FsShell du with its implementation. Contributed by Todd Lipcon
new fc880f9 HADOOP-6395. Upgrade some libraries to be consistent across common, hdfs, and mapreduce. (omalley)
new 3670034 HADOOP-6398. Build is broken after HADOOP-6395 patch has been applied. Contributed by Konstantin Boudnik
new ff6c0ef HADOOP-6108. Add support for EBS storage on EC2.
new 98beeca HADOOP-6307. Add a new SequenceFile.Reader constructor in order to support reading on un-closed file.
new ef643fd HADOOP-6405. Update Eclipse configuration to match changes to Ivy configuration. Contributed by Edwin Chan.
new 8d6c5c4 HADOOP-6400. Log errors getting Unix UGI. Contributed by Todd Lipcon.
new 3549d30 HADOOP-6411. Remove deprecated file src/test/hadoop-site.xml. Contributed by Konstantin Boudnik.
new 934deda HADOOP-6396. Fix unhelpful exception message when unable to parse umask (jghoman)
new 929e91a HADOOP-6386. NameNode's HttpServer can't instantiate InetSocketAddress: IllegalArgumentException is thrown. Contributed by Konstantin Boudnik.
new 368b6cc HADOOP-6254. Slow reads cause s3n to fail with SocketTimeoutException. Contributed by Andrew Hitchcock.
new 2e5fd1c HADOOP-6392. Run namenode and jobtracker on separate EC2 instances.
new a473f37 HADOOP-6346. Add support for specifying unpack pattern regex to RunJar.unJar. Contributed by Todd Lipcon.
new d7fb2d3 HADOOP-6428. HttpServer sleeps with negative values. Contributed by Konstantin Boudnik
new f9cb8b0 Add pyAntTasks jar for HADOOP 6426.
new 843ac12 HADOOP-6323. Add comparators to the serialization API. Contributed by Aaron Kimball.
new 6c842ad AVRO-6422. Make RPC backend plugable.
new 2ee8085 HADOOP-6422. Remove log line.
new c4e1126 HADOOP-6433. Introduce asychronous deletion of files via a pool of threads. This can be used to delete files in the Distributed Cache. (Zheng Shao via dhruba)
new 22fb497 HADOOP-6414. Add command line help for -expunge command. Contributed by Ravi Phulari.
new e28b9ae HADOOP-6391. Classpath should not be part of command line arguments. Contributed by Cristian Ivascu.
new ee6468b HADOOP-5958. Use JDK 1.6 File APIs in DF.java wherever possible. Contributed by Aaron Kimball.
new a0e1451 HADOOP-6413. Move TestReflectionUtils to Common. Contributed by Todd Lipcon.
new 1a2ab63 Add missing file for HADOOP-6413.
new 74b46cf HADOOP-5901. FileSystem.fixName() has unexpected behaviour. Contributed by Aaron Kimball.
new 7a9ec5d Reverting HADOOP-5901. FileSystem.fixName() has unexpected behaviour.
new e8d9bf4 HADOOP-6222. Core doesn't have TestCommonCLI facility. Contributed by Konstantin Boudnik.
new 875c9d6 HADOOP-6441. Protect web ui from cross site scripting attacks (XSS) on the host http header and using encoded utf-7. (omalley)
new 6a1e8bf HADOOP-6426. Create ant build for running EC2 unit tests.
new ea5db0c HADOOP-6394. Add a helper class to simplify FileContext related tests and improve code reusability. Contributed by Jitendra Nath Pandey.
new ae93ba7 HADOOP-4656. Add a user to groups mapping service (boryas and acmurthy_)
new fe47975 HADOOP-6415. Adds a common token interface for both job token and delegation token. Contributed by Kan Zhang.
new 3d3e1ff HADOOP-6462. Target compile does not exist in contrib/cloud.
new d2bae87 HADOOP-6444. Support additional security group option in hadoop-ec2 script. Contributed by Paul Egan.
new 0ebcb62 HADOOP-6454. Create setup.py for EC2 cloud scripts.
new bb9a3d3 Correction for the placement of some JIRAs: were put to the trunk's sections instead of ones for Release 0.21.
new 583c41b HADOOP-6434 Make HttpServer slightly easier to manage/diagnose faults with
new cc2f077 HADOOP-6452 Hadoop JSP pages don't work under a security manager
new d115e2c HADOOP-6435. Make RPC.waitForProxy with timeout public. Contributed by Steve Loughran.
new 29a1ba1 HADOOP-6460. Reinitializes buffers used for serializing responses in ipc server on exceeding maximum response size to free up Java heap. Contributed by Suresh Srinivas.
new 7d24405 HADOOP-6402. testConf.xsl is not well-formed XML. Contributed by Steve Loughran.
new e683a0d HADOOP-5849 hadoop-env.sh still refers to java1.5
new 3cb2e31 HADOOP-6472. add tokenCache option to GenericOptionsParser for passing file with secret keys to a map reduce job. (boryas)
new efcad06 HADOOP-6443. Serialization classes accept invalid metadata. Contributed by Aaron Kimball.
new ae91b5d HADOOP-3205. Read multiple chunks directly from FSInputChecker subclass into user buffers. Contributed by Todd Lipcon.
new b55377a HADOOP-6466. Add a ZooKeeper service to the cloud scripts.
new 889528e HADOOP-6408. Add a /conf servlet to dump running configuration. Contributed by Todd Lipcon.
new dec4c16 HADOOP-6479. TestUTF8 assertions could fail with better text. Contributed by Steve Loughran.
new 1ca1bfb HADOOP-6420. Add functionality permitting subsets of Configuration to be interpreted as Map<String,String>. Contributed by Aaron Kimball
new 8942119 HADOOP-6464. Write a Rackspace cloud provider.
new 4cecab7 HADOOP-6315. Avoid incorrect use of BuiltInflater/BuiltInDeflater in GzipCodec. Contributed by Aaron Kimball
new daed679 HADOOP-6451. Fix build to run contrib unit tests. Contributed by Tom White
new 08561f7 HADOOP-6155. Deprecate RecordIO anticipating Avro. Contributed by Tom White
new a90d320 HADOOP-6489. Fix 3 findbugs warnings. Contributed by Erik Steffl.
new 4cd159e HADOOP-6492. Make some Avro serialization APIs public. Contributed by Aaron Kimball.
new f3477eb HADOOP-6497. Add an adapter for Avro's SeekableInput interface, so that Avro can read FileSystem data. Contributed by Aaron Kimball.
new c7a3c78 HADOOP-6374. JUnit tests should never depend on anything in conf. Contributed by Anatoli Fomenko.
new aaf3b6c HADOOP-6495. Identifier should be serialized after the password is created In Token constructor (jnp via boryas)
new f38a996 HADOOP-6290. Prevent duplicate slf4j-simple jar via Avro's classpath. Contributed by Owen O'Malley
new 3ef40e1 HADOOP-6459. IPC client bug may cause rpc call hang. Contributed by Hairong Kuang.
new d6f4cf3 Revert commit 903015 because it was tagged with the wrong jira number HADOOP-6459.
new 34d1b39 HADOOP-6498. IPC client bug may cause rpc call hang. Contributed by Ruyue Ma and Hairong Kuang.
new 0c5734e HADOOP-6299. Reimplement the UserGroupInformation to use the OS specific and Kerberos JAAS login. (omalley)
new 6113407 HADOOP-6517. Fix UserGroupInformation so that tokens are saved/retrieved to/from the embedded Subject. Contributed by Owen O'Malley & Kan Zhang.
new ba8647f HADOOP-6520. Adds APIs to read/write Token and secret keys. Also adds the automatic loading of tokens into UserGroupInformation upon login. The tokens are read from a file specified in the environment variable. Contributed by Devaraj Das.
new 96cd62f HADOOP-6520. Adds APIs to read/write Token and secret keys. Also adds the automatic loading of tokens into UserGroupInformation upon login. The tokens are read from a file specified in the environment variable. Contributed by Devaraj Das.
new fe0ddc03 HADOOP-6518. Makes the UGI honor the env var KRB5CCNAME. Contributed by Owen O'Malley.
new 940389a HADOOP-6419. Adds SASL based authentication to RPC. Contributed by Kan Zhang.
new 9f7a07f HADOOP-6531. Enhance FileUtil with an API to delete all contents of a directory. Contributed by Amareshwari Sriramadasu.
new f786508 HADOOP-6538. Sets hadoop.security.authentication to simple by default. Contributed by Devaraj Das.
new 1793e7d HADOOP-6510. Adds a way for superusers to impersonate other users in a secure environment. Contributed by Jitendra Nath Pandey.
new 5b0d8a0 HADOOP-6540. Contrib unit tests have invalid XML for core-site, etc. Contributed by Aaron Kimball.
new 38c59c0 HADOOP-6547. Move DelegationToken into Common, so that it can be used by MapReduce also. (devaraj via omalley)
new cfbdd1a HADOOP-6552. Puts renewTGT=true and useTicketCache=true for the keytab kerberos options. Contributed by Devaraj Das.
new 8061821 HADOOP-6522. Fix decoding of codepoint zero in UTF8.
new e9ff651 HADOOP-5611. Commit to branch 0.20
new 139b2ea HADOOP-5612. Commit to branch 0.20
new e0a0e6b HADOOP-6505. Use tr rather than sed to effect literal substitution in the build script. Contributed by Allen Wittenauer
new fc83909 HADOOP-6548. Replace mortbay imports with commons logging.
new 96a1477 HADOOP-6534. Trim whitespace from directory lists initializing LocalDirAllocator. Contributed by Todd Lipcon
new 8b4b190c HADOOP-6559. Makes the RPC client automatically re-login when the SASL connection setup fails. This is applicable only to keytab based logins. Contributed by Devaraj Das.
new ea605b8 HADOOP-6421 Adds Symbolic links to FileContext, AbstractFileSystem. It also adds a limited implementation for the local file system (RawLocalFs) that allows local symlinks. (Eli Collins via Sanjay Radia)
new 44185c3 prep for making 0.20.2 rc2
new 18c6d65 HADOOP-6560. Handle invalid har:// uri in HarFileSystem.
new 3a7841a HADOOP-6549. TestDoAsEffectiveUser should use ip address of the host for superuser ip check
new 4b4e9d7 HADOOP-6570. RPC#stopProxy throws NPE if getProxyEngine(proxy) returns null. Contributed by Hairong Kuang.
new 50dcc33 HADOOP-6558. Return null in HarFileSystem.getFileChecksum(..) since no checksum algorithm is implemented.
new a417a8f HADOOP-6551. Delegation token renewing and cancelling should provide meaningful exceptions when there are failures instead of returning false. (omalley)
new d099c1c HADOOP-6572. Makes sure that SASL encryption and push to responder queue for the RPC response happens atomically. Contributed by Kan Zhang.
new 9871771 HADOOP-6577. Add hidden configuration option "ipc.server.max.response.size" to change the default 1 MB, the maximum size when large IPC handler response buffer is reset. Contributed by Suresh Srinivas.
new 115ef5b HADOOP-6545. Changes the Key for the FileSystem cache to be UGI. Contributed by Devaraj Das.
new ffdde40 HADOOP-6583. Captures authentication and authorization metrics. Contributed by Devaraj Das.
new c5622e5 HADOOP-6543. Allows secure clients to talk to unsecure clusters. Contributed by Kan Zhang.
new 4eedc77 HADOOP-6467. Improve the performance on HarFileSystem.listStatus(..). Contributed by mahadev
new 831da66 HADOOP-6579. Provide a mechanism for encoding/decoding Tokens from a url-safe string and change the commons-code library to 1.4. (omalley)
new 3721459 HADOOP-6596. Add a version field to the AbstractDelegationTokenIdentifier's serialized value. (omalley)
new 7785232 HADOOP-6568. Adds authorization for the default servlets. Contributed by Vinod Kumar Vavilapalli.
new 27ab7f3 HADOOP-6573. Support for persistent delegation tokens. Contributed by Jitendra Pandey.
new ea650d8 HADOOP-1849. Add undocumented configuration parameter for per handler call queue size in IPC Server. Contributed by Konstantin Shvachko.
new c4c122a HADOOP-6586. Log authentication and authorization failures and successes for RPC
new 1d8cb8b HADOOP-6594. Provide a fetchdt tool via bin/hdfs. Contributed by Jakob Homan.
new c93a912 HADOOP-6589. Provide better error messages when RPC authentication fails. (Kan Zhang via omalley)
new 80d0e78 JDiff output for release 0.20.2
new b4e4ed2 Set JDiff stable to 0.20.2
new 6b9fb8c HADOOP-6599 Split existing RpcMetrics into RpcMetrics & RpcDetailedMetrics. (Suresh Srinivas via Sanjay Radia)
new 1ab5aa5 HADOOP-6537 Declare more detailed exceptions in FileContext and AbstractFileSystem (Suresh Srinivas via Sanjay Radia)
new 393baff HADOOP-6569. FsShell#cat should avoid calling unecessary getFileStatus before opening a file to read. Contributed by Hairong Kuang.
new b1ec35e HADOOP-6609. Fixed deadlock in RPC by replacing shared static DataOutputBuffer in the UTF8 class with a thread local variable. (omalley)
new fe01f92 HADOOP-6504. Invalid example in the documentation of org.apache.hadoop.util.Tool. Contributed by Benoit Sigoure.
new 74d409c HADOOP-6486. fix common classes to work with Avro 1.3 reflection. Contributed by cutting.
new 6e86a67 HADOOP-6486. Update a few straggling references to Avro 1.2.0 to 1.3.0.
new 637cf89 HADOOP-6591. HarFileSystem can handle paths with the whitespace characters. (Rodrigo Schmidt via dhruba)
new b769d64 HADOOP-6407. Have a way to automatically update Eclipse .classpath file when new libs are added to the classpath through Ivy.
new a0a4bf0 HADOOP-3659. Patch to allow hadoop native to compile on Mac OS X. Contributed by Colin Evans and Allen Wittenauer.
new c8ffb22 HADOOP-6546. BloomMapFile can return false negatives. Contributed by Clark Jefcoat.
new f32ffc7 HADOOP-6593. TextRecordInputStream doesn't close SequenceFile.Reader. Contributed by Chase Bradford.
new 81c448a HADOOP-6637. Benchmark for establishing RPC session. Contributed by Konstantin Shvachko.
new 124137f HADOOP-6175. Incorrect version compilation with es_ES.ISO8859-15 locale on Solaris 10. Contributed by Urko Benito.
new 0485fe2 HADOOP-6471. StringBuffer -> StringBuilder - conversion of references as necessary. Contributed by Kay Kay.
new 35de12b HADOOP-6645. Bugs on listStatus for HarFileSystem (rodrigo via mahadev)
new e381af1 HADOOP-6645. Re: Bugs on listStatus for HarFileSystem (rodrigo via mahadev)
new 980f819 HADOOP-6646. Move HarfileSystem out of Hadoop Common. (mahadev)
new f4d31cd HADOOP-6566. Add methods supporting, enforcing narrower permissions on local daemon directories. Contributed by Arun Murthy and Luke Lu
new 6f35c10 HADOOP-6654. Fix code example in WritableComparable javadoc. Contributed by Tom White
new 7b1ac5a HADOOP-6640. FileSystem.get() does RPC retries within a static synchronized block. Contributed by Hairong Kuang.
new 4c062c7 HADOOP-6680. hadoop-cloud push command invokes proxy creation. Contributed by Andrew Klochkov.
new fb154e3 HADOOP-6691. TestFileSystemCaching sometimes hangs. Contributed by Hairong Kuang.
new 631f456 HADOOP-6507. Hadoop Common Docs - delete 3 doc files that do not belong under Common. Contributed by Corinne Chandel.
new 87c788d HADOOP-6689. Add directory renaming test to existing FileContext tests. Contributed by Eli Collins.
new b802476 HADOOP-6580. UGI should contain authentication method.
new a0ef69d HADOOP-6705. Fix to work with 1.5 version of jiracli
new 6f89a64 HADOOP-6657. Add a capitalization method to StringUtils for MAPREDUCE-1545
new 97c38f9 HADOOP-6439. Fixes handling of deprecated keys to follow order in which keys are defined. Contributed by V.V.Chaitanya Krishna.
new 980f99b HADOOP-6658. Exclude Private elements from generated Javadoc.
new b183665 HADOOP-6690. FilterFileSystem correctly handles setTimes call. (Rodrigo Schmidt via dhruba)
new 1e82194 HADOOP-6719. Insert all missing methods in FilterFs. (Rodrigo Schmidt via dhruba)
new 50f24d7 HADOOP-6686. Remove redundant exception class name from the exception message for the exceptions thrown at RPC client. Contributed by Suresh Srinivas.
new 67c006c HADOOP-6521. User specified umask using deprecated dfs.umask must override server configured using new dfs.umaskmode for backward compatibility. Contributed by Suresh Srinivas.
new 27a9fce HADOOP-6710. Symbolic umask for file creation is not conformant with posix. Contributed by Suresh Srinivas.
new 18262cc HADOOP-6635. Install/deploy source jars to Maven repo. (Patrick Angeles via jghoman)
new 5075d7d HADOOP-6717. Log levels in o.a.h.security.Groups too high. Todd Lipcon via jghoman.
new 33e3f79 HADOOP-6692. Add FileContext#listStatus that returns an iterator. Contributed by Hairong Kuang.
new 75e0b76 Move the change log of HADOOP-6692 to the right section.
new 2bec54d HADOOP-6667. RPC.waitForProxy should retry through NoRouteToHostException. Contributed by Todd Lipcon.
new 9ad633f HADOOP-6677. InterfaceAudience.LimitedPrivate should take a string not an enum.
new b212ed9 HADOOP-6713. The RPC server Listener thread is a scalability bottleneck. Contributed by Dmytro Molkov.
new e333072 HADOOP-6703. Prevent renaming a file, directory or symbolic link to itself. Contributed by Eli Collins.
new d2ca51b HADOOP-6701. Fix incorrect exit codes returned from chgrp, chown and chgrp commands from FsShell. Contributed by Ravi Phulari.
new f1fee18 Fixed incorrect description in CHANGES.txt for Hadoop-6701.
new cd85fc4 HADOOP-6724. IPC doesn't properly handle IOEs thrown by socket factory. Contributed by Todd Lipcon.
new c59b4cd HADOOP-6722. NetUtils.connect should check that it hasn't connected a socket to itself. Contributed by Todd Lipcon.
new 8991eb7 HADOOP-6678. Remove FileContext#isFile, isDirectory and exists. Contributed by Eli Collins.
new 00cb892 HADOOP-6634. Fix AccessControlList to use short names to verify access control. Contributed by Vinod Kumar Vavilapalli.
new 750fb2d HADOOP-6698. Revert the io.serialization package to 0.20.2's api. Reverted HADOOP-6165, HADOOP-6443, HADOOP-6323, and HADOOP-6420.
new b56827c HADOOP-6709. Re-instate deprecated FileSystem methods that were removed after 0.20.
new f6acb32 HADOOP-6515. Make maximum number of http threads configurable (Scott Chen via zshao)
new f8f275c HADOOP-6630. hadoop-config.sh fails to get executed if hadoop wrapper scripts are in path. Contributed by Allen Wittenauer.
new 704e919 HADOOP-6563. Add more symlink tests to cover intermediate symlinks in paths. Contributed by Eli Collins.
new 494ef1e HADOOP-6742. Add methods HADOOP-6709 from to TestFilterFileSystem. Contributed by Eli Collins.
new 4d04914 Preparing for release 0.21.0
new 14f02ef Preparing for 0.22.0 development
new fe49f6e HADOOP-6730. Bug in FileContext#copy and provide base class for FileContext tests. (Ravi Phulari via jghoman)
new 322f9ac HADOOP-6727. Remove UnresolvedLinkException from public FileContext APIs. Contributed by Eli Collins.
new 06a1375 HADOOP-6669. Respect compression configuration when creating DefaultCodec instances. Contributed by Koji Noguchi
new fe34ccd HADOOP-6623. Add StringUtils.split for non-escaped single-character separator. Contributed by Todd Lipcon.
new 44ebf5d HADOOP-6631. Fix FileUtil.fullyDelete() to continue deleting other files despite failure at any level. Contributed by Ravi Gummadi and Vinod Kumar Vavilapalli.
new 21476f0 HADOOP-6763. Remove verbose logging from the Groups class
new d9b6103 HADOOP-6600. mechanism for authorization check for inter-server protocols
new 1e15cf0 HADOOP-6612. Protocols RefreshUserToGroupMappingsProtocol and RefreshAuthorizationPolicyProtocol will fail with security enabled (boryas)
new 69693b6 HADOOP-6332. Large-scale Automated Test Framework. Contributed by Sharad Agarwal, Sreekanth Ramakrishnan, Konstantin Boudnik, at all.
new 175a928 HADOOP-6761. The Trash Emptier has the ability to run more frequently. (Dmytro Molkov via dhruba)
new 759494f HADOOP-6769. Add an API in FileSystem to get FileSystem instances based on users
new 0b14427 HADOOP-6627. 'Bad Connection to FS' message in FSShell should print message from the exception
new 578ea558 HADOOP-6752. Remote cluster control functionality needs JavaDocs improvement. Contributed by Balaji Rajagopalan.
new 847e009 HADOOP-6752. CHANGES.txt should be updated in 0.21 section instead of 0.22
new 78778a1 HADOOP-6633. normalize property names for JT/NN kerberos principal names in configuration
new f4998a7 HADOOP-6781. security audit log shouldn't have exception in it.
new af3fef3 HADOOP-6714. Resolve compressed files using CodecFactory in FsShell::text. Contributed by Patrick Angeles
new ec1a112 HADOOP-6778. add isRunning() method to AbstractDelegationTokenSecretManager (for HDFS-1044)
new 4e5bdc4 HADOOP-6760. WebServer shouldn't increase port number in case of negative port setting caused by Jetty's race. Contributed by Konstantin Boudnik.
new 70d7790 HADOOP-6760. Moving the entry to the correct base release 0.20.3
new 2786e80 HADOOP-6723. Unchecked exceptions thrown in IPC Connection should not orphan clients. Contributed by Todd Lipcon.
new 8a98e68 HADOOP-6771. Herriot's artifact id for Maven deployment should be set to hadoop-core-instrumented. Contributed by Konstantin Boudnik.
new 1739f73 HADOOP-6773. Ivy folder contains redundant files. Contributed by Konstantin Boudnik.
new 5392319 HADOOP-6772. Utilities for system tests specific. Contributed by Vinay Thota.
new 73643f4 HADOOP-6777. Implement a functionality for suspend and resume a process. Contributed by Vinay Thota.
new a7aacdc HADOOP6638. try to relogin in a case of failed RPC connection (expired tgt) only in case the subject is loginUser or proxyUgi.realUser.
new e346c2f HADOOP-6644. util.Shell getGROUPS_FOR_USER_COMMAND method name - should use common naming convention
new 24a2f1f HADOOP-6581. Add authenticated TokenIdentifiers to UGI so that they can be used for authorization. Kan Zhang and Jitendra Pandey via jghoman.
new 9dd25df HADOOP-6404. Rename the generated artifacts to common instead of core.
new aecf7af HADOOP-6747. TestNetUtils fails on Mac OS X (Todd Lipcon via jghoman)
new 7578282 HADOOP-6585. Add FileStatus#isDirectory and isFile. Contributed by Eli Collins.
new f0331cf HADOOP-6798. Align Ivy version for all Hadoop subprojects. Contributed by Konstantin Boudnik.
new da60eca HADOOP-6461. Webapps aren't located correctly post-split. Contributed by Todd Lipcon and Steve Loughran.
new 9e2c3bf HADOOP-6791. Refresh for proxy superuser config
new c6bc365 HADOOP-6787. Factor out glob pattern code from FileContext and FileSystem. Contributed by Luke Lu.
new 908fd45 HADOOP-6661. User document for UserGroupInformation.doAs. Contributed by Jitendra Pandey.
new 04a00b7 HADOOP-6788. [Herriot] Exception exclusion functionality is not working correctly. Contributed by Vinay Kumar Thota.
new ea5200d HADOOP-6738. Move cluster_setup.xml, hod_scheduler, commands_manual from MapReduce to Common.
new ff1fe08 HADOOP-6780. Move Hadoop cloud scripts to Whirr.
new bb29ad1 HADOOP-6780. Move Hadoop cloud scripts to Whirr.
new 56b15e9 HADOOP-6649. login object in UGI should be inside the subject (jnp via boryas)
new 4b9c956 HADOOP-6674. Makes use of the SASL authentication options in the SASL RPC. Contributed by Jitendra Pandey.
new 42a38a4 HADOOP-6687. user object in the subject in UGI should be reused in case of a relogin.
new 2232093 HADOOP-6813. Add a new newInstance method in FileSystem that takes a user as argument
new b78612c HADOOP-6796. FileStatus allows null srcPath but crashes if that's done. Contributed by Rodrigo Schmidt.
new f07af58 HADOOP-6526. Need mapping from long principal names to local OS user names
new 32469f1 HADOOP-6794. Move configuration and script files post split. Includes HDFS-1181, MAPREDUCE-1033.
new 222bd68 HADOOP-6403. Deprecate EC2 bash scripts.
new 754ea91 HADOOP-6603. Provide workaround for issue with Kerberos not resolving cross-realm principal. Contributed by Kan Zhang and Jitendra Pandey.
new 755a5d8 HADOOP-6814. Adds an API in UserGroupInformation to get the real authentication method of a passed UGI. Contributed by Jitendra Pandey.
new 4164d25 Move entries for HADOOP-6769 and HADOOP-6813 to 0.21 section of CHANGES.txt
new 6378822 HADOOP-6668. Apply audience and stability annotations to classes in common.
new fbdb249 HADOOP-6620. NPE if renewer is passed as null in getDelegationToken. Contributed by Jitendra Pandey.
new 8fa094a HADOOP-6613. Moves the RPC version check ahead of the AuthMethod check. Contributed by Kan Zhang.
new 687d4db HADOOP-6682. NetUtils:normalizeHostName does not process hostnames starting with [a-f] correctly.
new 6749f02 HADOOP-6796. Reverting the patch.
new e89ac4b HADOOP-6652. Removes the unnecessary cache from ShellBasedUnixGroupsMapping. Contributed by Devaraj Das.
new c6b8095 HADOOP-6821. Document changes to memory monitoring. Contributed by Hemanth Yamijala.
new 5807065 HADOOP-6828. Herrior uses old way of accessing logs directories. Contributed by Sreekanth Ramakrishnan
new 4b8e1bd HADOOP-6748. Removes hadoop.cluster.administrators, cluster administrators acl is passed as parameter in constructor. Contributed by Amareshwari Sriramadasu
new 35a4624 HADOOP-6826. Revert FileSystem create method that takes CreateFlags.
new 8970e93 HADOOP-6815. refreshSuperUserGroupsConfiguration should use server side configuration for the refresh
new 451c8ae HADOOP-6800. Harmonize JAR library versions.
new 05b1f87 HADOOP-6756. Documentation for common configuration keys. Contributed by Erik Steffl.
new 4b34109 HADOOP-6584. Provide Kerberized SSL encryption for webservices.
new 2a248df HADOOP-6835. Add support for concatenated gzip input. Contributed by Greg Roelofs
new 038d399 HADOOP-6847. Problem staging 0.21.0 artifacts to Apache Nexus Maven Repository. Contributed by Giridharan Kesavan
new 86e8338 HADOOP-6853. Common component of HDFS-1045.
new d2ade6a HADOOP-6845. Renames the TokenStorage class to Credentials. Contributed by Jitendra Pandey.
new 0ae9cbb HADOOP-6819. [Herriot] Shell command for getting the new exceptions in the logs returning exitcode 1 after executing successfully. Contributed by Vinay Thota.
new 4ff2991 HADOOP-6648. Adds a check for null tokens in Credentials.addToken api. Contributed by Owen O'Malley and Devaraj Das.
new 6ba9b70 HADOOP-6647. balancer fails with "is not authorized for protocol interface NamenodeProtocol" in secure environment
new 167bbd1 HADOOP-6825. FileStatus needs unit tests. Contributed by Rodrigo Schmidt.
new c757b9b Update CHANGES.txt to reflect previous commit.
new a73dfef HADOOP-6839. [Herriot] Implement a functionality for getting the user list for creating proxy users. Contributed by Vinay Thota.
new 7f14e37 HADOOP-6836. [Herriot]: Generic method for adding/modifying the attributes for new configuration. Contributed by Vinay Thota.
new 0ac0581 HADOOP-6859 - Introduce additional statistics to FileSystem to track file system operations. Contributed by Suresh Srinivas.
new 1b354e2 HADOOP-6834. TFile.append compares initial key against null lastKey (hong tang via mahadev)
new 44c364d HADOOP-6860. 'compile-fault-inject' should never be called directly. Contributed by Konstantin Boudnik.
new 02b87fc HADOOP-6670. Use the UserGroupInformation's Subject as the criteria for equals and hashCode. Contributed by Owen O'Malley and Kan Zhang.
new 75e78e0 HADOOP-6805. add buildDTServiceName method to SecurityUtil (as part of MAPREDUCE-1718)
new fa3a3bf HADOOP-6632. Adds support for using different keytabs for different servers in a Hadoop cluster. In the earier implementation, all servers of a certain type \(like TaskTracker\), would have the same keytab and the same principal. Now the principal name is a pattern that has _HOST in it. Contributed by Kan Zhang & Jitendra Pandey.
new 2c0598a HADOOP-6536. Fixes FileUtil.fullyDelete() not to delete the contents of the sym-linked directory. Contributed by Ravi Gummadi
new bd80242 HADOOP-6790. Instrumented (Herriot) build uses too wide mask to include aspect files. Contributed by Konstantin Boudnik.
new eb10b15 HADOOP-6861. Adds new non-static methods in Credentials to read and write token storage file. Contributed by Jitendra Pandey & Owen O'Malley.
new d6ef66a Fixing the order of records in the file
new f22e332 HADOOP-6875. [Herriot] Cleanup of temp. configurations is needed upon restart of a cluster. Contributed by Vinay Thota.
new 0d005c5 HADOOP-6877. Common part of HDFS-1178. Contributed by Kan Zhang.
new ba54f8b HADOOP-6881. Make WritableComparator initialize classes when looking for their raw comparator, as classes often register raw comparators in their initializer, which are no longer automatically run in Java 6 when a class is referenced. Contributed by omalley.
new fa49f73 HADOOP-6881. Move change message to section for earliest version it will appear in, 0.20.3.
new 5c5c163 HADOOP-6475. Adding some javadoc to Server.RpcMetrics, UGI. Contributed by Jitendra Pandey and borya.
new d010dd6 HADOOP-6869. Functionality to creating file or folder on a remote daemon side. Contributed by Vinay Thota.
new c539588 Fixing a typo in the JIRA name
new 19eea55 HADOOP-6870. Add a new API getFiles to FileSystem and FileContext. Contributed by Hairong Kuang.
new 1a6ed79 HADOOP-6656. Adds a thread in the UserGroupInformation to renew TGTs periodically. Contributed by Owen O'Malley and Devaraj Das.
new ff8b7bc HADOOP-6888. Add a new FileSystem API closeAllForUGI(..) for closing all file systems associated with a particular UGI. Contributed by Kan Zhang
new 7e7aff5 Added Devaraj Das as a contributor of HADOOP-6888.
new c15ae29 HADOOP-6873. using delegation token over hftp for long running clients
new d0ba178 HADOOP-6890. Improve listFiles API introduced by HADOOP-6870. Contributed by Hairong Kuang.
new 666a8e1 HADOOP-6890. Part 2: Incoport the change made in FileContext into FileSystem. Contributed by Hairong Kuang.
new 1035138 HADOOP-6892. Common component of HDFS-1150 (Verify datanodes' identities to clients in secure clusters).
new c47d34a HADOOP-6706. Improves the sasl failure handling due to expired tickets, and other server detected failures. Contributed by Jitendra Pandey and Devaraj Das.
new 714e5f7 HADOOP-6889. Make RPC to have an option to timeout. Contributed by Hairong Kuang.
new bd121ed HADOOP-6862. Adds api to add/remove user and group to AccessControlList. Contributed by Amareshwari Sriramadasu
new ccbdfba HADOOP-6911. doc update for DelegationTokenFetcher
new dc2a3d1 HADOOP-6900. Make the iterator returned by FileSystem#listLocatedStatus to throw IOException rather than RuntimeException when there is an IO error fetching the next file. Contributed by Hairong Kuang.
new 4c940af HADOOP-6715. Fixes AccessControlList.toString() to return a descriptive String representation of the ACL. Contributed by Ravi Gummadi
new 9950db1 HADOOP-6905. Better logging messages when a delegation token is invalid. Contributed by Kan Zhang.
new 6fe9218 HADOOP-6693. Add metrics to track kerberol login activity. Contributed by Suresh Srinivas.
new 76e22cc HADOOP-6885. Fix java doc warnings in Groups and RefreshUserMappingsProtocol. Contributed by Eli Collins.
new f74a3e4 HADOOP-6803. Add native gzip read/write coverage to TestCodec. Contributed by Eli Collins.
new 0acb205 HADOOP-6482. GenericOptionsParser constructor that takes Options and String[] ignores options. Contributed by Eli Collins.
new ad5306f HADOOP-6906. FileContext copy() utility doesn't work with recursive copying of directories. (vinod k v via mahadev)
new ced65de HADOOP-6453. Hadoop wrapper script shouldn't ignore an existing JAVA_LIBRARY_PATH. Contributed by Chad Metcalf.
new a7887e1 JDiff output for release 0.21.0
new 19e46e3 HADOOP-6925. BZip2Codec incorrectly implements read(). Contributed by Todd Lipcon.
new 97ce72a HADOOP-6833. IPC leaks call parameters when exceptions thrown. Contributed by Todd Lipcon.
new 7efb964 HADOOP-6884. Add LOG.isDebugEnabled() guard for each LOG.debug(..). Contributed by Erik Steffl
new a89fb4d HADOOP-6786. test-patch needs to verify Herriot integrity. Contributed by Konstantin Boudnik
new 4f79b07 HADOOP-6932. Namenode start (init) fails because of invalid kerberos key, even when security set to simple
new 5c8d9ae HADOOP-6913. Circular initialization between UserGroupInformation and KerberosName
new 1c75bcc HADOOP-6907. Rpc client doesn't use the per-connection conf to figure out server's Kerberos principal. Contributed by Kan Zhang.
new fa75e35 HADOOP-6934. Test for ByteWritable comparator. Contributed by Johannes Zillmann.
new becf8e9 HADOOP-6938. ConnectionId.getRemotePrincipal() should check if security is enabled. Contributed by Kan Zhang.
new 0862238 HADOOP-6930. AvroRpcEngine doesn't work with generated Avro code. Contributed by Sharad Agarwal.
new 8a85347 HADOOP-6940. RawLocalFileSystem's markSupported method misnamed markSupport. Contributed by Tom White.
new 1bc066c HADOOP-6950. Suggest that HADOOP_CLASSPATH should be preserved in hadoop-env.sh.template. Contributed by Philip Zeyliger.
new e9c1efd HADOOP-6922. COMMON part of MAPREDUCE-1664. Makes AccessControlList a writable and updates documentation for Job ACLs. Contributed by Ravi Gummadi.
new 0fd49b3 HADOOP-6951. Distinct minicluster services (e.g. NN and JT) overwrite each other's service policies. Contributed by Aaron T. Myers
new 47d4ebe Reverting commit 1001067 while related HDFS and MR JIRAs are tested (HADOOP-6951).
new 8db4b54 HADOOP-6965. Introduces checks for whether the original tgt is valid in the reloginFromKeytab method. Contributed by Jitendra Pandey.
new 642ed17 HADOOP-6951. Distinct minicluster services (e.g. NN and JT) overwrite each other's service policies. Contributed by Aaron T. Myers.
new 6333b3e HADOOP-6856. Simplify constructors for SequenceFile, and MapFile. (omalley)
new c7e1a1c HADOOP-6856. Simplify constructors for SequenceFile, and MapFile. (omalley) -- Missed some files
new 4f2c6bc HADOOP-6971. Clover build doesn't generate per-test coverage. Contributed by Konstantin Boudnik
new 95649ac HADOOP-6879. Provide SSH based (Jsch) remote execution API for system tests. Contributed by Konstantin Boudnik.
new 4bb06fb HADOOP-6989. Correct the parameter for SetFile to set the value type for SetFile to be NullWritable instead of the key. (jghoman via omalley)
new 9a8a10a Fixing attribution for HADOOP-6989 in CHANGES.txt
new aeafc8f HADOOP-6969. CHANGES.txt does not reflect the release of version 0.21.0
new 5001565 HADOOP-6984. Combine the compress kind and the codec in the same option for SequenceFiles. (cdouglas via omalley)
new bf9fccc HADOOP-6993. Broken link on cluster setup page of docs. Contributed by Eli Collins.
new a503521 HADOOP-6933. TestListFiles is flaky. Contributed by Todd Lipcon.
new 5fe802e HADOOP-6987. Use JUnit Rule to optionally fail test cases that run more than 10 seconds.
new e050832 HADOOP-6944. [Herriot] Implement a functionality for getting proxy users definitions like groups and hosts. Contributed by Vinay Thota.
new 13fcef2 HADOOP-6996. Allow CodecFactory to return a codec object given a codec' class name. Contributed by Hairong Kuang.
new 217ce2d HADOOP-7005: Update test-patch.sh to remove callback to Hudson master. Contributed by nigel.
new 7049c80 HADOOP-6985. Suggest that HADOOP-OPTS be preserved in hadoop-env.sh.template. Contributed by Ramkumar Vadali.
new 768cf33 HADOOP-7007: Update the hudson-test-patch ant target. Contributed by Giridharan Kesavan.
new 625e408 HADOOP-6985. Fix example to make more sense.
new 17f9e57f HADOOP-6663. BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file. Contributed by Kang Xiao.
new 3d27eaa Reverting HADOOP-6663.
new da234df HADOOP-6947. Kerberos relogin should set refreshKrb5Config to true. Contributed by Todd Lipcon.
new aa0ca9d HADOOP-6954. Sources JARs are not correctly published to the Maven repository.
new 0d8d3d0 HADOOP-7006. Fix 'fs -getmerge' command to not be a no-op. Contributed by Chris Nauroth.
new c4e049e HADOOP-7010. Typo in FileSystem.java. Contributed by Jingguo Yao.
new 4be1688 HADOOP-6663. BlockDecompressorStream get EOF exception when decompressing the file compressed from empty file. Contributed by Kang Xiao.
new f6a6c6e HADOOP-7009. MD5Hash provides a public factory method that creates an instance of MessageDigest. Contributed by Hairong Kuang.
new 7afa946 HADOOP-6991. Move testcase from mapreduce to common, since it tests SequenceFile.
new 0c462b2 HADOOP-6991. Fix SequenceFile::Reader to honor file lengths and call openFile (cdouglas via omalley)
new 6285cbb HADOOP-7011. Fix KerberosName.main() to not throw an NPE. Contributed by Aaron T. Myers.
new 1a865e3 HADOOP-6975. Integer overflow in S3InputStream for blocks > 2GB. Contributed by Patrick Kling.
new 7daf9a3 HADOOP-7008. Enable test-patch.sh to have a configured number of acceptable findbugs and javadoc warnings. Contributed by nigel and gkesavan.
new dfe57e0 HADOOP-6818. Provides a JNI implementation of group resolution. Contributed by Devaraj Das.
new 9ea883e HADOOP-7008. Fix bug and missing license header in test-patch files. (nigel)
new cf65399 HADOOP-6943. The GroupMappingServiceProvider interface should be public. Contributed by Aaron T. Myers.
new 3460a5e HADOOP-6758. MapFile.fix does not allow index interval definition. Contributed by Gianmarco De Francisci Morales.
new f1894a3 HADOOP-6926. SocketInputStream incorrectly implements read(). Contributed by Todd Lipcon.
new c979e30 HADOOP-6899 RawLocalFileSystem#setWorkingDir() does not work for relative names
new fa87ae8 HADOOP-4675. Current Ganglia metrics implementation is incompatible with Ganglia 3.1. Contributed by Brian Bockelman.
new 50659f1 HADOOP-6977. Herriot daemon clients should vend statistics. Contributed by Konstantin Boudnik
new ca3ef06 HADOOP-7024. Create a test method for adding file systems during tests. Contributed by Kan Zhang.
new 946eac3 HADOOP-6903 Make AbstractFSileSystem methods and some FileContext methods to be public
new 05a497f HADOOP-7034. Add TestPath tests to cover dot, dot dot, and slash normalization. Contributed by Eli Collins
new ee08b2c HADOOP-7032. Assert type constraints in the FileStatus constructor. Contributed by Eli Collins
new 7f138d0 HADOOP-6562. FileContextSymlinkBaseTest should use FileContextTestHelper. Contributed by Eli Collins
new f7105a2 HADOOP-6496. HttpServer sends wrong content-type for CSS files (and others). Contributed by Todd Lipcon.
new 468579d HADOOP-7028. ant eclipse does not include requisite ant.jar in the classpath. Contributed by Patrick Angeles
new fa08f46 HADOOP-7013. Add boolean field isCorrupt to BlockLocation. Contributed by Patrick Kling.
new 6c806f1 branching for 0.22
new 64f7101 Adding IntelliJ IDEA specific extentions to be ignored.
new 916e301 HADOOP-7042. Updates to test-patch.sh to include failed test names and improve other messaging. Contributed by nigel.
new 5665975 HADOOP-7015. RawLocalFileSystem#listStatus does not deal with a directory whose entries are changing (e.g. in a multi-thread or multi-process environment). Contributed by Sanjay Radia
new adb2bb2 HADOOP-7042. Updates to test-patch.sh to include failed test names and improve other messaging. Contributed by nigel.
new ab00be8 HADOOP-7042. Updates to test-patch.sh to include failed test names and improve other messaging. Contributed by nigel.
new 82c5214 HADOOP-7045. TestDU fails on systems with local file systems with extended attributes. Contributed by Eli Collins
new 8bd9dd0 HADOOP-6683. ZlibCompressor does not fully utilize the buffer. Contributed by Kang Xiao
new ca71e82 HADOOP-7023. Add listCorruptFileBlocks to FileSystem. Contributed by Patrick Kling.
new 04f1e7a HADOOP-7001. Configuration changes can occur via the Reconfigurable interface. (Patrick Kline via dhruba)
new 19a762d HADOOP-7001. Configuration changes can occur via the Reconfigurable interface. (Patrick Kline via dhruba and nigel)
new 3a43e59 HADOOP-6764. Add number of reader threads and queue length as configuration parameters in RPC.getServer. Contributed by Dmytro Molkov.
new c35e4a9 HADOOP-7052. misspelling of threshold in conf/log4j.properties. Contributed by Jingguo Yao
new c245af0 HADOOP-7049. TestReconfiguration should be junit v4. Contributed by Patrick Kling
new 5d9ed58 HADOOP-7053. wrong FSNamesystem Audit logging setting in conf/log4j.properties. Contributed by Jingguo Yao
new ebb236e HADOOP-7057. IOUtils.readFully and IOUtils.skipFully have typo in exception creation's message. Contributed by Konstantin Boudnik.
new dbd07f9 HADOOP-6978. Adds support for NativeIO using JNI. Contributed by Todd Lipcon, Devaraj Das & Owen O'Malley.
new ee705fa HADOOP-6939. Inconsistent lock ordering in AbstractDelegationTokenSecretManager. Contributed by Todd Lipcon.
new e75e481 HADOOP-7054 Change NN LoadGenerator to use FileContext APIs (Sanjay Radia)
new 6afbdb6 HADOOP-7060. A more elegant FileSystem#listCorruptFileBlocks API. Contributed by Patrick Kling.
new aa089fc HADOOP-7058. Expose number of bytes in FSOutputSummer buffer to implementatins. Contributed by Todd Lipcon.
new e98f5a9 HADOOP-7060 Remove the unused files from the repository
new dc24696 HADOOP-7061. unprecise javadoc for CompressionCodec. Contributed by Jingguo Yao
new bde004d HADOOP-7038. saveVersion script includes an additional \r while running whoami under windows. Contributed by Wang Xu.
new 19fc216 HADOOP-7059. Remove "unused" warning in native code. Contributed by Noah Watkins
new 29220b9 HADOOP-6298. Add copyBytes to Text and BytesWritable. (omalley)
new 8de8f43 HADOOP-7071. Fix bad ps command arg.
new 23da8fe HADOOP-6864. Provide a JNI-based implementation of ShellBasedUnixGroupsNetgroupMapping (implementation of GroupMappingServiceProvider)
new 38ab39a HADOOP-7078. Improve javadocs for RawComparator interface. Contributed by Harsh J Chouraria.
new 17b01dc HADOOP-7072. Remove java5 dependencies from build. Contributed by Konstantin Boudnik.
new 93f2dfc HADOOP-7072. Fixing incorrect count of parameters.
new 168bf7b HADOOP-6578. Configuration should trim whitespace around a lot of value types. Contributed by Michele Catasta
new 717579f HADOOP-7082. Configuration.writeXML should not hold lock while outputting. Contributed by Todd Lipcon
new c9fb201 HADOOP-7070. JAAS configuration should delegate unknown application names to pre-existing configuration. Contributed by Todd Lipcon
new c04751b HADOOP-6995. Allow wildcards to be used in ProxyUsers configurations. Contributed by Todd Lipcon
new a42c891 HADOOP-7091. reloginFromKeytab() should happen even if TGT can't be found. Contribued by Kan Zhang.
new 496b24d HADOOP-7087. SequenceFile.createWriter ignores FileSystem parameter. Contributed by Todd Lipcon
new f015768 HADOOP-6811. Remove EC2 bash scripts.
new 18cb6dc Moving HADOOP-7091 to 0.22 section in CHANGES.txt since it was put in branch
new 9ac35ce HADOOP-7100. Fix build to not refer to contrib/ec2 removed by HADOOP-6811. Contributed by Todd Lipcon
new db70f56 HADOOP-7097. JAVA_LIBRARY_PATH missing base directory. Contributed by Noah Watkins.
new f395f67 HADOOP-7102. Remove "fs.ramfs.impl" field from core-deafult.xml. Contributed by Konstantin Shvachko.
new ee27b8e HADOOP-7093. Servlets should default to text/plain. Contributed by Todd Lipcon
new ebb7b7f HADOOP-7101. UserGroupInformation.getCurrentUser() fails when called from non-Hadoop JAAS context. Contributed by Todd Lipcon
new 3d1b9ca HADOOP-7089. Fix link resolution logic in hadoop-config.sh. Contributed by Eli Collins
new c3fdd28 HADOOP-7104. Remove unnecessary DNS reverse lookups from RPC layer. Contributed by Kan Zhang
new a85e0ac Move HADOOP-7104 in CHANGES.txt to reflect inclusion in 0.22 branch
new 99e6ed0 HADOOP-6864. Moving CHANGES.txt record to the right place - trunk changes
new 37025ec HADOOP-6056. Use java.net.preferIPv4Stack to force IPv4. Contributed by Michele Catasta.
new a15d473 HADOOP-7046. Fix Findbugs warning in Configuration. Contributed by Po Cheung.
new 448f8db HADOOP-7110. Implement chmod with JNI. Contributed by Todd Lipcon
new 160b6fd HADOOP-7118. Fix NPE in Configuration.writeXml. Contributed by Todd Lipcon
new d2e07d2 HADOOP-7120. Fix a syntax error in test-patch.sh.
new c60feea HADOOP-7122. Fix thread leak when shell commands time out. Contributed by Todd Lipcon
new 077bc4a HADOOP-6812. Change documentation for correct placement of configuration variables: mapreduce.reduce.input.buffer.percent, mapreduce.task.io.sort.factor, mapreduce.task.io.sort.mb. Contributed by Chris Douglas.
new b1e3037 HADOOP-6904. Support method based RPC compatiblity. Contributed by Hairong Kuang.
new 9d615bd HADOOP-6436. Remove auto-generated native build files. Contributed by Roman Shaposhnik
new e82df7e HADOOP-7126. Fix file permission setting for RawLocalFileSystem on Windows. Contributed by Po Cheung.
new 7fc59af HADOOP-6642. Fix javac, javadoc, findbugs warnings related to security work. Contributed by Chris Douglas, Po Cheung.
new f593f14 HADOOP-7129. Fix typo in method name getProtocolSigature. Contributed by Todd Lipcon.
new 449478c HADOOP-6432. Add Statistics support in FileContext. Contributed by jitendra.
new bf1d3ba Fixed the order for my previous commit.
new a805223 HADOOP-7129. Complete patch by removing the transitional method name. Contributed by Todd Lipcon
new 223f651 HADOOP-7096. Allow setting of end-of-record delimiter for TextInputFormat. Contributed by Ahmed Radwan.
new ab611ed HADOOP-7048. Wrong description of Block-Compressed SequenceFile Format in SequenceFile's javadoc. Contributed by Jingguo Yao.
new 96dd151 HADOOP-7136. Remove failmon contrib component. (nigel)
new ec9f534 HADOOP-7136. Remove failmon contrib component. (nigel)
new bb2f967 HADOOP-7136. Remove failmon contrib component. (cos) Fixing the build
new 58ed6ab HADOOP-7134. configure files that are generated as part of the released tarball need to have executable bit set. Contributed by Roman Shaposhnik
new ae8b231 HADOOP-7140. IPC Reader threads do not stop when server stops. Contributed by Todd Lipcon.
new e59ee1b HADOOP-7094. hadoop.css got lost during project split. Contributed by Konstantin Boudnik.
new 02f996d HADOOP-7145. Configuration.getLocalPath should trim whitespace from the provided directories. Contributed by Todd Lipcon.
new 84ce621 HADOOP-7094. hadoop.css got lost during project split Committing missed folder
new 1560838 HADOOP-6970. SecurityAuth.audit should be generated under /build.
new eb2145f HADOOP-6970. Reordering commit message in CHANGES.txt
new 5148cc8 HADOOP-6376. Add a comment header to conf/slaves that specifies the file format. Contributed by Kay Kay.
new 27df75e HADOOP-7153. MapWritable violates contract of Map interface for equals() and hashCode(). Contributed by Nicholas Telford.
new 4d53649 HADOOP-7151. Document need for stable hashCode() in WritableComparable. Contributed by Dmitriy V. Ryaboy.
new d97ab37 HADOOP-7112. Issue a warning when GenericOptionsParser libjars are not on local filesystem.
new 2fbd0bf HADOOP-7114. FsShell should dump all exceptions at DEBUG level. Contributed by todd.
new 420a029 HADOOP-6754. DefaultCodec.createOutputStream() leaks memory. Contributed by Aaron Kimball.
new 1cd6bac HADOOP-7098. Tasktracker property not set in conf/hadoop-env.sh. Contributed by Bernd Fondermann.
new f2ff6cc HADOOP-7162. Rmove a duplicated call FileSystem.listStatus(..) in FsShell. Contributed by Alexey Diomin
new 97dcf05 HADOOP-7131. Exceptions thrown by Text methods should include the causing exception. Contributed by Uma Maheswara Rao G.
new 69fe37a HADOOP-7159. RPC server should log the client hostname when read exception happened. Contributed by Scott Chen.
new aac5472 HADOOP-6912. Guard against NPE when calling UGI.isLoginKeytabBased(). Contributed by Kan Zhang.
new 6d9ded1 HADOOP-7167. Allow using a file to exclude certain tests from build. Contributed by Todd Lipcon.
new ad45969 HADOOP-7154. Should set MALLOC_ARENA_MAX in hadoop-env.sh. Contributed by Todd Lipcon.
new 527bac7 HADOOP-7133. Batch the calls in DataStorage to FileUtil.createHardLink(). Contributed by Matt Foley.
new 96da4be HADOOP-7156. Workaround for unsafe implementations of getpwuid_r. Contributed by Todd Lipcon.
new 05704fe HADOOP-7166. Add DaemonFactory to common. Contributed by Erik Steffl and jitendra.
new fbc1107 HADOOP-7177. CodecPool should report which compressor it is using. Contributed by Allen Wittenauer
new a02641c HADOOP-7167. Amend previous commit under this JIRA to fix issue on cygwin. Contributed by Todd Lipcon
new e3b587e HADOOP-7175. Add isEnabled() to Trash. Contributed by Daryn Sharp
new 872ef2d HADOOP-7117. Remove fs.checkpoint.* from core-default.xml and replace fs.checkpoint.* with dfs.namenode.checkpoint.* in documentations. Contributed by Harsh J Chouraria
new 16593c1 HADOOP-7180. Better support on CommandFormat on the API and exceptions. Contributed by Daryn Sharp
new 1187d69 Commit the missing file TestCommandFormat.java for HADOOP-7180.
new 0d55e1a HADOOP-6949. Reduce RPC packet size of primitive arrays using ArrayPrimitiveWritable instead of ObjectWritable. Contributed by Matt Foley.
new 151c1a7 HADOOP-7204. remove local unused fs variable from CmdHandler and FsShellPermissions.changePermissions
new 06699c9 HADOOP-7193. Correct the "fs -touchz" command help message. Contributed by Uma Maheswara Rao G
new 43e800e HADOOP-7174. Null is displayed in the "fs -copyToLocal" command. Contributed by Uma Maheswara Rao G
new e86d487 HADOOP-7187. Fix socket leak in GangliaContext. Contributed by Uma Maheswara Rao G
new 1c0d271 HADOOP-7194. Fix resource leak in IOUtils.copyBytes(..). Contributed by Devaraj K
new 50b1f9f HADOOP-7202. Improve shell Command base class. Contributed by Daryn Sharp
new bb4f277 Revert HADOOP-7202 since HDFS cannot be compiled.
new 6cfb84c Remove redundant entry for HADOOP-7167 in CHANGES.txt
new f2625d4 HADOOP-7210. Chown command is not working from FSShell. Contributed by Uma Maheswara Rao G
new 67c79a25 HADOOP-7215. RPC clients must use network interface corresponding to the host in the client's kerberos principal key. Contributed by Suresh Srinivas.
new c77551b Removed an unnecessary line introduced into CHANGES.txt by change r1087844
new 3375405 HADOOP-7019 Refactor build targets to enable faster cross project dev cycles. Contributed by Luke Lu.
new 5bfd361 Committing HADOOP-6949 to branch 0.22.
new a65753d HADOOP-7202. Improve shell Command base class. Contributed by Daryn Sharp
new 7568e9c HADOOP-7216. Add FsCommand.runAll() with deprecated annotation for the transition of Command base class improvement. Contributed by Daryn Sharp
new 6e5bd7b HADOOP-6898. FileSystem.copyToLocal creates files with 777 permissions. Contributed by Aaron T. Myers.
new f5efc18 HADOOP-7223. FileContext createFlag combinations are not clearly defined. Contributed by Suresh Srinivas.
new d03e5b7 HADOOP-6994. Api to get delegation token in AbstractFileSystem. Contributed by jitendra.
new d358eb7 HADOOP-7224. Add CommandFactory to shell. Contributed by Daryn Sharp
new a12ab4b Undoing commit r1091613 for HADOOP-7223. FileContext createFlag combinations are not clearly defined.
new 7f30939 Add the missing file TestCommandFactory for HADOOP-7224.
new 6e74a35 HADOOP-7207. fs member of FSShell is not really needed
new a8dbce1 HADOOP-7223. FileContext createFlag combinations are not clearly defined. Contributed by Suresh Srinivas.
new 625b099 HADOOP-7171. Support UGI in FileContext API. Contributed by jitendra.
new 58ca227 HADOOP-7014. Generalize CLITest structure and interfaces to facilitate upstream adoption (e.g. for web testing). Contributed by Konstantin Boudnik
new 98a2b70 HADOOP-7014. Adding missed files
new 13e1be3 HADOOP-7230. Move "fs -help" shell command tests from HDFS to COMMOM. Contributed by Daryn Sharp
new 3b57b15 HADOOP-7231. Fix synopsis for -count. Contributed by Daryn Sharp.
new 7d6fa85 HADOOP-7229. Do not default to an absolute path for kinit in Kerberos auto-renewal thread. Contributed by Aaron T. Myers.
new 99ebad8 HADOOP-7233. Refactor ls to conform to new FsCommand class. Contributed by Daryn Sharp
new dc16490 HADOOP-7172. SecureIO should not check owner on non-secure clusters that have no native support. Contributed by Todd Lipcon
new e0cc260 HADOOP-7241. fix typo of command 'hadoop fs -help tail'. Contributed by Wei Yongjun
new 7ebfabc HADOOP-7235. Refactor the tail command to conform to new FsCommand class. Contributed by Daryn Sharp
new 27c1f1f Fixing typo in CHANGES.txt
new 76a7219 HADOOP-7184. Remove deprecated config local.cache.size from core-default.xml. Contributed by Todd Lipcon.
new accf84f HADOOP-7227. Remove protocol version check at proxy creation in Hadoop RPC. Contributed by jitendra.
new 28a6a83 Revert HADOOP-7227 from r1098792 since it broke HDFS and MR builds.
new bef14d0 HADOOP-7179. Federation: Improve HDFS startup scripts. Contributed by Erik Steffl and Tanping Wang.
new 78a7b97 HADOOP-7227. Remove protocol version check at proxy creation in Hadoop RPC. Contributed by jitendra.
new 369a203 HADOOP-7236. Refactor the mkdir command to conform to new FsCommand class. Contributed by Daryn Sharp
new b9599b2 HADOOP-7250. Refactor the setrep command to conform to new FsCommand class. Contributed by Daryn Sharp
new f1c74df HADOOP-7257 Client side mount tables (sanjay)
new f489f95 HADOOP-7245. FsConfig should use constants in CommonConfigurationKeys. Contributed by Tom White
new ad36a0e HADOOP-7244. Documentation change for updated configuration keys. Contributed by Tom White
new a213c56 HADOOP-7183. WritableComparator.get should not cache comparator objects. Contributed by Tom White
new 827401a HADOOP-6919. New metrics2 framework. Contributed by Luke Lu.
new 8c4a0a5 HADOOP-7261. Disable IPV6 for junit tests. Contributed by Suresh Srinivas.
new 38ac231 HADOOP-7249. Refactor the chmod/chown/chgrp command to conform to new FsCommand class. Contributed by Daryn Sharp
new 4de502c HADOOP-7251. Refactor the getmerge command to conform to new FsCommand class. Contributed by Daryn Sharp
new fa4855e Remove the empty file accidentally checked it with HADOOP-7249.
new a0391cd HADOOP-7265. Keep track of relative paths in PathData. Contributed by Daryn Sharp
new 3337cdb HADOOP-7238. Refactor the cat and text commands to conform to new FsCommand class. Contributed by Daryn Sharp
new 1bbebd1 HADOOP-7268. FileContext.getLocalFSFileContext() behavior needs to be fixed w.r.t tokens. Contributed by jitendra.
new a5290c9 HADOOP-7271. Standardize shell command error messages. Contributed by Daryn Sharp
new c0d7053 HADOOP-7272. Remove unnecessary security related info logs. Contributed by Suresh Srinivas.
new 8a2b40d HADOOP-6920. Metrics instrumentation to move new metrics2 framework. Contributed by Luke Lu.
new e2da258 HADOOP-7214. Add Common functionality necessary to provide an equivalent of /usr/bin/groups for Hadoop. Contributed by Aaron T. Myers.
new 610cc32 HADOOP-7068. Ivy resolve force mode should be turned off by default. Contributed by Luke Lu.
new 4aa51ca HADOOP-7275. Refactor the stat commands to conform to new FsCommand class. Contributed by Daryn Sharp
new cd2079f HADOOP-7237. Refactor the touchz commands to conform to new FsCommand class. Contributed by Daryn Sharp
new 7f77fad HADOOP-7267. Refactor the rm/rmr/expunge commands to conform to new FsCommand class. Contributed by Daryn Sharp
new 6511778 HADOOP-7189. Add ability to enable debug property in JAAS configuration. Contributed by Ted Yu.
new f23cc5b HADOOP-7137. Remove hod contrib. Contributed by Nigel Daley
new a8a336b HADOOP-7285. Refactor the test command to conform to new FsCommand class. Contributed by Daryn Sharp.
new a7bf585 HADOOP-7290. Unit test failure in TestUserGroupInformation.testGetServerSideGroups. Contributed by Trevor Robison
new 5b45604 HADOOP-7291. Update Hudson job not to run test-contrib. Contributed by Nigel Daley
new 8f57b51 HADOOP-7289. In ivy.xml, test conf should not extend common conf. Contributed by Eric Yang
new 1e0cc17 HADOOP-7192. Update fs -stat docs to reflect the format features. Contributed by Harsh J Chouraria.
new a97d6d9 Reverting the change r1102914 for HADOOP-7291 to fix build issues.
new 30fa80d HADOOP-7291. Update Hudson job not to run test-contrib. Contributed by Nigel Daley
new 4d205d5 HADOOP-7291. Remove spurious call to runTestContrib. Contributed by Eli Collins
new b04fb03 HADOOP-7286. Refactor the du/dus/df commands to conform to new FsCommand class. Contributed by Daryn Sharp.
new af8be47 HADOOP-7292. Fix racy test case TestSinkQueue. Contributed by Luke Lu.
new 2e6063b HADOOP-7296. The FsPermission(FsPermission) constructor does not use the sticky bit. Contributed by Siddharth Seth
new 31a77f9 HADOOP-7282. ipc.Server.getRemoteIp() may return null. Contributed by John George
new d1eaaf3 HADOOP-7300. Configuration methods that return collections are inconsistent about mutability. Contributed by Todd Lipcon.
new 14fd85c HADOOP-7301. FSDataInputStream should expose a getWrappedStream method. Contributed by Jonathan Hsieh
new ef543e3 HADOOP-7137. Remove hod contrib docs. Contributed by Nigel Daley
new da15b21 HADOOP-6832. Add an authentication plugin using a configurable static user for the web UI. Contributed by Owen O'Malley and Todd Lipcon
new 2a0bbd9 HADOOP-7305. Eclipse project classpath should include tools.jar from JDK. Contributed by Niels Basjes.
new 4977f4b HADOOP-7306. Start metrics system even if config files are missing. Contributed by Luke Lu.
new 088693f HADOOP-7302. webinterface.private.actions should be renamed and moved to the MapReduce project. Contributed by Ari Rabkin.
new 18ac828 HADOOP-7318. MD5Hash factory should reset the digester it returns. Contributed by Todd Lipcon
new f8841be HADOOP-7287. Configuration deprecation mechanism doesn't work properly for GenericOptionsParser and Tools. Contributed by Aaron T. Myers.
new 1e7fd0c HADOOP-7258. The Gzip codec should not return null decompressors. (omalley)
new a7ce0bb HADOOP-7329. Improve help message for "df" to include "-h" flag. Contributed by Xie Xianshan.
new 77b4fd6 HADOOP-7320. Refactor the copy and move commands to conform to new FsCommand class. Contributed by Daryn Sharp.
new 1596a10 HADOOP-7284 Trash and shell's rm does not work for viewfs (Sanjay Radia)
new e79d8af Revert HADOOP-7284 (r1127642) since it broke the HDFS build.
new 42a185b HADOOP-7322. Adding a util method in FileUtil for directory listing, avoid NPEs on File.listFiles(). Contributed by Bharath Mundlapudi.
new 2f6c03a HADOOP-7146. RPC server leaks file descriptors. Contributed by Todd Lipcon.
new 7df9a15 HADOOP-7312. Update value of hadoop.common.configuration.version. Contributed by Harsh J Chouraria.
new dec6fcd HADOOP-6255. Create RPM and Debian packages for common. Changes deployment layout to be consistent across the binary tgz, rpm, and deb. Adds setup scripts for easy one node cluster configuration and user creation. (Eric Yang via omalley)
new 6891b25 HADOOP-7333. Performance improvement in PureJavaCrc32. Contributed by Eric Caspole.
new 5ec9e9e HADOOP-7276. Hadoop native builds fail on ARM due to -m32. Contributed by Trevor Robinson
new 0317cf7 HADOOP-7337. Change PureJavaCrc32 annotations to public stable.
new b0c968e HADOOP-7208. Fix implementation of equals() and hashCode() in StandardSocketFactory. Contributed by Uma Maheswara Rao G.
new fe45b6e HADOOP-7336. TestFileContextResolveAfs will fail with default test.build.data property.
new e05a6d1 HADOOP-7121. Exceptions while serializing IPC call responses are not handled well. Contributed by Todd Lipcon.
new 3db6c4a HADOOP-7284 Trash and shell's rm does not work for viewfs
new 01b24a0 HADOOP-7355 Add audience and stability annotations to HttpServer class
new f4598b3 HADOOP-7351 Regression: HttpServer#getWebAppsPath used to be protected so subclasses could supply alternate webapps path but it was made private by HADOOP-6461
new 3c863fa HADOOP-7351 Regression: HttpServer#getWebAppsPath used to be protected so subclasses could supply alternate webapps path but it was made private by HADOOP-6461 -- Fix commit message; I'd put it in wrong location under 'new features' rather than under 'bugs'
new 8ed5d34 HADOOP-7349. HADOOP-7121 accidentally disabled some tests in TestIPC. Contributed by Todd Lipcon.
new 1e8c213 HADOOP-7331. Make hadoop-daemon.sh return exit code 1 if daemon processes did not get started. Contributed by Tanping Wang.
new 90a9262 HADOOP-7346. Send back nicer error message to clients using outdated IPC version. Contributed by Todd Lipcon.
new 01b83a1 HADOOP-7316. Add public javadocs to FSDataInputStream and FSDataOutputStream. Contributed by Eli Collins
new babd19d HADOOP-7144. Expose JMX metrics via JSON servlet. Contributed by Robert Joseph Evans
new a94b6a0 HADOOP-7342. Add an utility API in FileUtil for JDK File.list avoid NPEs on File.list(). Contributed by Bharath Mundlapudi.
new a7a3653 HADOOP-7341. Fix options parsing in CommandFormat. Contributed by Daryn Sharp.
new 0bcd7e9 HADOOP-7335. Force entropy to come from non-true random for tests. Contributed by Todd Lipcon
new 44a35b5 HADOOP-7353. Cleanup FsShell and prevent masking of RTE stack traces. Contributed by Daryn Sharp.
new 8336b05 HADOOP-7325. The hadoop command should not accept class names starting with a hyphen. Contributed by Brock Noland.
new cde5b33 HADOOP-7356. RPM packages broke bin/hadoop script in developer environment. Contributed by Eric Yang.
new 8576c39 HADOOP-7323. Add capability to resolve compression codec based on codec name. Contributed by Alejandro Abdelnur.
new 245c628 HADOOP-1886. Undocumented parameters in FilesSystem. Contributed by Frank Conrad
new 5068874 HADOOP-7375. Add resolvePath method to FileContext. Contributed by Sanjay Radia
new b39e5f9 HADOOP-7383. HDFS needs to export protobuf library dependency in pom. Contributed by Todd Lipcon
new a285fb5 HADOOP-7374. Don't add tools.jar to the classpath when running Hadoop. Contributed by Eli Collins
new a196766 HADOOP-7106. Reorganize SVN layout to combine HDFS, Common, and MR in a single tree (project unsplit)
new adfa76a Add HADOOP-7106 to CHANGES.txt for trunk.
new 87fee9c MAPREDUCE-2588. Change raid to the new DataTransferProtocol API.
new bea7851 Remove svn:ignore and svn:mergeinfo from hadoop/common/trunk/.
new b1b6315 HDFS-2046. Force entropy to come from non-true random for tests. Contributed by Todd Lipcon.
new 667c400 HADOOP-6605. Add JAVA_HOME detection to hadoop-config. Contributed by Eli Collins
new 3fd40ae MAPREDUCE-2106. [Gridmix] Cumulative CPU usage emulation in Gridmix. (amarrk)
new 7f0064e MAPREDUCE-2563. [Gridmix] Add High-Ram emulation system tests to Gridmix. (Vinay Kumar Thota via amarrk)
new b05f2bf HADOOP-7384. Allow test-patch to be more flexible about patch format. Contributed by Todd Lipcon.
new 3d795b6 Amend commit of HADOOP-7384 to include svn:executable bit on smart-apply-patch.sh
new c33c7fa HADOOP-7389. Use of TestingGroups by tests causes subsequent tests to fail. Contributed by Aaron T. Myers.
new a732ab3 MAPREDUCE-2107. [Gridmix] Total heap usage emulation in Gridmix. (Amar Kamat and Ravi Gummadi via amarrk)
new b1f806a HDFS-1942. Datanode must exist when all the block pool service threads exit. Contributed by Bharath Mundlapudi.
new f7c0c44 Move HDFS-941 to 0.22 section of CHANGES.txt since it was voted to go into that branch as well.
new 6a3963c HDFS-2071. Use of isConnected() in DataXceiver is invalid. Contributed by Kihwal Lee.
new de5bf9d HADOOP-7390. VersionInfo not generated properly in git after unsplit. (todd via atm)
new 7728f03 HADOOP-7379. Add the ability to serialize and deserialize protocol buffers in ObjectWritable. Contributed by Todd Lipcon.
new 4c290b5 HADOOP-7377. Fix command name handling affecting DFSAdmin. Contributed by Daryn Sharp.
new 53268e2 HDFS-2073. Add @Override annotation to NameNode. Contributed by Suresh Srinivas.
new f5c604f HADOOP-6929. RPC should have a way to pass Security information other than protocol annotations. (sharad and omalley via mahadev)
new c52787d MAPREDUCE-2576. Typo in comment in SimulatorLaunchTaskAction.java. Contributed by Tim Sell.
new 3361e76 Moved HDFS-1359 and HDFS-1439 description under trunk.
new 01a407d HDFS-1656. Fixes an issue to do with fetching of delegation tokens in HftpFileSystem. Contributed by Kan Zhang.
new 9185f8b HDFS-2055. Add hflush support to libhdfs. Contributed by Travis Crawford
new 58dc138 HDFS-1692. In secure mode, Datanode process doesn't exit when disks fail. Contributed by Bharath Mundlapudi.
new 7964df9 HDFS-1734. 'Chunk size to view' option is not working in Name Node UI. Contributed by Uma Maheswara Rao G.
new 5f81b0f MAPREDUCE-2550. Fix bin/mapred to work properly from within a source checkout. Contributed by Eric Yang.
new 47b416b HADOOP-7402. TestConfiguration doesn't clean up after itself. Contributed by Aaron T. Myers
new e45025c HDFS-420. Fuse-dfs should cache fs handles. Contributed by Brian Bockelman and Eli Collins
new 7e1e4bf HADOOP-7206. Integrate Snappy compression. Contributed by T Jake Luciani.
new 92aba1e HADOOP-7407. Snappy integration breaks HDFS build. Contributed by Alejandro Abdelnur.
new 3f190b3 HDFS-1568. Improve the log messages in DataXceiver. Contributed by Joey Echeverria
new a851ce5 HDFS-2100. Improve TestStorageRestore. Contributed by Aaron T. Myers.
new c7c8f2f MAPREDUCE-2603. Disable High-Ram emulation in system tests. (Vinay Kumar Thota via amarrk)
new 15e68cb HDFS-2083 Query JMX statistics over http via JMXJsonServlet. (tanping)
new 42863b9 HDFS-2086. If the include hosts list contains host names, after restarting namenode, data nodes registration is denied. Contributed by Tanping Wang.
new fd99979 HDFS-2092. Remove some object references to Configuration in DFSClient. Contributed by Bharath Mundlapudi
new 1191be6 HADOOP-7385 Remove StringUtils.stringifyException(ie) in logger functions. Contributed by Bharath Mundlapudi.
new 2f48fae HDFS-2087. Declare methods in DataTransferProtocol interface, and change Sender and Receiver to implement the interface.
new c37819c Revert commit 1137724 (HADOOP-7407)
new 75de23c Revert commit 1137690 (HADOOP-7206)
new 4c4eed1 HDFS-2082. SecondaryNameNode web interface doesn't show the right info. Contributed by Aaron T. Myers.
new d09e247 MAPREDUCE-2620. Update RAID for HDFS-2087.
new 6894ede HDFS-1321. If service port and main port are the same, there is no clear log message explaining the issue. (Jim Plush via atm)
new 8014dfa HADOOP-7206. Support Snappy compression. Contributed by Issei Yoshida and Alejandro Abdelnur
new 604383b HDFS-1381. HDFS javadocs hard-code references to dfs.namenode.name.dir and dfs.datanode.data.dir parameters (Jim Plush via atm)
new 9c83d16 HADOOP-7329. Add the capability of getting invividual attribute of a mbean using JMXProxyServlet. (tanping)
new b866ff6 HADOOP-310. Additional constructor requested in BytesWritable. (Brock Noland via atm)
new f43e0ff HDFS-1723. quota errors messages should use the same scale. (Jim Plush via atm)
new 3ebc992 HADOOP-7429. Add another IOUtils#copyBytes method. Contributed by Eli Collins
new 7663caa HDFS-2110. StreamFile and ByteRangeInputStream cleanup. Contributed by Eli Collins
new 1834fb9 HDFS-2053. Bug in INodeDirectory#computeContentSummary warning. Contributed by Michael Noll
new 1bcfe45 HDFS-2106. Move block management code from o.a.h.h.s.namenode to a new package o.a.h.h.s.blockmanagement.
new d58e3ef Fix CHANGES.txt (HDFS-2106 should be HDFS-2107) and add NumberReplicas.java.
new 97b6ca4 Revert 1140913 and 1140909 for HDFS-2107.
new 09b6f98 HDFS-2107. Move block management code from o.a.h.h.s.namenode to a new package o.a.h.h.s.blockmanagement.
new 61fa415 MAPREDUCE-2624. Update RAID for HDFS-2107.
new ad95cb1 Minor update to HADOOP-7429.
new 8851db1 Minor update to HDFS-2110.
new f853b52 HADOOP-7428. IPC connection is orphaned with null 'out' member. Contributed by Todd Lipcon
new 5147e28 HDFS-1955. FSImage.doUpgrade() was made too fault-tolerant by HDFS-1826. Contributed by Matt Foley.
new 3af5188 HDFS-2118. Couple dfs data dir improvements. Contributed by Eli Collins
new 7bd41f0 HDFS-2011. Removal and restoration of storage directories on checkpointing failure doesn't work properly. Contributed by Ravi Prakash.
new 09c8adf HDFS-2109. Store uMask as member variable to DFSClient.Conf. Contributed by Bharath Mundlapudi
new 6d9820a HADOOP-7437. IOUtils.copybytes will suppress the stream closure exceptions. Contributed by Uma Maheswara Rao G
new eadb1a0 Add .classpath, .project, build and build-fi to svn:ignore.
new 1e5e03c HDFS-1753. Resource Leak in StreamFile. Contributed by Uma Maheswara Rao G
new 5c778cd HDFS-1990. Fix resource leaks in BlockReceiver.close(). Contributed by Uma Maheswara Rao G
new d7f712c HADOOP-7090. Fix resource leaks in s3.INode, BloomMapFile, WritableUtils and CBZip2OutputStream. Contributed by Uma Maheswara Rao G
new b908c9e HADOOP-7440. HttpServer.getParameterValues throws NPE for missing parameters. Contributed by Uma Maheswara Rao G and Todd Lipcon.
new d782c40 HADOOP-7442. Docs in core-default.xml still reference deprecated config "topology.script.file.name" (atm)
new 99f0b7d MAPREDUCE-2323. Add metrics to the fair scheduler. Contributed by Todd Lipcon.
new ff05110 HADOOP-7327. FileSystem.listStatus() throws NullPointerException instead of IOException upon access permission failure. Contributed by Matt Foley.
new 952d970 HADOOP-7419. new hadoop-config.sh doesn't manage classpath for HADOOP_CONF_DIR correctly. Contributed by Bing Zheng and Todd Lipcon.
new 96e6203 Added Data(In,Out)putByteBuffer to work with ByteBuffer similar to Data(In,Out)putBuffer for byte[]. Contributed by Chris Douglas.
new d381ff2 HADOOP-7448. Merge from yahoo-merge branch -r 1079157 and -r 1079164: HttpServer /stacks servlet should use plain text content type, without escaping. Contributed by Luke Lu.
new f9e04d7 HADOOP-7451. Generalize StringUtils#join. Contributed by Chris Douglas.
new 473b189 HADOOP-7449. Add Data(In,Out)putByteBuffer to work with ByteBuffer similar to Data(In,Out)putBuffer for byte[]. Merge from yahoo-merge branch, -r 1079163. Fix missing Apache license headers. Contributed by Chris Douglas.
new 637cdae HADOOP-7380. Add client failover functionality to o.a.h.io.(ipc|retry). Contributed by Aaron T. Myers
new 86236dd MAPREDUCE-2249. Check the reflexive property of Counters objects when comparing equality. Contributed by Devaraj K.
new 209fd3f HDFS-2111. Add tests for ensuring that the DN will start with a few bad data directories. Contributed by Harsh J Chouraria.
new 787dcfb MAPREDUCE-2596. [Gridmix] Summarize Gridmix runs. (amarrk)
new 6ec9b17 HDFS-2034. Length in DFSInputStream.getBlockRange(..) becomes -ve when reading only from a currently being written block. Contributed by John George
new e8eed98 HADOOP-7361. Provide an option, -overwrite/-f, in put and copyFromLocal shell commands. Contributed by Uma Maheswara Rao G
new b9189f7 HDFS-2134. Move DecommissionManager to the blockmanagement package.
new 9e7e69e Add .launches to svn:ignore.
new ad7cf36 MAPREDUCE-2606. Remove IsolationRunner. Contributed by Alejandro Abdelnur
new 12b8d98 Fix missing close paragraph tag in previous commit.
new 1ba3ddb HDFS-2132. Potential resource leak in EditLogFileOutputStream.close. (atm)
new 224972e HADOOP-7324. Ganglia plugins for metrics v2. (Priyo Mustafi via llu)
new fd5a762 MAPREDUCE-2400. Remove Cluster's dependency on JobTracker via a ServiceProvider for the actual implementation. Contributed by Tom White.
new 714edd6 HDFS-2054 BlockSender.sendChunk() prints ERROR for connection closures encountered during transferToFully()
new 94f3b57 HDFS-2054 BlockSender.sendChunk() prints ERROR for connection closures encountered during transferToFully() -- moved the change notice into 0.22 section (i'd originally committed it in trunk section)
new faf8747 HADOOP-7430. Improve error message when moving to trash fails due to quota issue. Contributed by Ravi Prakash.
new 2c5dd54 HDFS-1977. Stop using StringUtils.stringifyException(). Contributed by Bharath Mundlapudi.
new bf1b1b4 HADOOP-7457. Remove out-of-date Chinese language documentation. Contributed by Jakob Homan
new 13a2637 HDFS-2131. Add new tests for the -overwrite/-f option in put and copyFromLocal by HADOOP-7361. Contributed by Uma Maheswara Rao G
new f57eaf3 MAPREDUCE-2679. Minor changes to sync trunk with MR-279 branch.
new e2a53a3 MAPREDUCE-2680. Display queue name in job client CLI.
new 654705b MAPREDUCE-2682. Add "mapred classpath" command to print classpath for MR applications. Contributed by vinodkv.
new 22fa0e4 HADOOP-7444. Add Checksum API to verify and calculate checksums "in bulk". Contributed by Todd Lipcon.
new d62523b HADOOP-7443. Add CRC32C as another DataChecksum implementation. Contributed by Todd Lipcon.
new 422608d MAPREDUCE-2670. Fixing spelling mistake in FairSchedulerServlet.java. Contributed by Eli Collins
new 8327e70 HDFS-2140. Move Host2NodesMap to the blockmanagement package.
new 4796e1a MAPREDUCE-2365. Add counters to track bytes (read,written) via File(Input,Output)Format. Contributed by Siddharth Seth.
new c54c117 HDFS-2120. on reconnect, DN can connect to NN even with different source versions. (John George via atm)
new 4ea4eec MAPREDUCE-2365. Adding newer files.
new 4f0dba4 HADOOP-7305. Eclipse project files are incomplete. Contributed by Niels Basjes
new f582aa4 HDFS-2154. In TestDFSShell, use TEST_ROOT_DIR and fix some deprecated warnings.
new 31f1a67 HADOOP-7314. Add support for throwing UnknownHostException when a host doesn't resolve. Contributed by Jeffrey Naisbitt.
new c093580 HDFS-2153. Move DFSClientAdapter to test and fix some javac warnings in OfflineEditsViewerHelper.
new c163455 HDFS-2159. Deprecate DistributedFileSystem.getClient() and fixed the deprecated warnings in DFSAdmin.
new eaa0638 HDFS-2152. TestWriteConfigurationToDFS causing the random failures. (Uma Maheswara Rao G via atm)
new 341b4a4 HADOOP-7465. A several tiny improvements for the LOG format. Contributed by Xie Xianshan
new 8a77d0b HDFS-2143. Federation: In cluster web console, add link to namenode page that displays live and dead datanodes. Contributed by Ravi Prakash.
new 0a84abf HADOOP-7434. Display error when using "daemonlog -setlevel" with illegal level. Contributed by yanjinshuang
new 8458893 HADOOP-7471. The saveVersion.sh script sometimes fails to extract SVN URL. Contributed by Alejandro Abdelnur
new d3b2f68 HADOOP-2081. Configuration getInt, getLong, and getFloat replace invalid numbers with the default value. Contributed by Harsh J
new 81001b8 HDFS-2157. Improve header comment in o.a.h.hdfs.server.namenode.NameNode. Contributed by Aaron T. Myers
new 2a49e1a MAPREDUCE-2623. Update ClusterMapReduceTestCase to use MiniDFSCluster.Builder. Contributed by Harsh J Chouraria
new c3f6575 HDFS-2147. Move cluster network topology to block management and fix some javac warnings.
new 6c0cb4d HDFS-2141. Remove NameNode roles Active and Standby (they become states of the namenode). Contributed by Suresh Srinivas.
new 710e5a9 HDFS-2161. Move createNamenode(..), createClientDatanodeProtocolProxy(..) and Random object creation to DFSUtil; move DFSClient.stringifyToken(..) to DelegationTokenIdentifier.
new f5690f5 MAPREDUCE-2710. Update JobSubmitter.printTokens(..) for HDFS-2161.
new 2614f6e Temporarily disable TestBlockPlacementPolicyRaid for MAPREDUCE-2711.
new cabec47 Revert r1148400 for MAPREDUCE-2711.
new 54c5bf2 Correct way to temporarily disable TestBlockPlacementPolicyRaid for MAPREDUCE-2711.
new cda43d7 HDFS-1774. Small optimization to FSDataset. Contributed by Uma Maheswara Rao G
new ee39160 HADOOP-7111. Several TFile tests failing when native libraries are present. (atm)
new 08928d0 HDFS-2114. re-commission of a decommissioned node does not delete excess replicas. Contributed by John George.
new 3810266 MAPREDUCE-2409. DistributedCache maps files and archives to the same path, despite semantic incompatibility. Contributed by Siddharth Seth
new c187bdc HDFS-2156. Make hdfs and mapreduce rpm only depend on the same major version for common and hdfs. (eyang via omalley)
new 233a7aa HDFS-2167. Move dnsToSwitchMapping and hostsReader from FSNamesystem to DatanodeManager.
new 184ff33 HADOOP-7460. Support pluggable trash policies. Contributed by Usman Masoon.
new ad3f694 HDFS-2116. Use Mokito in TestStreamFile and TestByteRangeInputStream. Contributed by Plamen Jeliazkov.
new 89537b7 HDFS-2112. Move ReplicationMonitor to block management. Contributed by Uma Maheswara Rao G
new 598b85c HDFS-1739. Add available volume size to the error message when datanode throws DiskOutOfSpaceException. Contributed by Uma Maheswara Rao G
new c316d43 HDFS-1776 Bug in Bug in Concat code. Contributed by Bharath Mundlapudi
new 00b526a MAPREDUCE-2575. TestMiniMRDFSCaching fails if test.build.dir is set to something other than build/test (Thomas Graves via mahadev)
new 85461fb HADOOP-7463. Adding a configuration parameter to SecurityInfo interface. (mahadev)
new 6720645 HADOOP-7298. Add test utility for writing multi-threaded tests. Contributed by Todd Lipcon and Harsh J Chouraria.
new db9d8333 HADOOP-7438. Fix deprecated warnings from hadoop-daemon.sh script. Contributed by Ravi Prakash.
new ef6110e MAPREDUCE-2622. Remove the last remaining reference to the deprecated configuration "io.sort.mb". Contributed by Harsh J Chouraria.
new e8f1245 MAPREDUCE-2602. Allow setting of end-of-record delimiter for TextInputFormat for the old API. Contributed by Ahmed Radwan.
new d2b31fe HDFS-2144. If SNN shuts down during initialization it does not log the cause. (Ravi Prakash via atm)
new 01cd616 HDFS-2180. Refactor NameNode HTTP server into new class. Contributed by Todd Lipcon.
new 60e4947 HADOOP-6385. dfs should support -rmdir (was HDFS-639). Contributed by Daryn Sharp.
new 438c32a HDFS-2149. Move EditLogOp serialization formats into FsEditLogOp implementations. Contributed by Ivan Kelly.
new 969a263 HDFS-2191. Move datanodeMap from FSNamesystem to DatanodeManager.
new 0b12cc8 HDFS-2200. Change FSNamesystem.LOG to package private.
new d356d64 MAPREDUCE-2723. Remove directly accessing FSNamesystem.LOG from TestCopyFiles and TestDistCh.
new f3f9029 Temporarily disable NameNodeRaidTestUtil.getDatanodeMap(..) for MAPREDUCE-2711.
new 4a53582 Fix a typo in CHANGE.txt: MAPREDUCE-2723 should be MAPREDUCE-2732.
new b60772c HDFS-2198. Remove hardcoded configuration keys. Contributed by Suresh Srinivas.
new 5dbd26f HADOOP-7485. Add -h option to ls to list file sizes in human readable format. Contributed by XieXianshan.
new c4f7d2f HDFS-2210. Remove hdfsproxy. Contributed by Eli Collins
new 0850205 HADOOP-7378. Add -d option to ls to not expand directories. Contributed by Daryn Sharp.
new 6f1ef98 HDFS-1981. NameNode does not saveNamespace() when editsNew is empty. Contributed by Uma Maheswara Rao G.
new ffbe9e5 HDFS-2195. Refactor StorageDirectory to not be an non-static inner class. Contributed by Todd Lipcon
new 60c41c5 MAPREDUCE-2463. Job history files are not moved to done folder when job history location is hdfs. Contributed by Devaraj K
new 44320ee HDFS-2212. Refactor double-buffering code out of EditLogOutputStreams. Contributed by Todd Lipcon
new 817df4d HADOOP-7474. Refactor ClientCache out of WritableRpcEngine. Contributed by jitendra.
new 0643a59 MAPREDUCE-2127. mapreduce trunk builds are filing on hudson. Contributed by Bruno Mahé
new c58366a HADOOP-7468 hadoop-core JAR contains a log4j.properties file.
new 28e6a4e HDFS-1073. Redesign the NameNode's storage layout for image checkpoints and edit logs to introduce transaction IDs and be more robust. Contributed by Todd Lipcon and Ivan Kelly.
new 8830af0 HADOOP-7491. hadoop command should respect HADOOP_OPTS when given a class name. Contributed by Eli Collins
new 8390152 HDFS-2202. Add a new DFSAdmin command to set balancer bandwidth of datanodes without restarting. Contributed by Eric Payne
new 4435aad Branching for HDFS-1623 - High Availability Framework for HDFS NN
new d68e38b HDFS-2199. Move blockTokenSecretManager from FSNamesystem to BlockManager. Contributed by Uma Maheswara Rao G
new 7e18c90 MAPREDUCE-2243. Close streams propely in a finally-block to avoid leakage in CompletedJobStatusStore, TaskLog, EventWriter and TotalOrderPartitioner. Contributed by Devaraj K
new 54860d8 HADOOP-7178. Add a parameter, useRawLocalFileSystem, to copyToLocalFile(..) in FileSystem. Contributed by Uma Maheswara Rao G
new 22f232b MAPREDUCE-2740. MultipleOutputs in new API creates needless TaskAttemptContexts. Contributed by Todd Lipcon.
new 9bac807 MAPREDUCE-2187. Reporter sends progress during sort/merge. Contributed by Anupam Seth.
new 0f6dfee HADOOP-6671. Use maven for hadoop common builds. Contributed by Alejandro Abdelnur.
new ddc3f5d Reinstate common/src/test/bin (used by externals) which was mistakenly deleted in HADOOP-6671 commit.
new b71b470 HDFS-2196. Make ant build system work with hadoop-common JAR generated by Maven. Contributed by Alejandro Abdelnur
new 44501d8 MAPREDUCE-2741. Make ant build system work with hadoop-common JAR generated by Maven. Contributed Alejandro Abdelnur.
new 102b94d MAPREDUCE-2760. mapreduce.jobtracker.split.metainfo.maxsize typoed in mapred-default.xml. Contributed by Todd Lipcon
new 12e09b2 HADOOP-7502. Make generated sources IDE friendly. (Alejandro Abdelnur via llu)
new 2db9aab HADOOP-7501. Publish Hadoop Common artifacts (post HADOOP-6671) to Apache SNAPSHOTs repo. Contributed by Alejandro Abdelnur
new 2025d4e HADOOP-7508. Compiled nativelib is in wrong directory and it is not picked up by surefire setup. Contributed by Alejandro Abdelnur.
new 44b7e03 MAPREDUCE-2705. Permits parallel multiple task launches. Contributed by Thomas Graves.
new 703b5f4 MAPREDUCE-2705. Permits parallel multiple task launches. Contributed by Thomas Graves.
new 924ed13 HDFS-2196. Make ant build system work with hadoop-common JAR generated by Maven. Fix for fusedfs contributed by szetszwo
new 218e96a Merge trunk into HA branch after mavenization of hadoop-common
new 57213db Add a CHANGES.txt file for HDFS-1623 branch
new 05c2493 HDFS-2179. Add fencing framework and mechanisms for NameNode HA. Contributed by Todd Lipcon.
new 3f85da7 Add Apache license header to StreamPumper.java missing in HDFS-2179 commit.
new bed3495 Add another license header missing from HDFS-2179 commit.
new 53190cf HDFS-2187. Make EditLogInputStream act like an iterator over FSEditLogOps. Contributed by Ivan Kelly and Todd Lipcon.
new 23762da HDFS-2225. Refactor file management so it's not in classes which should be generic. Contributed by Ivan Kelly.
new 7fac946 HDFS-2108. Move datanode heartbeat handling from namenode package to blockmanagement package.
new e639c33 HADOOP-7445. Implement bulk checksum verification using efficient native code. Contributed by Todd Lipcon.
new acd3ab5 Fix svn:ignore properties following HADOOP-6671.
new 9145ab5 HADOOP-7455. HA: Introduce HA Service Protocol Interface. Contributed by Suresh Srinivas.
new a61b24a HDFS-2226. Clean up counting of operations in FSEditLogLoader. Contributed by Todd Lipcon.
new ca4b2f1 HADOOP-7515. test-patch reports the wrong number of javadoc warnings.
new 3864369 HADOOP-7520. Fix to add distribution management info to hadoop-main. Contributed by Alejandro Abdelnur
new f0ecbd0 Create CHANGES.HDFS-1623.txt for HDFS-1623 branch changes and move one change from CHANGES.txt into it.
new 62f27b5 Edit change log entry for HDFS-2225 by request of Nicholas
new 8dc420b HADOOP-7523. Test org.apache.hadoop.fs.TestFilterFileSystem fails due to java.lang.NoSuchMethodException. Contributed by John Lee.
new 371f4a5 HDFS-2228. Move block and datanode code from FSNamesystem to BlockManager and DatanodeManager. (szetszwo)
new 498e290 HDFS-2238. In NamenodeFsck.toString(), uses StringBuilder.(..) instead of string concatenation. Contributed by Uma Maheswara Rao G
new a523fbd HDFS-2230. Fix ivy conf to resolve/retrieve latest common-tests jar published by hadoop common maven build. (gkesavan)
new 0a2b40f HADOOP-7528. Maven build fails in Windows. Contributed by Alejandro Abdelnur.
new 27b66e2 HADOOP-7525. Make arguments to test-patch optional.
new eb6e44b HDFS-2227. getRemoteEditLogManifest should pull its information from FileJournalManager during checkpoint process. Contributed by Ivan Kelly and Todd Lipcon.
new 5d5b1c6 HDFS-2239. Reduce access levels of the fields and methods in FSNamesystem.
new 2d653c9 MAPREDUCE-2797. Update mapreduce tests and RAID for HDFS-2239.
new 2a990ed HADOOP-7472. RPC client should deal with IP address change. Contributed by Kihwal Lee.
new 73f2092 HDFS-1974. Introduce active and standy states to the namenode. Contributed by Suresh Srinivas.
new ef223e8 HDFS-2241. Remove implementing FSConstants interface to just get the constants from the interface. Contributed by Suresh Srinivas.
new 95ecc91 Ignore CHANGES.HDFS-1623.txt from release audit warnings
new cde9879 HDFS-2237. Change UnderReplicatedBlocks from public to package private.
new 6a7c030 HDFS-2245. Fix a NullPointerException in BlockManager.chooseTarget(..).
new 5b7c0b6 MAPREDUCE-2805. Update RAID for HDFS-2241.
new 5c8f496 HADOOP-7533. Allow test-patch to be run from any subproject directory.
new 86195ce HADOOP-7499. Add method for doing a sanity check on hostnames in NetUtils. (Jeffrey Naisbit via mahadev)
new 3228351 MAPREDUCE-2489. Jobsplits with random hostnames can make the queue unusable (jeffrey naisbit via mahadev)
new ba0b61cf HADOOP-7512. Fix example mistake in WritableComparable javadocs. Contributed by Harsh J
new 7528853 HADOOP-7357. hadoop.io.compress.TestCodec#main() should exit with non-zero exit code if test failed. Contributed by Philip Zeyliger
new 1dd48b1 HDFS-2229. Fix a deadlock in namenode by enforcing lock acquisition ordering.
new fdd81b2 HADOOP-6158. Move CyclicIteration to HDFS. Contributed by Eli Collins
new 7153d50 HADOOP-6622. Token should not print the password in toString.
new 28fd74c HADOOP-7526. Add TestPath tests for URI conversion and reserved characters. Contributed by Eli Collins
new 961bae4 Fix bad import in HADOOP-615.
new 96a87ae HADOOP-7531. Add servlet util methods for handling paths in requests. Contributed by Eli Collins
new a9a4f25 MAPREDUCE-2187 - Missed adding the file
new 4673ab1 HDFS-2235. Encode servlet paths. Contributed by Eli Collins
new 8061bb5 Fix HDFS-2235 FI test failure.
new 1c2ab72 HDFS-2186. DN volume failures on startup are not counted. Contributed by Eli Collins
new d5ef72e HDFS-2240. Fix a deadlock in LeaseRenewer by enforcing lock acquisition ordering.
new 7d612e9 HADOOP-7529. Fix lock cycles in metrics system. (llu)
new 504b801 HDFS-73. DFSOutputStream does not close all the sockets. Contributed by Uma Maheswara Rao G
new ded6f22 MAPREDUCE-2837. Ported bug fixes from y-merge to prepare for MAPREDUCE-279 merge.
new 989c5e9 MAPREDUCE-2037. Capture intermediate progress, CPU and memory usage for tasks. Contributed by Dick King.
new 24676e8 MAPREDUCE-901. Efficient framework counters. Contributed by Luke Lu.
new 2cd4c6a MAPREDUCE-2541. Fixed a race condition in IndexCache.removeMap. Contributed by Binglin Chang.
new a464402 MAPREDUCE-2839. Fixed TokenCache to get delegation tokens using both new and old apis. Contributed by Siddharth Seth.
new cb98b81 MAPREDUCE-2727. Fix divide-by-zero error in SleepJob for sleepCount equals 0. Contributed by Jeffrey Naisbitt.
new b2b976a Fixed bad commit for MAPREDUCE-901.
new 2ab3433 HDFS-2233. Add WebUI tests with URI reserved chars. Contributed by Eli Collins
new e550849 HADOOP-7545. Common -tests JAR should not include properties and configs. Contributed by Todd Lipcon.
new c65a01e Merge trunk into HDFS-1623 branch.
new 86ef57f HADOOP-7536. Correct the dependency version regressions introduced in HADOOP-6671. Contributed by Alejandro Abdelnur.
new 9c7e27c HADOOP-7493. Add ShortWritable. Constributed by Uma Maheswara Rao G
new b094465 HDFS-2265. Remove unnecessary BlockTokenSecretManager fields/methods from BlockManager.
new cc875f0 DFS-1257. Fix a race condition on BlockManager.recentInvalidateSets. Contributed by Eric Payne
new dd86860 HDFS-2260. Refactor BlockReader into an interface and implementation. Contributed by Todd Lipcon.
new dbecbe5 MAPREDUCE-279. MapReduce 2.0. Merging MR-279 branch into trunk. Contributed by Arun C Murthy, Christopher Douglas, Devaraj Das, Greg Roelofs, Jeffrey Naisbitt, Josh Wills, Jonathan Eagles, Krishna Ramachandran, Luke Lu, Mahadev Konar, Robert Evans, Sharad Agarwal, Siddharth Seth, Thomas Graves, and Vinod Kumar Vavilapalli.
new 42b49c2 Updating CHANGES.txt to reflect fixes from MR-279 branch that came into trunk when merging the two of them.
new a027cbf HADOOP-7555. Add a eclipse-generated files to .gitignore. (atm)
new fe87d6a MAPREDUCE-2854. update INSTALL with config necessary run mapred on yarn. (thomas graves via mahadev)
new 1ac6c0c Missing findbugs exclude file from MR-279 branch merge.
new 9a61221 MAPREDUCE-2860. Fix log4j logging in the maven test cases. (mahadev)
new 6ee5a73 HADOOP-7264. Bump avro version to at least 1.4.1. Contributed by Alejandro Abdelnur
new d86f318 HDFS-2096. Mavenization of hadoop-hdfs. Contributed by Alejandro Abdelnur.
new f6d2453 Fix svn:ignore following integration of MR-279 and HDFS mavenization.
new b0ea4b7 Merge trunk into HDFS-1623 post-mavenization.
new a0f120c HADOOP-7119. add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles. (Alejandro Abdelnur via atm)
new b77bc47 Follow-up to HADOOP-7119 - removing two files which were moved.
new 272c6eb MAPREDUCE-2867. Remove Unused TestApplicaitonCleanup in resourcemanager/applicationsmanager. (mahadev)
new 8d34a17 HADOOP-7498. Remove legacy TAR layout creation. Contributed by Alejandro Abdelnur.
new 14b97a9 HADOOP-7496. Break Maven TAR & bintar profiles into just LAYOUT & TAR proper. Contributed by Alejandro Abdelnur.
new 7c8fcbe MAPREDUCE-2701. app/Job.java needs UGI for the user that launched it. (Robert Evans via mahadev)
new fa62567 HADOOP-7390. Move changes under 0.22 branch.
new 8c8f3b7 MAPREDUCE-2868. ant build broken in hadoop-mapreduce dir (mahadev, giri and arun via mahadev)
new fdef052 HADOOP-7566. MR tests are failing webapps/hdfs not found in CLASSPATH. (Alejandro Abdelnur via mahadev)
new 513f17d HDFS-2273. Refactor BlockManager.recentInvalidateSets to a new class.
new 2892f6d HDFS-2266. Add Namesystem and SafeMode interfaces to avoid directly referring to FSNamesystem in BlockManager.
new 8af5c4b MAPREDUCE-2649. Handling of finished applications in RM. Contributed by Thomas Graves.
new b04aafe HDFS-2267. DataXceiver thread name incorrect while waiting on op during keepalive. Contributed by Todd Lipcon.
new 61cbfa5 MAPREDUCE-2838. Fix MapReduce builds to use new hadoop-common test jars. Contributed by gkesavan.
new ec559db HDFS-1480. All replicas of a block can end up on the same rack when some datanodes are decommissioning. Contributed by Todd Lipcon.
new 1eb2720 MAPREDUCE-2859 - Fix eclipse plugin contrib module compilation. Contributed by Giridharan Kesavan
new 71c2f73 HADOOP-7561. Make test-patch only run tests for changed modules.
new fdae3cd HADOOP-7567. 'mvn eclipse:eclipse' fails for hadoop-alfredo (auth). Contributed by Alejandro Abdelnur.
new ebf61db MAPREDUCE-2846. Fix missing synchronization in the task log management. (omalley)
new bb0005c HADOOP-7563. Setup HADOOP_HDFS_HOME, HADOOP_MAPRED_HOME and classpath correction. Contributed by Eric Yang.
new cd71577 HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur.
new 6316e66 HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur.
new f2b91a8 MAPREDUCE-2807. Fix AM restart and client redirection. Contributed by Sharad Agarwal.
new 31903fe Setup svn:ignore in hadoop-auth.
new 7c85f33 MAPREDUCE-2877. Add missing Apache license header in some files in MR and also add the rat plugin to the poms. (mahadev)
new 1dd113b MAPREDUCE-2796. Set start times for MR applications for clients to see. Contributed by Devaraj K.
new 58676ed MAPREDUCE-2879. Fix version for MR-279 to 0.23.0.
new 01f24e1 HADOOP-7578. Fix test-patch to be able to run on MR patches. (mahadev and tom white)
new ee05510 Preparing for release 0.23.0
new 5675dad MAPREDUCE-2879. Fix version for MR-279 to 0.23.0
new a44ffcc Preparing for hadoop-0.24.0 development.
new e096d0b HADOOP-7578. Fix a mess up in svn move (mahadev)
new a415733 HADOOP-7578. Adding needed files in svn (mahadev)
new 0ee0fa4 MAPREDUCE-2881. Fix to include log4j 1.2.16 depenency. Contributed by Giridharan Kesavan
new e6339be HDFS-349. DFS Scalability: Incremental block reports. Contributed by Tomasz Nykiel.
new 522fe14 Move change log for HDFS-395 from 0.23 section to trunk
new e680023 Revert 1161976 since the log message was incorrectly marked the issue as HDFS-349.
new 73451ed HDFS-395. DFS Scalability: Incremental block reports. Contributed by Tomasz Nykiel.
new 7cf49f5 HDFS-2286. DataXceiverServer logs AsynchronousCloseException at shutdown. Contributed by Todd Lipcon.
new 23e7fc4 HDFS-2287. TestParallelRead has a small off-by-one bug. Contributed by Todd Lipcon.
new 56dd8ba HADOOP-7547. Add generic type in WritableComparable subclasses. Contributed by Uma Maheswara Rao G
new d8c3e63 MAPREDUCE-2885. Fix mapred-config.sh to look for hadoop-config.sh in HADOOP_COMMON_HOME/libexec.
new 5116ea4 Merge trunk into HA branch
new 8b56463 HDFS-2289. Ensure jsvc is bundled with the HDFS distribution artifact. Contributed by Alejandro Abdelnur.
new c9cbd8e MAPREDUCE-2893. Remove duplicate entry of YarnClientProtocolProvider in ClientProtocolProvider services file. Contributed by Liang-Chi Hsieh.
new 00d2263 MAPREDUCE-2891. Javadoc for AMRMProtocol and related records. Contributed by acmurthy.
new b9259a2 MAPREDUCE-2898. Javadoc for ContainerManager protocol and related records.
new 602dd3c HADOOP-7589. Prefer mvn test -DskipTests over mvn compile in test-patch.sh (Robert Evans via mahadev)
new 3380d8f MAPREDUCE-2904. Fixed bin/yarn to correctly include HDFS jars and clean up of stale refs to pre-mavenized Hadoop Common and HDFS. Contributed by Sharad Agarwal and Arun C. Murthy.
new aad81a1 MAPREDUCE-2737. Update the progress of jobs on client side. (Siddharth Seth and Mahadev Konar via mahadev)
new fb6ecb9 MAPREDUCE-2886. Fix Javadoc warnings in MapReduce. (mahadev)
new c2b851b MAPREDUCE-2897. Javadoc for ClientRMProtocol protocol and related records.
new aba0e22 HDFS-1217. Change some NameNode methods from public to package private. Constributed by Laxman
new 4b661b3 HADOOP-7576. Fix findbugs warnings and javac warnings in hadoop-auth.
new 8c9c8c7 Remove svn:mergeinfo from TestSequenceFile.java
new 1cd3791 HDFS-1330 and HADOOP-6889. Added additional unit tests. Contributed by John George.
new f10c97d HADOOP-7593. Fix AssertionError in TestHttpServer.testMaxThreads(). Contributed by Uma Maheswara Rao G
new 5786efb MAPREDUCE-2916. Ivy build for MRv1 fails with bad organization for common daemon. (mahadev)
new ade0f05 MAPREDUCE-2652. Enabled multiple NMs to be runnable on a single node by making shuffle service port to be truely configurable. Contributed by Robert Joseph Evans.
new b9a5fd5 MAPREDUCE-2917. Fixed corner case in container reservation which led to starvation and hung jobs.
new 4f1a0e3 HDFS-2258. Reset lease limits to default values in TestLeaseRecovery2. Contributed by Konstantin Shvachko
new 2b016da HADOOP-7579. Rename package names from alfredo to auth. Contributed by Alejandro Abdelnur
new 19523b6 HADOOP-7594. Support HTTP REST in HttpServer.
new 99af7d8 set svn:ignore for hadoop-auth-examples.
new a2b1aa9 HADOOP-7595. Upgrade dependency to Avro 1.5.3. (Alejandro Abdelnur via atm)
new d873f11 HDFS-2299. TestOfflineEditsViewer is failing on trunk. (Uma Maheswara Rao G via atm)
new c5ef34a Revert 1164192 given review feedback provided after initial commit.
new a9bf334 MAPREDUCE-2756. Better error handling in JobControl for failed jobs. Contributed by Robert Evans.
new 5d4f16b MAPREDUCE-2735. Add an applications summary log to ResourceManager. Contributed by Thomas Graves.
new 07c5741 HADOOP-7552. FileUtil#fullyDelete doesn't throw IOE but lists it in the throws clause. Contributed by Eli Collins
new 2566043 HDFS-2299. TestOfflineEditsViewer is failing on trunk. (Uma Maheswara Rao G via atm)
new b97a4d4 HADOOP-7524 and MapReduce-2887 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia)
new 6c33846 HADOOP-7606. Upgrade Jackson to version 1.7.1 to match the version required by Jersey (Alejandro Abdelnur via atm)
new 6bdf574 MAPREDUCE-2716. MRReliabilityTest job fails because of missing job-file. Contributed by Jeffrey Naisbitt.
new 8ae98a9 HDFS-1620. Rename HdfsConstants -> HdfsServerConstants, FSConstants -> HdfsConstants. (Harsh J Chouraria via atm)
new 458c34a Follow-up commit for HDFS-1620 since I missed some files.
new 6b608aa MAPREDUCE-2697. Enhance CapacityScheduler to cap concurrently running applications per-queue & per-user.
new ae367be MAPREDUCE-2882. TestLineRecordReader depends on ant jars. Contributed by Todd Lipcon.
new d1438b5 HDFS-2310. TestBackupNode fails since HADOOP-7524 went in. Contributed by Ivan Kelly.
new b0632df HDFS-2197. Refactor RPC call implementations out of NameNode class. Contributed by Todd Lipcon.
new c2e1756 HADOOP-7580. Add a version of getLocalPathForWrite to LocalDirAllocator which doesn't create dirs. Contributed by Chris Douglas & Siddharth Seth.
new 9e95326 HDFS-2313. Rat excludes has a typo for excluding editsStored files. (atm)
new e20f135 MAPREDUCE-2936. Contrib Raid compilation broken after HDFS-1620. Contributed by Vinod Kumar Vavilapalli.
new bdc3720 HDFS-2018. Move all journal stream management code into one place. Contributed by Ivan Kelly.
new 42d443f HDFS-2314. MRV1 test compilation broken after HDFS-2197. Contributed by Todd Lipcon
new fd804b5 MAPREDUCE-2767. Remove Linux task-controller. Contributed by Milind Bhandarkar.
new f560a10 MAPREDUCE-2687. Fix NodeManager to use the right version of LocalDirAllocator.getLocalPathToWrite. Contributed by mahadev & acmurthy.
new 3a3f277 MAPREDUCE-2767. CHANGES.txt
new 03c1015 MAPREDUCE-2800. Set final progress for tasks to ensure all task information is correctly logged to JobHistory. Contributed by Siddharth Seth.
new d51078e MAPREDUCE-2774. Add startup message to ResourceManager & NodeManager on startup. Contributed by Venu Gopala Rao.
new cdfabf5 MAPREDUCE-2655. Add audit logs to ResourceManager and NodeManager. Contributed by Thomas Graves.
new 8815bdf Adding new files for MAPREDUCE-2655.
new 0ecba04 MAPREDUCE-2938. Log application submission failure in CapacityScheduler
new 1d6793d Commit the test and the conf changes in common for HDFS-2284.
new 1c15670 MAPREDUCE-2948. Hadoop streaming test failure, post MR-2767 (mahadev)
new 2ca9c8d HADOOP-7507. Allow ganglia metrics to include the metrics system tags in the gmetric names. Contributed by Alejandro Abdelnur.
new 06e84a1 HDFS-2223. Untangle depencencies between NN components. Contributed by Todd Lipcon.
new 8b9a2c7 HDFS-2232. Generalize regular expressions in TestHDFSCLI. Contributed by Plamen Jeliazkov.
new d10631f Merge trunk into HA branch
new ae5e8e0 MAPREDUCE-2784. [Gridmix] Bug fixes in ExecutionSummarizer and ResourceUsageMatcher. (amarrk)
new 1f46b99 MAPREDUCE-2908. Fix all findbugs warnings. Contributed by Vinod K V.
new 8ac20f9 MAPREDUCE-2942. TestNMAuditLogger.testNMAuditLoggerWithIP failing (Thomas Graves via mahadev)
new 70f9ace HADOOP-7612. Change test-patch to run tests for all nested modules.
new 6b6ef7b MAPREDUCE-2947. Fixed race condition in AuxiliaryServices. Contributed by Vinod K V.
new 1b294f2 MAPREDUCE-2844. Fixed display of nodes in UI. Contributed by Ravi Teja Ch N V.
new dd34c4e MAPREDUCE-2844. Fixed display of nodes in UI.
new b3c9c3c MAPREDUCE-2677. Fixed 404 for some links from HistoryServer. Contributed by Robert Evans.
new 96a5bef HADOOP-7598. Fix smart-apply-patch.sh to handle patching from a sub directory correctly. Contributed by Robert Evans.
new fafe8cd MAPREDUCE-2864. Normalize configuration variable names for YARN. Contributed by Robert Evans.
new 035937b MAPREDUCE-2690. Web-page for FifoScheduler. Contributed by Eric Payne.
new a0ef2d7 MAPREDUCE-2937. Ensure reason for application failure is displayed to the user. Contributed by Mahadev Konar.
new ca85344 MAPREDUCE-2953. Fix a race condition on submission which caused client to incorrectly assume application was gone by making submission synchronous for RMAppManager. Contributed by Thomas Graves.
new a0f13a2 Adding back hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources which was missed during the merge of MAPREDUCE-279.
new 71e0515 MAPREDUCE-2963. Fix hang in TestMRJobs. Contributed by Siddharth Seth.
new 85e17fd MAPREDUCE-2711. Update TestBlockPlacementPolicyRaid for the new namesystem and block management APIs.
new 1d84d98 MAPREDUCE-2954. Fixed a deadlock in NM caused due to wrong synchronization in protocol buffer records. Contributed by Siddharth Seth.
new 68cb2b0 HADOOP-7607 and MAPREDUCE-2934. Simplify the RPC proxy cleanup process. (atm)
new fbf0035 MAPREDUCE-2975. Fixed YARNRunner to use YarnConfiguration rather than Configuration. Contributed by Mahadev Konar.
new 592aaa1 HADOOP-7328. When a serializer class is missing, return null, not throw an NPE. Contributed by Harsh J Chouraria.
new 146c170 Add autoconf-related side-effect files to svn:ignore for container-executor
new b982e62 MAPREDUCE-2971. ant build mapreduce fails protected access jc.displayJobList (jobs) (Thomas Graves via mahadev)
new a3df5d0 HADOOP-7610. Fix for hadoop debian package. Contributed by Eric Yang
new 61d0b75 HDFS-2284. Add a new FileSystem, webhdfs://, for supporting write Http access to HDFS.
new 8fb6765 MAPREDUCE-2691. Finish up the cleanup of distributed cache file resources and related tests. Contributed by Siddharth Seth.
new 817ead6 MAPREDUCE-2933. Change allocate call to return ContainerStatus for completed containers rather than Container.
new 6b2f2ef MAPREDUCE-2749. Ensure NM registers with RM after starting all its services correctly. Contributed by Thomas Graves.
new e14da3a MAPREDUCE-2978. Fixed test-patch to make Jenkins report findbugs warnings properly. Contributed by Tom White.
new be32d25 MAPREDUCE-2675. Reformat JobHistory Server main page to be more useful. Contributed by Robert Joseph Evans.
new fb65bfc MAPREDUCE-2979. Removed the needless ClientProtocolProvider configuration from the hadoop-mapreduce-client-core module. Contributed by Siddharth Seth.
new 1c01951 MAPREDUCE-2669. Add new examples for Mean, Median, and Standard Deviation. Contributed by Plamen Jeliazkov.
new 8332126 HADOOP-7568. SequenceFile should not print into stdout. Contributed by Plamen Jeliazkov.
new c8383a5 MAPREDUCE-2985. Fixed findbugs warnings in ResourceLocalizationService. Contributed by Thomas Graves.
new 7fa0bf3 MAPREDUCE-2874. Fix formatting of ApplicationId in web-ui. Contributed by Eric Payne.
new 6165875 MAPREDUCE-2896. Simplify all apis to in org.apache.hadoop.yarn.api.records.* to be get/set only. Added javadocs to all public records.
new 468775a HADOOP-7599. Script improvements to setup a secure Hadoop cluster. Contributed by Eric Yang.
new b6d5d02 HADOOP-7626. Bugfix for a config generator. Contributed by Eric Yang.
new 6c3b595 HDFS-2317. Support read access to HDFS in webhdfs.
new e4dc2e1 HDFS-2323. start-dfs.sh script fails for tarball install
new 53f9214 MAPREDUCE-2995. Better handling of expired containers in MapReduce ApplicationMaster. Contributed by Vinod K V.
new 88ff272 MAPREDUCE-2995. Fixed race condition in ContainerLauncher. Contributed by Vinod K V.
new 4d90df8 Merge -r 1170285:1170286 from branch-0.20-security to trunk to fix MAPREDUCE-2549.
new f4b2b63 Merge trunk into HA branch
new a3e8f68 MAPREDUCE-2676. MR-279: JobHistory Job page needs reformatted. (Robert Evans via mahadev)
new 29eadf1 HADOOP-7629. Allow immutable FsPermission objects to be used as IPC parameters. Contributed by Todd Lipcon.
new 88b82a0 MAPREDUCE-2899. Replace major parts of ApplicationSubmissionContext with a ContainerLaunchContext (Arun Murthy via mahadev)
new 47e04d3 MAPREDUCE-2949. Fixed NodeManager to shut-down correctly if a service startup fails. Contributed by Ravi Teja Ch N V.
new 4ba2acf MAPREDUCE-2966. Added ShutDown hooks for MRV2 processes so that they can gracefully exit. Contributed by Abhijit Suresh Shingate.
new 5183e88 MAPREDUCE-3005. Fix both FifoScheduler and CapacityScheduler to correctly enforce locality constraints.
new 9704960 MAPREDUCE-2991. queueinfo.jsp fails if queue names contain special symbols. Contributed by Priyo Mustafi.
new be2b092 HDFS-2331. Fix WebHdfsFileSystem compilation problems for a bug in JDK version < 1.6.0_26. Contributed by Abhijit Suresh Shingate
new cb48bc1 MAPREDUCE-3007. Fixed Yarn Mapreduce client to be able to connect to JobHistoryServer in secure mode. Contributed by Vinod Kumar Vavilapalli.
new 376a1a2 HDFS-2333. Change DFSOutputStream back to package private, otherwise, there are two SC_START_IN_CTOR findbugs warnings.
new b9af522 HADOOP-7641. Add Apache License to template config files (Eric Yang via atm)
new e66d697 HADOOP-7635. RetryInvocationHandler should release underlying resources on close (atm)
new d9ba467 MAPREDUCE-2672. MR-279: JobHistory Server needs Analysis this job. (Robert Evans via mahadev)
new 6af0c27 Merge trunk into HA branch
new cde0e48 HDFS-2338. Add configuration option to enable/disable webhdfs. Contributed by jitendra
new 341a15a MAPREDUCE-2994. Fixed a bug in ApplicationID parsing that affects RM UI. Contributed by Devaraj K.
new 78e3821 HDFS-2318. Provide authentication to webhdfs using SPNEGO and delegation tokens.
new ff44372 Revised the entry for HDFS-2318 in CHANGES.txt.
new a89d460 HDFS-2337. DFSClient shouldn't keep multiple RPC proxy references (atm)
new 0d99429 HADOOP-7608. SnappyCodec check for Hadoop native lib is wrong. Contributed by Alejandro Abdelnur.
new 70a180d Merge trunk into HA branch
new ca333f1 MAPREDUCE-2836. Provide option to fail jobs when submitted to non-existent fair scheduler pools. Contributed by Ahmed Radwan.
new 9a11a3a HADOOP-7637. Fix to include FairScheduler configuration file in RPM. Contributed by Eric Yang.
new 2eab7a2 MAPREDUCE-2987. Fixed display of logged user on RM Web-UI. Contributed by Thomas Graves.
new 94096ff HADOOP-7633. Adds log4j.properties to the hadoop-conf dir on deploy. Contributed by Eric Yang.
new dafa8f7 HDFS-362. FSEditLog should not writes long and short as UTF8, and should not use ArrayWritable for writing non-array items. Contributed by Uma Maheswara Rao G
new e1acb12 MAPREDUCE-1788. o.a.h.mapreduce.Job shouldn't make a copy of the JobConf. (Arun Murthy via mahadev)
new 7985d39 HADOOP-7631. Fixes a config problem to do with running streaming jobs. Contributed by Eric Yang.
new 6190065 MAPREDUCE-3006. Fixed MapReduce AM to exit only after properly writing out history file. (vinodkv)
new 34d3936 MAPREDUCE-2965. Streamlined the methods hashCode(), equals(), compareTo() and toString() for all IDs. Contributed by Siddharth Seth.
new e56579b MAPREDUCE-2965. Fixed two FindBugs warnings in the previous commit.
new e34d2c0 HDFS-2330. In NNStorage and FSImagePreTransactionalStorageInspector, IOExceptions of stream closures can mask root exceptions. Contributed by Uma Maheswara Rao G
new 29552ee MAPREDUCE-2925. Fixed Yarn+MR client code to behave saner with completed jobs. Contributed by Devaraj K.
new 2e61ed3 MAPREDUCE-3030. Fixed a bug in NodeId.equals() that was causing RM to reject all NMs. Contributed by Devaraj K.
new b7660f2 MAPREDUCE-2726. Added job-file to the AM and JobHistoryServer web interfaces. Contributed by Jeffrey Naisbitt.
new 8ae3cde MAPREDUCE-3042. Fixed default ResourceTracker address. Contributed by Chris Riccomini.
new e16f8a9 MAPREDUCE-3038. job history server not starting because conf() missing HsController (Jeffrey Naisbitt via mahadev)
new 482d840 MAPREDUCE-3004. Fix ReduceTask to not assume 'local' mode in YARN. Contributed by Hitesh Shah.
new bbfd815 MAPREDUCE-3017. The Web UI shows FINISHED for killed/successful/failed jobs. (mahadev)
new 9d14f10 HDFS-2347. Fix checkpointTxnCount's comment about editlog size. Contributed by Uma Maheswara Rao G.
new f0fedda MAPREDUCE-3040. Fixed extra copy of Configuration in YarnClientProtocolProvider and ensured MiniMRYarnCluster sets JobHistory configuration for tests.
new c382e38 Merge trunk into HA branch
new e49ef2e HADOOP-7639. Enhance HttpServer to allow passing path-specs for filtering, so that servers like Yarn WebApp can get filtered the paths served by their own injected servlets. Contributed by Thomas Graves.
new adcebcb HADOOP-7630. hadoop-metrics2.properties should have a property *.period set to a default value for metrics. Contributed by Eric Yang.
new 8cd6eb6 HADOOP-7633. Missed this file in previous commit.
new b8e8b8d MAPREDUCE-3018. Fixed -file option for streaming. Contributed by Mahadev Konar.
new 339b85b MAPREDUCE-3036. Fixed metrics for reserved resources in CS. Contributed by Robert Evans.
new 1d067c6 MAPREDUCE-2998. Fixed a bug in TaskAttemptImpl which caused it to fork bin/mapred too many times. Contributed by Vinod K V.
new 0e870d7 MAPREDUCE-3023. Fixed clients to display queue state correctly. Contributed by Ravi Prakash.
new 4dc4e9e HDFS-2340. Support getFileBlockLocations and getDelegationToken in webhdfs.
new 7d8e9d6 HADOOP-7524 Change RPC to allow multiple protocols including multuple versions of the same protocol (sanjay Radia)
new 01fbb0f MAPREDUCE-2930. Added the ability to be able to generate graphs from the state-machine definitions. Contributed by Binglin Chang.
new af61f4a MAPREDUCE-2970. Fixed NPEs in corner cases with different configurations for mapreduce.framework.name. Contributed by Venu Gopala Rao.
new d50ecc3 HADOOP-7575. Enhanced LocalDirAllocator to support fully-qualified paths. Contributed by Jonathan Eagles.
new 83e4b2b HADOOP-7621. alfredo config should be in a file not readable by users (Alejandro Abdelnur via atm)
new d00b3c4 MAPREDUCE-2880. Improved classpath-construction for mapreduce AM and containers. Contributed by Arun C Murthy.
new 32f28e6 MAPREDUCE-3062. Fixed default RMAdmin address. Contributed by Chris Riccomini.
new ed7eda0 MAPREDUCE-3066. Fixed default ResourceTracker address for the NodeManager. Contributed by Chris Riccomini.
new 3557202 MAPREDUCE-3044. Pipes jobs stuck without making progress. (mahadev)
new f553ff0 MAPREDUCE-3048. Fixed test-patch to run tests via "mvn clean install test" (vinodkv)
new d773bf0 HDFS-46. Change default namespace quota of root directory from Integer.MAX_VALUE to Long.MAX_VALUE. Contributed by Uma Maheswara Rao G
new 4806d7b MAPREDUCE-2754. Fixed MR AM stdout, stderr and syslog to redirect to correct log-files. Contributed by Ravi Teja Ch N V.
new 1eb7008 MAPREDUCE-3073. Fixed build issues in MR1. Contributed by Mahadev Konar.
new 36d7ab3 HADOOP-7542. Change Configuration XML format to 1.1 to support for serializing additional characters Contributed by Christopher Egner.
new 516fc91 marking HADOOP-7542 as potentially incompatible
new 864630b HADOOP-7669 Fix newly introduced release audit warning.
new 2726398 Move the CHANGES.txt note for HADOOP-7542 to the right release section.
new b549c10 MAPREDUCE-3055. Simplified ApplicationAttemptId passing to ApplicationMaster via environment variable. (vinodkv)
new 7e0a224 Add "target" to svn:ignore for hadoop-common-project and hadoop-hdfs-project.
new 83a83d3 HDFS-2356. Support case insensitive query parameter names in webhdfs.
new 5a6f8e3 HDFS-2290. Block with corrupt replica is not getting replicated. Contributed by Benoy Antony.
new 029914a HADOOP-7457. Move to 0.22 branch section in CHANGES.txt
new e7b63ae HADOOP-7663. Fix TestHDFSTrash failure. Contributed by Mayank Bansal.
new d09ceac MAPREDUCE-2691. Increase threadpool size for launching containers in MapReduce ApplicationMaster. Contributed by Vinod K V.
new 5ace0ca MAPREDUCE-2990. Fixed display of NodeHealthStatus. Contributed by Subroto Sanyal.
new c285cf3 MAPREDUCE-3053. Better diagnostic message for unknown methods in ProtoBuf RPCs. Contributed by Vinod K V.
new a5c9ede MAPREDUCE-2952. Fixed ResourceManager/MR-client to consume diagnostics for AM failures in a couple of corner cases. Contributed by Arun C Murthy.
new 5a3040c MAPREDUCE-3064. 27 unit test failures with Invalid mapreduce.jobtracker.address configuration value for JobTracker: local (Venu Gopala Rao via mahadev)
new c9a7d3d MAPREDUCE-3090. Fix MR AM to use ApplicationAttemptId rather than (ApplicationId, startCount) consistently.
new 1e6dfa7 MAPREDUCE-2646. Fixed AMRMProtocol to return containers based on priority. Contributed by Sharad Agarwal and Arun C Murthy.
new eff931a MAPREDUCE-3031. Proper handling of killed containers to prevent stuck containers/AMs on an external kill signal. Contributed by Siddharth Seth.
new 8192639 MAPREDUCE-2984. Better error message for displaying completed containers. Contributed by Devaraj K.
new bf78f15 HDFS-2366. Initialize WebHdfsFileSystem.ugi in object construction.
new 70388cff MAPREDUCE-3071. app master configuration web UI link under the Job menu opens up application menu. (thomas graves via mahadev)
new 17da0bd MAPREDUCE-3067. Ensure exit-code is set correctly for containers. Contributed by Hitesh Shah.
new 6507a0b MAPREDUCE-3092. Removed a special comparator for JobIDs in JobHistory as JobIDs are already comparable. Contributed by Devaraj K.
new 87b969c MAPREDUCE-2999. Fix YARN webapp framework to properly filter servlet paths. Contributed by Thomas Graves.
new 98cc200 MAPREDUCE-3081. Fix vaidya startup script. Contributed by Suhas
new 359c170 MAPREDUCE-3095. fairscheduler ivy including wrong version for hdfs. (John George via mahadev)
new 0d2bb06 MAPREDUCE-3054. Unable to kill submitted jobs. (mahadev)
new 8e4c70f MAPREDUCE-3099. Add docs for setting up a single node MRv2 cluster. (mahadev)
new 201b787 HDFS-2373. Commands using webhdfs and hftp print unnecessary debug info on the console with security enabled. Contributed by Arpit Gupta.
new 5f6adcf MAPREDUCE-3021. Change base urls for RM web-ui. Contributed by Thomas Graves.
new eb3a692 HDFS-2332. Add test for HADOOP-7629 (using an immutable FsPermission object as an RPC parameter fails). Contributed by Todd Lipcon.
new d06916f MAPREDUCE-3021. Adding additional files needed for new web-ui.
new eda0ad4 MAPREDUCE-3041. Fixed ClientRMProtocol to provide min/max resource capabilities along-with new ApplicationId for application submission. Contributed by Hitesh Shah.
new 59265d6 HDFS-2368. Move SPNEGO conf properties from hdfs-default.xml to hdfs-site.xml.
new 825f9c8 HDFS-2361. hftp is broken, fixed username checks in JspHelper.
new cc42ccf MAPREDUCE-2843. Fixed the node-table to be completely displayed and making node entries on RM UI to be sortable. Contributed by Abhijit Suresh Shingate.
new 96f9fc9 HDFS-2363. Move datanodes size printing from FSNamesystem.metasave(..) to BlockManager. Contributed by Uma Maheswara Rao G
new f4a425e MAPREDUCE-3110. Fixed TestRPC failure. Contributed by Vinod Kumar Vavilapalli.
new 312a7e7 MAPREDUCE-3078. Ensure MapReduce AM reports progress correctly for displaying on the RM Web-UI. Contributed by Vinod K V.
new 59586d8 HADOOP-7662. Fixed logs servlet to use the pathspec '/*' instead of '/' for correct filtering. Contributed by Thomas Graves.
new 9799353 HADOOP-7668. Add a NetUtils method that can tell if an InetAddress belongs to local host. Contributed by Suresh Srinivas.
new 08db2a1 HDFS-2346. TestHost2NodesMap & TestReplicasMap will fail depending upon execution order of test methods (Laxman via atm)
new bfc830c HADOOP-7687 Make getProtocolSignature public (sanjay)
new 484649a Removing entry for CHANGES.txt since this was back-ported to 0.23.
new 05aeb2d HADOOP-7668 revert the System.out() calls
new c5179b1 HADOOP-6220
new e9dd78d HDFS-2355. Federation: enable using the same configuration file across all the nodes in the cluster. Contributed by Suresh Srinivas.
new 1221139 Merging trunk to HDFS-1623 branch.
new 9992cae Reverting the previous trunk merge since it added other unintended changes in addition
new ab0402b Merging trunk to HDFS-1623 branch
new e90a5b4 HDFS-2371. Refactor BlockSender.java for better readability. Contributed by Suresh Srinivas.
new 4409073 MAPREDUCE-3114. Fixed invalid ApplicationURL on RM WebUI. Contributed by Subroto Sanyal.
new 7188665 MAPREDUCE-3001. Added task-specific counters to AppMaster and JobHistory web-UIs. Contributed by Robert Joseph Evans.
new 47c8528 HADOOP-7693. Enhance AvroRpcEngine to support the new #addProtocol introduced in HADOOP-724.
new 7d1897d HADOOP-7693. Moving to 0.24 section for now.
new 1ae5b5e HDFS-2158. Add JournalSet to manage the set of journals.
new 0b3c654 MAPREDUCE-2791. Added missing info on 'job -status' output. Contributed by Devaraj K.
new 964d4a1 MAPREDUCE-2996. Add uber-ness information to JobHistory. Contributed by Jonathan Eagles.
new 063e33a MAPREDUCE-3098. Fixed RM and MR AM to report YarnApplicationState and application's FinalStatus separately. Contributed by Hitesh Shah.
new ebdc7f8 HADOOP-7469 Add a standard handler for socket connection problems
new 32431d2 HADOOP-7469 backporting to 0.23; moving in CHANGES.TXT
new f48280a HDFS-2298. Fix TestDfsOverAvroRpc by changing ClientProtocol to not include multiple methods of the same name.
new 960d764 MAPREDUCE-2779. JobSplitWriter.java can't handle large job.split file. Contributed by Ming Ma.
new dcf9d47 MAPREDUCE-3050. Add ability to get resource usage information for applications and nodes. Contributed by Robert Evans.
new fad230a MAPREDUCE-2719. Add a simple, DistributedShell, application to illustrate alternate frameworks on YARN. Contributed by Hitesh Shah.
new f3b98a2 MAPREDUCE-3113. Ensure bin/yarn and bin/yarn-daemon.sh identify the root of the install properly. Contributed by Xie Xianshan.
new dc8464f HDFS-2348. Support getContentSummary and getFileChecksum in webhdfs.
new 7aa8a3c MAPREDUCE-2889. Added documentation for writing new YARN applications. Contributed by Hitesh Shah.
new 4ee39ff HADOOP-7542. Reverting the patch to address issues.
new 43b59b8 MAPREDUCE-3134. Added documentation the CapacityScheduler.
new 93e0265 Fix CHANGES.txt to include complete subtask list for HDFS-1073.
new 12743d2 MAPREDUCE-2792. Replace usage of node ip-addresses with hostnames. Contributed by Vinod K V.
new de03173 HADOOP-7691. Fixed conflict uid for install packages. (Eric Yang)
new 2d45bfd HADOOP-7716 RPC protocol registration on SS does not log the protocol name
new abc2b45 HADOOP-7603. Set hdfs, mapred uid, and hadoop uid to fixed numbers. (Eric Yang)
new 62682a1 HADOOP-7658. Fixed HADOOP_SECURE_DN_USER environment variable in hadoop-evn.sh (Eric Yang)
new 4f97e37 MAPREDUCE-3138. Add a utility to help applications bridge changes in Context Objects APIs due to MAPREDUCE-954. Contributed by omalley.
new 3edf357 HADOOP-7684. Added init.d script for jobhistory server and secondary namenode. (Eric Yang)
new a48e6f2 MAPREDUCE-3112. Fixed recursive sourcing of HADOOP_OPTS environment variable. (Eric Yang)
new 5c4ed07 HADOOP-7715. Removed unnecessary security logger configuration. (Eric Yang)
new 97a6031 HADOOP-7685. Improved directory ownership check function in hadoop-setup-conf.sh. (Eric Yang)
new e979a3d MAPREDUCE-3056. Changed the default staging directory to not include user.name to prevent issues with non-secure mode. Contributed by Devaraj K.
new 266cb1d HADOOP-7711. Fixed recursive sourcing of HADOOP_OPTS environment variables (Arpit Gupta via Eric Yang)
new c9aed1f HADOOP-7681. Fixed security and hdfs audit log4j properties (Arpit Gupta via Eric Yang)
new b7c2431 HADOOP-7710. Added hadoop-setup-application.sh for creating application directory (Arpit Gupta via Eric Yang)
new cf4fade HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config files consistently. (Eric Yang)
new 496b4b9 HADOOP-7708. Fixed hadoop-setup-conf.sh to handle config file consistently. (Eric Yang)
new 4d81e96 HADOOP-7707. Added toggle for dfs.support.append, webhdfs and hadoop proxy user to setup config script. (Arpit Gupta via Eric Yang)
new a3df6dd HADOOP-7720. Added parameter for HBase user to setup config script. (Arpit Gupta via Eric Yang)
new ff9d7de Move MAPREDUCE-2531 changes to Release 0.22 section.
new 45e6fb0 MAPREDUCE-2950. [Gridmix] TestUserResolve fails in trunk. (Ravi Gummadi via amarrk)
new 1b1016b HDFS-2395. Add a root element in the JSON responses of webhdfs.
new 66137cf MAPREDUCE-3013. Removed YarnConfiguration.YARN_SECURITY_INFO and its usage as it doesn't affect security any more. (vinodkv)
new f24dcb3 MAPREDUCE-2907. Changed log level for various messages in ResourceManager from INFO to DEBUG. Contributed by Ravi Prakash.
new f29bfa0 MAPREDUCE-2702. Added a new API in OutputCommitter for recovering the outputs of tasks from a crashed job so as to support MR Application Master recovery. Contributed by Sharad Agarwal and Arun C Murthy.
new 9a4e890 MAPREDUCE-2738. Added the missing cluster level statisticss on the RM web UI. Contributed by Robert Joseph Evans.
new c90d7d6 HADOOP-7703. Improved excpetion handling of shutting down web server. (Devaraj K via Eric Yang)
new 9b6671d HADOOP-7704. Reduce number of object created by JMXJsonServlet. (Devaraj K via Eric Yang)
new 282e2e9 MAPREDUCE-2913. Fixed TestMRJobs.testFailingMapper to assert the correct TaskCompletionEventStatus. Contributed by Jonathan Eagles.
new 14569ab HADOOP-7717. Move handling of concurrent client fail-overs to RetryInvocationHandler (atm)
new 60dcc5f Merging trunk to HDFS-1623 branch.
new e95dfd8 HADOOP-7695. RPC.stopProxy can throw unintended exception while logging error (atm)
new 90727b8 HDFS-2407. getServerDefaults and getStats don't check operation category (atm)
new a2d7287 HDFS-2403. NamenodeWebHdfsMethods.generateDelegationToken(..) does not use the renewer parameter.
new 6f1d18b HDFS-2409. _HOST in dfs.web.authentication.kerberos.principal. Incorporates HDFS-2405 as well.
new a90f8fb HADOOP-7721. Add a log before login in KerberosAuthenticationHandler.
new e4db38b HDFS-2181 Separate HDFS Client wire protocol data types (sanjay)
new 9291197 HDFS-2294. Download of commons-daemon TAR should not be under target (tucu)
new 8b4f497 HDFS-1973. HA: HDFS clients must handle namenode failover and switch over to the new active namenode. (atm)
new 21cb78d HADOOP-7624. Set things up for a top level hadoop-tools module. (tucu)
new 77f79ee HADOOP-7724. Fixed hadoop-setup-conf.sh to put proxy user in core-site.xml. (Arpit Gupta via Eric Yang)
new c1c0e8c MAPREDUCE-3008. Improvements to cumulative CPU emulation for short running tasks in Gridmix. (amarrk)
new b8102db MAPREDUCE-2794. [MR-279] Incorrect metrics value for AvailableGB per queue per user. (John George via mahadev)
new a56f393 MAPREDUCE-2783. Fixing RM web-UI to show no tracking-URL when AM crashes. Contributed by Eric Payne.
new fa2529c MAPREDUCE-3141. Fix the broken MRAppMaster to work over YARN in security mode.(vinodkv)
new 639121c HADOOP-7727 fix some typos and tabs in CHANGES.TXT
new 02a8120 MAPREDUCE-2751. Modified NodeManager to stop leaving around local files after application finishes. Contributed by Siddharth Seth.
new aace6cb HDFS-2209. Make MiniDFS easier to embed in other apps.
new 2b157c6 HDFS-2322. the build fails in Windows because commons-daemon TAR cannot be fetched. (tucu)
new 02ce6b3 MAPREDUCE-3014. Rename and invert logic of '-cbuild' profile to 'native' and off by default. Contributed by Alejandro Abdelnur.
new 68d1162 MAPREDUCE-3003. Publish Yarn and MapReduce artifacts to Maven snapshot repository. (tucu)
new 54e8146 HDFS-2412. Add backwards-compatibility layer for renamed FSConstants class. Contributed by Todd Lipcon.
new 6b343ad MAPREDUCE-3033. Ensure Master interface pays attention to classic v/s yarn frameworks. Contributed by Hitesh Shah.
new 047b175 MAPREDUCE-2802. Ensure JobHistory filenames have jobId. Contributed by Jonathan Eagles.
new 0d1fe12 HADOOP-7627. Improve MetricsAsserts to give more understandable output on failure. Contributed by Todd Lipcon.
new 4972959 Reverted MAPREDUCE-3003
new 3ab2e79 HDFS-2209 datanode connection failure logging
new 4cf6bc4 HDFS-2414. Fix TestDFSRollback to avoid spurious failures. Contributed by Todd Lipcon.
new a09a2b4 Move MAPREDUCE-3138 changes to Release 0.22 section.
new 676f488 HDFS-2404. webhdfs liststatus json response is not correct. Contributed by Suresh Srinivas.
new 3ddb52c MAPREDUCE-2876. Use a different config for ContainerAllocationExpirer. Contributed by Anupam Seth.
new 4f1cdab MAPREDUCE-3153. Fix TestFileOutputCommitter which was broken by MAPREDUCE-2702. Contributed by Mahadev Konar.
new 811a6a9 MAPREDUCE-3123. Fix NM to quote symlink names to escape special characters. Contributed by Hitesh Shah.
new d0016c6 MAPREDUCE-3154. Fix JobSubmitter to check for output specs before copying job submission files to fail fast. Contributed by Abhijit Suresh Shingate.
new a8190ce MAPREDUCE-2988. Reenabled TestLinuxContainerExecutor reflecting the current NodeManager code. Contributed by Robert Joseph Evans.
new 42e9382 MAPREDUCE-3158. Fix test failures in MRv1 due to default framework being set to yarn. Contributed by Hitesh Shah.
new f527f98 HDFS-2422. The NN should tolerate the same number of low-resource volumes as failed volumes (atm)
new 11b9dd4 MAPREDUCE-3161. Improved some javadocs and fixed some typos in YARN. Contributed by Todd Lipcon.
new 5a249b7 MAPREDUCE-3167. container-executor is not being packaged with the assembly target. (mahadev)
new 7d5434c MAPREDUCE-3020. Fixed TaskAttemptImpl to log the correct node-address for a finished Reduce task. Contributed by Chackaravarthy.
new 1c358b0 MAPREDUCE-2668. Fixed AuxServices to send a signal on application-finish to all the services. Contributed by Thomas Graves.
new b8f0836 MAPREDUCE-3126. Fixed a corner case in CapacityScheduler where headroom wasn't updated on changes to cluster size.
new ac64df8 MAPREDUCE-3148. Ported MAPREDUCE-2702 to old mapred api for aiding task recovery.
new f00198b HDFS-2301. Start/stop appropriate namenode services when transition to active and standby states. Contributed by Suresh Srinivas.
new 3f998db HADOOP-7642. create hadoop-dist module where TAR stitching would happen. Contributed by Thomas White.
new eba49b8 HADOOP-6490. Use StringUtils over String#replace in Path#normalizePath. Contributed by Uma Maheswara Rao G.
new 532872b HDFS-2349. Corruption detected during block transfers should log WARNs.
new 68328e2 HADOOP-7736. Remove duplicate Path#normalizePath call.
new 85588e5 MAPREDUCE-3140. Fixed the invalid JobHistory URL for failed applications. Contributed by Subroto Sanyal.
new 0a96e88 Move the HADOOP-6490 Changes note to the right section. Accidentally placed it under Bugs in r1182189.
new c3792b4 Move line for HDFS-2422 under 0.23 instead of 0.24.
new d6546fc MAPREDUCE-3125. Modified TaskImpl to consider only non-failed, non-killed task-attempts for obtaining task's progress. Contributed by Hitesh Shah.
new efb3cd6 MAPREDUCE-3157. [Rumen] Fix TraceBuilder to handle 0.20 history file names also.
new f143895 MAPREDUCE-3166. [Rumen] Make Rumen use job history api instead of relying on current history file name format.
new 327e02f MAPREDUCE-3171. normalize nodemanager native code compilation with common/hdfs native. (tucu)
new 277e520 MAPREDUCE-2666. Retrieve shuffle port number from JobHistory on MR AM restart. Contributed by Jonathan Eagles.
new 26d63ec MAPREDUCE-2789. Complete schedulingInfo on CLI. Contributed by Eric Payne.
new 7ca7832 HDFS-2231. Configuration changes for HA namenode. Contributed by Suresh Srinivas.
new 3e6d128 HADOOP-7509. Improve exception message thrown when Authentication is required. Contributed by Ravi Prakash.
new d15e607 HADOOP-7664. Remove warmings when overriding final parameter configuration if the override value is same as the final parameter value. Contributed by Ravi Prakash.
new 4f5932f Add svn:ignore for target directories
new 5a71f00 HADOOP-7709. Running a set of methods in a Single Test Class. (Jonathan Eagles via mahadev)
new 6b6f02c MAPREDUCE-3133. Running a set of methods in a Single Test Class. (Jonathan Eagles via mahadev)
new e123a37 HDFS-2401. Running a set of methods in a Single Test Class. (Jonathan Eagles via mahadev)
new e9544ef HADOOP-7737. normalize hadoop-mapreduce & hadoop-dist dist/tar build with common/hdfs (tucu)
new 7d1a507 HDFS-2441. Remove the Content-Type set by HttpServer.QuotingInputFilter in webhdfs responses.
new 5904e00 HDFS-2428. Convert com.sun.jersey.api.ParamException$QueryParamException to IllegalArgumentException and response it http BAD_REQUEST in webhdfs.
new 0c77d70 HADOOP-7545. Fix wrong variable name in exception message introduced in HADOOP-7509. Contributed by Ravi Prakash.
new 3790f31 HADOOP-7743. Add Maven profile to create a full source tarball. (tucu)
new 59df2d4 MAPREDUCE-3183. hadoop-assemblies/src/main/resources/assemblies/hadoop-mapreduce-dist.xml missing license header. (Hitesh Shah via tucu).
new c46dbed HDFS-2424. Added a root element "HdfsFileStatuses" for the response of webhdfs listStatus.
new c7fb49b MAPREDUCE-3170. Fixed job output commit for deep hierarchies. Contributed by Hitesh Shah.
new 002dd69 MAPREDUCE-2764. Fix renewal of dfs delegation tokens. Contributed by Owen.
new 09eb725 MAPREDUCE-3124. Fixed location of native libs i.e. libhadoop.so for containers. Contributed by John George.
new 65861ab HADOOP-7705
new 068556b Fix the jira number from HADOOP-7545 to HADOOP-7745.
new 4cb7a48 HDFS-2012. Balancer incorrectly treats nodes whose utilization equals avgUtilization. Contributed by Uma Maheswara Rao G.
new a11f67f HADOOP-7729. Send back valid HTTP response if user hits IPC port with HTTP GET. Contributed by Todd Lipcon.
new 57f99c2 MAPREDUCE-3192. Fix Javadoc warning in JobClient.java and Cluster.java.
new 5f9eab4 HADOOP-7655. Provide a small validation script that smoke tests the installed cluster. Contributed by Arpit Gupta.
new b3284c4 MAPREDUCE-3059. QueueMetrics do not have metrics for aggregate containers-allocated and aggregate containers-released. (Devaraj K via mahadev)
new b5e21e7 MAPREDUCE-3057. Job History Server goes of OutOfMemory with 1200 Jobs and Heap Size set to 10 GB. (Eric Payne via mahadev)
new 50cb277 HDFS-2439. Fix NullPointerException in webhdfs when opening a non-existing file or creating a file without specifying the replication parameter.
new 68328ae MAPREDUCE-3187. Add names for various unnamed threads in MR2. (Todd Lipcon and Siddharth Seth via mahadev)
new 94b3bf9 MAPREDUCE-2840. mr279 TestUberAM.testSleepJob test fails. (jonathan eagles via mahadev)
new 4872615 MAPREDUCE-3190. Ensure bin/yarn fails early with a clear error message when HADOOP_COMMON_HOME or HADOOP_HDFS_HOME are not set. Contributed by todd & acmurthy.
new 86e1c95 MAPREDUCE-3136. Added documentation for setting up Hadoop clusters in both non-secure and secure mode for both HDFS & YARN.
new 29f65be MAPREDUCE-3189. Add link decoration back to MR2's CSS. (Todd Lipcon via mahadev)
new bc6220c MAPREDUCE-3136. Added the missing link to index.html.
new 6b2f3dd MAPREDUCE-3101. Changed default value of yarn.resourcemanager.acl.enable to true and added some more documentation.
new 9f36bdd MAPREDUCE-3127. Fixed CHANGES.txt to reflect correct jira.
new a26b167 MAPREDUCE-3032. Fixed TaskAttemptImpl so that JobHistory can have error information about failed tasks. Contributed by Devaraj K.
new 15a1d9a MAPREDUCE-3003. Publish MR JARs to Maven snapshot repository. (tucu)
new 8d48423 HDFS-2188. Make FSEditLog create its journals from a list of URIs rather than NNStorage. Contributed by Ivan Kelly.
new ab7e7df Merged r1185354 from trunk for HDFS-2188.
new 955d8ec MAPREDUCE-3196. TestLinuxContainerExecutorWithMocks fails on Mac OSX. (Arun Murthy via mahadev)
new c1d9077 MAPREDUCE-3068. Added a whitelist of environment variables for containers from the NodeManager and set MALLOC_ARENA_MAX for all daemons and containers. Contributed by Chris Riccomini.
new 9ff7c1b MAPREDUCE-3197. TestMRClientService failing on building clean checkout of branch 0.23 (mahadev)
new bb00ab6 MAPREDUCE-279. Adding a changelog to branch-0.23.
new 073a13a HDFS-2467. HftpFileSystem uses incorrect compare for finding delegation tokens. (omalley)
new 51a667b MAPREDUCE-2762. Cleanup MR staging directory on completion. Contributed by Mahadev Konar.
new ab787f4 MAPREDUCE-3165. Ensure logging options are set correctly for MR AM and tasks. Contributed by Todd Lipcon.
new b4d20c7 MAPREDUCE-3203. Fix some javac warnings in MRAppMaster. (mahadev)
new d0a301e HADOOP-7755. Detect MapReduce PreCommit Trunk builds silently failing when running test-patch.sh. Contributed by Jonathan Eagles
new 3e3abcb MAPREDUCE-3199. Fixed pom files to include correct log4j configuration for tests. (vinodkv)
new 13e4562 MAPREDUCE-3144. Augmented JobHistory with the information needed for serving aggregated logs. Contributed by Siddharth Seth.
new e3bb120 MAPREDUCE-3162. Separated application-init and container-init event types in NodeManager's Application state machine. Contributed by Todd Lipcon.
new 94e1703 MAPREDUCE-3176. Fixed ant mapreduce tests that are timing out because of wrong framework name. Contributed by Hitesh Shah.
new 9473b2e MAPREDUCE-3181. Fixed MapReduce runtime to load yarn-default.xml and yarn-site.xml.
new e549ac9 MAPREDUCE-2788. Normalize resource requests in FifoScheduler appropriately. Contributed by Ahmed Radwan.
new 2edd042 HDFS-2474. Make GlobFilter class public. (tucu)
new 01d408d Reverted HDFS-2474
new 0bd8f0b HDFS-2453. Fix http response code for partial content in webhdfs, added getDefaultBlockSize() and getDefaultReplication() in WebHdfsFileSystem and cleared content type in ExceptionHandler.
new ba66ca6 MAPREDUCE-3149. Add a test to verify that TokenCache handles file system uri with no authority. Contributed by John George.
new 74748ec62 MAPREDUCE-2693. Fix NPE in job-blacklisting. Contributed by Hitesh Shah.
new 7ca7fda MAPREDUCE-3208. Fix NPE task/container log appenders. Contributed by liangzhwa.
new 7a2744c MAPREDUCE-3212. Fix usage/help message for bin/yarn. Contributed by Bhallamudi Venkata Siva Kamesh.
new b91900b HADOOP-7744. Ensure failed tests exit with proper error code. Contributed by Jonathan Eagles.
new a6cc9ba HDFS-2445. Ensure failed tests exit with proper error code. Contributed by Jonathan Eagles.
new fc362b1 MAPREDUCE-3179. Ensure failed tests exit with right error code. Contributed by Jonathan Eagles.
new aeae1ba MAPREDUCE-3188. Ensure correct shutdown in services. Contributed by Todd Lipcon.
new 3713784 Merging change r1186579 for HDFS-2471 from 0.23 branch
new df2991c MAPREDUCE-3104. Implemented Application-acls. (vinodkv)
new 520d250 HDFS-2459. Separate datatypes for Journal Protocol. (suresh)
new 0cbcc12 HADOOP-7758. Make GlobFilter class public. (tucu)
new 49baada MAPREDUCE-3204. mvn site:site fails on MapReduce. (tucu)
new 6cd5a1b HADOOP-7749. Add a NetUtils createSocketAddr call which provides more help in exception messages. Contributed by Todd Lipcon.
new 02d5fa3 MAPREDUCE-3226. Fix shutdown of fetcher threads. Contributed by Vinod K V.
new 7c48130 HDFS-2427. Change the default permission in webhdfs to 755 and add range check/validation for all parameters.
new 5945a05 MAPREDUCE-2629. Workaround a JVM class loading quirk which prevents JIT compilation of inner classes methods in ReduceContextImpl. Contributed by Eric Caspole.
new 45b2bce MAPREDUCE-3163. JobClient spews errors when killing MR2 job. (mahadev)
new 89e7ca6 MAPREDUCE-3070. Fix NodeManager to use ephemeral ports by default. Contributed by Devaraj K.
new d2e1a71 HDFS-2480. Separate datatypes for NamenodeProtocol. Contributed by Suresh Srinivas.
new 4186121 MAPREDUCE-3239. Use new createSocketAddr API in MRv2 to give better error messages on misconfig (Todd Lipcon via mahadev)
new 49ab924 HADOOP-7564. Remove test-patch SVN externals
new e175574 MAPREDUCE-3242. Trunk compilation broken with bad interaction from MAPREDUCE-3070 and MAPREDUCE-3239. (mahadev)
new 5795fcf MAPREDUCE-3058. Fixed MR YarnChild to report failure when task throws an error and thus prevent a hanging task and job. (vinodkv)
new 665a90c MAPREDUCE-3087. Fixed the mapreduce classpath to correctly include the generated-classpath file needed for tests. Contributed by Ravi Prakash.
new 977d7cc MAPREDUCE-3233. Fixed a bug in MR Job so as to be able to restart the application on AM crash. Contributed by Mahadev Konar.
new 7dd869c HDFS-2491. TestBalancer can fail when datanode utilization and avgUtilization is exactly same. Contributed by Uma Maheswara Rao G.
new 2690d0d HDFS-2485
new a54ccc0 HDFS-2485
new 6e09917 HDFS-2452. OutOfMemoryError in DataXceiverServer takes down the DataNode. Contributed by Uma Maheswara Rao.
new 4086566 MAPREDUCE-2708. Designed and implemented MR Application Master recovery to make MR AMs resume their progress after restart. Contributed by Sharad Agarwal.
new 7ce1c4a MAPREDUCE-2747. Cleaned up LinuxContainerExecutor binary sources and changed the configuration to use yarn names. Contributed by Robert Joseph Evans.
new 2b35e8a HDFS-2489. Move Finalize and Register to separate file out of DatanodeCommand.java. Contributed by Suresh Srinivas.
new 8fe95d2 Added missing files for HDFS-2489 commit.
new 0920056 HDFS-2481 Unknown protocol: org.apache.hadoop.hdfs.protocol.ClientProtocol (sanjay)
new 6288dfa MAPREDUCE-3028. Added job-end notification support. Contributed by Ravi Prakash.
new a503755 MAPREDUCE-3249. Ensure shuffle-port is correctly used duringMR AM recovery. Contributed by Vinod K V.
new 43553df MAPREDUCE-3252. Fix map tasks to not rewrite data an extra time when map output fits in spill buffer. Contributed by Todd Lipcon.
new 4846ca7 HDFS-2497 Fix TestBackupNode failure. Contributed by Suresh Srinivas.
new 6217e54 MAPREDUCE-3159. Ensure DefaultContainerExecutor doesn't delete application directories during app-init. Contributed by Todd Lipcon.
new c70ee24 MAPREDUCE-3248. Fixed log4j properties. Contributed by Vinod K V.
new bccfd6a Amend MAPREDUCE-3159. Fix JavaDoc warnings in previous commit.
new a268a3c HDFS-2488. Separate datatypes for InterDatanodeProtocol. Contributed by Suresh Srinivas.
new d19cfe0 MAPREDUCE-2746. Yarn servers can't communicate with each other with hadoop.security.authorization set to true (acmurthy via mahadev)
new fffdf66 MAPREDUCE-2821. Added missing fields (resourcePerMap & resourcePerReduce) to JobSummary logs. Contributed by Mahadev Konar.
new 2486e4e MAPREDUCE-3253. Fixed ContextFactory to clone JobContext correctly.
new 029d86e HADOOP-7769. TestJMXJsonServlet is failing.
new 7dcef36 MAPREDUCE-3263. Fixed the MAPREDUCE-3028 commit which broke MR1. Contributed by Hitesh Shah.
new 0365998 MAPREDUCE-3269. Fixed log4j properties to correctly set logging options for JobHistoryServer vis-a-vis JobSummary logs. Contributed by Mahadev Konar.
new 29c6c3e MAPREDUCE-2977. Fix ResourceManager to renew HDFS delegation tokens for applications.
new 2adc51c MAPREDUCE-3250. When AM restarts, client keeps reconnecting to the new AM and prints a lots of logs. (vinodkv via mahadev)
new 8335995 HDFS-2501. Add version prefix and root methods to webhdfs.
new 8aabd3d MAPREDUCE-2858. Added a WebApp Proxy for applications. Contributed by Robert Evans.
new 46676b3 HADOOP-7764. Allow HttpServer to set both ACL list and path spec filters. Contributed by Jonathan Eagles.
new 8534e70 HDFS-2411. The auth to local mappings are not respected with webhdfs and security enabled.
new 2ce817a HADOOP-7766. The auth to local mappings are not being respected, with webhdfs and security enabled.
new 7581943 HDFS-2494. Close the streams and DFSClient in DatanodeWebHdfsMethods. Contributed by Uma Maheswara Rao G
new 753c14c Move webhdfs entries from trunk to 0.23 in CHANGES.txt.
new 2371549 MAPREDUCE-3205. Fix memory specifications to be physical rather than virtual, allowing for a ratio between the two to be configurable. Contributed by Todd Lipcon.
new 10dc6b0 HDFS-1869. mkdirs should use the supplied permission for all of the created directories. Contributed by Daryn Sharp
new e51c3a1 HADOOP-7768. PreCommit-HADOOP-Build is failing on hadoop-auth-examples
new 3e4efbb MAPREDUCE-3254. Fixed streaming to set the job.jar by using the right JobConf ctor.
new 0e75187 HADOOP-7761. Improve the performance of raw comparisons. Contributed by Todd Lipcon.
new 33dc657 MAPREDUCE-3264. mapreduce.job.user.name needs to be set automatically. (acmurthy via mahadev)
new 5fadd4d MAPREDUCE-3175. Add authorization to admin web-pages such as /stacks, /jmx etc. Contributed by Jonathan Eagles.
new db8ac0e MAPREDUCE-3257. Added authorization checks for the protocol between ResourceManager and ApplicatoinMaster. Contributed by Vinod K V.
new fc74b5a MAPREDUCE-3259. Added java.library.path of NodeManager to ContainerLocalizer in LinuxContainerExecutor. Contributed by Kihwal Lee.
new f799e61 MAPREDUCE-3279. Fixed TestJobHistoryParsing which assumed user name to be mapred all the time. Contributed by Siddharth Seth.
new 2fe343f MAPREDUCE-3240. Fixed NodeManager to be able to forcefully cleanup its containers (process-trees) irrespective of whether the container succeeded, or killed. Contributed by Hitesh Shah.
new f114dad MAPREDUCE-2986. Fixed MiniYARNCluster to support multiple NodeManagers. Contributed by Anupam Seth.
new 1b8511e MAPREDUCE-3281. Fixed a bug in TestLinuxContainerExecutorWithMocks. (vinodkv)
new a3c0a0e HADOOP-7772
new 724f217 MAPREDUCE-3228. Fixed MR AM to timeout RPCs to bad NodeManagers. Contributed by Vinod K V.
new 456ca74 HDFS-2496. Separate datatypes for DatanodeProtocol. Contributed by Suresh Srinivas.
new 48339ba HADOOP-7762. Common side of MR-2736. Contributed by Eli Collins
new 1ad8415 MAPREDUCE-2736. Remove unused contrib components dependent on MR1. Contributed by Eli Collins
new b9f6890 MAPREDUCE-3281. Fixed one more bug due to which TestLinuxContainerExecutorWithMocks was failing. (vinodkv)
new 072ef95 HADOOP-7728. Enable task memory management to be configurable in hadoop config setup script. (ramya)
new ebb6cc6 HDFS-2507. Allow saveNamespace operations to be canceled. Contributed by Todd Lipcon.
new 646e855 HDFS-2507. Allow saveNamespace operations to be canceled. Contributed by Todd Lipcon.
new 78336e7 HADOOP-7753. Support fadvise and sync_file_range in NativeIO. Add ReadaheadPool infrastructure for use in HDFS and MR. Contributed by Todd Lipcon.
new 221aadb HDFS-2500. Avoid file system operations in BPOfferService thread while processing deletes. Contributed by Todd Lipcon.
new 8cb0d4b HDFS-2432. Webhdfs: response FORBIDDEN when setReplication on non-files; clear umask before creating a flie; throw IllegalArgumentException if setOwner with both owner and group empty; throw FileNotFoundException if getFileStatus on non-existing files; fix bugs in getBlockLocations; and changed getFileChecksum json response root to "FileChecksum".
new 180646d HDFS-2418. Change ConfiguredFailoverProxyProvider to take advantage of HDFS-2231. (atm)
new 739acd6 MAPREDUCE-3284. Moved JobQueueClient to hadoop-mapreduce-client-core.
new efb2d93 HDFS-2393. Mark appropriate methods of ClientProtocol with the idempotent annotation. (atm)
new 101962e HADOOP-7778. FindBugs warning in Token.getKind().
new 659ea4c HADOOP-7360. Preserve relative paths that do not contain globs in FsShell. Contributed by Daryn Sharp and Kihwal Lee
new 35b62e6 MAPREDUCE-3282. bin/mapred job -list throws exception. (acmurthy via mahadev)
new b304062 MAPREDUCE-3186. User jobs are getting hanged if the Resource manager process goes down and comes up while job is getting executed. (Eric Payne via mahadev)
new 4a98639 Move HDFS-2355, HDFS-2371 and HDFS-2298 entries from trunk to 0.23 in CHANGES.txt.
new b49c95a HDFS-2479 HDFS Client Data Types in Protocol Buffers (sanjay)
new caf0789 MAPREDUCE-2736. Resurrecting bin/mapred and bin/mapred-config.sh.
new 3cccbc9 MAPREDUCE-2736. Removing bin/(start,stop)-mapred.sh
new 037964f Move HADOOP-7668, HADOOP-7509, HADOOP-7745, MAPREDUCE-2764, HADOOP-7766 and HADOOP-7721 entries from trunk to 0.23 in CHANGES.txt.
new 29b51cc HADOOP-7424. Log an error if the topology script doesn't handle multiple args. Contributed by Uma Maheswara Rao G
new 9b34900 MAPREDUCE-3209. Jenkins reports 160 FindBugs warnings (mahadev)
new 34e6de8 MAPREDUCE-3258. Fixed AM & JobHistory web-ui to display counters properly. Contributed by Siddharth Seth.
new 69dd284 MAPREDUCE-3290. Fixed a NPE in ClientRMService.
new 062876b MAPREDUCE-3185. RM Web UI does not sort the columns in some cases. (Jonathan Eagles via mahadev)
new 47c28ce MAPREDUCE-3292. In secure mode job submission fails with Provider org.apache.hadoop.mapreduce.security.token.JobTokenIndentifier not found. (mahadev)
new 670fa24 MAPREDUCE-2989. Modified JobHistory to link to task and AM logs from the JobHistoryServer. Contributed by Siddharth Seth.
new a39992e MAPREDUCE-3296. Fixed the remaining nine FindBugs warnings. (vinodkv)
new da1db28 HADOOP-7740. Fixed security audit logger configuration. (Arpit Gupta via Eric Yang)
new cbdb07f MAPREDUCE-2775. Fixed ResourceManager and NodeManager to force a decommissioned node to shutdown. Contributed by Devaraj K.
new 9692cfc HDFS-2493. Remove reference to FSNamesystem in blockmanagement classes.
new b93abdc MAPREDUCE-3304. Fixed intermittent test failure due to a race in TestRMContainerAllocator#testBlackListedNodes. Contributed by Ravi Prakash.
new c1e333f MAPREDUCE-3306. Fixed a bug in NodeManager ApplicationImpl that was causing NodeManager to crash. (vinodkv)
new dbe1e4d HADOOP-7770. ViewFS getFileChecksum throws FileNotFoundException for files in /tmp and /user. Contributed by Ravi Prakash.
new b4992f6 HADOOP-7774. HA: Administrative CLI to control HA daemons. Contributed by Todd Lipcon.
new 1bcff68 Adding missing CHANGES.txt entry for MAPREDUCE-3014
new 55d3dc5 HADOOP-7773. Add support for protocol buffer based RPC engine. Contributed by Suresh Srinivas.
new c0c938f HDFS-2499. RPC client is created incorrectly introduced in HDFS-2459. Contributed by Suresh Srinivas.
new 6b0963c HDFS-2465. Add HDFS support for fadvise readahead and drop-behind. Contributed by Todd Lipcon.
new 5839aa0 HADOOP-7446. Implement CRC32C native code using SSE4.2 instructions. Contributed by Kihwal Lee and Todd Lipcon.
new c8ac31e HDFS-2509. Add a test for DistributedFileSystem.getFileChecksum(..) on directories or non existing files. Contributed by Uma Maheswara Rao G
new cd77a16 HADOOP-7763. Add top-level navigation to APT docs.
new 2dcd43c HDFS-2436. Change FSNamesystem.setTimes(..) for allowing setting times on directories. Contributed by Uma Maheswara Rao G
new 7f4dc27 MAPREDUCE-3256. Added authorization checks for the protocol between NodeManager and ApplicationMaster. Contributed by Vinod K V.
new 2eca601 Revert 1190677 for HDFS-2509.
new 64c019c HDFS-2285. BackupNode should reject requests to modify namespace. Contributed by Konstantin Shvachko and Uma Maheswara Rao G.
new 1c8d64f MAPREDUCE-3274. Fixed a race condition in MRAppMaster that was causing a task-scheduling deadlock. Contributed by Robert Joseph Evans.
new 273e092 MAPREDUCE-3313. Fixed initialization of ClusterMetrics which was failing TestResourceTrackerService sometimes. Contributed by Hitesh Shah.
new 85fce90 Adding executable svn prop on mock-container-executor.
new 5f9e67e MAPREDUCE-2766. Fixed NM to set secure permissions for files and directories in distributed-cache. Contributed by Hitesh Shah.
new 47a381e MAPREDUCE-3146. Added a MR specific command line to dump logs for a given TaskAttemptID. Contributed by Siddharth Seth.
new a75c4cf MAPREDUCE-2696. Fixed NodeManager to cleanup logs in a thread when logs' aggregation is not enabled. Contributed by Siddharth Seth.
new 21b1e1d MAPREDUCE-3262. Fixed Container's state-machine in NodeManager to handle a couple of events in failure states correctly. Contributed by Hitesh Shah and Siddharth Seth.
new 7e05601 MAPREDUCE-3241. [Rumen] Fix Rumen to ignore the AMStartedEvent. (amarrk)
new 9db0782 MAPREDUCE-3035. Fixed MR JobHistory to ensure rack information is present. Contributed by chakravarthy.
new b3f90c7 MAPREDUCE-3275. Added documentation for AM WebApp Proxy. Contributed by Robert Evans.
new 7cb77a3 HDFS-2334. Add Closeable to JournalManager. Contributed by Ivan Kelly.
new 32cad9a HDFS-2385. Support renew and cancel delegation tokens in webhdfs.
new c468769 HDFS-2512. Add textual error message to data transfer protocol responses. Contributed by Todd Lipcon.
new 8d1a09b HDFS-2065. Add null checks in DFSClient.getFileChecksum(..). Contributed by Uma Maheswara Rao G
new 5f7e991 MAPREDUCE-3321. Disabled a few MR tests for 0.23. Contributed by Hitesh Shah.
new b451dd7 MAPREDUCE-3220. Fixed TestCombineOutputCollector. Contributed by Devaraj K.
new 3ab2959 HDFS-2523. Small NN fixes to include HAServiceProtocol and prevent NPE on shutdown. Contributed by Todd Lipcon.
new bb8fd6a TestHDFSCLI is failing due to HADOOP-7360. HDFS-2038 is going to fix it. Disable it for the moment.
new 8f9661d HADOOP-7771. FsShell -copyToLocal, -get, etc. commands throw NPE if the destination directory does not exist. Contributed by John George and Daryn Sharp
new 68fa208 MAPREDUCE-3103. Implement Job ACLs for MRAppMaster. (mahadev)
new d36f847 MAPREDUCE-3322. Added a better index.html and an brief overview of YARN architecture.
new e5badc0 Fixing CHANGES.txt to reflect 0.23 content.
new cfb6a98 MAPREDUCE-3237. Move LocalJobRunner to hadoop-mapreduce-client-core. Contributed by Tom White.
new 68dfbff MAPREDUCE-3316. Rebooted link is not working properly. (Bhallamudi Venkata Siva Kamesh via mahadev)
new adf58e7 MAPREDUCE-3317. Rumen TraceBuilder is emiting null as hostname. (Ravi Gummadi via mahadev)
new 8e04fa8 HADOOP-7782. Aggregate project javadocs.
new 1c94063 HDFS-2521. Remove custom checksum headers from data transfer protocol. Contributed by Todd Lipcon.
new a6c110e HADOOP-7785. Add equals, hashcode, toString to DataChecksum. Contributed by Todd Lipcon.
new a3a4ccf Preparing for release 0.23.0.
new 22000ce HDFS-2002. Incorrect computation of needed blocks in getTurnOffTip(). Contributed by Plamen Jeliazkov.
new 4e42044 Preparing for release 0.23.0.
new 1112a50 HADOOP-7789. Improvements to site navigation.
new 4961441 HDFS-2308. NamenodeProtocol.endCheckpoint is vestigial and can be removed. Contributed by Eli Collins
new 877021e HADOOP-7786. Remove HDFS-specific config keys defined in FsConfig. Contributed by Eli Collins
new 1852c2c Remove FsConfig as intended in HADOOP-7786.
new abe45f5 HDFS-2526. (Client)NamenodeProtocolTranslatorR23 do not need to keep a reference to rpcProxyWithoutRetry (atm)
new eee85ad HADOOP-7789. Minor edits to add CHANGES.txt and yarn-default.xml to the site.
new bb35bff MAPREDUCE-3332. contrib/raid compile breaks due to changes in hdfs/protocol/datatransfer/Sender#writeBlock related to checksum handling (Hitesh Shah via mahadev)
new cd2a553 HADOOP-7792. Common component for HDFS-2416: Add verifyToken method to AbstractDelegationTokenSecretManager.
new e161ab0 Add transient file to svn:ignore in hadoop-mapreduce-project
new 0732100 HADOOP-7789. Fixed site to include yarn-default.xml.
new 3ad6024 HADOOP-7789. Fixed site to include yarn-default.xml.
new bd21ddc HDFS-2416. distcp with a webhdfs uri on a secure cluster fails.
new 571d799 Merge trunk into HA branch
new a4baabe HDFS-2477. Optimize computing the diff between a block report and the namenode state. Contributed by Tomasz Nykiel.
new 201a18d MAPREDUCE-3139. SlivePartitioner generates negative partitions.
new f84552a HDFS-2130. Switch default checksum to CRC32C. Contributed by Todd Lipcon.
new 11cf658 HDFS-2533. Remove needless synchronization on some FSDataSet methods. Contributed by Todd Lipcon.
new fd8c757 Add new section to HDFS CHANGES.txt for 0.23.1. Moved two things that were recently committed post-0.23.0 to this new section.
new 59c0b31 HADOOP-7789. Add support gpg signatures for maven release artifacts. Contributed by Doug Cutting.
new c7b1d6f HADOOP-7798. Fixed jira number in CHANGES.txt.
new 5d5e2df HADOOP-7797. Fix top-level pom.xml to refer to correct staging maven repository. Contributed by Owen O'Malley.
new 40fe965 HDFS-2129. Simplify BlockReader to not inherit from FSInputChecker. Contributed by Todd Lipcon.
new 0df4878 MAPREDUCE-3337. Added missing license headers.
new c27601f MAPREDUCE-3297. Moved log related components into yarn-common so that HistoryServer and clients can use them without depending on the yarn-server-nodemanager module. Contributed by Siddharth Seth.
new aa297b1 MAPREDUCE-3221. Reneabled the previously ignored test in TestSubmitJob and fixed bugs in it. Contributed by Devaraj K.
new dae055b MAPREDUCE-3215. Reneabled and fixed bugs in the failing test TestNoJobSetupCleanup. Contributed by Hitesh Shah.
new 6afe3e0 HDFS-2527. WebHdfs: remove the use of "Range" header in Open; use ugi username if renewer parameter is null in GetDelegationToken; response OK when setting replication for non-files; rename GETFILEBLOCKLOCATIONS to GET_BLOCK_LOCATIONS and state that it is a private unstable API; replace isDirectory and isSymlink with enum {FILE, DIRECTORY, SYMLINK} in HdfsFileStatus JSON object.
new 08cb4cf MAPREDUCE-3219. Reenabled and fixed bugs in the failing test TestDelegationToken. Contributed by Hitesh Shah.
new 0b5a482 MAPREDUCE-3217. Reenabled and fixed bugs in the failing ant test TestAuditLogger. Contributed by Devaraj K.
new db13c99 Add the missing test file to HDFS-2477.
new 072bdd8 HADOOP-7776 Make the Ipc-Header in a RPC-Payload an explicit header (sanjay)
new 6733a1c MAPREDUCE-3291. App fail to launch due to delegation token not found in cache (Robert Evans via mahadev)
new a590b49 HDFS-2528. Webhdfs: set delegation kind to WEBHDFS and add a HDFS token when http requests are redirected to datanode.
new 9a6da79 MAPREDUCE-3344. o.a.h.mapreduce.Reducer since 0.21 blindly casts to ReduceContext.ValueIterator. Contributed by Brock Noland.
new 00b5aa7 Update CHANGES.txt for commit 1198910.
new a83753b HADOOP-7688. Add servlet handler check in HttpServer.start(). Contributed by Uma Maheswara Rao G
new 6dff932 HDFS-2495. Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lock. Contributed by Tomasz Nykiel.
new cb7f819 HADOOP-7801. HADOOP_PREFIX cannot be overriden. Contributed by Bruno Mahé.
new 6749d13 [Rumen] LoggedTaskAttempt#getHostName() returns null. (amarrk)
new 9fe9f42 MAPREDUCE-3342. Fixed JobHistoryServer to also show the job's queue name. Contributed by Jonathan Eagles.
new 80cc8e9 MAPREDUCE-3345. Fixed a race condition in ResourceManager that was causing TestContainerManagerSecurity to fail sometimes. Contributed by Hitesh Shah.
new 94c631a HDFS-2540. Webhdfs: change "Expect: 100-continue" to two-step write; change "HdfsFileStatus" and "localName" respectively to "FileStatus" and "pathSuffix" in JSON response.
new cec9f82 MAPREDUCE-2733. [Gridmix] Gridmix3 cpu emulation system tests. (Vinay Thota via amarrk)
new 3853d11 MAPREDUCE-3336. Replaced guice internal.Preconditions api usage with the public Preconditions API. Contributed by Thomas Graves.
new 2df83e5 MAPREDUCE-3333. Fixed bugs in ContainerLauncher of MR AppMaster due to which per-container connections to NodeManager were lingering long enough to hit the ulimits on number of processes. (vinodkv)
new 15150cd MAPREDUCE-3280. Removed the unnecessary job user-name configuration in mapred-site.xml. (vinodkv)
new 200bb27 MAPREDUCE-3392. Fixed Cluster's getDelegationToken's API to return null when there isn't a supported token. Contributed by John George.
new 09a156f HDFS-2539. Support doAs and GETHOMEDIRECTORY in webhdfs.
new dbc82db MAPREDUCE-3379. Fixed LocalResourceTracker in NodeManager to remove deleted cache entries correctly. Contributed by Siddharth Seth.
new 9c17410 MAPREDUCE-3370. Fixed MiniMRYarnCluster and related tests to not use a hard-coded path for the mr-app jar. Contributed by Ahmed Radwan.
new 27c9b88 MAPREDUCE-3370. More changes accidentally missed from the previous commit.
new 3cedc5f HADOOP-7813. Fix test-patch to use proper numerical comparison when checking javadoc and findbugs warning counts. Contributed by Jonathan Eagles.
new ac320f5 MAPREDUCE-3324. Not All HttpServer tools links (stacks,logs,config,metrics) are accessible through all UI servers (Jonathan Eagles via mahadev)
new 503593a MAPREDUCE-3325. Improvements to CapacityScheduler doc. (Thomas Graves via mahadev)
new 58bfa24 MAPREDUCE-3341. Enhance logging of initalized queue limit values. (Anupam Seth via mahadev)
new 4cdcf7b MAPREDUCE-3243. Invalid tracking URL for streaming jobs (Jonathan Eagles via mahadev)
new 51ce383 HDFS-2532. Add timeout to TestDfsOverAvroRpc
new 9a3f147 HDFS-2476. More CPU efficient data structure for under-replicated, over-replicated, and invalidated blocks. Contributed by Tomasz Nykiel.
new 116b91c MAPREDUCE-3375. [Gridmix] Memory Emulation system tests. (Vinay Thota via amarrk)
new 3491205 MAPREDUCE-3331. Improvement to single node cluster setup documentation for 0.23 (Anupam Seth via mahadev)
new 0d171f6 Merge trunk into HA branch
new c56e051 MAPREDUCE-3102. Changed NodeManager to fail fast when LinuxContainerExecutor has wrong configuration or permissions. Contributed by Hitesh Shah.
new 6490801 HADOOP-7811. TestUserGroupInformation#testGetServerSideGroups test fails in chroot. (Jonathan Eagles via mahadev)
new 00b50a5 MAPREDUCE-3355. Fixed MR AM's ContainerLauncher to handle node-command timeouts correctly. (vinodkv)
new 9d7402e MAPREDUCE-3407. Fixed pom files to refer to the correct MR app-jar needed by the integration tests. Contributed by Hitesh Shah.
new 61f7739 Merge trunk into HA branch.
new 6c710f5 Merge trunk into HA branch.
new 302e3df MAPREDUCE-3169. Create a new MiniMRCluster equivalent which only provides client APIs cross MR1 and MR2. (Ahmed via tucu)
new ed45ad0 MAPREDUCE-3415. improve MiniMRYarnCluster & DistributedShell JAR resolution (tucu)
new 7edfff5 HADOOP-7787. Make source tarball use conventional name. Contributed by Bruno Mahé
new 0864ef1 HDFS-2560. Refactor BPOfferService to be a static inner class. Contributed by Todd Lipcon.
new 41cfb68 HADOOP-7802. Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. Contributed by Bruno Mahé
new dc5a0ab HDFS-2544. Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. Contributed by Bruno Mahé
new bd2e2aa MAPREDUCE-3373. Hadoop scripts unconditionally source "$bin"/../libexec/hadoop-config.sh. Contributed by Bruno Mahé
new 6a01c22 HDFS-2543. HADOOP_PREFIX cannot be overridden. Contributed by Bruno Mahé.
new bd0fbbb MAPREDUCE-3372. HADOOP_PREFIX cannot be overridden. Contributed by Bruno Mahé.
new 905a127 HDFS-2562. Refactor DN configuration variables out of DataNode class. Contributed by Todd Lipcon.
new 67c3729 Merge trunk into HA branch.
new 2644722 HADOOP-7590. Mavenize streaming and MR examples. (tucu)
new 1f92266 HDFS-2563. Some cleanup in BPOfferService. Contributed by Todd Lipcon.
new b7cd8c0 HDFS-2564. Cleanup unnecessary exceptions thrown and unnecessary casts. Contributed by Hari Mankude
new 7a8015c HDFS-2541. For a sufficiently large value of blocks, the DN Scanner may request a random number with a negative seed value. Contributed by Harsh J
new 84f0c0f HDFS-2502. hdfs-default.xml should include dfs.name.dir.restore. Contributed by Harsh J
new 0e5c1a4 HDFS-208. name node should warn if only one dir is listed in dfs.name.dir. Contributed by Uma Maheswara Rao G
new b231302 HDFS-2536. Remove unused imports. Contributed by Harsh J
new 513718f HDFS-2568. Use a set to manage child sockets in XceiverServer. Contributed by Harsh J
new 8e8bb50 HDFS-2454. Move maxXceiverCount check to before starting the thread in dataXceiver. Contributed by Harsh J
new 8686a00 HDFS-2570. Add descriptions for dfs.*.https.address in hdfs-default.xml. Contributed by Eli Collins
new 5573b69 HDFS-2567. When 0 DNs are available, show a proper error when trying to browse DFS via web UI. Contributed by Harsh J
new 67f25b0 HDFS-2572. Remove Unnecessary double-check in DN#getHostName (harsh)
new 796d308 HADOOP-7841. Run tests with non-secure random. Contributed by Todd Lipcon.
new 896b28e HADOOP-7833. Fix findbugs warnings in protobuf generated code. Contributed by John Lee.
new 5bc66c4 HDFS-2532. TestDfsOverAvroRpc timing out in trunk. Contributed by Uma Maheswara Rao G.
new 9c2f4f6 HDFS-2514. Link resolution bug for intermediate symlinks with relative targets. Contributed by Eli Collins
new 5760d03 Revert accidental change in previous commit.
new d4306d4 HADOOP-7783. Add more symlink tests that cover intermediate links. Contributed by Eli Collins
new eec2782 HADOOP-6614. RunJar should provide more diags when it can't create a temp file. Contributed by Jonathan Hsieh
new 54ac7e5 HDFS-2517. Add protobuf service for JounralProtocol. Contributed by Suresh Srinivas.
new 63edb9d MAPREDUCE-3434. Nightly build broken (Hitesh Shah via mahadev)
new 68173af HDFS-2575. DFSTestUtil may create empty files. Contributed by Todd Lipcon.
new 39ce694 HDFS-2566. Move BPOfferService to be a non-inner class. Contributed by Todd Lipcon.
new 6ee82ee MAPREDUCE-3447. mapreduce examples not working (mahadev)
new 38fea39 MAPREDUCE-3444. trunk/0.23 builds broken (Hitesh Shah via mahadev)
new 4754b80 HDFS-2518. Add protobuf service for NamenodeProtocol. Contributed by Suresh Srinivas.
new b76b859 HDFS-2520. Add protobuf service for InterDatanodeProtocol. Contributed by Suresh Srinivas.
new 5293760 HDFS-2410. Further cleanup of hardcoded configuration keys and values. Contributed by Suresh Srinivas.
new a2e6677 HDFS-2573. TestFiDataXceiverServer is failing, not testing OOME. Contributed by Konstantin Boudnik.
new 2ab10e2 HDFS-2246. Enable reading a block directly from local file system for a client on the same node as the block file. Contributed by Andrew Purtell, Suresh Srinivas and Jitendra Nath Pandey
new 6a06719 Merge trunk into HDFS-1623 branch
new 4941759 HDFS-2519. Add protobuf service for DatanodeProtocol. Contributed by Suresh Srinivas.
new e21c2ff MAPREDUCE-3412. Fix 'ant docs'. (amarrk)
new fac80b8 MAPREDUCE-3454. [Gridmix] TestDistCacheEmulation is broken (Hitesh Shah MAPREDUCE-3454. via mahadev)
new 7381884 HDFS-2552. Add Forrest doc for WebHDFS REST API.
new 2e3f531 MAPREDUCE-3408. yarn-daemon.sh unconditionnaly sets yarn.root.logger (Bruno Mahe via mahadev)
new 865cd32 MAPREDUCE-3411. Performance Upgrade for jQuery (Jonathan Eagles via mahadev)
new 41b1e3f MAPREDUCE-3329. Fixed CapacityScheduler to ensure maximum-capacity cannot be lesser than capacity for any queue.
new db092f5 HADOOP-7827 HDFS-2588 MAPREDUCE-3464. jsp pages missing DOCTYPE. Contributed by Dave Vronay.
new d3a5147 HDFS-2587. Add apt doc for WebHDFS REST API.
new f17ed54 MAPREDUCE-3265. Removed debug logs during job submission to LOG.debug to cut down noise.
new 5f5b3bb HDFS-2577. NN fails to start since it tries to start secret manager in safemode. Contributed by Todd Lipcon.
new e3c6965 HADOOP-7358. Improve log levels when exceptions caught in RPC handler. Contributed by Todd Lipcon.
new 080a341 HADOOP-7861. changes2html.pl generates links to HADOOP, HDFS, and MAPREDUCE jiras. Contributed by Konstantin Shvachko.
new 4b65d10 HDFS-2590. Fix the missing links in the WebHDFS forrest doc.
new 783dbb4 HADOOP-7777 a base class for DNSToSwitchMapping implementations
new 2d0f5e9 insert NEW-FEATURES section onto trunk
new 6558066 HADOOP-7777 changes.txt
new cb5c6c9 HADOOP-7859. TestViewFsHdfs.testgetFileLinkStatus is failing an assert. Contributed by Eli Collins
new 229a3a2 HADOOP-7858. Drop some info logging to DEBUG level in IPC, metrics, and HTTP. Contributed by Todd Lipcon
new 64b5a70 MAPREDUCE-3371. Review and improve the yarn-api javadocs. (Ravi Prakash via mahadev)
new 7f0f8cb MAPREDUCE-3238. Small cleanup in SchedulerApp. (Todd Lipcon via mahadev)
new cc4a468 MAPREDUCE-3413. RM web ui applications not sorted in any order by default. (Jonathan Eagles via mahadev)
new e9c2307 HDFS-2316. Record completion of umbrella jira. Contributed by Tsz Wo (Nicholas), Sze.
new 73b3de6 Merge trunk into HA branch.
new 91a75ad Fix WebHDFS capitalization in CHANGES.txt.
new 18d9942 HADOOP-7863: apply HADOOP-7424 to 0.23.1
new 3c602e0 Apply HADOOP-7777 to 0.23.1
new 49c4411 Fix typo in HDFS-993 commit. Was -933.
new b32543d HDFS-2596. TestDirectoryScanner doesn't test parallel scans. (eli)
new 32935d3 Fix CHANGES.txt for HDFS-2346 in trunk.
new 82da8fb Fix CHANGES.txt. Some changes have been committed under 0.21.1 section rather than 0.22.0.
new 3083d7d Fix CHANGES.txt. Moving changes from 0.21.1 section to 0.22.0.
new 68f56ca HDFS-2287. Fix second assert.
new 784a4a3 MAPREDUCE-3045. Fixed UI filters to not filter on hidden title-numeric sort fields. Contributed by Jonathan Eagles
new 9146ad2 HDFS-2582. Scope dfs.ha.namenodes config by nameservice. Contributed by Todd Lipcon.
new be9c46a MAPREDUCE-3433. Finding counters by legacy group name returns empty counters.
new ee97365 Merge trunk into HA branch.
new ea17da8 MAPREDUCE-3121. NodeManager should handle disk-failures (Ravi Gummadi via mahadev)
new 03e8ec7 MAPREDUCE-3448. TestCombineOutputCollector javac unchecked warning on mocked generics (Jonathan Eagles via mahadev)
new 0398a9e HDFS-2604. Add a log message to show if WebHDFS is enabled and a configuration section in the forrest doc.
new 65681d5 HADOOP-7804. Enable hadoop config generator to set configurations to enable short circuit read. Contributed by Arpit Gupta.
new 670fa87 HADOOP-7864. Building mvn site with Maven < 3.0.2 causes OOM errors. Contributed by Andrew Bayer
new afbc3aa HDFS-2606. webhdfs client filesystem impl must set the content-type header for create/append. (tucu)
new bb91ebb HDFS-2591. MiniDFSCluster support to mix and match federation with HA. Contributed by Todd Lipcon.
new 68ff73c Ammend HDFS-2570 to shorten description.
new 94bf0da MAPREDUCE-3450. NM port info no longer available in JobHistory. (Siddharth Seth via mahadev)
new 0eec221 Merge trunk into HA branch.
new d8930fe HADOOP-7853. multiple javax security configurations cause conflicts. (daryn via tucu)
new ff9bae6 MAREDUCE-3477. Hadoop site documentation cannot be built anymore. (jeagles via tucu)
new e2a78da MAPREDUCE-3488. Streaming jobs are failing because the main class isnt set in the pom files. (mahadev)
new f87a4b4 HDFS-1975. Support for sharing the namenode state from active to standby. Contributed by Jitendra Nath Pandey, Aaron T Myers, and Todd Lipcon.
new 1e346aa HDFS-1971. Send block report from datanode to both active and standby namenodes. (sanjay, todd via suresh)
new efc83da HADOOP-7854. UGI getCurrentUser is not synchronized. Contributed by Daryn Sharp.
new f5cffab HDFS-2614. hadoop dist tarball is missing hdfs headers. (tucu)
new 8dbb523 HDFS-2616. Change DatanodeProtocol#sendHeartbeat() to return HeartbeatResponse. (suresh)
new 08da8ea MAPREDUCE-3463. Second AM fails to recover properly when first AM is killed with java.lang.IllegalArgumentException causing lost job. (Siddharth Seth via mahadev)
new 6a9624d MAPREDUCE-3452. fifoscheduler web ui page always shows 0% used for the queue (Jonathan Eagles via mahadev)
new 2033b52 Merge trunk into HA branch.
new 4cbead8 HDFS-2622. Fix TestDFSUpgrade in HA branch. Contributed by Todd Lipcon.
new 102541b MAPREDUCE-3443. JobClient and Job should function in the context of the UGI which created them. (Contributed by Mahadev Konar)
new 449554f MAPREDUCE-3169 amendment. Deprecate MiniMRCluster. Contributed by Ahmed Radwan)
new 6b55500 HADOOP-7877. Update balancer CLI usage documentation to include the new -policy option.
new f4fa767 HDFS-2612. Handle refreshNameNodes in federated HA clusters. Contributed by Todd Lipcon.
new 28dbd56 HDFS-2623. Add test case for hot standby capability. Contributed by Todd Lipcon.
new 714ae6e MAPREDUCE-3369. Migrate MR1 tests to run on MR2 using the new interfaces introduced in MAPREDUCE-3169. Contributed by Ahmed Radwan.
new c5777e0 HADOOP-7874. native libs should be under lib/native/ dir. (tucu)
new 74b1f06 Amend HDFS-2616 to fix mocking in TestBPOfferService
new a3f37e1 MAPREDUCE-3460. MR AM can hang if containers are allocated on a node blacklisted by the AM. (Contributed by Hitesh Shah and Robert Joseph Evans)
new 6b2cbe1 MAPREDUCE-3453. RM web ui application details page shows RM cluster about information. (Contributed by Jonathan Eagles)
new 72e9ec7 MAPREDUCE-3479. JobClient#getJob cannot find local jobs.
new f7eda5a MAPREDUCE-3500. MRJobConfig creates an LD_LIBRARY_PATH using the platform ARCH. (tucu)
new bb2b8f5 MAPREDUCE-3456. /bin/yarn should set defaults for *_HOME (Eric Payne via mahadev)
new 1972a76 MAPREDUCE-3458. Fix findbugs warnings in hadoop-examples. (Devaraj K via mahadev)
new e948247 MAPREDUCE-3485. DISKS_FAILED -101 error code should be defined in same location as ABORTED_CONTAINER_EXIT_STATUS. (Ravi Gummadi via mahadev)
new 6520099 HADOOP-7862 Move the support for multiple protocols to lower layer so that Writable, PB and Avro can all use it (includes HDFS and MR changes to match) (Sanjay)
new 560c894 HADOOP-7875. Add helper class to unwrap protobuf ServiceException. Contributed by Suresh Srinivas.
new 0acc00b HADOOP-7876. Provided access to encoded key in DelegationKey for use in protobuf based RPCs. Contributed by Suresh Srinivas.
new b3f28db HDFS-2626. BPOfferService.verifyAndSetNamespaceInfo needs to be synchronized. Contributed by Todd Lipcon.
new c7f5167 HDFS-2624. ConfiguredFailoverProxyProvider doesn't correctly stop ProtocolTranslators. Contributed by Todd Lipcon.
new ad7fe4e HDFS-2625. TestDfsOverAvroRpc failing after introduction of HeartbeatResponse type. Contributed by Todd Lipcon.
new 8a4db4d Merge trunk into HA branch.
new 6a358ee MAPREDUCE-3389. MRApps loads the 'mrapp-generated-classpath' file with classpath from the build machine. (tucu)
new d18e5b3 HDFS-1580. Add interface for generic Write Ahead Logging mechanisms. Contributed by Ivan Kelly.
new 6491444 Fix to previous trunk merge - RPC's addProtocol method now needs an RpcKind
new c256f82 HDFS-2581. Implement protobuf service for JournalProtocol. Contributed Suresh Srinivas.
new f39aac6 Merge trunk into branch.
new 0a71303 HDFS-2618. Implement protobuf service for NamenodeProtocol. Contributed by Suresh Srinivas.
new a555990 MAPREDUCE-3496. Fixed client to print queue acls in consistent order. Contributed by Jonathan Eagles.
new 8c0f2a0 HDFS-2618. Fix for the build failure caused by previous commit.
new b981daa HDFS-1580. Committing the test case, it was missed in earlier commit.
new 788f28b HADOOP-7886. Add toString to FileStatus. Contributed by SreeHari.
new 7a59150 HDFS-2629. Implement protobuf service for InterDatanodeProtocol. Contributed by Suresh Srinivas.
new ec87e16 MAPREDUCE-3147. Handle leaf queues with the same name properly. (Ravi Prakash via mahadev)
new c17bb83 HDFS-2636. Implement protobuf service for ClientDatanodeProtocol. Contributed by Suresh Srinivas.
new a27adf3 HDFS-2430. The number of failed or low-resource volumes the NN can tolerate should be configurable. Contributed by Aaron T. Myers
new 58361d3 HADOOP-7887. KerberosAuthenticatorHandler is not setting KerberosName name rules from configuration. (tucu)
new d9690b0 HADOOP-7888. TestFailoverProxy fails intermittently on trunk. Contributed by Jason Lowe.
new 6016e95 HDFS-2627. Determine DN's view of which NN is active based on heartbeat responses. Contributed by Todd Lipcon.
new d9ea5bb Merge trunk into HA branch.
new 9f69ae5 HDFS-2597 ClientNameNodeProtocol in Protocol Buffers (sanjay)
new 4283ac6 HADOOP-7897. ProtobufRpcEngine client side exception mechanism is not consistent with WritableRpcEngine. Contributed by Suresh Srinivas.
new 8cd80b3 HADOOP-7898. Fix javadoc warnings in AuthenticationToken.java. Contributed by Suresh Srinivas.
new 3334306 HDFS-2178. Contributing Hoop to HDFS, replacement for HDFS proxy with read/write capabilities. (tucu)
new dec5260 HADOOP-6840. Support non-recursive create() in FileSystem and SequenceFile.Writer. Contributed by Jitendra and Eli
new 2deaca4 HADOOP-6886. LocalFileSystem Needs createNonRecursive API. Contributed by Nicolas Spiegelberg and Eli Collins
new 7584901 HADOOP-7870. fix SequenceFile#createWriter with boolean createParent arg to respect createParent. Contributed by Jon Hsieh
new 2481474 HDFS-2634. Standby needs to ingest latest edit logs before transitioning to active. Contributed by Todd Lipcon.
new 224fc10 MAPREDUCE-3327. RM web ui scheduler link doesn't show correct max value for queues (Anupam Seth via mahadev)
new 066cddb MAPREDUCE-3513. Capacity Scheduler web UI has a spelling mistake for Memory. (chackaravarthy via mahadev)
new 82d57ee HADOOP-7851. Configuration.getClasses() never returns the default value. (amarrk)
new b4afbe6 Added Uma's name to the CHANGES.txt file for HADOOP-7851.
new 9b1f472 HDFS-2594. Support getDelegationTokens and createSymlink in WebHDFS.
new 66fce20 HADOOP-7902. skipping name rules setting (if already set) should be done on UGI initialization only. (tucu)
new 38a19bc HDFS-2642. Protobuf translators for DatanodeProtocol.
new e7682e1 HDFS-2511. Add dev script to generate HDFS protobufs. (tucu)
new ad7d537 HADOOP-7899. Generate proto java files as part of the build. (tucu)
new b0d3781 MAPREDUCE-3519. Fixed a deadlock in NodeManager LocalDirectories's handling service. Contributed by Ravi Gummadi.
new 604f99e Fixup changelog for HADOOP-7898
new 2740112 HDFS-2647. Used protobuf based RPC for InterDatanodeProtocol, ClientDatanodeProtocol, JournalProtocol, NamenodeProtocol. Contributed by Suresh Srinivas.
new 2c1ee1d Preparing for release 0.22.0
new 48da033 HDFS-2651 ClientNameNodeProtocol Translators for Protocol Buffers (sanjay)
new 3128c78 JDiff output for release 0.22.0
new 0f70398 HADOOP-7878 Regression: HADOOP-7777 switch changes break HDFS tests when the isSingleSwitch() predicate is used
new 6571d39 MAPREDUCE-3527. Fix minor API incompatibilities between 1.0 and 0.23.
new 89379bc Merge trunk into HA branch.
new 7c2a8c7 Merge trunk into HA branch.
new 6fc7e2e HADOOP-7912. test-patch should run eclipse:eclipse to verify that it does not break again. Contributed by Robert Joseph Evans
new 14e6f1e MAPREDUCE-3518. mapred queue -info <queue> -showJobs throws NPE. (Jonathan Eagles via mahadev)
new 9b75b05 MAPREDUCE-3328. mapred queue -list output inconsistent and missing child queues. (Ravi Prakash via mahadev)
new e52291e MAPREDUCE-3510. Capacity Scheduler inherited ACLs not displayed by mapred queue -showacls (Jonathan Eagles via mahadev)
new 13345f3 HDFS-2663. Handle protobuf optional parameters correctly. Contributed by Suresh Srinivas.
new 43100e9 HDFS-1765. Block Replication should respect under-replication block priority. Contributed by Uma Maheswara Rao G
new 2892b05 Put HDFS-1765 in the right place in the changelog.
new f611e1d MAPREDUCE-3537. Fix race condition in DefaultContainerExecutor which led to container localization occuring in wrong directories.
new 197634f HDFS-2653. DFSClient should cache whether addrs are non-local when short-circuiting is enabled. Contributed by Eli Collins
new 5f39d6c HDFS-2654. Make BlockReaderLocal not extend RemoteBlockReader2. Contributed by Eli Collins
new c3f7c1f Add missing file to previous commit.
new 40cc6fc HADOOP-7914. Remove the duplicated declaration of hadoop-hdfs test-jar in hadoop-project/pom.xml.
new 186df14 HADOOP-7913 Fix bug in ProtoBufRpcEngine (sanjay)
new eae3a91 Add .classpath, .externalToolBuilders, .launches, .project and .settings to svn:ignore of hadoop-mapreduce-project/hadoop-mapreduce-examples.
new 4ec8424 HDFS-2666. Fix TestBackupNode failure. Contributed by Suresh Srinivas.
new f2f4e93 HDFS-2650. Replace @inheritDoc with @Override. Contributed by Hari Mankude.
new a0fe4f4 Merge trunk into HA branch.
new 0201be4 HADOOP-7810. move hadoop archive to core from tools. (tucu)
new 74c9166 HADOOP-7810. move hadoop archive to core from tools [missing file from original commit]. (tucu)
new fac14e7 HADOOP-7892. IPC logs too verbose after "RpcKind" introduction. Contributed by Todd Lipcon.
new 37b8cc3 MAPREDUCE-3542. Support "FileSystemCounter" legacy counter group name for compatibility.
new 0ea8570 MAPREDUCE-2863. Support web services for YARN and MR components. (Thomas Graves via vinodkv)
new 3001a17 Reverting r1213512 because it committed changes that were not part of the patch.
new b5229fd HDFS-2663. Optional protobuf parameters are not handled correctly. Contributed by Suresh Srinivas.
new 1f2f4e1 HDFS-234. Integration with BookKeeper logging system. Contributed by Ivan Kelly.
new 6a609cb Reverting the patch r1213981
new 3954a2f HDFS-2663. Optional protobuf parameters are not handled correctly. Contributed by Suresh Srinivas.
new b7ae5a6 MAPREDUCE-3426. Fixed MR AM in uber mode to write map intermediate outputs in the correct directory to work properly in secure mode. Contributed by Hitesh Shah.
new a839f87 MAPREDUCE-3544. gridmix build is broken, requires hadoop-archives to be added as ivy dependency. (tucu)
new 433a6e7 HDFS-2545. Change WebHDFS to support multiple namenodes in federation.
new 3cffe34 HDFS-2661. Enable protobuf RPC for DatanodeProtocol.
new bdc2a77 HDFS-2649. eclipse:eclipse build fails for hadoop-hdfs-httpfs. Contributed by Jason Lowe
new ec4971a MAPREDUCE-3545. Remove Avro RPC. Contributed by Suresh Srinivas.
new 9818091a HADOOP-7896. HA: if both NNs are in Standby mode, client needs to try failing back and forth several times with sleeps. Contributed by Aaron T. Myers
new 9cf3e08 HADOOP-7922. Improve some logging for client IPC failovers and StandbyExceptions. Contributed by Todd Lipcon.
new d5a658e HADOOP-7921. StandbyException should extend IOException. Contributed by Todd Lipcon.
new b9238e3 HDFS-2675. Reduce warning verbosity when double-closing edit logs. Contributed by Todd Lipcon.
new 60dd76c HDFS-2676. Remove Avro RPC. Contributed by Suresh Srinivas.
new 95bdb29 r1214102 should have removed the file. Committing this to remove empty file.
new f7f5e51 Missed deleting the files in r1214066
new d9c9fb9 HADOOP-7920. Remove Avro Rpc. Contributed by Suresh Srinivas.
new 7e8accd HDFS-2671. NN should throw StandbyException in response to RPCs in STANDBY state. Contributed by Todd Lipcon.
new d8dfcdc HDFS-2669 Enable protobuf rpc for ClientNamenodeProtocol
new 2e6c75a MAPREDUCE-3557. MR1 test fail to compile because of missing hadoop-archives dependency. (tucu)
new 739f887 MAPREDUCE-3541. Fix broken TestJobQueueClient test. (Ravi Prakash via mahadev)
new 50fa9b8 MAPREDUCE-3398. Fixed log aggregation to work correctly in secure mode. Contributed by Siddharth Seth.
new c32ca00 MAPREDUCE-3530. Fixed an NPE occuring during scheduling in the ResourceManager. Contributed by Arun C Murthy.
new 6c2da4b HDFS-2680. DFSClient should construct failover proxy with exponential backoff. Contributed by Todd Lipcon.
new 3758710 HADOOP-7920. Remove a few more bits that are no longer required.
new 8134b1c Merge trunk into HA branch.
new ecdf9da Fix treatment of NNHAStatusHeartbeat in protobuffer.
new b77c107 Committing rest of merge from trunk (accidentally only committed the HDFS portion before)
new cfbde6a MAPREDUCE-3484. Fixed JobEndNotifier to not get interrupted before completing all its retries. Contributed by Ravi Prakash.
new afd0333 HDFS-2683. Authority-based lookup of proxy provider fails if path becomes canonicalized. Contributed by Todd Lipcon.
new 14ba2e6 MAPREDUCE-3531. Fixed a race in ContainerTokenSecretManager. (Contributed by Robert Joseph Evans)
new beec374 MAPREDUCE-3251. Network ACLs can prevent some clients to talk to MR ApplicationMaster (Anupam Seth via mahadev)
new 227fb56 MAPREDUCE-3560. TestRMNodeTransitions is failing on trunk. (Siddharth Seth via mahadev)
new 6cf3a15 HADOOP_7917. compilation of protobuf files fails in windows/cygwin. (tucu)
new 558185a Add target directory to svn:ignore
new d937abd Merge trunk into HA branch.
new 353bc37 HDFS-2689. HA: BookKeeperEditLogInputStream doesn't implement isInProgress(). Contributed by Aaron T. Myers
new c2fe4a7 MAPREDUCE-3487. Fixed JobHistory web-UI to display links to single task's counters' page. Contributed by Jason Lowe.
new 116bf57 HADOOP-7928. HA: Client failover policy is incorrectly trying to fail over all IOExceptions. Contributed by Aaron T. Myers.
new f73bd54 MAPREDUCE-3564. Fixed failures in TestStagingCleanup and TestJobEndNotifier tests. Contributed by Siddharth Seth.
new c4ff892 MAPREDUCE-3422. Counter display names are not being picked up. Contributed by Jonathan Eagles)
new 71071b9 HDFS-2602. NN should log newly-allocated blocks without losing BlockInfo. Contributed by Aaron T. Myers
new cdb9f01 HDFS-2667. Fix transition from active to standby. Contributed by Todd Lipcon.
new 6d551b8 MAPREDUCE-3366. Mapreduce component should use consistent directory structure layout as HDFS/common (Eric Yang via mahadev)
new a238f93 MAPREDUCE-778. Rumen Anonymizer. (Amar Kamat and Chris Douglas via amarrk)
new 371f422 HDFS-2684. Fix up some failing unit tests on HA branch. Contributed by Todd Lipcon.
new feb3a23 MAPREDUCE-3387. Fixed AM's tracking URL to always go through the proxy, even before the job started, so that it works properly with oozie throughout the job execution. Contributed by Robert Joseph Evans.
new 9b7617a HDFS-2640. Javadoc generation hangs.
new 059290c HADOOP-7931. o.a.h.ipc.WritableRpcEngine should have a way to force initialization. Contributed by Aaron T. Myers
new 52c1491 HDFS-2694. Removal of Avro broke non-PB NN services. Contributed by Aaron T. Myers.
new 89553be HDFS-2687. Tests failing with ClassCastException post protobuf RPC changes. Contributed by Suresh Srinivas.
new 08c9dc3 Merge trunk into HA branch.
new 2cf4aca MAPREDUCE-3579. ConverterUtils shouldn't include a port in a path from a url without a port (Contributed by atm)
new 191b56d HADOOP-7657. Add support for LZ4 compression. Contributed by Binglin Chang.
new fa1edc9 HDFS-2700. Fix failing TestDataNodeMultipleRegistrations in trunk. Contributed by Uma Maheswara Rao G.
new a89baed HDFS-2553. Fix BlockPoolSliceScanner spinning in a tight loop. Contributed by Uma Maheswara Rao G.
new 5e18570 HDFS-2335. DataNodeCluster and NNStorage always pull fresh entropy. Contributed by Uma Maheswara Rao G
new 45e81ae HADOOP-7925. Add interface and update CLI to query current state to HAServiceProtocol. Contributed by Eli Collins.
new 3297172 HDFS-2679. Add interface to query current state to HAServiceProtocol. Contributed by Eli Collins.
new 625d1b3 HDFS-2677. Web UI should indicate the NN state. Contributed by Eli Collins.
new 8ff28f4 Merge trunk into HA branch.
new 35206c7 Merge trunk into HA branch.
new de928a4 HDFS-2658. HttpFS introduced 70 javadoc warnings. (tucu)
new dfba847 Amend HDFS-234 (bkjournal contrib). Fix findbugs build
new 08bde10 Merge trunk into HA branch to pick up fix for bkjournal findbugs
new 4bb0456 HDFS-2678. When a FailoverProxyProvider is used, DFSClient should not retry connection ten times before failing over. Contributed by Aaron T. Myers.
new 009dfed HADOOP-7932. Make client connection retries on socket time outs configurable. Contributed by Uma Maheswara Rao G.
new 57ef902 HDFS-2682. When a FailoverProxyProvider is used, Client should not retry for 45 times if it is timing out to connect to server. Contributed by Uma Maheswara Rao G.
new a61a18c MAPREDUCE-3563. Fixed LocalJobRunner to work correctly with new mapreduce apis.
new 3503d9a HDFS-2706. Use configuration for blockInvalidateLimit if it is set.
new f9b2197 HADOOP-7837. no NullAppender in the log4j config. Contributed by Eli Collins
new 96247ea MAPREDUCE-3376. Fixed Task to ensure it passes reporter to combiners using old MR api. Contributed by Subroto Sanyal.
new 4e1d5a0 MAPREDUCE-3391. Making a trivial change to correct a log message in DistributedShell app's AM. Contributed by Subroto Sanyal.
new e7543b9 MAPREDUCE-3339. Fixed MR AM to stop considering node blacklisting after the number of nodes blacklisted crosses a threshold. Contributed by Siddharth Seth.
new 8626f1b MAPREDUCE-3588. Fixed bin/yarn which was broken by MAPREDUCE-3366 so that yarn daemons can start. Contributed by Arun C Murthy.
new 45620ee HDFS-2646. Hadoop HttpFS introduced 4 findbug warnings. (tucu)
new 264d3b7 MAPREDUCE-3349. Log rack-name in JobHistory for unsuccessful tasks. (Devaraj K and Amar Kamat via amarrk)
new 8fe3dd3 HDFS-2657. TestHttpFSServer and TestServerWebApp are failing on trunk. (tucu)
new 36d1c49 HDFS-2693. Fix synchronization issues around state transition. Contributed by Todd Lipcon.
new 31c9170 HDFS-1972. Fencing mechanism for block invalidations and replications. Contributed by Todd Lipcon.
new 6b4f40c HttpFS server should check that upload requests have correct content-type. (tucu)
new 55ad017 HADOOP-7890. Redirect hadoop script's deprecation message to stderr. (Koji Knoguchi via mahadev)
new ef9b974 MAPREDUCE-3586. Modified CompositeService to avoid duplicate stop operations thereby solving race conditions in MR AM shutdown. (vinodkv)
new 8fa0a3c MAPREDUCE-3567. Extraneous JobConf objects in AM heap. Contributed by Vinod Kumar Vavilapalli)
new 1dcc4b5 MAPREDUCE-3597. [Rumen] Rumen should provide APIs to access all the job-history related information.
new ae0d488 HDFS-2707. HttpFS should read the hadoop-auth secret from a file instead inline from the configuration. (tucu)
new a500ba5 Merge trunk into HA branch.
new cd90b82 MAPREDUCE-3399. Modifying ContainerLocalizer to send a heartbeat to NM immediately after downloading a resource instead of always waiting for a second. Contributed by Siddarth Seth.
new fcbad14 MAPREDUCE-3568. Optimized Job's progress calculations in MR AM. (vinodkv)
new 9eb8757 HADOOP-7574. Improve FSShell -stat, add user/group elements (XieXianshan via harsh)
new a9ffbdd MAPREDUCE-2944. Improve checking of input for JobClient.displayTasks() (XieXianshan via harsh)
new 1e0c51c HADOOP-7348. Change 'addnl' in getmerge util to be a flag '-nl' instead (XieXianshan via harsh)
new 919f56c MAPREDUCE-3604. Fixed streaming to use new mapreduce.framework.name to check for local mode.
new d619dee Merge trunk into HA branch.
new 4173743 HDFS-2726. Fix a logging issue under DFSClient's createBlockOutputStream method (harsh)
new f025652 MAPREDUCE-3547. Added a bunch of unit tests for the the RM/NM webservices. Contributed by Thomas Graves.
new 7afb9ac MAPREDUCE-3521. Fixed streaming to ensure it doesn't silently ignore unknown arguments. Contributed by Robert Evans.
new 07027b8 HADOOP-7910. Add Configuration.getLongBytes to handle human readable byte size values. (Sho Shimauchi via harsh)
new 6c349f9 HDFS-2729. Update BlockManager's comments regarding the invalid block set (harsh)
new f216303 Merge trunk into HA branch.
new 743a5b7 MAPREDUCE-3522. Ensure queues inherit ACLs from parent if they aren't explicitly specified. Contributed by Jonathan Eagles.
new 15ebdd5 HDFS-2714. Fix test cases which use standalone FSNamesystems. Contributed by Todd Lipcon.
new 20a6560 HDFS-2692. Fix bugs related to failover from/into safe mode. Contributed by Todd Lipcon.
new 4ab6ae5 MAPREDUCE-3608. Fixed compile issue with MAPREDUCE-3522. Contributed by Mahadev Konar.
new 4d76814 Merge trunk into HA branch.
new 737df8b HDFS-2716. Configuration needs to allow different dfs.http.addresses for each HA NN. Contributed by Todd Lipcon.
new 1190551 HDFS-2574. Remove references to some deprecated properties in conf templates and defaults files. (Joe Crobak via harsh)
new 8e8203f HDFS-554. Use System.arraycopy in BlockInfo.ensureCapacity. (harsh)
new 36a2d57 HADOOP-7919. Remove the unused hadoop.logfile.* properties from the core-default.xml file. (harsh)
new 5f15c29 HADOOP-7504. Add the missing Ganglia31 opts to hadoop-metrics.properties as a comment. (harsh)
new 05ed36c HDFS-2722. HttpFs should not be using an int for block size. (harsh)
new 1423fff Merge trunk into HA branch.
new 7ee3e07 HADOOP-7933. Add a getDelegationTokens api to FileSystem which checks for known tokens in the passed Credentials object. (sseth)
new 4c0bac5 MAPREDUCE-3462. Fix Gridmix JUnit testcase failures. (Ravi Prakash and Ravi Gummadi via amarrk)
new 2f19c59 MAPREDUCE-3610. Remove use of the 'dfs.block.size' config for default block size fetching. Use FS#getDefaultBlocksize instead. (Sho Shimauchi via harsh)
new 0751226 HDFS-1314. Make dfs.blocksize accept size-indicating prefixes (Sho Shimauchi via harsh)
new 1447274 HADOOP-7948. Shell scripts created by hadoop-dist/pom.xml to build tar do not properly propagate failure. (cim_michajlomatijkiw via tucu)
new 55e94dc MAPREDUCE-3490. Fixed MapReduce AM to count failed maps also towards Reduce ramp up. Contributed by Sharad Agarwal and Arun C Murthy.
new c27de4b MAPREDUCE-1744. DistributedCache creates its own FileSytem instance when adding a file/archive to the path. (Dick King via tucu)
new cd81cc6 Merge trunk into HA branch.
new d004dde HDFS-2720. Fix MiniDFSCluster HA support to work properly on Windows. Contributed by Uma Maheswara Rao G.
new f445eb3 MAPREDUCE-3529. TokenCache does not cache viewfs credentials correctly. (sseth)
new be285fc MAPREDUCE-3595. Add missing TestCounters#testCounterValue test from branch 1 to 0.23 (Contributed by Tom White)
new e793ba8 MAPREDUCE-3478. Cannot build against ZooKeeper 3.4.0. (Tom White via mahadev)
new 5b8dcb2 HDFS-2291. Allow the StandbyNode to make checkpoints in an HA setup. Contributed by Todd Lipcon.
new 0870734 MAPREDUCE-3566. Fixed MR AM to construct CLC only once across all tasks. Contributed by Vinod K V.
new 85c4158 HADOOP-7949. Updated maxIdleTime default in the code to match core-default.xml. Contributed by Eli Collins
new 08f8abf MAPREDUCE-3572. Moved AM event dispatcher to a separate thread for performance reasons. Contributed by Vinod K V.
new 03d46dc MAPREDUCE-3569. TaskAttemptListener holds a global lock for all task-updates. (Contributed by Vinod Kumar Vavilapalli)
new 4bb572d HADOOP-7808. Port HADOOP-7510 - Add configurable option to use original hostname in token instead of IP to allow server IP change. Contributed by Daryn Sharp.
new a2bcb86 MAPREDUCE-3615. Fix some ant test failures. (Contributed by Thomas Graves)
new 472e971 HDFS-2710. Add HDFS tests related to HADOOP-7933. Contributed by Siddarth Seth.
new 3187a3a Merge trunk into HA branch.
new 6d45b9e HADOOP-7934. Normalize dependencies versions across all modules. (tucu)
new 4404f206 MAPREDUCE-3326. Added detailed information about queue's to the CapacityScheduler web-ui. Contributed by Jason Lowe.
new 7440a8a MAPREDUCE-3548. Added more unit tests for MR AM & JHS web-services. Contributed by Thomas Graves.
new 2919ce8 MAPREDUCE-3617. Removed wrong default value for yarn.resourcemanager.principal and yarn.nodemanager.principal. Contributed by Jonathan Eagles.
new fb9cdcf HADOOP-7924. 
FailoverController for client-based configuration. Contributed by Eli Collins
new 5f5561d Fixing CHANGES.txt files, moving JIRAs from trunk to 0.23.1 section. (tucu)
new a230d19 HADOOP-7957. Classes deriving GetGroupsBase should be able to override proxy creation.
new 4efd369 HDFS-2697. Move RefreshAuthPolicy, RefreshUserMappings, GetUserMappings protocol to protocol buffers.
new b3bcbe2 HADOOP-7907. hadoop-tools JARs are not part of the distro. (tucu)
new 20af882 Fix bad merge which mixed up two configuration options.
new 574f0b4 HADOOP-4515. Configuration#getBoolean must not be case sensitive. (Sho Shimauchi via harsh)
new 750c5d8 HADOOP-7936. There's a Hoop README in the root dir of the tarball. (tucu)
new a878bea HADOOP-7937. Forward port SequenceFile#syncFs and friends from Hadoop 1.x.
new d680080 Merge trunk into HA branch.
new 5ba6477 MAPREDUCE-3624. Remove unnecessary dependency on JDK's tools.jar. Contributed by Mahadev Konar.
new 9a07ba8 HDFS-2709. Appropriately handle error conditions in EditLogTailer. Contributed by Aaron T. Myers.
new 2d0b340 HADOOP-7961. Move HA fencing to common. Contributed by Eli Collins
new fcf1039 Previous commit didn't fixup package statements.
new 89937fe Previous commit missed test packages.
new 8819fda Merged HDFS-2349, HDFS-2729, HDFS-2726, HDFS-554, HDFS-1314, HADOOP-7910 to branch-0.23, updating CHANGES.txt for trunk.
new 736b186 HDFS-2730. Refactor shared HA-related test code into HATestUtil class. Contributed by Todd Lipcon.
new a7195bd HDFS-2765. TestNameEditsConfigs is incorrectly swallowing IOE. Contributed by Aaron T. Myers
new ade8976 Merge trunk into HA branch.
new e864563 MAPREDUCE-3511. Removed a multitude of cloned/duplicate counters in the AM thereby reducing the AM heap size and preventing full GCs. (vinodkv)
new 8feb26f HADOOP-7963. Fix ViewFS to catch a null canonical service-name and pass tests TestViewFileSystem* (Siddharth Seth via vinodkv)
new 239a554 MAPREDUCE-3616. Thread pool for launching containers in MR AM not expanding as expected. (Contributed by Vinod Kumar Vavilapalli)
new 428529b MAPREDUCE-3528. Fixed TaskHeartBeatHandler to use a new configuration for the thread loop interval separate from task-timeout configuration property. (Siddharth Seth via vinodkv)
new 48150cd MAPREDUCE-3639. Fixed TokenCache to work with absent FileSystem canonical service-names. (Siddharth Seth via vinodkv)
new 849c68c MAPREDUCE-3312. Modified MR AM to not send a stop-container request for a container that isn't launched at all. Contributed by Robert Joseph Evans.
new 526efb4 HDFS-2762. Fix TestCheckpoint timing out on HA branch. Contributed by Uma Maheswara Rao G.
new 44d070c HDFS-2724. NN web UI can throw NPE after startup, before standby state is entered. Contributed by Todd Lipcon.
new 469f9e2 Update CHANGES.txt to reflect merge.
new 44e0bb8 MAPREDUCE-3382. Enhanced MR AM to use a proxy to ping the job-end notification URL. Contributed by Ravi Prakash.
new bc37462 MAPREDUCE-3299. Added AMInfo table to the MR AM job pages to list all the job-attempts when AM restarts and recovers. (Jonathan Eagles via vinodkv)
new 7712e70 MAPREDUCE-3251. Network ACLs can prevent some clients to talk to MR AM. Improved the earlier patch to not to JobHistoryServer repeatedly. Contributed by Anupam Seth.
new bc4b1f4 MAPREDUCE-3380. Token infrastructure for running clients which are not kerberos authenticated. (mahadev)
new 8faf7e8 HDFS-2739. SecondaryNameNode doesn't start up.
new 1c8e3e8 Add HDFS-2499 to CHANGES.txt.
new 190dc1c HDFS-2753. Fix standby getting stuck in safemode when blocks are written while SBN is down. Contributed by Hari Mankude and Todd Lipcon.
new 298e867 HDFS-2773. Reading edit logs from an earlier version should not leave blocks in under-construction state. Contributed by Todd Lipcon.
new a4f4bec HDFS-2775. Fix TestStandbyCheckpoints.testBothNodesInStandbyState failing intermittently. Contributed by Todd Lipcon.
new 39b8bbe MAPREDUCE-3618. Fixed TaskHeartbeatHandler to not hold a global lock for all task-updates. Contributed by Siddarth Seth.
new a339836 HDFS-2766. Test for case where standby partially reads log and then performs checkpoint. Contributed by Aaron T. Myers
new 4f1bf2f HDFS-2738. FSEditLog.selectinputStreams is reading through in-progress streams even when non-in-progress are requested. Contributed by Aaron T. Myers
new c4c6d8e MAPREDUCE-3648. TestJobConf failing. (Thomas Graves via mahadev)
new ede7f21 Merge trunk into HA branch.
new 8f83a23 HADOOP-7964. Deadlock in NetUtils and SecurityUtil class initialization. Contributed by Daryn Sharp.
new 3e76f00 Fix expected error text in assertion.
new c832b46 MAPREDUCE-3651. TestQueueManagerRefresh fails. (Thomas Graves via mahadev)
new d0f8930 MAPREDUCE-3645. TestJobHistory fails. (Thomas Graves via mahadev)
new 0510e06 MAPREDUCE-3652. org.apache.hadoop.mapred.TestWebUIAuthorization.testWebUIAuthorization fails. (Thomas Graves via mahadev)
new 5f79f18 MAPREDUCE-3553. Add support for data returned when exceptions thrown from web service apis to be in either xml or in JSON. (Thomas Graves via mahadev)
new 0086014 MAPREDUCE-3625. CapacityScheduler web-ui display of queue's used capacity is broken. (Jason Lowe via mahadev)
new 09e5af7 HADOOP-7970. HAServiceProtocol methods must throw IOException.Contributed by Hari Mankude.
new 74697f2 MAPREDUCE-3512. Batching JobHistory flushing to DFS so that we don't flush for every event slowing down AM. Contributed by Siddarth Seth.
new dcea80a HDFS-69. Improve the 'dfsadmin' commandline help. (harsh)
new 6234f3d HADOOP-2776. Missing interface annotation on JournalSet. Contributed by Brandon Li.
new 8610a92 Merge trunk into HA branch.
new f717c57 MAPREDUCE-3664. Federation Documentation has incorrect configuration example. Contributed by Brandon Li.
new 7220759 HADOOP-7972. HAServiceProtocol exceptions need to be unwrapped. Contributed by Hari Mankude.
new be33949 Remove the empty avro directories for MAPREDUCE-3545.
new 58f2da1 Merge trunk into HA branch.
new 78ff0b7 MAPREDUCE-3596. Fix scheduler to handle cleaned up containers, which NMs may subsequently report as running. (Contributed by Vinod Kumar Vavilapalli)
new 0c278b0 MAPREDUCE-3656. Fixed a race condition in MR AM which is failing the sort benchmark consistently. Contributed by Siddarth Seth.
new 90f096d MAPREDUCE-3532. Modified NM to report correct http address when an ephemeral web port is configured. Contributed by Bhallamudi Venkata Siva Kamesh.
new b62c1b8 MAPREDUCE-3404. Corrected MR AM to honor speculative configuration and enable speculating either maps or reduces. Contributed by Eric Payne.
new 6b8bcfa HDFS-2788. HdfsServerConstants#DN_KEEPALIVE_TIMEOUT is dead code. Contributed by Eli Collins
new f02ea82 HDFS-2790. FSNamesystem.setTimes throws exception with wrong configuration name in the message. Contributed by Arpit Gupta
new 1c24ae0 HDFS-2789. TestHAAdmin.testFailover is failing. Contributed by Eli Collins
new 69290d3 HADOOP-7975. Add LZ4 as an entry in the default codec list, missed by HADOOP-7657 (harsh)
new aee1bb8 HADOOP-7974. TestViewFsTrash incorrectly determines the user's home directory. Contributed by Harsh J
new a9002bf HADOOP-7968. Errant println left in RPC.getHighestSupportedProtocol (Sho Shimauchi via harsh)
new a24339e MAPREDUCE-3649. Job End notification gives an error on calling back. (Ravi Prakash via mahadev)
new c81995e MAPREDUCE-3657. State machine visualize build fails. (Jason Lowe via mahadev)
new 2f26475 HDFS-2747. Entering safe mode after starting SBN can NPE. Contributed by Uma Maheswara Rao G.
new 4a343c9 MAPREDUCE-3641. Making CapacityScheduler more conservative so as to assign only one off-switch container in a single scheduling iteration. Contributed by Arun C Murthy.
new 940eeb8 Merge trunk into HA branch.
new d880c7c HDFS-2772. On transition to active, standby should not swallow ELIE. Contributed by Aaron T. Myers
new c53c94e Update changelog for HDFS-362 to reflect the merge.
new 212678f HDFS-2767. ConfiguredFailoverProxyProvider should support NameNodeProtocol. Contributed by Uma Maheswara Rao G.
new 0c1450c HDFS-2795. Standby NN takes a long time to recover from a dead DN starting up. Contributed by Todd Lipcon.
new d05e6d2 MAPREDUCE-2450. Fixed a corner case with interrupted communication threads leading to a long timeout in Task. Contributed by Rajesh Balamohan.
new 5ffff3a HADOOP-7971. Adding back job/pipes/queue commands to bin/hadoop for backward compatibility. Contributed by Prashath Sharma.
new 4c7a6c6 Amend HDFS-2795. Fix PersistBlocks failure due to an NPE in isPopulatingReplQueues()
new a380dc8 HDFS-2592. Balancer support for HA namenodes. Contributed by Uma Maheswara Rao G.
new d737c32 MAPREDUCE-3669. Allow clients to talk to MR HistoryServer using both delegation tokens and kerberos. Contributed by Mahadev Konar.
new 8b2f690 MAPREDUCE-3684. LocalDistributedCacheManager does not shut down its thread pool.
new 10325d9 MAPREDUCE-3582. Move successfully passing MR1 tests to MR2 maven tree.(ahmed via tucu)
new 6177bf6 Merge trunk into HA branch.
new 1d2e706 HDFS-2803. Add logging to LeaseRenewer for better lease expiration debugging. Contributed by Jimmy Xiang.
new 3e17cdd Merge trunk into HA branch.
new 02919e6 HDFS-2367. Enable the configuration of multiple HA cluster addresses. Contributed by Aaron T. Myers.
new fa6033a HDFS-2768. BackupNode stop can not close proxy connections because it is not a proxy instance. Contributed by Uma Maheswara Rao G.
new 6861560 MAPREDUCE-3692. yarn-resourcemanager out and log files can get big. Contributed by Eli Collins
new 1aed129 HDFS-2812. When becoming active, the NN should treat all leases as freshly renewed. Contributed by Todd Lipcon.
new b7eb533 HADOOP-7982. UserGroupInformation fails to login if thread's context classloader can't load HadoopLoginModule. Contributed by Todd Lipcon.
new 520a39a HDFS-2810. Leases not getting renewed properly by clients. Contributed by Todd Lipcon.
new f7d20b2 HDFS-2751. Datanode may incorrectly drop OS cache behind reads even for short reads. Contributed by Todd Lipcon.
new 2abe5c8 Merge trunk into HA branch.
new 959d1d0 HADOOP-7986. Adding config for MapReduce History Server protocol in hadoop-policy.xml for service level authorization. Contributed by Mahadev Konar.
new c692306 MAPREDUCE-3698. Client cannot talk to the history server in secure mode. (mahadev)
new 654b90f HDFS-2816. Fix missing license header in httpfs findbugsExcludeFile.xml. (hitesh via tucu)
new b49aae0 MAPREDUCE-3689. RM web UI doesn't handle newline in job name. (Thomas Graves via mahadev)
new c840548 HDFS-2817. Combine the two TestSafeMode test suites. Contributed by Todd Lipcon.
new 8a1719e MAPREDUCE-3549. write api documentation for web service apis for RM, NM, mapreduce app master, and job history server (Thomas Graves via mahadev)
new 355ba01 MAPREDUCE-3705. ant build fails on 0.23 branch. (Thomas Graves via mahadev)
new c3e62de HDFS-2737. Automatically trigger log rolls periodically on the active NN. Contributed by Todd Lipcon and Aaron T. Myers.
new ece8542 HDFS-2818. Fix a missing space issue in HDFS webapps' title tags. (Devaraj K via harsh)
new e42bbfb Merge trunk into HA branch.
new 12645ff HDFS-2822. processMisReplicatedBlock incorrectly identifies under-construction blocks as under-replicated. Contributed by Todd Lipcon.
new c415dee MAPREDUCE-3691. webservices add support to compress response. (Thomas Graves via mahadev)
new 4b36997 MAPREDUCE-3702. internal server error trying access application master via proxy with filter enabled. (Thomas Graves via mahadev.
new f07d91a HADOOP-7981. Improve documentation for org.apache.hadoop.io.compress.Decompressor.getRemaining (Jonathan Eagles via mahadev)
new c10853a HDFS-2820. Add a simple sanity check for HA config. Contributed by Todd Lipcon.
new 8d1c996 HDFS-2688. Add tests for quota tracking in an HA cluster. Contributed by Todd Lipcon.
new c0016ba HDFS-2825. Add test hook to turn off the writer preferring its local DN. Contributed by Todd Lipcon.
new 465663a HDFS-2804. Should not mark blocks under-replicated when exiting safemode. Contributed by Todd Lipcon.
new 27c56b0 MAPREDUCE-3646. Remove redundant URL info from "mapred job" output. (Jonathan Eagles via mahadev)
new 1525aae HDFS-2826. Add test case for HDFS-1476 (safemode can initialize replication queues before exiting) (todd)
new fa4a33a Merge trunk into HA branch.
new 9a15333 MAPREDUCE-3681. Fixed computation of queue's usedCapacity.
new 5dfe62d HDFS-2397. Undeprecate SecondaryNameNode. Contributed by Eli Collins
new 7c69883 HDFS-442. dfsthroughput in test jar throws NPE (harsh)
new 83bcb1b Merge trunk into HA branch.
new f73daf6 MAPREDUCE-3505. yarn APPLICATION_CLASSPATH needs to be overridable. (ahmed via tucu)
new 0b2245a HDFS-2807. Service level authorizartion for HAServiceProtocol.
new dea3164 HDFS-2809. Add test to verify that delegation tokens are honored after failover.
new dc615c3 MAPREDUCE-3710. Improved FileInputFormat to return better locality for the last split. Contributed by Siddarth Seth.
new 078ae89 MAPREDUCE-3714. Fixed EventFetcher and Fetcher threads to shut-down properly so that reducers don't hang in corner cases. (vinodkv)
new c7642a1 MAPREDUCE-3712. The mapreduce tar does not contain the hadoop-mapreduce-client-jobclient-tests.jar. (mahadev)
new c43a5a9 MAPREDUCE-3717. JobClient test jar has missing files to run all the test programs. (mahadev)
new a02f07c MAPREDUCE-3630. Fixes a NullPointer exception while running TeraGen - if a map is asked to generate 0 records. (Contributed by Mahadev Konar)
new cbfe8fe HADOOP-7992. Add ZKClient library to facilitate leader election. Contributed by Bikas Saha.
new 1853b9d Merge trunk into HA branch.
new 9d1621d MAPREDUCE-3683. Fixed maxCapacity of queues to be product of parent maxCapacities.
new a00640a HADOOP-7987. Support setting the run-as user in unsecure mode.
new 1149d9a MAPREDUCE-3194. "mapred mradmin" command is broken in mrv2 (Jason Lowe via bobby)
new 21c9116 MAPREDUCE-3713. Fixed the way head-room is allocated to applications by CapacityScheduler so that it deducts current-usage per user and not per-application. Contributed by Arun C Murthy.
new fae75c2 MAPREDUCE-3721. Fixed a race in shuffle which caused reduces to hang. Contributed by Siddharth Seth.
new d069480 MAPREDUCE-2765. DistCp Rewrite. (Mithun Radhakrishnan via mahadev)
new d5bcc58 MAPREDUCE-2765. DistCp Rewrite. (Mithun Radhakrishnan via mahadev) - wrong version in poms
new 34a6a9f MAPREDUCE-3733. Add Apache License Header to hadoop-distcp/pom.xml. (mahadev)
new 563b09c merge HADOOP-4515 HADOOP-6490 HADOOP-7574 HADOOP-7736 HADOOP-7919 to 0.23 from trunk and update CHANGES.txt file accordingly.
new a709189 HDFS-2836. HttpFSServer still has 2 javadoc warnings in trunk (revans2 via tucu)
new 1c95060 Merge trunk into HA branch.
new faa6806 MAPREDUCE-3735. Add distcp jar to the distribution (tar). (mahadev)
new cf16929 HDFS-2837. mvn javadoc:javadoc not seeing LimitedPrivate class (revans2 via tucu)
new 2bd728b MAPREDUCE-3712. Change default AM heartbeat interval to 1 second. (Contributed by Hitesh Shah)
new 5283398 MAPREDUCE-3718. Amending incorrect JIRA number in CHANGES.txt
new af6448e MAPREDUCE-3737. The Web Application Proxy's is not documented very well. (Robert Evans via mahadev)
new 54f7385 MAPREDUCE-3699. Increased RPC handlers for all YARN servers to reasonable values for working at scale. Contributed by Hitesh Shah.
new 3cdc100 MAPREDUCE-3360. Added information about lost/rebooted/decommissioned nodes on the webapps. Contributed by Bhallamudi Venkata Siva Kamesh and Jason Lowe.
new 12289ef HADOOP-7965. Support for protocol version and signature in PB.
new fdf7b18 HDFS-2838. NPE in FSNamesystem when in safe mode. Contributed by Gregory Chanan
new c5caed9 HADOOP-7997. SequenceFile.createWriter(...createParent...) no longer works on existing file. Contributed by Gregory Chanan
new e7775e0 HDFS-2805. Add a test for a federated cluster with HA NNs. Contributed by Brandon Li.
new c8bb6f5 HADOOP-7993. Hadoop ignores old-style config options for enabling compressed output. (Anupam Seth via mahadev)
new 0cb3dd9 MAPREDUCE-3720. Changed bin/mapred job -list to not print job-specific information not available at RM. Contributed by Vinod K V.
new f57de0d MAPREDUCE-3693. Added mapreduce.admin.user.env to mapred-default.xml. Contributed by Roman Shapshonik.
new fdb9d51 MAPREDUCE-3742. "yarn logs" command fails with ClassNotFoundException. (Jason Lowe via mahadev)
new fe4bff7 MAPREDUCE-3740. Fixed broken mapreduce compilation after the patch for HADOOP-7965. Contributed by Devaraj K.
new cc8a2a2 HADOOP-7998 CheckFileSystem does not correctly honor setVerifyChecksum (Daryn Sharp via bobby)
new 5d15e56 HADOOP-8000. fetchdt command not available in bin/hadoop. (Arpit Gupta via mahadev)
new 8a234f3 HADOOP-7939. Improve Hadoop subcomponent integration in Hadoop 0.23. (rvs via tucu)
new 2b2e560 Merge trunk into HA branch.
new 0d5b734 HDFS-2840. TestHostnameFilter should work with localhost or localhost.localdomain (tucu)
new da91e0d HDFS-2791. If block report races with closing of file, replica is incorrectly marked corrupt. Contributed by Todd Lipcon.
new 5262b7b MAPREDUCE-3732. Modified CapacityScheduler to use only users with pending requests for computing user-limits. Contributed by Arun C Murthy.
new ed6a731 HADOOP-7988. Upper case in hostname part of the principals doesn't work with kerberos.
new 327c216 Merge trunk into HA branch.
new 9340476 HADOOP-8002. SecurityUtil acquired token message should be a debug rather than info. (Arpit Gupta via mahadev)
new 976c076 HDFS-2759. Pre-allocate HDFS edit log files after writing version number. Contributed by Aaron T. Myers.
new 30dd704 Merge trunk into HA branch.
new 9830297 HDFS-2801. Provide a method in client side translators to check for a methods supported in underlying protocol.
new 6122357 HDFS-2841. HAAdmin does not work if security is enabled. Contributed by Aaron T. Myers.
new 5652e71 MAPREDUCE-3481. [Gridmix] Improve Gridmix STRESS mode. (amarrk)
new be2c641 Delete svn:mergeinfo from .gitignore and test java source files.
new e6ca182 HADOOP-7999. "hadoop archive" fails with ClassNotFoundException. (Jason Lowe via mahadev)
new 7e4725d MAPREDUCE-3703. ResourceManager should provide node lists in JMX output. (Eric Payne via mahadev)
new 846f973 HDFS-2691. Fixes for pipeline recovery in an HA cluster: report RBW replicas immediately upon pipeline creation. Contributed by Todd Lipcon.
new 9a8f119 Amend HDFS-2841 to include new file which was omitted from original commit.
new 5c15651 HADOOP-7983. HA: failover should be able to pass args to fencers. Contributed by Eli Collins
new 6884348 HADOOP-7938. HA: the FailoverController should optionally fence the active during failover. Contributed by Eli Collins
new 641f79a HDFS-2824. Fix failover when prior NN died just after creating an edit log segment. Contributed by Aaron T. Myers.
new 6be1333 HDFS-2853. HA: NN fails to start if the shared edits dir is marked required. Contributed by Aaron T. Myers.
new 76b653a MAPREDUCE-3716. Fixing YARN+MR to allow MR jobs to be able to use java.io.File.createTempFile to create temporary files as part of their tasks. Contributed by Jonathan Eagles.
new 443d8f6 MAPREDUCE-3679. AM logs and others should not automatically refresh after every 1 second. (Vinod KV via mahadev)
new 7ed0f74 MAPREDUCE-3748. Changed a log in CapacityScheduler.nodeUpdate to debug. Contributed by Ramya Sunil.
new 7f23d72 MAPREDUCE-3764. Fixed resource usage metrics for queues and users.
new 8dfef7d HDFS-2827. When the parent of a directory is the root, renaming the directory results in leases updated incorrectly. Contributed by Uma Maheswara Rao G
new a8b6ee0 MAPREDUCE-3756. Made single shuffle limit configurable. Contributed by Hitesh Shah.
new 05efddf MAPREDUCE-3749. ConcurrentModificationException in counter groups.
new 319021d HDFS-2857. Cleanup BlockInfo class. Contributed by Suresh Srinivas.
new 536b30e HDFS-2835. Fix findbugs and javadoc issue with GetConf.java. Contributed by Suresh Srinivas.
new f8a245c HADOOP-8006 TestFSInputChecker is failing in trunk. (Daryn Sharp via bobby)
new d1f805f MAPREDUCE-3754. Modified RM UI to filter applications based on state of the applications. (vinodkv)
new 43679fc HDFS-2845. SBN should not allow browsing of the file system via web UI. Contributed by Bikas Saha.
new cf61125 HDFS-2742. HA: observed dataloss in replication stress test. Contributed by Todd Lipcon
new dbbfaeb HDFS-2864. Remove some redundant methods and the constant METADATA_VERSION from FSDataset.
new f49ba35 MAPREDUCE-3762. Fixed default CapacityScheduler configs. Contributed by Mahadev Konar.
new e3d555a MAPREDUCE-3499. New MiniMR does not setup proxyuser configuration correctly, thus tests using doAs do not work. (johnvijoe via tucu)
new 320771b Setting the svn:ignore flag to target dirs of modules which didn't have it
new e5ab158 HADOOP-8009. Create hadoop-client and hadoop-minicluster artifacts for downstream projects. (tucu)
new 048c416 HDFS-2870. Fix log level for block debug info in processMisReplicatedBlocks. Contributed by Todd Lipcon.
new b33c66e MAPREDUCE-3774. Moved yarn-default.xml to hadoop-yarn-common from hadoop-server-common.
new 947ede4 MAPREDUCE-3696. MR job via oozie does not work on hadoop 23. (John George via mahadev)
new 4d779e0 HDFS-2859. LOCAL_ADDRESS_MATCHER.match has NPE when called from DFSUtil.getSuffixIDs when the host is incorrect. Contributed by Bikas Saha.
new 42d1c9b HADOOP-7470. Move up to Jackson 1.8.8. Contributed by Enis Soztutar
new ab75b8b MAPREDUCE-3427. Fix streaming unit tests broken after mavenization. Contributed by Hitesh Shah.
new b4929bc MAPREDUCE-3640. Allow AMRecovery to work with partial JobHistory files. (Contributed by Arun C Murthy)
new ef1a619 MAPREDUCE-3752. Modified application limits to include queue max-capacities besides the usual user limits. Contributed by Arun C Murthy.
new 6ba0375 MAPREDUCE-3744. Fix the yarn logs command line. Improve error messages for mapred job -logs. (Contributed by Jason Lowe)
new 70bc14f MAPREDUCE-3780. Fixed a bug where applications killed before getting activated were not getting cleaned up properly. Contributed by Hitesh Shah.
new c909aed HDFS-2814 NamenodeMXBean does not account for svn revision in the version information. Contributed by Hitesh Shah.
new cc74881 MAPREDUCE-3771. Un-deprecated the old mapred apis, port of MAPREDUCE-1735.
new 58ba16e HADOOP-8001 ChecksumFileSystem's rename doesn't correctly handle checksum files (Daryn Sharp via bobby)
new 1950f97 HADOOP-8012. hadoop-daemon.sh and yarn-daemon.sh are trying to mkdir and chown log/pid dirs which can fail. Contributed by Roman Shaposhnik
new 191db6a HDFS-2718. Optimize OP_ADD in edits loading. Contributed by Konstantin Shvachko.
new 9eb8f4d HDFS-2784. Update hftp and hdfs for host-based token support. Contributed by Kihwal Lee.
new 4324e1b HADOOP-7991. HA: the FailoverController should check the standby is ready before failing over. Contributed by Eli Collins
new 6d5510d HDFS-2877. If locking of a storage dir fails, it will remove the other NN's lock file on exit. Contributed by Todd Lipcon.
new 32c313d HDFS-2861. checkpointing should verify that the dfs.http.address has been configured to a non-loopback for peer NN. Contributed by Todd Lipcon.
new 7e8bf2c HADOOP-8015 ChRootFileSystem should extend FilterFileSystem (Daryn Sharp via bobby)
new 72d34e6 MAPREDUCE-3708. Metrics: Incorrect Apps Submitted Count (Bhallamudi via mahadev)
new 05ab55b HDFS-2860. TestDFSRollback#testRollback is failing. Contributed by Aaron T. Myers.
new a5c46c9 MAPREDUCE-3784. Fixed CapacityScheduler so that maxActiveApplications and maxActiveApplicationsPerUser per queue are not too low for small clusters. Contributed by Arun C Murthy.
new d2b5531 HDFS-2769. HA: When HA is enabled with a shared edits dir, that dir should be marked required. Contributed by Aaron T. Myers.
new 38ad4b5 HDFS-2879. Change FSDataset to package private.
new fdc47f7 HADOOP-8018 Hudson auto test for HDFS has started throwing javadoc (Jon Eagles via bobby)
new 969318c HDFS-2863. Failures observed if dfs.edits.dir and shared.edits.dir have same directories. Contributed by Bikas Saha.
new da00476 HADOOP-8013 ViewFileSystem does not honor setVerifyChecksum (Dayrn Sharp via bobby)
new cf897b6 HADOOP-8013 ViewFileSystem does not honor setVerifyChecksum (Missed a file) (Daryn Sharp via bobby)
new b030231 MAPREDUCE-3727. jobtoken location property in jobconf refers to wrong jobtoken file (tucu)
new 447e81f HDFS-2889. getNumCurrentReplicas is package private but should be public on0.23 (see HDFS-2408). Contributed by Gregory Chanan.
new 94242c9 MAPREDUCE-3711. Fixed MR AM recovery so that only single selected task output is recovered and thus reduce the unnecessarily bloated recovery time. Contributed by Robert Joseph Evans.
new 3343494 MAPREDUCE-3760. Changed active nodes list to not contain unhealthy nodes on the webUI and metrics. (vinodkv)
new fe1cf3b MAPREDUCE-3417. Fixed job-access-controls to work with MR AM and JobHistoryServer web-apps. Contributed by Jonathan Eagles.
new 1de317a MAPREDUCE-3803. Fix broken build of raid contrib due to HDFS-2864. Contributed by Ravi Prakash.
new 11df1c2 HDFS-2874. Edit log should log to shared dirs before local dirs. Contributed by Todd Lipcon.
new 3cc7193 HDFS-2890. DFSUtil#getSuffixIDs should skip unset configurations. Contributed by Aaron T. Myers.
new ec6961b HDFS-2792. Make fsck work. Contributed by Aaron T. Myers.
new 205f047 HDFS-2785. Update webhdfs and httpfs for host-based token support. Contributed by Robert Joseph Evans.
new 2c32cd7 MAPREDUCE-3791. can't build site in hadoop-yarn-server-common. (mahadev)
new caed1cf MAPREDUCE-3723. TestAMWebServicesJobs & TestHSWebServicesJobs incorrectly asserting tests (Bhallamudi Venkata Siva Kamesh via mahadev)
new f2280f6 MAPREDUCE-3795. "job -status" command line output is malformed. (vinodkv via mahadev)
new c7d6476 MAPREDUCE-3759. ClassCastException thrown in -list-active-trackers when there are a few unhealthy nodes (vinodkv via mahadev)
new 7b91318 HDFS-2808. HA: haadmin should use namenode ids. Contributed by Eli Collins
new a660c5d Add missing file from previous commit.
new f3c3522 MAPREDUCE-3775. Change MiniYarnCluster to escape special chars in testname. (Hitesh Shah via mahadev)
new 23e336a MAPREDUCE-3765. FifoScheduler does not respect yarn.scheduler.fifo.minimum-allocation-mb setting (Hitesh Shah via mahadev)
new f88574a HDFS-2880. Protobuf chagnes in DatanodeProtocol to add multiple storages. Contributed by Suresh Srinivas.
new c7007a8 MAPREDUCE-3747. Initialize queue metrics upfront and added start/finish time to RM Web-UI.
new da7b0d9 HDFS-2868. Expose xceiver counts via the DataNode MXBean. (harsh)
new c17b4f8 HDFS-2819. Document new HA-related configs in hdfs-default.xml. Contributed by Eli Collins
new 2e4cf97 HDFS-2752. HA: exit if multiple shared dirs are configured. Contributed by Eli Collins
new 296b6c0 HDFS-2894. HA: automatically determine the nameservice Id if only one nameservice is configured. Contributed by Eli Collins
new b837bbb HDFS-2893. The start/stop scripts don't start/stop the 2NN when using the default configuration. Contributed by Eli Collins
new 2a9e430 HDS-2895. Remove Writable wire protocol types and translators to complete transition to protocol buffers. Contributed by Suresh Srinivas.
new 3f02d8d MAPREDUCE-3814. Fixed MRV1 compilation. (Arun C Murthy via vinodkv)
new db7c013 HDFS-2733. Document HA configuration and CLI. Contributed by Aaron T. Myers.
new 2c91c9d HADOOP-8017. Configure hadoop-main pom to get rid of M2E plugin execution not covered (Eric Charles via bobby)
new 28a2eb9 MAPREDUCE-3810. Performance tweaks - reduced logging in AM and defined hascode/equals for ResourceRequest & Priority. Contributed by Vinod K V.
new c6282df MAPREDUCE-3813. Added a cache for resolved racks. Contributed by Vinod K V.
new 9f2b77a MAPREDUCE-3808. Fixed an NPE in FileOutputCommitter for jobs with maps but no reduces. Contributed by Robert Joseph Evans.
new bdf837a MAPREDUCE-3804. yarn webapp interface vulnerable to cross scripting attacks (Dave Thompson via bobby)
new 4f6839f MAPREDUCE-3354. Changed scripts so that jobhistory server is started by bin/mapred instead of bin/yarn. Contributed by Jonathan Eagles.
new 0847937 MAPREDUCE-3818. Fixed broken compilation in TestSubmitJob after the patch for HDFS-2895. Contributed by Suresh Srinivas.
new 75d2d61 MAPREDUCE-3809. Ensure that there is no needless sleep in Task at the end of the task. Contributed by Siddharth Seth.
new 8dbf374 MAPREDUCE-3811. Made jobclient-to-AM retries configurable. Contributed by Siddharth Seth.
new 7e4bd89 HDFS-2886. CreateEditLogs should generate a realistic edit log. Contributed by Konstantin Shvachko.
new 59d1f07 MAPREDUCE-3794. Support mapred.Task.Counter and mapred.JobInProgress.Counter enums for compatibility (Tom White via mahadev)
new 2d1406e HADOOP-8027. Visiting /jmx on the daemon web interfaces may print unnecessary error in logs. Contributed by Aaron T. Myers.
new 7f0a99f HDFS-2794. Active NN may purge edit log files before standby NN has a chance to read them. Contributed by Todd Lipcon.
new 35f12b9 MAPREDUCE-3697. Support binary compatibility for Counters after MAPREDUCE-901.
new 6e376a3 MAPREDUCE-3817. Fixed bin/mapred to allow running of distcp and archive jobs. Contributed by Arpit Gupta.
new aaace5e MAPREDUCE-3709. TestDistributedShell is failing. (Hitesh Shah via mahadev)
new 28eadb7 HDFS-2899. Service protocol changes in DatanodeProtocol to add multiple storages. Contributed by Suresh Srinivas.
new acacde5 HDFS-2901. Improvements for SBN web UI - not show under-replicated/missing blocks. Contributed by Brandon Li.
new fb49892 MAPREDUCE-3436. JobHistory webapp address should use the host configured in the jobhistory address. (Contributed by Ahmed Radwan)
new 90bc439 MAPREDUCE-3815. Fixed MR AM to always use hostnames and never IPs when requesting containers so that scheduler can give off data local containers correctly. Contributed by Siddarth Seth.
new 59b8865 MAPREDUCE-3833. Fixed a bug in reinitiaziling of queues. Contributed by Jason Lowe.
new 7dfe20d MAPREDUCE-3823. Fixed a bug in RM web-ui which broke sorting. Contributed by Jonathan Eagles.
new d8e9f84 Fixed jira id in commit for MAPREDUCE-3826.
new ccc2807 MAPREDUCE-3823. Ensure counters are calculated only once after a job finishes. (Contributed by Vinod Kumar Vavilapalli)
new 04f685e MAPREDUCE-3827. Changed Counters to use ConcurrentSkipListMap for performance. Contributed by Vinod K V.
new 23e4ada HADOOP-7813. Added to CHANGES.txt
new 47c5d51 HADOOP-7841. Added to CHANGES.txt
new 5fdfa2b MAPREDUCE-3822. Changed FS counter computation to use all occurences of the same FS scheme, instead of randomly using one. (Contributed by Mahadev Konar)
new fa7294e HADOOP-7851. Moving to 0.23.1 section in CHANGES.txt
new 7ae94c6 MAPREDUCE-3834. Changed MR AM to not add the same rack entry multiple times into the container request table when multiple hosts for a split happen to be on the same rack. Contributed by Siddarth Seth.
new cb25aee HADOOP-8013. Moved to 0.23.1 section.
new eabe75d HDFS-2572. Moved to trunk section from 0.23.1
new 8e524e7 Fixing 0.23.1 version of the CHANGES.txt to make it consistent with the CHANGES.txt from 0.23.1 release.
new 4018798 MAPREDUCE-3415. Moving to 0.23.1 section.
new b9e74da HDFS-2905. HA: Standby NN NPE when shared edits dir is deleted. Contributed by Bikas Saha.
new 11db1b8 HDFS-2786. Fix host-based token incompatibilities in DFSUtil. Contributed by Kihwal Lee.
new 4d3dc53 HDFS-2764. TestBackupNode is racy. Contributed by Aaron T. Myers.
new 1de681b MAPREDUCE-3828. Ensure that urls in single-node mode are correct. Contributed by Siddharth Seth.
new 647f374 Preparing for release 0.23.1
new e5060d3 MAPREDUCE-3770. Zombie.getJobConf() results into NPE. (amarrk)
new b2d49ac MAPREDUCE-3840 JobEndNotifier doesn't use the proxyToUse during connecting (Ravi Prakash via bobby)
new da10820 HADOOP-8038. Add 'ipc.client.connect.max.retries.on.timeouts' entry in core-default.xml file. Contributed by Uma Maheswara Rao G.
new b6ffb08 HDFS-2887. FSVolume, is a part of FSDatasetInterface implementation, should not be referred outside FSDataset. A new FSVolumeInterface is defined. The BlockVolumeChoosingPolicy.chooseVolume(..) method signature is also updated. (szetszwo)
new e03964d HADOOP-8032. mvn site:stage-deploy should be able to use the scp protocol to stage documents (Ravi Prakash via tgraves)
new 987449b HDFS-2908. Add apache license header for StorageReport.java. Contributed by Brandon Li.
new a1574e1 HDFS-2923. Namenode IPC handler count uses the wrong configuration key. Contributed by Todd Lipcon.
new e918b91 HDFS-2579. Starting delegation token manager during safemode fails. Contributed by Todd Lipcon.
new 7f7b052 HADOOP-8042. When copying a file out of HDFS, modifying it, and uploading it back into HDFS, the put fails due to a CRC mismatch (Daryn Sharp via bobby)
new bad0a2a HDFS-2510. Add HA-related metrics. Contributed by Aaron T. Myers.
new 5e26de9 HDFS-2924. Standby checkpointing fails to authenticate in secure cluster. Contributed by Todd Lipcon.
new 1b4c990 HADOOP-8041. Log a warning when a failover is first attempted. Contributed by Todd Lipcon.
new 03ee90b HADOOP-7923. Automate the updating of version numbers in the doc system.
new 4b09ebd HADOOP-8035 Hadoop Maven site is inefficient and runs phases redundantly (abayer via tucu)
new b5d02a6 HDFS-2915. HA: TestFailureOfSharedDir.testFailureOfSharedDir() has race condition. Contributed by Bikas Saha.
new 2c9ca86 Fix weird unicode character in CHANGES.txt on HA branch.
new 3c6863a Update CHANGES.txt to reflect the back-port of HDFS-2764 from trunk to branch-0.23.
new 467059b HDFS-2912. Namenode not shutting down when shared edits dir is inaccessible. Contributed by Bikas Saha.
new a63e12c HDFS-2922. HA: close out operation categories. Contributed by Eli Collins
new 2a2faac HADOOP-8048. Allow merging of Credentials (Daryn Sharp via tgraves)
new 8af96c7 HDFS-2917. HA: haadmin should not work if run by regular user. Contributed by Eli Collins
new c14bb61 Merge trunk into HA branch
new dc847b3 HDFS-2486. Remove unnecessary priority level checks in UnderReplicatedBlocks. Contributed by Uma Maheswara Rao G
new 73a72e0 MAPREDUCE-3680. FifoScheduler web service rest API can print out invalid JSON. (B Anil Kumar via tgraves)
new 8e32744 Fixing CHANGES.txt, move JIRAs from trunk to 0.23.2 section (tgraves).
new 05d56e5 Merge trunk into HA branch.
new a626fa0 Revert HDFS-2922 via svn merge -c -1242572
new 83fd316 HDFS-2931. Switch DataNode's BlockVolumeChoosingPolicy to private-audience. Contributed by harsh
new 56b6f4a Cleaning up hadoop-mapreduce-project/CHANGES.txt a bit.
new 0bf146b MAPREDUCE-3843. Job summary log file found missing on the RM host (Anupam Seth via tgraves)
new 27035f5 HADOOP-8051 HttpFS documentation it is not wired to the generated site (tucu)
new 8be9441 HDFS-2878. Fix TestBlockRecovery and move it back into main test directory. Contributed by Todd Lipcon.
new 6bec403 HADOOP-8055. Hadoop tarball distribution lacks a core-site.xml (harsh)
new 726f6e3 Amend HADOOP-8055. Placed changes log in a released section, corrected to 0.23.2. (harsh)
new 8b730c8 HDFS-2869. Fix an error in the webhdfs docs for the mkdir op (harsh)
new 00ee058 HADOOP-8052. Hadoop Metrics2 should emit Float.MAX_VALUE (instead of Double.MAX_VALUE) to avoid making Ganglia's gmetad core. Contributed by Varun Kapoor.
new f6e407b HDFS-2939. TestHAStateTransitions fails on Windows. Contributed by Uma Maheswara Rao G.
new 5c46ba4 MAPREDUCE-3852. Test TestLinuxResourceCalculatorPlugin failing. (Thomas Graves via mahadev)
new 52004aa HDFS-776. Fix exception handling in Balancer. Contributed by Uma Maheswara Rao G
new a70bc6c HDFS-2815. Namenode sometimes oes not come out of safemode during NN crash + restart. Contributed by Uma Maheswara Rao.
new 2acafd1 HDFS-2944. Typo in hdfs-default.xml causes dfs.client.block.write.replace-datanode-on-failure.enable to be mistakenly disabled. Contributed by Aaron T. Myers.
new db187cf Merge trunk into HA branch. Some conflicts around TestBlockRecovery: mocking changed for new heartbeat types/responses
new ce77846 MAPREDUCE-3837. Job tracker is not able to recover jobs after crash. Contributed by Mayank Bansal.
new 0515b33 MAPREDUCE-3846. Addressed MR AM hanging issues during AM restart and then the recovery. (vinodkv)
new a87328d HDFS-2943. Expose last checkpoint time and transaction stats as JMX metrics. Contributed by Aaron T. Myers.
new 1b2ecc6 HDFS-2947. On startup NN throws an NPE in the metrics system. Contributed by Aaron T. Myers.
new a0e4ae5 HDFS-2942. TestActiveStandbyElectorRealZK fails if build dir does not exist. Contributed by Aaron T. Myers.
new 1903e54 MAPREDUCE-3802. Added test to validate that AM can crash multiple times and still can recover successfully after MAPREDUCE-3846. (vinodkv)
new 82ffe0e HADOOP-8070. Add a standalone benchmark for RPC call performance. Contributed by Todd Lipcon.
new 439490f HDFS-2948. NN throws NPE during shutdown if it fails to startup. Contributed by Todd Lipcon.
new f42e58c HADOOP-8071. Avoid an extra packet in client code when nagling is disabled. Contributed by Todd Lipcon.
new 011611c Merge trunk into HA branch.
new 16a44b6 MAPREDUCE-3854. Fixed and reenabled tests related to MR child JVM's environmental variables in TestMiniMRChildTask. (Tom White via vinodkv)
new 83ab8f0 MAPREDUCE-3858. Task attempt failure during commit results in task never completing. (Tom White via mahadev)
new 89bd221 MAPREDUCE-3736. Variable substitution depth too large for fs.default.name causes jobs to fail (ahmed via tucu)
new 063be57 HADOOP-6502. Improve the performance of Configuration.getClassByName when the class is not found by caching negative results. Contributed by Sharad Agarwal and Todd Lipcon.
new cdc8146 HADOOP-8068. void methods can swallow exceptions when going through failover path. Contributed by Todd Lipcon.
new 3bd230a HDFS-2950. Secondary NN HTTPS address should be listed as a NAMESERVICE_SPECIFIC_KEY. Contributed by Todd Lipcon.
new f82e862 HDFS-2525. Race between BlockPoolSliceScanner and append. Contributed by Brandon Li.
new 1fb0ab9 Merge trunk into HA branch.
new ff91453 HDFS-2938. Recursive delete of a large directory make namenode unresponsive. Contributed by Hari Mankude.
new 3c145d3 HDFS-2909. HA: Inaccessible shared edits dir not getting removed from FSImage storage dirs upon error. Contributed by Bikas Saha.
new 05151ec HDFS-2934. Allow configs to be scoped to all NNs in the nameservice. Contributed by Todd Lipcon.
new f7f2ef4 HDFS-2935. Shared edits dir property should be suffixed with nameservice and namenodeID. Contributed by Todd Lipcon.
new 1ceb0ee HADOOP-8074. Small bug in hadoop error message for unknown commands. Contributed by Colin Patrick McCabe
new 0663b51 Amend HDFS-2948. NN throws NPE during shutdown if it fails to startup
new 83a922b ConfiguredFailoverProxyProvider should not create a NameNode proxy with an underlying retry proxy. Contributed by Uma Maheswara Rao G.
new 2081621 MAPREDUCE-3864. Fix cluster setup docs for correct SecondaryNameNode HTTPS parameters. Contributed by Todd Lipcon.
new cfc4ad7 MAPREDUCE-3849. Change TokenCache's reading of the binary token file (Daryn Sharp via bobby)
new eb80104 HADOOP-8082 add hadoop-client and hadoop-minicluster to the dependency-management section. (tucu)
new 833e965 Merge trunk into HA branch.
new b8448de HDFS-2655. BlockReaderLocal#skip performs unnecessary IO. Contributed by Brandon Li.
new 153e0cc HDFS-2955. IllegalStateException during standby startup in getCurSegmentTxId. Contributed by Hari Mankude.
new d686027 HADOOP-8066 The full docs build intermittently fails (abayer via tucu)
new a64046d MAPREDUCE-3856. Instances of RunningJob class givs incorrect job tracking urls when mutiple jobs are submitted from same client jvm. (Contributed by Eric Payne)
new 11c127b MAPREDUCE-3757. [Rumen] Fixed Rumen Folder to adjust shuffleFinished and sortFinished times when needed.
new 257e944 Moving HDFS-2525 to relevant release section (0.23.2) in CHANGES.txt
new 482f11a HADOOP-8083 javadoc generation for some modules is not done under target/ (tucu)
new 1a03127 HDFS-2937. TestDFSHAAdmin needs tests with MiniDFSCluster. Contributed by Brandon Li.
new 7933dc5 HDFS-2586. Add protobuf service and implementation for HAServiceProtocol. Contributed by Suresh Srinivas.
new 1425c65 HADOOP-8054. NPE with FilterFileSystem (Daryn Sharp via bobby)
new 53b7d6c Merge trunk into HA branch.
new daf22e5 HADOOP-8036. TestViewFsTrash assumes the user's home directory is 2 levels deep. Contributed by Colin Patrick McCabe
new dd732d5 Fix TestViewFsFileStatusHdfs per previous commit.
new ff33b38 MAPREDUCE-3862 Nodemanager can appear to hang on shutdown due to lingering DeletionService threads (Jason Lowe via bobby)
new b4c8567e MAPREDUCE-3583. Change pid to String and stime to BigInteger in order to handle integers larger than Long.MAX_VALUE. Contributed by Zhihong Yu
new a8e7f74 HDFS-2969. ExtendedBlock.equals is incorrectly implemented. Contributed by Todd Lipcon.
new 9ae4fac HDFS-2968. Protocol translator for BlockRecoveryCommand broken when multiple blocks need recovery. Contributed by Todd Lipcon.
new ef5d7156 Merge trunk into HA branch
new 089714f HADOOP-8054. Committing to 0.23.1.
new 3c5eb01 MAPREDUCE-3856. Committing to 0.23.1.
new e38b7e6 Preparing for hadoop-0.23.1-rc2.
new 566f0b5 MAPREDUCE-3880. Changed LCE binary to be 32-bit.
new 41e56df HDFS-2952. NN should not start with upgrade option or with a pending an unfinalized upgrade. Contributed by Aaron T. Myers.
new 3f8d7db HADOOP-8046 Revert StaticMapping semantics to the existing ones, add DNS mapping diagnostics in progress
new 3d8907f MAPREDUCE-3877 Add a test to formalise the current state transitions of the yarn lifecycle
new a57b9b8 HDFS-2725 script to mention dfs command
new 2147427 HADOOP-8057 hadoop-setup-conf.sh not working because of some extra spaces.
new 145338b HADOOP-7680 TestHardLink fails on Mac OS X, when gnu stat is in path.
new def0ac8 HADOOP-8050. Deadlock in metrics. Contributed by Kihwal Lee.
new d03dac7 HDFS-2974. MiniDFSCluster does not delete standby NN name dirs during format. Contributed by Aaron T. Myers.
new f0db867 Merge trunk into HA branch.
new 5ee495e MAPREDUCE-3634. Fixed all daemons to crash instead of hanging around when their EventHandlers get exceptions. (vinodkv)
new ae7e431 HADOOP-8084. Updates ProtoBufRpc engine to not do an unnecessary copy for RPC request/response. Contributed by Devaraj Das.
new b2172c3 MAPREDUCE-3798. Fixed failing TestJobCleanup.testCusomCleanup() and moved it to the maven build. Contributed by Ravi Prakash.
new 60ab297 Merge trunk into HA branch.
new c78f6aa Merge trunk into HA branch.
new efbc58f HDFS-2907. Add a conf property dfs.datanode.fsdataset.factory to make FSDataset in Datanode pluggable.
new 267bebe MAPREDUCE-3884. PWD should be first in the classpath of MR tasks (tucu)
new b69e4d9 HADOOP-7660 Maven generated .classpath doesnot includes "target/generated-test-source/java" as source directory. (Laxman via bobby)
new c149127 HDFS-2929. Stress test and fixes for block synchronization. Contributed by Todd Lipcon.
new 7527e94 HDFS-2972. Small optimization building incremental block report. Contributed by Todd Lipcon.
new 475db83 HDFS-2985. Improve logging when replicas are marked as corrupt. Contributed by Todd Lipcon.
new 90a14f8 HDFS-2973. Re-enable NO_ACK optimization for block deletion. Contributed by Todd Lipcon.
new 8db31c5 HDFS-2922. HA: close out operation categories. Contributed by Eli Collins
new af70add Move HDFS-2944 entry to 0.23 in CHANGES.txt.
new f11b078 HDFS-2981. In hdfs-default.xml, the default value of dfs.client.block.write.replace-datanode-on-failure.enable should be true.
new 2e9b8df HDFS-2993. HA: BackupNode#checkOperation should permit CHECKPOINT operations. Contributed by Eli Collins
new 8a2073c MAPREDUCE-3787. [Gridmix] Optimize job monitoring and STRESS mode for faster job submission. (amarrk)
new 81f5c59 MAPREDUCE-3878. Null user on filtered jobhistory job page (Jonathon Eagles via tgraves)
new f3026e1 Merge trunk into HA branch.
new 6112940 MAPREDUCE 3738. NM can hang during shutdown if AppLogAggregatorImpl thread dies unexpectedly. (Contributed by Jason Lowe)
new 22d5944 HADOOP-8085. Add RPC metrics to ProtobufRpcEngine. Contributed by Hari Mankude.
new 584a1ca HADOOP-8108. Move method getHostPortString() from NameNode to NetUtils. Contributed by Brandon Li.
new 3287028 Merge trunk into HA branch.
new 62c7e2e HDFS-3003. Remove getHostPortString() from NameNode, replace it with NetUtils.getHostPortString(). Contributed by Brandon Li.
new 0e79131 HDFS-3009. Remove duplicate code in DFSClient#isLocalAddress by using NetUtils. Contributed by Hari Mankude.
new 78f22bc HDFS-3008. Negative caching of local addrs doesn't work. Contributed by Eli Collins
new 969b380 MAPREDUCE-3866. Fixed the bin/yarn script to not print the command line unnecessarily. (vinodkv)
new c057265 MAPREDUCE-3730. Modified RM to allow restarted NMs to be able to join the cluster without waiting for expiry. Contributed by Jason Lowe.
new 582b97c MAPREDUCE-3904. Job history produced with mapreduce.cluster.acls.enabled false can not be viewed with mapreduce.cluster.acls.enabled true (Jonathon Eagles via tgraves)
new 4e64d7b MAPREDUCE-3918 proc_historyserver no longer in command line arguments for HistoryServer (Jon Eagles via bobby)
new 5293e5d HDFS-3002. TestNameNodeMetrics need not wait for metrics update. Contributed by Suresh Srinivas.
new 481f845 HDFS-2904. Client support for getting delegation tokens. Contributed by Todd Lipcon.
new dacbeb5 HDFS-3006. In WebHDFS, when the return body is empty, set the Content-Type to application/octet-stream instead of application/json.
new 1de3fa8 Preparing for 0.23.3 release.
new 7a082ec MAPREDUCE-2793. Corrected AppIDs, JobIDs, TaskAttemptIDs to be of correct format on the web pages. Contributed by Bikas Saha.
new d83672d MAPREDUCE-2793. Reneabling commented out test from previous comment.
new b57260f HDFS-2978. The NameNode should expose name dir statuses via JMX. Contributed by Aaron T. Myers.
new ae9014e Merge trunk into HA branch.
new f3cc891 MAPREDUCE-3910. Fixed a bug in CapacityScheduler LeafQueue which was causing app-submission to fail. Contributed by John George.
new f071323 MAPREDUCE-3686. Fixed two bugs in Counters because of which web app displays zero counter values for framework counters. Contributed by Bhallamudi Venkata Siva Kamesh.
new d6170f0 MAPREDUCE-3913. RM application webpage is unresponsive after 2000 jobs (Jason Lowe via tgraves)
new acf8e6f trailing whitespace on end of title lines
new 008cf6a MAPREDUCE-3909
new 5fd47e7 Merge trunk into HA branch.
new da2e449 HADOOP-8113. Correction to BUILDING.txt: HDFS needs ProtocolBuffer, too (not just MapReduce). Contributed by Eugene Koontz.
new dee6ca3 Move entries to 0.23.3 in CHANGES.txt for the 0.23-PB merge.
new 7144c91 Move entries to 0.23.3 in CHANGES.txt for the 0.23-PB merge.
new 7475e83 MAPREDUCE-3901. Modified JobHistory records in YARN to lazily load job and task reports so as to improve UI response times. Contributed by Siddarth Seth.
new da9aa34 HDFS-3013. HA: NameNode format doesn't pick up dfs.namenode.name.dir.NameServiceId configuration. Contributed by Mingjie Lai.
new 12b3ce7 Move entries to 0.23.3 in CHANGES.txt for the 0.23-PB merge.
new 165cd62 MAPREDUCE-2855. Passing a cached class-loader to ResourceBundle creator to minimize counter names lookup time. Contributed by Siddarth Seth.
new 586bd47 Merge trunk into HA branch.
new cfe2142 MAPREDUCE-3922. Fixed build to not compile 32bit container-executor binary by default on all platforms. Contributed by Hitesh Shah.
new 4775adf HADOOP-8078. Add capability to turn on security in unit tests. Contributed by Jaimin Jetly.
new dcd2056 HADOOP-8116. RetriableCommand is using RetryPolicy incorrectly after HADOOP-7896. Contributed by Aaron T. Myers.
new 858c6d2 MAPREDUCE-3790 Broken pipe on streaming job can lead to truncated output for a successful job (Jason Lowe via bobby)
new ab29f5c MAPREDUCE-3790 Broken pipe on streaming job can lead to truncated output for a successful job (Jason Lowe via bobby)
new 7decf11 HDFS-3024. Improve performance of stringification in addStoredBlock. Contributed by Todd Lipcon.
new e43656c HADOOP-8098. KerberosAuthenticatorHandler should use _HOST replacement to resolve principal name (tucu)
new 375c6b8 Merge trunk into HA branch.
new 1ab31b1 HDFS-3019. Fix silent failure of TestEditLogJournalFailures. Contributed by Todd Lipcon.
new daf782c HDFS-3016. Security in unit tests. Contributed by Jaimin Jetly.
new f83be7c HADOOP-8104. Inconsistent Jackson versions (tucu)
new ffdf980 MAPREDUCE-3816 capacity scheduler web ui bar graphs for used capacity wrong (tgraves via bobby)
new c69dfdd HDFS-2958. Sweep for remaining proxy construction which doesn't go through failover path.
new 137aa07 MAPREDUCE-3930. Fixed an NPE while accessing the AM page/webservice for a task attempt without an assigned container. (Contributed by Robert Joseph Evans)
new 978a805 HDFS-2920. fix remaining TODO items. Contributed by Aaron T. Myers and Todd Lipcon.
new e58b7e2 HDFS-3014. FSEditLogOp and its subclasses should have toString() method. Contributed by Sho Shimauchi.
new 44a003d MAPREDUCE-3931. Changed PB implementation of LocalResource to take locks so that race conditions don't fail tasks by inadvertantly changing the timestamps. Contributed by Siddarth Seth.
new 271654c HADOOP-7994. Remove getProtocolVersion and getProtocolSignature from the client side translator and server side implementation.
new e57fd85 HDFS-3030. Remove getProtocolVersion and getProtocolSignature from translators.
new e478bc4 HADOOP-7940. The Text.clear() method does not clear the bytes as intended. Contributed by Csaba Miklos.
new defa1c5 MAPREDUCE-3687. If AM dies before it returns new tracking URL, proxy redirects to http://N/A/ and doesn't return error code (Ravi Prakash via bobby)
new 547ded7 MAPREDUCE-3920. Revise yarn default port number selection (Dave Thompson via tgraves)
new a4ad12d MAPREDUCE-3933. Failures because MALLOC_ARENA_MAX is not set (ahmed via tucu)
new 34c73db HDFS-2991. Fix case where OP_ADD would not be logged in append(). Contributed by Todd Lipcon.
new fbf3a9e HDFS-2992. Edit log failure trace should include transaction ID of error. Contributed by Colin Patrick McCabe
new ca9b4de HDFS-3012. Exception while renewing delegation token. Contributed by Bobby Evans.
new 28de362 HDFS-3020. Fix editlog to automatically sync when buffer is full. Contributed by Todd Lipcon.
new 2249e00 HADOOP-8118. In metrics2.util.MBeans, change log level to trace for the stack trace of InstanceAlreadyExistsException.
new 2659fde MAPREDUCE-3728. ShuffleHandler can't access results when configured in a secure mode (ahmed via tucu)
new 46d0d47 HADOOP-8119. Fix javac warnings in TestAuthenticationFilter in hadoop-auth.
new 7ae0465 HADOOP-7557 Make IPC header be extensible (sanjay radia)
new 3cbb9d2 MAPREDUCE-3903. Add support for mapreduce admin users. (Contributed by Thomas Graves)
new 7b6b204 HDFS-3027. Implement a simple NN health check. Contributed by Aaron T. Myers.
new 753c2ba HDFS-3012. Moving to hadoop-0.23.2.
new 7bf2f95 MAPREDUCE-3706. Fix circular redirect error in job-attempts page. Contributed by Robert Evans.
new 01b17c4 HDFS-2979. Balancer should use logical uri for creating failover proxy with HA enabled. Contributed by Aaron T. Myers.
new 1ba3575 Merge trunk into HA branch.
new 1d3a0c9 Fix two more issues from trunk merge just committed -- removal of VersionedProtocol
new 30cffeb HDFS-3023. Optimize entries in edits log for persistBlocks call. Contributed by Todd Lipcon.
new 7ae1523 MAPREDUCE-3885. Avoid an unnecessary copy for all requests/responses in MRs ProtoOverHadoopRpcEngine. (Contributed by Devaraj Das)
new 9318ff4 Revert commit of HDFS-2979.
new 0d7de50 HDFS-2979. Balancer should use logical uri for creating failover proxy with HA enabled. Contributed by Aaron T. Myers.
new 6e5e1e5 Amend HDFS-3023. Add new layout version number to ImageLoaderCurrent to fix TestOfflineImageViewer.
new 55832c6 HDFS-3035. Fix failure of TestFileAppendRestart due to OP_UPDATE_BLOCKS. Contributed by Todd Lipcon.
new 9e31bf6 HDFS-3021. Use generic type to declare FSDatasetInterface.
new f22677e HDFS-3036. Remove unused method DFSUtil#isDefaultNamenodeAddress. Contributed by Aaron T. Myers.
new b2f67b4 HADOOP-8124, HDFS-3034, MAPREDUCE-3956. Remove the deprecated Syncable.sync().
new 6da670c HDFS-3037. TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy. Contributed by Aaron T. Myers.
new 7be4e5b HDFS-3039. Address findbugs and javadoc warnings on branch. Contributed by Todd Lipcon.
new 8a99218 HDFS-3038. Add FSEditLog.metrics to findbugs exclude list. Contributed by Todd Lipcon.
new 87d1c67 Merge trunk into HA branch
new 97d1047 HADOOP-8131. FsShell put doesn't correctly handle a non-existent dir (Daryn Sharp via bobby)
new 99bf290 MAPREDUCE-3896. Add user information to the delegation token issued by the history server. (Contributed by Vinod Kumar Vavilapalli)
new ffa5271 Merge trunk into HA branch.
new ee486e8 Merge trunk into HA branch.
new ce11ff7 MAPREDUCE-3935. Annotate Counters.Counter and Counters.Group as @Public.
new a1fc055 HDFS-1623. High Availability Framework for HDFS NN. Contributed by Todd Lipcon, Aaron T. Myers, Eli Collins, Uma Maheswara Rao G, Bikas Saha, Suresh Srinivas, Jitendra Nath Pandey, Hari Mankude, Brandon Li, Sanjay Radia, Mingjie Lai, and Gregory Chanan
new 8e30301 Fix up CHANGES.txt files post commit of HDFS-1623 and HADOOP-7454.
new 26cd235 HADOOP-8135. Add ByteBufferReadable interface to FSDataInputStream. Contributed by Henry Robinson.
new fab57a1 MAPREDUCE-3792. Fix "bin/mapred job -list" to display all jobs instead of only the jobs owned by the user. Contributed by Jason Lowe.
new 5f52156 MAPREDUCE-3614. Fixed MR AM to close history file quickly and send a correct final state to the RM when it is killed. Contributed by Ravi Prakash.
new bd38a29 MAPREDUCE-3929. Fixed output of 'bin/mapred queue -showacl' command to clarify ACLs for users. Contributed by John George.
new 9f16abf HADOOP-8123. Use java.home rather than env.JAVA_HOME for java in the project. Contributed by Jonathan Eagles.
new d41cb76 MAPREDUCE-3960. Fix web-proxy to forward request to AM with configured hostname or IP. Contributed by Thomas Graves.
new 6d80dc2 MAPREDUCE-3897. Fixed computation of maxActiveAppsPerUser for queues by using capacity and not max-capacity since we are already scaling it by userLimitFactor. Contributed by Eric Payne.
new d5f4fce MAPREDUCE-3497. Added docs for YARN CLI. Contributed by Thomas Graves.
new 7819483 HADOOP-8137. Added links to CLI manuals to the site. Contributed by Thomas Graves.
new 231e394 MAPREDUCE-2722. [Gridmix] Gridmix simulated job's map's hdfsBytesRead counter is wrong when compressed input is used.(ravigummadi)
new b73738d MAPREDUCE-3009. Fixed node link on JobHistory webapp. Contributed by hackaravarthy.
new 7c1e857 MAPREDUCE-3954. Added new envs to separate heap size for different daemons started via bin scripts. Contributed by Robert Joseph Evans. .--This line, and those below, will be ignored--
new 774f809 MAPREDUCE-3964. ResourceManager does not have JVM metrics (Jason Lowe via bobby)
new c1b0706 HADOOP-8125. make hadoop-client set of curated jars available in a distribution tarball (rvs via tucu)
new 03e4684 HADOOP-8064. Remove unnecessary dependency on w3c.org in document processing (Khiwal Lee via bobby)
new 2b634e9 HADOOP-8025. Amendment
new 739f688 MAPREDUCE-3952. In MR2, when Total input paths to process == 1, CombinefileInputFormat.getSplits() returns 0 split. (zhenxiao via tucu)
new b9fd9e1 MAPREDUCE-3034. Ensure NodeManager reboots itself on direction from ResourceManager. Contributed by Devaraj K & Eric Payne.
new 0ee71ad HDFS-3032. Change DFSClient.renewLease() so that it only retries up to the lease soft-limit. Contributed by Kihwal Lee
new a98b756 MAPREDUCE-3976. TestRMContainerAllocator failing (Jason Lowe via bobby)
new 1a0e088 MAPREDUCE-3974. TestSubmitJob in MR1 tests doesn't compile after HDFS-1623 merge. Contributed by Aaron T. Myers.
new 4ce5f65 MAPREDUCE-3944. Change the history jobs/ webservice to return partial job info for a significant performance improvement. (Contributed by Robert Joseph Evans)
new bb86825 HADOOP-8140. dfs -getmerge should process its argments better (Daryn Sharp via bobby)
new c3a4de0 MAPREDUCE-3961. Map/ReduceSlotMillis computation incorrect (Siddharth Seth via bobby)
new 25cceb6 MAPREDUCE-3977. LogAggregationService leaks log aggregator objects (Jason Lowe via bobby)
new 13ea1d5 MAPREDUCE-3975. Default value not set for Configuration parameter mapreduce.job.local.dir (Eric Payne via bobby)
new 6f8d347 Moving HDFS-2158, HDFS-2188, HDFS-2334, HDFS-2477, HDFS-2495, HDFS-2476, HDFS-1580, HDFS-1765 to 0.23.3 section in CHANGES.txt
new 0aeed92 HADOOP-8141. Add method to SecurityUtil to init krb5 cipher suites. Contributed by Todd Lipcon.
new 0a2b413 HDFS-3060. Bump TestDistributedUpgrade#testDistributedUpgrade timeout. Contributed by Eli Collins
new 22738ae HDFS-2038. Update TestHDFSCLI to handle relative paths with globs. Contributed by Kihwal Lee
new c36326a Moving HADOOP-7557, HADOOP-8108, HADOOP-7888, HADOOP-2430, HADOOP-7358, HADOOP-7729, HADOOP-7717 to 0.23.3 section
new b874d06 Moving HDFS-3036, HDFS-3014, HDFS-3003, HDFS-2878, HDFS-208, HDFS-2764, HDFS-2410, HDFS-2285, HDFS-2507 to 0.23.3 section
new b19d118 HDFS-2976. Remove unnecessary method (tokenRefetchNeeded) in DFSClient. (Contributed by Uma Maheswara Rao G)
new 6c0c140 HDFS-2976 corrected the previous wrong commit for this issue.
new 069fb57 HDFS-2976 removed the unused imports that were missed in previous commit.
new d8cc362 HADOOP-8154. DNS#getIPs shouldn't silently return the local host IP for bogus interface names. Contributed by Eli Collins
new 07c3b02 HADOOP-7806. Support binding to sub-interfaces. Contributed by Eli Collins
new 381a9b2 HDFS-2966
new 4001b95 MAPREDUCE-3578. Starting nodemanager as root gives "Unknown -jvm option"
new 3c37340 HADOOP-8146. FsShell commands cannot be interrupted. Contributed by Daryn Shar
new ad3d3f5 MAPREDUCE-3348. Fixed a bug in MR client to redirect to JobHistoryServer correctly when RM forgets the app. Contributed by Devaraj K.
new 1c534d0 MAPREDUCE-3991. Streaming FAQ has some wrong instructions about input files splitting. (harsh)
new 558cc8c MAPREDUCE-3982. Fixed FileOutputCommitter to not err out for an 'empty-job' whose tasks don't write any outputs. Contributed by Robert Joseph Evans.
new ed4c222 MAPREDUCE-3773. Add queue metrics with buckets for job run times. Contributed by Owen O'Malley.
new 501a283 HDFS-3056. Add a new interface RollingLogs for DataBlockScanner logging.
new c8f2889 HDFS-3056: add the new file for the previous commit.
new 46a88de Moving HDFS-1623 and HADOOP-7454 to 0.23.3 section in CHANGES.txt files
new 42900bd HADOOP-7900. LocalDirAllocator confChanged() accesses conf.get() twice. Contributed by Ravi Gummadi.
new 7d60932 MAPREDUCE-3829. [Gridmix] Gridmix should give better error message when input data directory already exists and -generate option is given.(ravigummadi)
new 3f46a62 MAPREDUCE-3974. Change to release 23.3
new 1a75ec8 HDFS-2731. Add command to bootstrap the Standby Node's name directories from the Active NameNode. Contributed by Todd Lipcon.
new ab20dae HDFS-2303. Unbundle jsvc. Contributed by Roman Shaposhnik and Mingjie Lai.
new 03e036b HADOOP-8164. Back slash as path separator is handled for Windows only. Contributed by Daryn Sharp.
new 3e582c6 HDFS-3082. Clean up FSDatasetInterface and change DataNode.data to package private.
new 18fd4c9 HADOOP-8169. javadoc generation fails with java.lang.OutOfMemoryError: Java heap space (tgraves via bobby)
new a0ee9ad HDFS-3057. httpfs and hdfs launcher scripts should honor CATALINA_HOME and HADOOP_LIBEXEC_DIR (rvs via tucu)
new 9180eca HADOOP-8167. Configuration deprecation logic breaks backwards compatibility (tucu)
new 7609243 MAPREDUCE-4007. JobClient getJob(JobID) should return NULL if the job does not exist (for backwards compatibility) (tucu)
new 59eb544 HDFS-3093. Fix bug where namenode -format interpreted the -force flag in reverse. Contributed by Todd Lipcon.
new af0227e MAPREDUCE-3970 ServiceOperations class
new 5a5307a MAPREDUCE-3970 ServiceOperations class
new 1177d4e HDFS-3005. FSVolume.decDfsUsed(..) should be synchronized.
new 6d96a28 HDFS-3067. NPE in DFSInputStream.readBuffer if read is repeated on corrupted block. Contributed by Henry Robinson.
new 65425b0 HDFS-3099. SecondaryNameNode does not properly initialize metrics system. Contributed by Aaron T. Myers.
new dffd379 HADOOP-8173. FsShell needs to handle quoted metachars. Contributed by Daryn Sharp
new 889a863 HADOOP-8175. FsShell: Add -p option to mkdir. Contributed by Daryn Sharp
new c7feccd Revert previous commit r1301273 for HADOOP-8175.
new 49619e8 HDFS-3062. Fix bug which prevented MR job submission from creating delegation tokens on an HA cluster. Contributed by Mingjie Lai.
new 7e5b601 HDFS-3101. Cannot read empty file using WebHDFS.
new 9b2a324 HDFS-3098. Update and add tests for HADOOP-8173. Contributed by Daryn Sharp
new 483ca92 HADOOP-8175. Add -p option to mkdir in FsShell. Contributed by Daryn Sharp
new 2a0147f HADOOP-6941. Adds support for building Hadoop with IBM's JDK. Contributed by Stephen Watt, Eli Collins and Devaraj Das.
new 3f77993 HADOOP-6941. Forgot to add a License header
new 8c7f5f2 MAPREDUCE-3431
new e8ae528 MAPREDUCE-3431
new 3e8c273 MAPREDUCE-4010. TestWritableJobConf fails on trunk (tucu via bobby)
new af3163d HADOOP-8176. Disambiguate the destination of FsShell copies (Daryn Sharp via bobby)
new 662b188 HDFS-3088. Move FSDatasetInterface inner classes to a package.
new 2a00244 HDFS-3104. Add tests for HADOOP-8175. Contributed by Daryn Sharp
new 274d690 MAPREDUCE-4005. Fixes broken AM container logs URL on ResourceManager Application Info page. (Contributed by Jason Lowe)
new f58e3c8 MAPREDUCE-4006. History server container log web UI sometimes combines stderr/stdout/syslog contents together (Siddharth Seth via tgraves)
new be5181f Fixing an issue to do with setting of correct groups for tasks. Contributed by Aaron T Myers.
new 3573d50 HDFS-3111. Missing license headers in trunk. (Contributed by Uma Maheswara Rao G).
new 875080c HDFS-3111. Missing license headers in trunk. Deleted this file from svn repositiry as this file was already empty. (Contributed by Uma MAheswara Rao G).
new 0ac5e89 HADOOP-8088. User-group mapping cache incorrectly does negative caching on transient failures (Khiwal Lee via bobby)
new a019a6f HADOOP-8177. MBeans shouldn't try to register when it fails to create MBeanName. (Contributed by Devaraj K).
new 978e2d6 HADOOP-8183. Stop using mapred.used.genericoptions.parser (harsh)
new f77b1a6 HDFS-3091. Update the usage limitations of ReplaceDatanodeOnFailure policy in the config description for the smaller clusters. Contributed by Nicholas.
new 9d8d02b MAPREDUCE-4025. AM can crash if task attempt reports bogus progress value (Jason Lowe via bobby)
new 6326605 HDFS-3105. Add DatanodeStorage information to block recovery.
new 54db828 HADOOP-6924. Adds a directory to the list of directories to search for the libjvm.so file. The new directory is found by running a 'find' command and the first output is taken. This was done to handle the build of Hadoop with IBM's JDK. Contributed by Stephen Watt, Guillermo Cabrera and Devaraj Das.
new 6b4625e HADOOP-6924. Moved the entry in CHANGES.txt to the right place.
new 21426e6 HADOOP-8121. Active Directory Group Mapping Service. Contributed by Jonathan Natkins.
new 04a47de MAPREDUCE-3992. Reduce fetcher doesn't verify HTTP status code of response. Contributed by Todd Lipcon.
new 12fca4c HADOOP-8189. LdapGroupsMapping shouldn't throw away IOException. Contributed by Jonathan Natkins.
new 40a8293 MAPREDUCE-4034. Unable to view task logs on history server with mapreduce.job.acl-view-job=* (Jason Lowe and Siddarth Seth via bobby)
new a24d12b MAPREDUCE-1740. NPE in getMatchingLevelForNodes when node locations are variable depth (ahmed via tucu)
new 4ceca97 HDFS-3083. Cannot run an MR job with HA and security enabled when second-listed NN active. Contributed by Aaron T. Myers.
new 8fd473c HADOOP-8191. SshFenceByTcpPort uses netcat incorrectly. Contributed by Todd Lipcon.
new 19495b2 HADOOP-7788. Add simple HealthMonitor class to watch an HAService. Contributed by Todd Lipcon.
new 9e108e6 HDFS-3086. Change Datanode not to send storage list in registration.
new 7b3a98c MAPREDUCE-3953. [Gridmix] Gridmix throws NPE and does not simulate a job if the trace contains null taskStatus for a task.(ravigummadi)
new f55a1c0 HDFS-2834. Add a ByteBuffer-based read API to DFSInputStream. Contributed by Henry Robinson.
new 2f820dd HDFS-309. FSEditLog should log progress during replay. Contributed by Sho Shimauchi.
new 0c4acdc HDFS-3100. In BlockSender, throw an exception when it needs to verify checksum but the meta data does not exist. Contributed by Brandon Li
new 76817c2 HADOOP-8157. Fix race condition in Configuration that could cause spurious ClassNotFoundExceptions after a GC. Contributed by Todd Lipcon.
new a8ebdae HADOOP-8197. Configuration logs WARNs on every use of a deprecated key (tucu)
new 4feef86 HDFS-3044. fsck move should be non-destructive by default. Contributed by Colin Patrick McCabe
new 4e58186 Removed some logs.
new 0259a3e HADOOP-8200. Remove HADOOP_[JOBTRACKER|TASKTRACKER]_OPTS. Contributed by Eli Collins
new b5a8ccb HADOOP-8159. NetworkTopology: getLeaf should check for invalid topologies. Contributed by Colin Patrick McCabe
new b795c65 HDFS-3071. haadmin failover command does not provide enough detail when target NN is not ready to be active. Contributed by Todd Lipcon.
new 081eda9 HADOOP-8184. ProtoBuf RPC engine uses the IPC layer reply packet. Contributed by Sanjay Radia
new f67c2d1 MAPREDUCE-4043. Secret keys set in Credentials are not seen by tasks (Jason Lowe via bobby)
new 1ff0359 HADOOP-7030. Add TableMapping topology implementation to read host to rack mapping from a file. Contributed by Patrick Angeles and tomwhite.
new 805c128 HADOOP-8163. Improve ActiveStandbyElector to provide hooks for fencing old active. Contributed by Todd Lipcon.
new 4cb809b HDFS-3132. Fix findbugs warning on HDFS trunk. Contributed by Todd Lipcon.
new 90ea037 HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon.
new ea868d3 HDFS-3116. Typo in fetchdt error message. Contributed by AOE Takashi.
new 39775dc Revert HADOOP-8193 from r1304967. Patch introduced some NPEs in a test case.
new 840df19 HADOOP-8193. Refactor FailoverController/HAAdmin code to add an abstract class for "target" services. Contributed by Todd Lipcon.
new 1d5e7dd HADOOP-8204. TestHealthMonitor fails occasionally. Contributed by Todd Lipcon.
new 606114d MAPREDUCE-3533. Add a channel between RM and AM to get information on nodes. Contributed by Bikas Saha.
new d583685 MAPREDUCE-4066. Use default value when fetching MR_AM_STAGING_DIR. Contributed by xieguiming.
new ce1a7ec HDFS-2941. Add an administrative command to download a copy of the fsimage from the NN. Contributed by Aaron T. Myers.
new 429baf6 Move CHANGES.txt entry for HDFS-2941 to the right version.
new 1a9385d MAPREDUCE-3353. Fixed commit msg to point to right jira.
new 31c2e3f HADOOP-8212. Improve ActiveStandbyElector's behavior when session expires. Contributed by Todd Lipcon.
new 1ebcc37 HDFS-3089. Move FSDatasetInterface and the related classes to a package.
new 5e38a9a Revert 1305590 for HDFS-3089.
new 67bdbd6 (recommit) HDFS-3089. Move FSDatasetInterface and the related classes to a package.
new 1650a49 MAPREDUCE-4061. RM only has 1 AM launcher thread (tgraves via bobby)
new 99a3214 HDFS-3129. NetworkTopology: add test that getLeaf should check for invalid topologies. Contributed by Colin Patrick McCabe
new 7ef57bf Fix CHANGES.txt for HDFS-3129
new 525ceb9 HDFS-2413. Add an API DistributedFileSystem.isInSafeMode() and change DistributedFileSystem to @InterfaceAudience.LimitedPrivate. Contributed by harsh
new 578f413 HADOOP-8206. Common portion of a ZK-based failover controller. Contributed by Todd Lipcon.
new 466908e HDFS-3131. Improve TestStorageRestore. Contributed by Brandon Li.
new 600e327 HADOOP-8202. RPC stopProxy() does not close the proxy correctly. Contributed by Hari Mankude.
new 940dac5 HDFS-3125. Add JournalService to enable Journal Daemon. Contributed by Suresh Srinivas.
new f9fec98 HADOOP-8216. Address log4j.properties inconsistencies btw main and template dirs. Contributed by Patrick Hunt
new 84a97fb HADOOP-8218. RPC.closeProxy shouldn't throw error when closing a mock. Contributed by Todd Lipcon.
new f23fc4a Branch for automatic NN failover support (HDFS-3042)
new 67a7419 Changed version in trunk to 3.0.0-SNAPSHOT.
new 1427468 HDFS-3156. TestDFSHAAdmin is failing post HADOOP-8202. Contributed by Aaron T. Myers.
new 991eddd Change "0.23.3" to "2.0.0" in CHANGES.txt files.
new aa8cb22 HDFS-3143. TestGetBlocks.testGetBlocks is failing. Contributed by Arpit Gupta.
new 0475795 HDFS-3139. Minor Datanode logging improvement. Contributed by Eli Collins
new 99a68a1 HDFS-3155. Clean up FSDataset implemenation related code.
new a9471b9 Merge trunk into HDFS-3042 branch
new 17d22e6 HDFS-3158. LiveNodes member of NameNodeMXBean should list non-DFS used space and capacity per DN. Contributed by Aaron T. Myers.
new e7444b2 HDFS-3160. httpfs should exec catalina instead of forking it. Contributed by Roman Shaposhnik
new db3e592 REDUCE-3955. Change MR to use ProtobufRpcEngine from hadoop-common instead of ProtoOverHadoopRpcEngine. (Contributed by Jitendra Nath Pandey)
new 9bb6a02 MAPREDUCE-3377. Added a unit test to ensure OutputCommitter.checkOutputSpecs is called prior to copying job.xml. Contributed by Jane Chen.
new f11a5dc MAPREDUCE-4081. TestMROutputFormat.java does not compile (Jason Lowe via bobby)
new 978404d HADOOP-8208. Disallow self failover. Contributed by Eli Collins
new da58921 HDFS-3066. Cap space usage of default log4j rolling policy. Contributed by Patrick Hunt
new d05cc8e MAPREDUCE-3989. Cap space usage of default log4j rolling policy. Contributed by Patrick Hunt
new 9b588ed HADOOP-8149. Cap space usage of default log4j rolling policy. Contributed by Patrick Hunt
new 57e175f hadoop-mapreduce-client-app's mrapp-generated-classpath file should not be in the module JAR (tucu)
new 0441686 Amend HADOOP-8212 (Improve ActiveStandbyElector's behavior when session expires)
new 5190878 HDFS-3142. TestHDFSCLI.testAll is failing. Contributed by Brandon Li.
new 64641c2 HDFS-3137. Bump LAST_UPGRADABLE_LAYOUT_VERSION to -16. Contributed by Eli Collins
new c5c476e Move HDFS-3137 to the right place in CHANGES.txt
new d1893c8 MAPREDUCE-3916. various issues with running yarn proxyserver (devaraj via tucu)
new a8cbf19 HDFS-3138. Move DatanodeInfo#ipcPort to DatanodeID. Contributed by Eli Collins
new 6693167 HADOOP-8220. ZKFailoverController doesn't handle failure to become active correctly. Contributed by Todd Lipcon.
new 5437013 HADOOP-8228. Auto HA: Refactor tests and add stress tests. Contributed by Todd Lipcon.
new c4c7ee5 MAPREDUCE-4091. tools testcases failing because of MAPREDUCE-4082 (tucu)
new 170ff8d MAPREDUCE-4087. [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases (ravigummadi)
new ff897e7 HDFS-3070. HDFS balancer doesn't ensure that hdfs-site.xml is loaded. Contributed by Aaron T. Myers.
new eeb687d HDFS-3172. dfs.upgrade.permission is dead code. Contributed by Eli Collins
new 8bd825b HDFS-3164. Move DatanodeInfo#hostName to DatanodeID. Contributed by Eli Collins
new eacd9ab HADOOP-8211. Update commons-net version to 3.1. Contributed by Eli Collins
new 0663dba HDFS-3171. The DatanodeID "name" field is overloaded. Contributed by Eli Collins
new a232d5c HDFS-3167. CLI-based driver for MiniDFSCluster. Contributed by Henry Robinson.
new 43afa4e HDFS-2995. start-dfs.sh should only start the 2NN for namenodes with dfs.namenode.secondary.http-address configured. Contributed by Eli Collins
new 2c47463 HADOOP-8199. Fix issues in start-all.sh and stop-all.sh Contributed by Devaraj K.
new 78e3568 HADOOP-8238. NetUtils#getHostNameOfIP blows up if given ip:port string w/o port. Contributed by Eli Collins
new be7dd83 HDFS-3144. Refactor DatanodeID#getName by use. Contributed by Eli Collins
new ad0c49e Fixup CHANGES.txt for HDFS-3144.
new be8a0d1 HDFS-3174. Fix assert in TestPendingDataNodeMessages. Contributed by Eli Collins
new a4ccb8f HADOOP-8236. haadmin should have configurable timeouts for failover commands. Contributed by Todd Lipcon.
new 2fd05aa Merge trunk into auto-failover branch
new bc13dfb HDFS-3130. Move fsdataset implementation to a package.
new 950273b HADOOP-8210. Common side of HDFS-3148: The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins
new 57af34b Preping for 0.23.3 stabilization.
new 9b1d294 HADOOP-8242. AbstractDelegationTokenIdentifier: add getter methods for owner and realuser. Contributed by Colin Patrick McCabe
new 3a8d123 MAPREDUCE-4092. commitJob Exception does not fail job (Jon Eagles via bobby)
new 354025b MAPREDUCE-4095. TestJobInProgress#testLocality uses a bogus topology. Contributed by Colin Patrick McCabe
new bb74427 MAPREDUCE-4089. Hung Tasks never time out. (Robert Evans via tgraves)
new 01ce7ba MAPREDUCE-4024. RM webservices can't query on finalStatus (Tom Graves via bobby)
new 72b3f30 HDFS-3148. The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins
new f44ca78 Previous commit was for HDFS-3120, fixing up CHANGES.txt
new 4f15b9d HDFS-3148. The client should be able to use multiple local interfaces for data transfer. Contributed by Eli Collins
new e449de0 HDFS-3126. Journal stream from Namenode to BackupNode needs to have timeout. Contributed by Hari Mankude.
new 789ed57 HDFS-2185. HDFS portion of ZK-based FailoverController. Contributed by Todd Lipcon.
new 4d876c7 MAPREDUCE-4060. Multiple SLF4J binding warning (Jason Lowe via bobby)
new 8c8dbba MAPREDUCE-3983. TestTTResourceReporting can fail, and should just be deleted (Ravi Prakash via bobby)
new 00eb28d MAPREDUCE-4012 Hadoop Job setup error leaves no useful info to users. (tgraves)
new 2b5c36b MAPREDUCE-4062. AM Launcher thread can hang forever (tgraves via bobby)
new 949b34e Missed a test file as part of MAPREDUCE-4062
new 20184e7 MAPREDUCE-4072. User set java.library.path seems to overwrite default creating problems native lib loading (Anupam Seth via bobby)
new b45c450 MAPREDUCE-3988. mapreduce.job.local.dir doesn't point to a single directory on a node. (Eric Payne via bobby)
new 0db8003 HDFS-3166. Add timeout to Hftp connections. Contributed by Daryn Sharp
new 7b387f5 MAPREDUCE-3999. Tracking link gives an error if the AppMaster hasn't started yet (Ravi Prakash via bobby)
new e561cb9 HDFS-3176. Use MD5MD5CRC32FileChecksum.readFields() in JsonUtil . Contributed by Kihwal Lee
new 1f41979 MAPREDUCE-4020. Web services returns incorrect JSON for deep queue tree (Anupam Seth via tgraves)
new 84ff2d6 HADOOP-8243. Security support broken in CLI (manual) failover controller. Contributed by Todd Lipcon.
new 39a5fd5 Merge trunk into auto-failover branch
new 9972a96 HDFS-3187. Upgrade guava to 11.0.2. Contributed by Todd Lipcon.
new 30e1b3b HADOOP-8215. Security support for ZK Failover controller. Contributed by Todd Lipcon.
new 8c0366b HDFS-3168. Remove unnecessary "throw IOException" and change fields to final in FSNamesystem and BlockManager.
new 7525ee5 HDFS-3000. Add a public API for setting quotas. Contributed by Aaron T. Myers.
new dae6dab HADOOP-8007. Use substitution tokens for fencing argument. Contributed by Todd Lipcon.
new d99c295 MAPREDUCE-3672. Killed maps shouldn't be counted towards JobCounter.NUM_FAILED_MAPS. (Anupam Seth via tgraves)
new da1b01c MAPREDUCE-4098. TestMRApps testSetClasspath fails (tucu)
new b518a98 moved HADOOP-8088 to 0.23.3
new 4e44259 MAPREDUCE-3682 Tracker URL says AM tasks run on localhost. (Ravi Prakash via tgraves)
new 594dd9e MAPREDUCE-3082. Archive command take wrong path for input file with current directory (John George via bobby)
new db075f9 MAPREDUCE-3650. testGetTokensForHftpFS() fails (Ravi Prakash via bobby)
new 4f7f58f Updated CHANGES.txt to reflect HDFS-2564 merge
new a7d6bdc HDFS-3084. FenceMethod.tryFence() and ShellCommandFencer should pass namenodeId as well as host:port. Contributed by Todd Lipcon.
new 1b93f8e MAPREDUCE-4103. Fix HA docs for changes to shell command fencer args. Contributed by Todd Lipcon.
new b74d742 HADOOP-8245. Fix flakiness in TestZKFailoverController. Contributed by Todd Lipcon.
new fcacb14 HADOOP-8179. risk of NPE in CopyCommands processArguments() (Daryn Sharp via bobby)
new 00a1548 Merge trunk into auto-HA branch
new ba688e1 HDFS-3102. Add CLI tool to initialize the shared-edits dir. Contributed by Aaron T. Myers.
new 1d6038e MAPREDUCE-4097. tools testcases fail because missing mrapp-generated-classpath file in classpath (rvs via tucu)
new 8a109eb HADOOP-8244. Improve comments on ByteBufferReadable.read. Contributed by Henry Robinson.
new 4f6e0a5 HDFS-3050. rework OEV to share more code with the NameNode. Contributed by Colin Patrick McCabe
new 663fbd4 HDFS-3199. TestValidateConfigurationSettings is failing. Contributed by Todd Lipcon
new 85a76eb HADOOP-7757. Test file reference count is at least 3x actual value (Jon Eagles via bobby)
new 8e739ff HDFS-3202. NamespaceInfo PB translation drops build version. Contributed by Aaron T. Myers.
new 4c908d0 HDFS-3109. Remove hsqldf exclusions from pom.xml. Contributed by Ravi Prakash.
new bf5b508 HADOOP-6963. In FileUtil.getDU(..), neither include the size of directories nor follow symbolic links. Contributed by Ravi Prakash
new 76ec7a1 Moved HADOOP-6963 to 0.23.3
new f843f59 HADOOP-8180. Remove hsqldb since its not needed from pom.xml (Ravi Prakash via tgraves
new 98df316 MAPREDUCE-3621. TestDBJob and TestDataDrivenDBInputFormat ant tests fail (Ravi Prakash via tgraves)
new c76b264 MAPREDUCE-4073. CS assigns multiple off-switch containers when using multi-level-queues (Siddharth Seth via bobby)
new 80bbefa HDFS-3178. Add states and state handler for journal synchronization in JournalService.
new 861c872 HDFS-3204. Minor modification to JournalProtocol.proto to make it generic. Contributed by Suresh Srinivas.
new 112c324 HDFS-3210. JsonUtil#toJsonMap for for a DatanodeInfo should use "ipAddr" instead of "name". Contributed by Eli Collins
new e505b7e HDFS-3208. Bogus entries in hosts files are incorrectly displayed in the report. Contributed by Eli Collins
new 844faef HDFS-3200. Scope all ZKFC configurations by nameservice. Contributed by Todd Lipcon.
new 04cc1d6 HADOOP-8251. Fix SecurityUtil.fetchServiceTicket after HADOOP-6941. Contributed by Todd Lipcon.
new d483b6f HADOOP-8077. HA: fencing method should be able to be configured on a per-NN or per-NS basis. Contributed by Todd Lipcon.
new 30068a1 Merge trunk into auto-failover branch.
new b455e54 Fix trivial mistake in test code in previous merge - tests were failing due to misuse of NodeFencer.create
new d166bd1 HDFS-3110. Use directRead API to reduce the number of buffer copies in libhdfs. Contributed by Henry Robinson.
new 31aee4a HADOOP-8086. KerberosName silently sets defaultRealm to empty if the Kerberos config is not found, it should log a WARN (tucu)
new 90d9cab HADOOP-8249. invalid hadoop-auth cookies should trigger authentication if info is avail before returning HTTP 401 (tucu)
new adeef5e MAPREDUCE-4113. Fix tests org.apache.hadoop.mapred.TestClusterMRNotification (Devaraj K via bobby)
new b447d94 MAPREDUCE-4112. Fix tests org.apache.hadoop.mapred.TestClusterMapReduceTestCase (Devaraj K via bobby)
new 2bb3407 MAPREDUCE-4111. Fix tests in org.apache.hadoop.mapred.TestJobName (Devaraj K via bobby)
new b3ac250 HDFS-3136. Remove SLF4J dependency as HDFS does not need it to fix unnecessary warnings. Contributed by Jason Lowe.
new 5345916 HADOOP-8014. ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary (John George via bobby)
new 58e920d HDFS-2505. Add a test to verify getFileChecksum(..) with ViewFS. Contributed by Ravi Prakash
new c156906 MAPREDUCE-4051. Remove the empty hadoop-mapreduce-project/assembly/all.xml file (Ravi Prakash via bobby)
new 5af7077 Added toString to ContainerToken. Contributed by Jason Lowe.
new b435e22 MAPREDUCE-4110. Fix tests in TestMiniMRClasspath & TestMiniMRWithDFSWithDistinctUsers (Devaraj K via bobby)
new fcb3ff5 HADOOP-8014. ViewFileSystem does not correctly implement getDefaultBlockSize, getDefaultReplication, getContentSummary
new c42a90b HADOOP-8257. TestZKFailoverControllerStress occasionally fails with Mockito error. Contributed by Todd Lipcon.
new 97804ba HDFS-3223. add zkfc to hadoop-daemon.sh script. Contributed by Todd Lipcon.
new de3fb5c HDFS-3121. Add HDFS tests for HADOOP-8014 change. Contributed by John George.
new 02f5e43 HDFS-3121. Add HDFS tests for HADOOP-8014 change. Contributed by John George. Missed adding the file in the earlier commit.
new 2ab67dc HDFS-3226. Allow GetConf tool to print arbitrary keys. Contributed by Todd Lipcon.
new 74b4b45 HDFS-3211. Add fence(..) and replace NamenodeRegistration with JournalInfo and epoch in JournalProtocol. Contributed by suresh
new 3646705 HADOOP-8260. Replace ClientBaseWithFixes with our own modified copy of the class. Contributed by Todd Lipcon.
new ca6f094 Merge trunk into auto-failover branch
new 693ec45 HADOOP-8246. Auto-HA: automatically scope znode by nameservice ID. Contributed by Todd Lipcon.
new ee5daee HDFS-3214. InterDatanodeProtocolServerSideTranslatorPB doesn't handle null response from initReplicaRecovery. Contributed by Todd Lipcon.
new 909176c HADOOP-8261. Har file system doesn't deal with FS URIs with a host but no port. Contributed by Aaron T. Myers.
new 3ced5ea HDFS-3119. Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file. Contributed by Ashish Singhi.
new 706394d HDFS-3004. Implement Recovery Mode. Contributed by Colin Patrick McCabe
new 48ab08f MAPREDUCE-4117. mapred job -status throws NullPointerException (Devaraj K via bobby)
new 241e3d4 MAPREDUCE-4105. Yarn RackResolver ignores rack configurations. Contributed by Ahmed Radwan.
new b28f134 MAPREDUCE-3869. Fix classpath for DistributedShell application. (Contributed by Devaraj K)
new 91528ce HDFS-3234. Accidentally left log message in GetConf after HDFS-3226. Contributed by Todd Lipcon.
new 4b0d4d5 HADOOP-8263. Stringification of IPC calls not useful. Contributed by Todd Lipcon.
new 9597c81 HDFS-3236. NameNode does not initialize generic conf keys when started with -initializeSharedEditsDir. Contributed by Aaron T. Myers.
new 53dc854 HDFS-3235. MiniDFSClusterManager doesn't correctly support -format option. Contributed by Henry Robinson.
new df3e1a3 HDFS-3240. Drop log level of "heartbeat: ..." in BPServiceActor to DEBUG. Contributed by Todd Lipcon.
new 482e063 HADOOP-8264. Remove irritating double double quotes in front of hostname (Bernd Fondermann via bobby)
new 926f0a5 HDFS-3238. ServerCommand and friends don't need to be writables. Contributed by Eli Collins
new 000859a MAPREDUCE-3983. TestTTResourceReporting can fail, and should just be deleted
new cbb5f61 MAPREDUCE-4059. The history server should have a separate pluggable storage/query interface. (Robert Evans via tgraves).
new 7937468 MAPREDUCE-4099. ApplicationMaster may fail to remove staging directory (Jason Lowe via bobby)
new d9b740c MAPREDUCE-4057. Update RAID for the HA and fsdataset changes. Contributed by Devaraj K
new 2accda3 MAPREDUCE-4017. Add jobname to jobsummary log (tgraves and Koji Noguchi via bobby)
new eb74ff0 MAPREDUCE-4076. Stream job fails with ZipException when use yarn jar command (Devaraj K via bobby)
new 94843b8 MAPREDUCE-4108. Fix tests in org.apache.hadoop.util.TestRunJar (Devaraj K via tgraves)
new 3ffdb91 HDFS-3094. add -nonInteractive and -force option to namenode -format command. Contributed by Arpit Gupta.
new 7c2e10e HDFS-3248. bootstrapStandby repeated twice in hdfs namenode usage message. Contributed by Colin Patrick McCabe.
new 58228e4 HDFS-3243. TestParallelRead timing out on jenkins. Contributed by Henry Robinson.
new 80447bd HDFS-3244. Remove dead writable code from hdfs/protocol. Contributed by Eli Collins
new e235dd3 HDFS-2696. Fix the fuse-fds build. Contributed by Bruno Mahé
new 13bfe47 MAPREDUCE-4040. History links should use hostname rather than IP address. (Contributed by Bhallamudi Venkata Siva Kamesh)
new 21824d8 HDFS-3247. Improve bootstrapStandby behavior when original NN is not active. Contributed by Todd Lipcon.
new dab66be HDFS-3249. Use ToolRunner.confirmPrompt in NameNode. Contributed by Todd Lipcon.
new 41a014c HADOOP-8247. Add a config to enable auto-HA, which disables manual FailoverController. Contributed by Todd Lipcon.
new 2bf1997 Merge trunk into auto-failover branch.
new 6f2aae0 Resolve trivial compilation error after previous merge
new bc2340e HADOOP-8147. test-patch should run tests with -fn to avoid masking test failures (Robert Evans via tgraves)
new cfafd8c MAPREDUCE-4099 amendment. ApplicationMaster will remove staging directory after the history service is stopped. (Contributed by Jason Lowe)
new ed678e5 HDFS-3179. Improve the exception message thrown by DataStreamer when it failed to add a datanode.
new 7809acd MAPREDUCE-3932. Fix the TaskAttempt state machine to handle CONTIANER_LAUNCHED and CONTIANER_LAUNCH_FAILED events in additional states. (Contributed by Robert Joseph Evans)
new aca6ca0 MAPREDUCE-4107. Fix tests in org.apache.hadoop.ipc.TestSocketFactory (Devaraj K via tgraves)
new b31d9d9 HADOOP-8270. hadoop-daemon.sh stop action should return 0 for an already stopped service. Contributed by Roman Shaposhnik
new 7f42764 HDFS-2983. Relax the build version check to permit rolling upgrades within a release. Contributed by Aaron T. Myers.
new 4ea0426 HDFS-3260. TestDatanodeRegistration should set minimum DN version in addition to minimum NN version. Contributed by Aaron T. Myers.
new 989d65a HDFS-3261. TestHASafeMode fails on HDFS-3042 branch. Contributed by Todd Lipcon.
new d310c48 MAPREDUCE-4083. [Gridmix] NPE in cpu emulation. (amarrk)
new 346d507 MAPREDUCE-4140. mapreduce classes incorrectly importing "clover.org.apache.*" classes. Contributed by Patrick Hunt
new f01ede2 HADOOP-8144. pseudoSortByDistance in NetworkTopology doesn't work properly if no local node and first node is local rack node. Contributed by Junping Du
new 72406e9 HDFS-3255. HA DFS returns wrong token service. Contributed by Daryn Sharp.
new ecb30a4 MAPREDUCE-4050. For tasks without assigned containers, changes the node text on the UI to N/A instead of a link to null. (Contributed by Bhallamudi Venkata Siva Kamesh)
new 047a7b2 HADOOP-7510. Tokens should use original hostname provided instead of ip (Daryn Sharp via bobby)
new 07a4367 HDFS-3259. NameNode#initializeSharedEdits should populate shared edits dir with edit log segments. Contributed by Aaron T. Myers.
new 4f230ad HDFS-3256. HDFS considers blocks under-replicated if topology script is configured with only 1 rack. Contributed by Aaron T. Myers.
new 2ed825e HDFS-3159. Document NN auto-failover setup and configuration. Contributed by Todd Lipcon.
new 10a0fcb Add .classpath, .project and .settings to svn:ignore.
new 02db5b7 MAPREDUCE-4147. YARN should not have a compile-time dependency on HDFS.
new 27ea3ab MAPREDUCE-4128. AM Recovery expects all attempts of a completed task to also be completed. (Bikas Saha via bobby)
new 5a20d44 HDFS-2799. Trim fs.checkpoint.dir values. Contributed by Amith D K
new 9a10b4e MAPREDUCE-4144. Fix a NPE in the ResourceManager when handling node updates. (Contributed by Jason Lowe)
new d6533cc Move CHANGES.txt message for HDFS-2765 to be under 2.0.0 instead of trunk.
new f694ecd Add .classpath, .project and .settings to svn:ignore.
new 841fdc5 HDFS-3273. Refactor BackupImage and FSEditLog, and rename JournalListener.rollLogs(..) to startLogSegment(..).
new 15fe3ae HDFS-2708. Stats for the # of blocks per DN. Contributed by Aaron T. Myers.
new fccbc53 HADOOP-8283. Allow tests to control token service value (Daryn Sharp via bobby)
new 24d6a8b MAPREDUCE-4008. ResourceManager throws MetricsException on start up saying QueueMetrics MBean already exists (Devaraj K via tgraves)
new 5514683 HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan.
new 258da66 HDFS-3268. FileContext API mishandles token service and incompatible with HA. Contributed by Daryn Sharp.
new f1667de HDFS-3279. Move the FSEditLog constructor with @VisibleForTesting to TestEditLog. Contributed by Arpit Gupta
new 159646f MAPREDUCE-4156. ant build fails compiling JobInProgress (tgraves)
new 2d370ef HADOOP-8117. Upgrade test build to Surefire 2.12. Contributed by Todd Lipcon.
new 574f99b HDFS-3284. bootstrapStandby fails in secure cluster. Contributed by Todd Lipcon.
new 1d5861a HDFS-3165. HDFS Balancer scripts are refering to wrong path of hadoop-daemon.sh. Contributed by Amith D K
new 207a2ad HADOOP-8282. start-all.sh refers incorrectly start-dfs.sh existence for starting start-yarn.sh. Contributed by Devaraj K
new a98ba41 HADOOP-8286. Simplify getting a socket address from conf (Daryn Sharp via bobby)
new e8eed2f HADOOP-8227. Allow RPC to limit ephemeral port range. (bobby)
new c7fb5ad Pulled HADOOP-8108 into branch-0.23
new 1675c18 Revert HADOOP-8280 so it can be recommitted using `svn mv'
new c21bd72 HADOOP-8280. Move VersionUtil/TestVersionUtil and GenericTestUtils from HDFS into Common. Contributed by Ahmed Radwan.
new fe7711d MAPREDUCE-3942. Randomize master key generation for ApplicationTokenSecretManager and roll it every so often. (Contributed by Vinod Kumar Vavilapalli)
new b89b6bd MAPREDUCE-4160. some mrv1 ant tests fail with timeout - due to 4156 (tgraves)
new ca9f621 MAPREDUCE-4151. RM scheduler web page should filter apps to those that are relevant to scheduling (Jason Lowe via tgraves)
new a15e69c MAPREDUCE-4134. Remove references of mapred.child.ulimit etc. since they are not being used any more (Ravi Prakash via bobby)
new c80dbe5 HDFS-2652. Add support for host-based delegation tokens. Contributed by Daryn Sharp
new 7d04a96 MAPREDUCE-3972. Fix locking and exception issues in JobHistory server. (Contributed by Robert Joseph Evans)
new eeec4dc HDFS-3294. Fix code indentation in NamenodeWebHdfsMethods and DatanodeWebHdfsMethods.
new 2ada53f MAPREDUCE-4149. [Rumen] Rumen fails to parse certain counter strings. (ravigummadi)
new 14c61e6 HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh)
new 3ac2808 HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh) (fixed commit)
new d34fee4 HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh) (fixed commit after revert)
new 6b69ba6 Reverting all commit booboos made on HADOOP-8290. Resetting to state before that. Sorry for so much noise. (harsh)
new 4e4ba4c HADOOP-8290. Remove remaining references to hadoop.native.lib (harsh)
new 32d5110 MAPREDUCE-4161. create sockets consistently (Daryn Sharp via bobby)
new 8bda086 HDFS-3263. HttpFS should read HDFS config from Hadoop site.xml files (tucu)
new 2bf8be3 HDFS-3292. Remove the deprecated DiskStatus, getDiskStatus(), getRawCapacity() and getRawUsed() from DistributedFileSystem. Contributed by Arpit Gupta
new cc052d2 Move HADOOP-8117 from 3.0 to 2.0 in CHANGES.txt after commit to branch-2
new ca49126 Merge trunk into auto-HA branch
new 0c16ec4 HDFS-891. DataNode no longer needs to check for dfs.network.script. Contributed by Harsh J
new 54e61ff HDFS-3206. Miscellaneous xml cleanups for OEV. Contributed by Colin Patrick McCabe
new 4550627 HDFS-3169. TestFsck should test multiple -move operations in a row. Contributed by Colin Patrick McCabe
new c6d3537 HDFS-3282. Expose getFileLength API. Contributed by Uma Maheswara Rao G.
new ba4ec5f iHDFS-3282. Expose getFileLength API. Contributed by Uma Maheswara Rao G.
new 3edc40e MAPREDUCE-4100. [Gridmix] Bug fixed in compression emulation feature for map only jobs. (amarrk)
new 97ae5b6 MAPREDUCE-4074. Client continuously retries to RM When RM goes down before launching Application Master (xieguiming via tgraves)
new f6cadd8 HADOOP-8288. Remove references of mapred.child.ulimit etc. since they are not being used any more (Ravi Prakash via bobby)
new e380606 MAPREDUCE-4159. Job is running in Uber mode after setting "mapreduce.job.ubertask.maxreduces" to zero (Devaraj K via bobby)
new 0363ca0 HADOOP-7350. Use ServiceLoader to discover compression codec classes.
new 5b35f7d MAPREDUCE-4165. Committing is misspelled as commiting in task logs (John Eagles via bobby)
new d09cf90 MAPREDUCE-4093. Improve RM WebApp start up when proxy address is not set (Devaraj K vai bobby)
new 7d2466c MAPREDUCE-4129. Lots of unneeded counters log messages (Ahmed Radwan via bobby)
new df654cc MAPREDUCE-3867. MiniMRYarn/MiniYarn uses fixed ports (tucu)
new 8d09ab0 MAPREDUCE-3947. yarn.app.mapreduce.am.resource.mb not documented (Devaraj K via bobby)
new 49ed783 HDFS-3305. GetImageServlet should consider SBN a valid requestor in a secure HA setup. Contributed by Aaron T. Myers.
new ab8f458 HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp
new 201af20 Revert r1328482 for HDFS-3308.
new cdbe15c HDFS-3308. Uses canonical URI to select delegation tokens in HftpFileSystem and WebHdfsFileSystem. Contributed by Daryn Sharp
new 1eb1d0a MAPREDUCE-3812. Lower default allocation sizes, fix allocation configurations and document them (Harsh J via bobby)
new 589c68a HADOOP-8285 Use ProtoBuf for RpcPayLoadHeader (sanjay radia)
new 796e1a4 MAPREDUCE-4190. Improve web UI for task attempts userlog link (Tom Graves via bobby)
new 80ab78c MAPREDUCE-4133. MR over viewfs is broken (John George via bobby)
new 93c5585 HDFS-3312. In HftpFileSystem, the namenode URI is non-secure but the delegation tokens have to use secure URI. Contributed by Daryn Sharp
new 1ac0171 HADOOP-8284. clover integration broken, also mapreduce poms are pulling in clover as a dependency. (phunt via tucu)
new ebe0e9a MAPREDUCE-4141. clover integration broken, also mapreduce poms are pulling in clover as a dependency. (phunt via tucu)
new 858887e HADOOP-8152. Expand public APIs for security library classes. Contributed by Aaron T. Myers
new f340d6c MAPREDUCE-4079. Allow MR AppMaster to limit ephemeral port range.(bobby via tgraves)
new f9993b5 HADOOP-8309. Pseudo & Kerberos AuthenticationHandler should use getType() to create token (tucu)
new f4711ef HDFS-3314. HttpFS operation for getHomeDirectory is incorrect. (tucu)
new c6e1321 HADOOP-8306. ZKFC: improve error message when ZK is not running. Contributed by Todd Lipcon.
new 706e861 HADOOP-7549. Use JDK ServiceLoader mechanism to find FileSystem implementations. (tucu)
new ea32198 HDFS-3298. Add HdfsDataOutputStream as a public API.
new e29ede3 HADOOP-8314. HttpServer#hasAdminAccess should return false if authorization is enabled but user is not authenticated. (tucu)
new bcfb66e MAPREDUCE-4193. broken doc link for yarn-default.xml in site.xml. Contributed by Patrick Hunt.
new 8e99d9a Move HDFS-3282 and HDFS-3298 to 2.0.0 in CHANGES.txt.
new e84b552 HADOOP-8296. hadoop/yarn daemonlog usage wrong (Devaraj K via tgraves)
new f86352c HDFS-3318. Use BoundedInputStream in ByteRangeInputStream, otherwise, it hangs on transfers >2 GB. Contributed by Daryn Sharp
new 2584779 HDFS-3321. Fix safe mode turn off tip message. Contributed by Ravi Prakash
new 3b773da HDFS-3319. Change DFSOutputStream to not to start a thread in constructors.
new 719b719 MAPREDUCE-4194. ConcurrentModificationError in DirectoryCollection (Jonathan Eagles via bobby)
new e7583d8 MAPREDUCE-3613. web service calls header contains 2 content types (tgraves)
new 2b254da HDFS-3258. Test for HADOOP-8144 (pseudoSortByDistance in NetworkTopology for first rack local node). Contributed by Junping Du
new 4b62c68 HADOOP-8310. FileContext#checkPath should handle URIs with no port. Contributed by Aaron T. Myers.
new cda1631 MAPREDUCE-4169. Container Logs appear in unsorted order (Jonathan Eagles via bobby)
new 1a118d6 MAPREDUCE-4138. Reduce memory usage of counters due to non-static nested classes.
new 1c0231c MAPREDUCE-4189. TestContainerManagerSecurity is failing (Devaraj K via bobby)
new d28b982 HDFS-3222. DFSInputStream#openInfo should not silently get the length as 0 when locations length is zero for last partial block. Contributed by Uma Maheswara Rao G.
new 17e0354 HADOOP-8321. TestUrlStreamHandler fails. (tucu)
new 1a76c82 HDFS-3322. Use HdfsDataInputStream and HdfsDataOutputStream in Hdfs.
new 3e835c4 HDFS-3181. Fix a test case in TestLeaseRecovery2.
new 500dc61 HADOOP-8305. distcp over viewfs is broken (John George via bobby)
new 84b36cf HDFS-3309. HttpFS (Hoop) chmod not supporting octal and sticky bit permissions. (tucu)
new 920b8fa HDFS-3334. Fix ByteRangeInputStream stream leakage. Contributed by Daryn Sharp
new cd27177 HDFS-3331. In namenode, check superuser privilege for setBalancerBandwidth and acquire the write lock for finalizeUpgrade.
new a22c138 HDFS-3326. Append enabled log message uses the wrong variable. Contributed by Matthew Jacobs
new d5edc04 HDFS-2743. Streamline usage of bookkeeper journal manager. Contributed by Ivan Kelly.
new c203c76 HDFS-3265. PowerPc Build error. Contributed by Kumar Ravi.
new 2525680 MAPREDUCE-3883. Document yarn.nodemanager.delete.debug-delay-sec configuration property (Eugene Koontz via tgraves)
new 7407d5c MAPREDUCE-4209. junit dependency in hadoop-mapreduce-client is missing scope test (Radim Kolar via bobby)
new 47df469 MAPREDUCE-4206. Sorting by Last Health-Update on the RM nodes page sorts does not work correctly (Jonathon Eagles via tgraves)
new 097a001 HADOOP-8334. HttpServer sometimes returns incorrect port (Daryn Sharp via bobby)
new 8a0c732 HADOOP-8325. Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook (tucu)
new f484a3c HADOOP-8330. Update TestSequenceFile.testCreateUsesFsArg() for HADOOP-8305. Contributed by John George
new bd95655 HADOOP-8312. testpatch.sh should provide a simpler way to see which warnings changed (bobby)
new 1e88c1f HADOOP-8335. Improve Configuration's address handling (Daryn Sharp via bobby)
new 2af70cb HDFS-3293. Add toString(), equals(..) and hashCode() to JournalInfo. Contributed by Hari Mankude
new 0e31fba HADOOP-8308. Support cross-project Jenkins builds.
new 086fa86 HDFS-3275. Skip format for non-file based directories. Contributed by Amith D K.
new d37ec9d HDFS-3286. When the threshold value for balancer is zero, unexpected output is displayed. Contributed by Ashish Singhi.
new 2755a2e MAPREDUCE-4212. TestJobClientGetJob sometimes fails (Daryn Sharp via tgraves)
new 506232d MAPREDUCE-4211. Error conditions (missing appid, appid not found) are masked in the RM app page (Jonathan Eagles via bobby)
new 512fd27 MAPREDUCE-4202. TestYarnClientProtocolProvider is broken (Daryn Sharp via bobby)
new 6fec13a MAPREDUCE-4202. Updating changes to just be branch-2
new 934f466 HADOOP-8317. Update maven-assembly-plugin to 2.3 - fix build on FreeBSD (Radim Kolar via bobby)
new 7d1b804 HADOOP-8172. Configuration no longer sets all keys in a deprecated key list. (Anupam Seth via bobby)
new bbfda83 HADOOP-8275. Range check DelegationKey length. Contributed by Colin Patrick McCabe
new 70c392d HADOOP-8339. jenkins complaining about 16 javadoc warnings (Tom White and Robert Evans via tgraves)
new 8620a99 HDFS-3339. Change INode to package private. Contributed by John George
new 1c96e52 MAPREDUCE-3173. MRV2 UI doesn't work properly without internet (Devaraj K via bobby)
new 13a5af0 HADOOP-8185. Update namenode -format documentation and add -nonInteractive and -force. Contributed by Arpit Gupta.
new f8ed2ad MAPREDUCE-4210. Expose listener address for WebApp (Daryn Sharp via bobby)
new a5a2abb HADOOP-8342. HDFS command fails with exception following merge of HADOOP-8325 (tucu)
new 6575fcd HADOOP-8214. make hadoop script recognize a full set of deprecated commands (rvs via tucu)
new e1a961d HDFS-3336. hdfs launcher script will be better off not special casing namenode command with regards to hadoop.security.logger (rvs via tucu)
new ca5b406 MAPREDUCE-4219. make default container-executor.conf.dir be a path relative to the container-executor binary. (rvs via tucu)
new cbc2424 HDFS-3330. If GetImageServlet throws an Error or RTE, response should not have HTTP "OK" status. Contributed by Todd Lipcon.
new 9d57995 HADOOP-8279. Allow manual failover to be invoked when auto-failover is enabled. Contributed by Todd Lipcon.
new f6c01e2 Merge trunk into auto-HA branch
new 470b119 HDFS-3351. NameNode#initializeGenericKeys should always set fs.defaultFS regardless of whether HA or Federation is enabled. Contributed by Aaron T. Myers.
new d948998 HADOOP-8347. Hadoop Common logs misspell 'successful'. Contributed by Philip Zeyliger
new e3242b9 HADOOP-8346. Makes oid changes to make SPNEGO work. Was broken due to fixes introduced by the IBM JDK compatibility patch. Contributed by Devaraj Das.
new 48414b0 MAPREDUCE-4163. consistently set the bind address (Daryn Sharp via bobby)
new 9aae7c2 HDFS-3332. NullPointerException in DN when directoryscanner is trying to report bad blocks. Contributed by Amith D K.
new 25882b1 HDFS-3359. DFSClient.close should close cached sockets. Contributed by Todd Lipcon.
new 0318102 HADOOP-8350. Improve NetUtils.getInputStream to return a stream which has a tunable timeout. Contributed by Todd Lipcon.
new 6b58fa6 Amend previous commit of HADOOP-8350 (missed new SocketInputWrapper file)
new dd8b7ae HDFS-3350. In INode, add final to compareTo(..), equals(..) and hashCode(), and remove synchronized from updatePermissionStatus(..).
new af66607 HADOOP-8356. FileSystem service loading mechanism should print the FileSystem impl it is failing to load (tucu)
new a7993ef HADOOP-8355. SPNEGO filter throws/logs exception when authentication fails (tucu)
new 0fca4fb MAPREDUCE-4205. retrofit all JVM shutdown hooks to use ShutdownHookManager (tucu)
new a70587f HADOOP-8343. Allow configuration of authorization for JmxJsonServlet and MetricsServlet (tucu)
new 48f9577 MAPREDUCE-4048. NullPointerException exception while accessing the Application Master UI (Devaraj K via bobby)
new 407cfa3 MAPREDUCE-3958. RM: Remove RMNodeState and replace it with NodeState (Bikas Saha via bobby)
new a701c79 HDFS-3357. DataXceiver reads from client socket with incorrect/no timeout. Contributed by Todd Lipcon.
new 0bf8f11 HDFS-3303. Remove Writable implementation from RemoteEditLogManifest. Contributed by Brandon Li
new 5dbbe0e HDFS-2617. Replaced Kerberized SSL for image transfer and fsck with SPNEGO-based solution. Contributed by Jakob Homan, Alejandro Abdelnur, and Aaron T. Myers
new a2eb525 Move HDFS-2617 commit message to the right place.
new 51e520c HADOOP-8349. ViewFS doesn't work when the root of a file system is mounted. Contributed by Aaron T. Myers.
new e7d0363 HADOOP-8323. Revert HADOOP-7940, cause it may cause a performance regression. (harsh)
new 8069771 HADOOP-8327. distcpv2 and distcpv1 jars should not coexist (Dave Thompson via bobby)
new 35a3306 HADOOP-8328. Duplicate FileSystem Statistics object for 'file' scheme.
new d3599de MAPREDUCE-4220. RM apps page starttime/endtime sorts are incorrect (Jonathan Eagles via bobby)
new eca2c85 HDFS-3376. DFSClient fails to make connection to DN if there are many unusable cached sockets. Contributed by Todd Lipcon.
new 55cd161 MAPREDUCE-4226. ConcurrentModificationException in FileSystemCounterGroup.
new 567aed4 HDFS-3365. Enable users to disable socket caching in DFS client configuration. Contributed by Todd Lipcon.
new 07280c9 HADOOP-8359. Fix javadoc warnings in Configuration. Contributed by Anupam Seth
new 7aa2889 HDFS-3375. Put client name in DataXceiver thread name for readBlock and keepalive. Contributed by Todd Lipcon.
new f0f9a36 HDFS-3363. Define BlockCollection and MutableBlockCollection interfaces so that INodeFile and INodeFileUnderConstruction do not have to be used in block management. Contributed by John George
new 1d7b980 HDFS-3378. Remove DFS_NAMENODE_SECONDARY_HTTPS_PORT_KEY and DEFAULT. Contributed by Eli Collins
new a9808de HADOOP-8341. Fix or filter findbugs issues in hadoop-tools (bobby)
new aa60da6 MAPREDUCE-4162. Correctly set token service (Daryn Sharp via bobby)
new 67a514b MAPREDUCE-3850. Avoid redundant calls for tokens in TokenCache (Daryn Sharp via bobby)
new 0caac70 MAPREDUCE-4215. RM app page shows 500 error on appid parse error (Jonathon Eagles via tgraves)
new f6d6218 MAPREDUCE-4231. Update RAID to use the new BlockCollection interface.
new 408e558 HDFS-3157. Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened. Contributed by Ashish Singhi.
new 27ce5a6 Remove the empty file FSInodeInfo.java for HDFS-3363.
new b1e8831 HADOOP-8354. test-patch findbugs may fail if a dependent module is changed Contributed by Tom White and Robert Evans.
new c853a42 HADOOP-8373. Port RPC.getServerAddress to 0.23 (Daryn Sharp via bobby)
new e3fbc52 HDFS-3390. DFSAdmin should print full stack traces of errors when DEBUG logging is enabled. Contributed by Aaron T. Myers.
new 0308423 MAPREDUCE-4237. TestNodeStatusUpdater can fail if localhost has a domain associated with it (bobby)
new 1ceecf2 HADOOP-8372. NetUtils.normalizeHostName() incorrectly handles hostname starting with a numeric character. Contributed by Junping Du.
new b75f018 HDFS-3341, HADOOP-8340. SNAPSHOT build versions should compare as less than their eventual release. Contributed by Todd Lipcon.
new a67054d HDFS-3328. NPE in DataNode.getIpcPort. Contributed by Eli Collins
new 1849fde HADOOP-7868. Hadoop native fails to compile when default linker option is -Wl,--as-needed. Contributed by Trevor Robinson
new 5430346 HDFS-3396. FUSE build fails on Ubuntu 12.04. Contributed by Colin Patrick McCabe
new f1ff05b Reverting (Need to re-do the patch. new BlockInfo does not set iNode ) HDFS-3157. Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened.
new f5960f7 HDFS-3395. NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0. Contributed by Aaron T. Myers.
new 6a08654 HDFS-3230. Cleanup DatanodeID creation in the tests. Contributed by Eli Collins
new 6957c78 HADOOP-8375. test-patch should stop immediately once it has found compilation errors (bobby)
new 7e8e983 HDFS-3369. Rename {get|set|add}INode(..) methods in BlockManager and BlocksMap to {get|set|add}BlockCollection(..). Contributed by John George
new 98b00d7 HDFS-3134. harden edit log loader against malformed or malicious input. Contributed by Colin Patrick McCabe
new 032216a HADOOP-8361. Avoid out-of-memory problems when deserializing strings. Contributed by Colin Patrick McCabe
new 1a4539a Remove SHORT_STRING_MAX, left out of the previous commit.
new dfd7334 HADOOP-8388. Remove unused BlockLocation serialization. Contributed by Colin Patrick McCabe
new fcb4b19 HDFS-3401. Cleanup DatanodeDescriptor creation in the tests. Contributed by Eli Collins
new ba6360e HDFS-3385. The last block of INodeFileUnderConstruction is not necessarily a BlockInfoUnderConstruction, so do not cast it in FSNamesystem.recoverLeaseInternal(..).
new 8def56e HDFS-3400. DNs should be able start with jsvc even if security is disabled. Contributed by Aaron T. Myers
new 5dbd09e HDFS-3026. HA: Handle failure during HA state transition. Contributed by Aaron T. Myers.
new aea890f MAPREDUCE-4148. MapReduce should not have a compile-time dependency on HDFS.
new cc9c6bd HADOOP-8353. hadoop-daemon.sh and yarn-daemon.sh can be misleading on stop. Contributed by Roman Shaposhnik.
new 235a288 HADOOP-8276. Auto-HA: add config for java options to pass to zkfc daemon. Contributed by Todd Lipcon
new 2116f28 HADOOP-8366 Use ProtoBuf for RpcResponseHeader (sanjay radia)
new e2af2f1 HADOOP-8316. Audit logging should be disabled by default. Contributed by Eli Collins
new f092e9f HADOOP-8224. Don't hardcode hdfs.audit.logger in the scripts. Contributed by Tomohiko Kinebuchi
new a446ad2 MAPREDUCE-4233. NPE can happen in RMNMNodeInfo. (bobby)
new 4dfc8e6 Add HADOOP-8113 to CHANGES.txt
new 7c3dd7e Move HADOOP-8285 and HADOOP-8366 to 2.0.0 in CHANGES.txt.
new 3d18382 Move HDFS-3211 to 2.0.0 in CHANGES.txt.
new 810ae61 HADOOP-8395. Text shell command unnecessarily demands that a SequenceFile's key class be WritableComparable (harsh)
new 4cd70e8 Merge trunk into auto-HA branch
new f22341a HDFS-3404. Make putImage in GetImageServlet infer remote address to fetch from request. Contributed by Aaron T. Myers.
new f1560d3 HDFS-2312. FSNamesystem javadoc incorrectly says its for DNs. (harsh)
new 05c5fcf HDFS-3414. Balancer does not find NameNode if rpc-address or servicerpc-address are not set in client configs. Contributed by Aaron T. Myers.
new bcdb125 HDFS-3031. Fix complete() and getAdditionalBlock() RPCs to be idempotent. Contributed by Todd Lipcon.
new a8eef98 HDFS-3163. TestHDFSCLI.testAll fails if the user name is not all lowercase. Contributed by Brandon Li.
new 2a406d0 Move HDFS-2759 to branch-2 section of CHANGES.txt.
new 95710c1 HDFS-3335. check for edit log corruption at the end of the log. Contributed by Colin Patrick McCabe.
new f22276e HADOOP-8297. Writable javadocs don't carry default constructor (harsh)
new e4df14f HDFS-3417. Rename BalancerDatanode#getName to getDisplayName to be consistent with Datanode. Contributed by Eli Collins
new e9a7648 HDFS-3416. Cleanup DatanodeID and DatanodeRegistration constructors used by testing. Contributed by Eli Collins
new c4e4e56 HDFS-3419. Cleanup LocatedBlock. Contributed by Eli Collins
new b64cd82 HADOOP-8398. Cleanup BlockLocation. Contributed by Eli Collins
new 52ecdb751e HDFS-3412. Fix findbugs warnings in auto-HA branch. Contributed by Todd Lipcon.
new 7428aec HDFS-3418. Rename BlockWithLocationsProto datanodeIDs field to storageIDs. Contributed by Eli Collins
new f35294e MAPREDUCE-4238. mavenize data_join. (tgraves)
new dac828d HDFS-3197. Incorrect class comments in a few tests. Contributed by Andy Isaacson
new c743168 HADOOP-8393. hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster. (phunt via tucu)
new 2eeafa7 MAPREDUCE-4250. hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster. (phunt via tucu)
new 9142dca Move changes from 2.0.0-alpha to 2.0.1-alpha in CHANGES.txt for those that did not make rc1
new 7e3d016 MAPREDUCE-4102. job counters not available in Jobhistory webui for killed jobs (Bhallamudi Venkata Siva Kamesh via tgraves)
new 7286e8a HDFS-3413. TestFailureToReadEdits timing out. Contributed by Aaron T. Myers.
new 235502d HADOOP-8400. All commands warn 'Kerberos krb5 configuration not found' when security is not enabled. (tucu)
new e14e10f Merge trunk into auto-HA branch
new 97e1d5c HDFS-860. fuse-dfs truncate behavior causes issues with scp. Contributed by Brian Bockelman
new 0600e83 HDFS-3432. TestDFSZKFailoverController tries to fail over too early. Contributed by Todd Lipcon.
new 7b1d347 HADOOP-8405. ZKFC tests leak ZK instances. Contributed by Todd Lipcon.
new ba1e4a8 HDFS-3422. TestStandbyIsHot timeouts too aggressive. Contributed by Todd Lipcon.
new 026d0b4 HADOOP-8406. CompressionCodecFactory.CODEC_PROVIDERS iteration is thread-unsafe. Contributed by Todd Lipcon.
new 1377709 HDFS-3433. GetImageServlet should allow administrative requestors when security is enabled. Contributed by Aaron T. Myers.
new e1f0936 HADOOP-8360. empty-configuration.xml fails xml validation. Contributed by Radim Kolar. (harsh)
new dcf8470 MAPREDUCE-3543. Mavenize Gridmix. (tgraves)
new 6d71407 HDFS-1153. dfsnodelist.jsp should handle invalid input parameters. Contributed by Ravi Phulari
new 5ef725e HDFS-3434. InvalidProtocolBufferException when visiting DN browseDirectory.jsp. Contributed by Eli Collins
new 15ddb66 HDFS-2800. Fix cancellation of checkpoints in the standby node to be more reliable. Contributed by Todd Lipcon.
new 5258d6b HDFS-3391. Fix InvalidateBlocks to compare blocks including their generation stamps. Contributed by Todd Lipcon.
new fe07758 HADOOP-8287. etc/hadoop is missing hadoop-env.sh. Contributed by Eli Collins
new bacb408 MAPREDUCE-4197. Include the hsqldb jar in the hadoop-mapreduce tar file (Ravi Prakash via tgraves)
new eae281c HADOOP-8408. MR doesn't work with a non-default ViewFS mount table and security enabled. Contributed by Aaron T. Myers
new 7d1f97b HDFS-3440. More effectively limit stream memory consumption when reading corrupt edit logs. Contributed by Colin Patrick McCabe.
new ea0baa3 HDFS-3444. hdfs groups command doesn't work with security enabled. Contributed by Aaron T. Myers.
new 20f935e HADOOP-8329. Build fails with Java 7. Contributed by Eli Collins
new d1a54b8 HDFS-3438. BootstrapStandby should not require a rollEdits on active node. Contributed by Todd Lipcon.
new 1a3bd5d Merge trunk into auto-HA branch
new a37aa28 MAPREDUCE-4002. MultiFileWordCount job fails if the input path is not from default file system. Contributed by Bhallamudi Venkata Siva Kamesh.
new 75041b9 HDFS-2717. BookKeeper Journal output stream doesn't check addComplete rc. Contributed by Ivan Kelly.
new 260dfa3 HDFS-2885. Remove "federation" from the nameservice config options. Contributed by Tsz Wo (Nicholas), SZE
new d239307 MAPREDUCE-4269. documentation: Gridmix has javadoc warnings in StressJobFactory (Jonathon Eagles via tgraves).
new 99a552f HADOOP-8413. test-patch.sh gives out the wrong links for newPatchFindbugsWarnings (Colin Patrick McCabe via bobby)
new d69510a HDFS-3394. Do not use generic in INodeFile.getLastBlock(): the run-time ClassCastException check is useless since generic type information is only available in compile-time.
new 2eebc21 MAPREDUCE-4274 MapOutputBuffer should use native byte order for kvmeta. (todd via bobby)
new d74bec2 MAPREDUCE-3870. Invalid App Metrics (Bhallamudi Venkata Siva Kamesh via tgraves).
new 23b9676 Amend HADOOP-8408 per Daryn's post-commit feedback.
new aa80e68 HDFS-3415. Make sure all layout versions are the same for all storage directories in the Namenode. Contributed by Brandon Li
new 445018c HDFS-3454. Balancer unconditionally logs InterruptedException at INFO level on shutdown if security is enabled. Contributed by Eli Collins
new ade42bc HDFS-3436. In DataNode.transferReplicaForPipelineRecovery(..), it should use the stored generation stamp to check if the block is valid. Contributed by Vinay
new 432c4a6 MAPREDUCE-4262. NM gives wrong log message saying Connected to ResourceManager before trying to connect. (Devaraj K via tgraves)
new 74dfa8f HDFS-2982. Startup performance suffers when there are many edit log segments. Contributed by Colin Patrick McCabe.
new 266a0f1 HADOOP-8367 Improve documentation of declaringClassProtocolName in rpc headers (Sanjay Radia)
new cf7b017 MAPREDUCE-4276. Allow setting yarn.nodemanager.delete.debug-delay-sec property to -1 for easier container debugging. (ahmed via tucu)
new 14bf2d4 HDFS-1013. Miscellaneous improvements to HTML markup for web UIs. Contributed by Eugene Koontz.
new 6c544ad Merge HDFS-3042 (automatic failover) to trunk.
new c4f17d2 MAPREDUCE-4224. TestFifoScheduler throws org.apache.hadoop.metrics2.MetricsException (Devaraj K via tgraves)
new e937068 HDFS-3460. HttpFS proxyuser validation with Kerberos ON uses full principal name. (tucu)
new 64ec449 HDFS-3058. HA: Bring BookKeeperJournalManager up to date with HA changes. Contributed by Ivan Kelly.
new 39661c0 Revert HDFS-3058
new 22cb0ec HADOOP-8422. Deprecate FileSystem#getDefault* and getServerDefault methods that don't take a Path argument. Contributed by Eli Collins
new 458be39 HADOOP-8415. Add getDouble() and setDouble() in org.apache.hadoop.conf.Configuration. Contributed by Jan van der Lugt. (harsh)
new 2e0a15c HDFS-3368. Missing blocks due to bad DataNodes coming up and down.
new e62a76a HADOOP-8323. Add javadoc and tests for Text.clear() behavior (harsh)
new befd45f HDFS-2391. Newly set BalancerBandwidth value is not displayed anywhere. (harsh)
new e767845 HDFS-2717. BookKeeper Journal output stream doesn't check addComplete rc. Contributed by Ivan Kelly.
new ceaf168 HADOOP-7659. fs -getmerge isn't guaranteed to work well over non-HDFS filesystems (harsh)
new 2ebb1f4 MAPREDUCE-3302. Remove the last dependency call from org.apache.hadoop.record package in MR. (harsh)
new 4709160 HADOOP-6871. When the value of a configuration key is set to its unresolved form, it causes an IllegalStateException in Configuration.get() stating that substitution depth is too large. Contributed by Arvind Prabhakar (harsh)
new 0037bf5 MAPREDUCE-2384. The job submitter should make sure to validate jobs before creation of necessary files. (harsh)
new fcf47eb MAPREDUCE-3990. MRBench allows Long-sized input-lines value but parses CLI argument as an Integer. (harsh)
new 1fab229 HADOOP-8268. A few pom.xml across Hadoop project may fail XML validation. Contributed by Radim Kolar. (harsh)
new d2b57e0 HADOOP-8358. Config-related WARN for dfs.web.ugi can be avoided. (harsh)
new e576bac HADOOP-8444. Fix the tests FSMainOperationsBaseTest.java and FileContextMainOperationsBaseTest.java to avoid potential test failure. Contributed by Madhukara Phatak. (harsh)
new 45be2c0 MAPREDUCE-4146. Support limits on task status string length and number of block locations in branch-2. Contributed by Ahmed Radwan.
new 5cf21e4 HDFS-3462. TestDFSClientRetries.busyTest() should restore default xceiver count in the config. Contributed by Madhukara Phatak. (harsh)
new 515e29a MAPREDUCE-3493. Add the default mapreduce.shuffle.port property to mapred-default.xml. Contributed by Madhukara Phatak. (harsh)
new 787c08c HDFS-3452. BKJM:Switch from standby to active fails and NN gets shut down due to delay in clearing of lock. Contributed by Uma Maheswara Rao G.
new 47a29c6 HDFS-3398. Client will not retry when primaryDN is down once it's just got pipeline. Contributed by Amith D K.
new 0a80f82 MAPREDUCE-4152. map task left hanging after AM dies trying to connect to RM (Tom Graves via bobby)
new 7a4c33a HDFS-3474. Cleanup Exception handling in BookKeeper journal manager. Contributed by Ivan Kelly.
new f2c3d3a HDFS-3476. Correct the default used in TestDFSClientRetries.busyTest() after HDFS-3462. (harsh)
new 83cf475 HDFS-744. Support hsync in HDFS. Contributed by Lars Hofhans
new ed7b062 HDFS-3468. Make BKJM-ZK session timeout configurable. Contributed by Uma Maheswara Rao G.
new 8d559d2 HADOOP-8452. DN logs backtrace when running under jsvc and /jmx is loaded (Andy Isaacson via bobby)
new 8bbacfa MAPREDUCE-4297. Usersmap file in gridmix should not fail on empty lines (Ravi Prakash via bobby)
new fe6dfad HDFS-3423. BKJM: NN startup is failing, when tries to recoverUnfinalizedSegments() a bad inProgress_ ZNodes. Contributed by Ivan and Uma.
new c0dcdd6 HDFS-3441. Race condition between rolling logs at active NN and purging at standby. Contributed by Rakesh R.
new 675a7e4 HDFS-3484. hdfs fsck doesn't work if NN HTTP address is set to 0.0.0.0 even if NN RPC address is configured. Contributed by Aaron T. Myers
new 4eb6d65 HDFS-3486. offlineimageviewer can't read fsimage files that contain persistent delegation tokens. Contributed by Colin Patrick McCabe
new f343419 HDFS-3487. offlineimageviewer should give byte offset information when it encounters an exception. Contributed by Colin Patrick McCabe
new 800cfd5 HADOOP-8460. Document proper setting of HADOOP_PID_DIR and HADOOP_SECURE_DN_PID_DIR (bobby)
new f65f528 Merge back changelog entries for HDFS-3042 into main CHANGES.txt files
new ca90e29 HADOOP-8466. hadoop-client POM incorrectly excludes avro. (bmahe via tucu)
new 1cf6010 MAPREDUCE-4302. NM goes down if error encountered during log aggregation (Daryn Sharp via bobby)
new d1207cb HDFS-3442. Incorrect count for Missing Replicas in FSCK report. Contributed by Andrew Wang.
new 2db3003 HADOOP-8368. Use CMake rather than autotools to build native code (ccccabe via tucu)
new 18ba716 MAPREDUCE-4307. TeraInputFormat calls FileSystem.getDefaultBlockSize() without a Path - Failure when using ViewFileSystem. Contributed by Ahmed Radwan
new 28ca281 HDFS-2025. Go Back to File View link is not working in tail.jsp. Contributed by Ashish and Sravan.
new 30807fe HADOOP-8450. Remove src/test/system. Contributed by Eli Collins
new 1283ab5 MAPREDUCE-4301. Dedupe some strings in MRAM for memory savings (bobby via tgraves)
new 358eda0 MAPREDUCE-3350. Per-app RM page should have the list of application-attempts like on the app JHS page (Jonathon Eagles via tgraves)
new 1e48813 MAPREDUCE-3350. Per-app RM page should have the list of application-attempts like on the app JHS page (Jonathon Eagles via tgraves)
new 8bab8b7 HDFS-3501. Checkpointing with security enabled will stop working after ticket lifetime expires. Contributed by Aaron T. Myers
new 1c6242e HADOOP-8481. update BUILDING.txt to talk about cmake rather than autotools. Contributed by Colin Patrick McCabe
new 119a8c7 Updated CHANGES.txt files to reflect the 2.0.0-alpha release.
new a4b1793 HDFS-3266. DFSTestUtil#waitCorruptReplicas doesn't sleep between checks. Contributed by Madhukara Phatak.
new d6467bb MAPREDUCE-4313. TestTokenCache doesn't compile due TokenCache.getDelegationToken compilation error (bobby)
new d44513c svn merge -c -1345421 for reverting HADOOP-8368.
new 67cbc28 MAPREDUCE-3873. Fixed NodeManagers' decommissioning at RM to accept IP addresses also. Contributed by xieguiming and vinodkv.
new 8ad1fcb svn merge -c -1346491 for re-committing HADOOP-8368. (tucu)
new 8813f42 HDFS-3505. DirectoryScanner does not join all threads in shutdown. Contributed by Colin Patrick McCabe
new df57680 HADOOP-8485. Don't hardcode "Apache Hadoop 0.23" in the docs. Contributed by Eli Collins
new 9ae7639 Fixing CHANGES.txt to refer to branch-2 instead of (an unreleased, not-yet-decided) release.
new bef65d0 HDFS-3492. Fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe.
new 743cbf6 svn merge -c -1347092 for reverting HADOOP-8368 again.
new 6d8efb7 HDFS-3485. DataTransferThrottler will over-throttle when currentTimeMillis jumps. Contributed by Andy Isaacson.
new 05a73a3 Revert HDFS-3492 from r1347192: patch broke TestShortCircuitLocalRead
new 0b3af2a Move HDFS-3042 (automatic failover) to branch-2 section of CHANGES.txt
new bce811c HADOOP-8488. test-patch.sh gives +1 even if the native build fails. Contributed by Colin Patrick McCabe
new 415ce38 HADOOP-8469. Make NetworkTopology class pluggable. Contributed by Junping Du
new 072ae08 HDFS-3040. TestMulitipleNNDataBlockScanner is misspelled. Contributed by Madhukara Phatak.
new b98e26a HDFS-2914. HA: Standby should not enter safemode when resources are low. Contributed by Vinay.
new 9368be0 MAPREDUCE-3842. Stop webpages from automatic refreshing (tgraves)
new bc367be HDFS-3514. Add missing TestParallelLocalRead. Contributed by Henry Robinson.
new 51d889e Move several JIRAs from trunk to branch-2 section of CHANGES.txt
new 5991ed9 HDFS-3490. DatanodeWebHdfsMethods throws NullPointerException if NamenodeRpcAddressParam is not set.
new 27d1c74 MAPREDUCE-3927. Shuffle hang when set map.failures.percent (Bhallamudi Venkata Siva Kamesh via tgraves)
new 56d2ef6 HDFS-2797. Fix misuses of InputStream#skip in the edit log code. Contributed by Colin Patrick McCabe
new 8a9e63e HADOOP-8368. Use CMake rather than autotools to build native code (ccccabe via tucu)
new 56f386b HADOOP-8368. Amendment to add entry in CHANGES.txt
new 13ad756 MAPREDUCE-3871. Allow symlinking in LocalJobRunner DistributedCache.
new ca39e78 HDFS-3052. Change INodeFile and INodeFileUnderConstruction to package private.
new 9e7334a HDFS-3517. TestStartup should bind ephemeral ports. Contributed by Eli Collins
new 6e3ebf4 HADOOP-8491. Check for short writes when using FileChannel#write and related methods. Contributed by Colin Patrick McCabe
new eff9fa1 MAPREDUCE-3921. MR AM should act on node health status changes. Contributed by Bikas Saha.
new 543f866 HDFS-3522. If a namenode is in safemode, it should throw SafeModeException when getBlockLocations has zero locations. Contributed by Brandon Li
new 9947d80 HDFS-3049. During the normal NN startup process, fall back on a different edit log if we see one that is corrupt. Contributed by Colin Patrick McCabe.
new 8879653 HDFS-3520. Add transfer rate logging to TransferFsImage. Contributed by Eli Collins
new 45fafc2 HDFS-3504. Support configurable retry policy in DFSClient for RPC connections and RPC calls, and add MultipleLinearRandomRetry, a new retry policy.
new 797c854 Revert HADOOP-8491
new eb0537b HDFS-3408. BKJM : Namenode format fails, if there is no BK root. Contributed by Rakesh R.
new 048c2f2 HDFS-3408. BKJM : Namenode format fails, if there is no BK root. Contributed by Rakesh R.
new f9c9386 HDFS-3389. Document the BKJM usage in Namenode HA. Contributed by Uma Maheswara Rao G and Ivan Kelly.
new 22c6588 HADOOP-8458. Add management hook to AuthenticationHandler to enable delegation token operations support (tucu)
new 4d46618 HDFS-3228. Move DelegationTokenRenewer to common (tucu)
new c83ccc5 Amendment to my previous commit, fixing JIRA in CHANGES.txt from HDFS-3228 to HDFS-3428
new 0199fe9 HADOOP-8507. Avoid OOM while deserializing DelegationTokenIdentifer. Contributed by Colin Patrick McCabe
new 0297662 Fix bug in CHANGES.txt
new 5a2e0ee HADOOP-8465. hadoop-auth should support ephemeral authentication (tucu)
new 07b8584 HDFS-3531. EditLogFileOutputStream#preallocate should check for incomplete writes. Contributed by Colin Patrick McCabe
new 6702d5d HDFS-3372. offlineEditsViewer should be able to read a binary edits file with recovery mode. Contributed by Colin Patrick McCabe
new fda95a6 HDFS-3478. Test quotas with Long.Max_Value. Contributed by Sujay Rau
new 9cabf93 HDFS-766. Error message not clear for set space quota out of boundary values. Contributed by Jon Zuanich.
new cd72aad HADOOP-8433. Don't set HADOOP_LOG_DIR in hadoop-env.sh. Contributed by Brahma Reddy Battula
new 29d39bc HDFS-3480. Multiple SLF4J binding warning. Contributed by Vinay
new a304569 HADOOP-8509. JarFinder duplicate entry: META-INF/MANIFEST.MF exception (tucu)
new 9d2b1b2 HDFS-3524. Update TestFileLengthOnClusterRestart for HDFS-3522. Contributed by Brandon Li
new 7a5c2e8 Updated CHANGES.txt for HDFS-3408(BKJM : Namenode format fails, if there is no BK root) And HDFS-3389(Document the BKJM usage in Namenode HA)
new 5572f73 HDFS-3518. Add a utility method HdfsUtils.isHealthy(uri) for checking if the given HDFS is healthy.
new 19ac5c4 HADOOP-8468. Add NetworkTopologyWithNodeGroup, a 4-layer implementation of NetworkTopology. Contributed by Junping Du
new 0e72149 HADOOP-8495. Update Netty to avoid leaking file descriptors during shuffle (Jason Lowe via tgraves)
new 3dd40a7 HADOOP-8512. AuthenticatedURL should reset the Token when the server returns other than OK on authentication (tucu)
new 5ee172b SVN-ignoring target/download directories
new 9ab9bc9 Revert r1351163 for fixing the JIRA number; it should be HADOOP-8470 but not HADOOP-8468.
new ed7040f HADOOP-8470. Add NetworkTopologyWithNodeGroup, a 4-layer implementation of NetworkTopology. Contributed by Junping Du
new 277b3dd MAPREDUCE-3868. Make Raid Compile. (Weiyan Wang via schen)
new 01b61c76 MAPREDUCE-4311. Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings (Karthik Kambatla via tgraves)
new 01b2040 MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves).
new 49feb6a MAPREDUCE-4267. mavenize pipes (tgraves via bobby)
new 10bc39e MAPREDUCE-4270. Move the data_join test classes to the correct path. (Contributed by Thomas Graves)
new daa28cc MAPREDUCE-4306. Fix distributed shell to work with users other than the one running the daemons. (Contributed by Ahmed Radwan)
new cf5dd32 MAPREDUCE-3889. job client tries to use /tasklog interface, but that doesn't exist anymore (Devaraj K via bobby)
new b685486 MAPREDUCE-4356. [Rumen] Provide access to the method ParsedTask.obtainTaskAttempts(). (ravigummadi)
new b91910d MAPREDUCE-4320. gridmix mainClass wrong in pom.xml (tgraves)
new 126dd6a MAPREDUCE-4295. RM crashes due to DNS issue (tgraves)
new d1138f0 HADOOP-8524. Allow users to get source of a Configuration parameter. (harsh)
new a945336 MAPREDUCE-4031. Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K)
new 1805279 MAPREDUCE-4031 amendment. Fixes CHANGES.txt to reflect correct fix version.
new 4b88923 HDFS-3550. Fix raid javadoc warnings. (Jason Lowe via daryn)
new db31b6c MAPREDUCE-4336. Distributed Shell fails when used with the CapacityScheduler (ahmed via tucu)
new 15b61c7 Adding svn-ignore for hdfs-raid and pipe target dirs
new 75269b5 MAPREDUCE-4290. Fix Yarn Applicaiton Status to MR JobState conversion. (Contributed by Devaraj K)
new 60f4f25 HDFS-3549. Fix dist tar build fails in hadoop-hdfs-raid project. (Jason Lowe via daryn)
new 5b36106 MAPREDUCE-2289. Permissions race can make getStagingDir fail on local filesystem (ahmed via tucu)
new d9bbd59 MAPREDUCE-4355. Add JobStatus getJobStatus(JobID) to JobClient. (kkambatl via tucu)
new 361ea9a HDFS-3516. Check content-type in WebHdfsFileSystem.
new bbab35e HDFS-3498. Support replica removal in BlockPlacementPolicy and make BlockPlacementPolicyDefault extensible for reusing code in subclasses. Contributed by Junping Du
new f455566 HADOOP-8129. ViewFileSystemTestSetup setupForViewFileSystem is erring (Ahmed Radwan and Ravi Prakash via bobby)
new 0270889 HDFS-3535. Audit logging should log denied accesses. Contributed by Andy Isaacson
new 03f2f9b MAPREDUCE-4228. mapreduce.job.reduce.slowstart.completedmaps is not working properly (Jason Lowe via bobby)
new bf1649d HDFS-3551. WebHDFS CREATE should use client location for HTTP redirection.
new bb9ac4f MAPREDUCE-4372. Deadlock in Resource Manager (Devaraj K via bobby)
new d263653 HDFS-3481. Refactor HttpFS handling of JAX-RS query string parameters (tucu)
new 38f8b0a Amendment to previous commit, correct JIRA is HDFS-3113
new c03f1dc Re-amendment to previous commit JIRA was HDFS-3481
new 1b21c98 Reverting MAPREDUCE-4346 r1353757
new 24c4216 HADOOP-8059. Add javadoc to InterfaceAudience and InterfaceStability. Contributed by Brandon Li.
new 5770a45 HDFS-3572. Cleanup code which inits SPNEGO in HttpServer. Contributed by Todd Lipcon.
new 4438939 HDFS-3576. Move the definition of the constant NameNode.DEFAULT_PORT to DFSConfigKeys.DFS_NAMENODE_RPC_PORT_DEFAULT. Contributed by Brandon Li
new f105784 svn merge -c -1354790 for reverting HDFS-3576 since it requires more changes.
new 46aad80 HADOOP-8535. Cut hadoop build times in half (Job Eagles via bobby)
new 32d3ed5 HADOOP-8168. empty-string owners or groups causes {{MissingFormatWidthException}} in o.a.h.fs.shell.Ls.ProcessPath() (ekoontz via tucu)
new 5508532 HDFS-3475. Make the replication monitor multipliers configurable. Contributed by Harsh J Chouraria
new aad2a6f MAPREDUCE-4376. TestClusterMRNotification times out (Kihwal Lee via bobby)
new 78c27ca MAPREDUCE-4371. Check for cyclic dependencies in Jobcontrol job DAG (madhukara phatak via bobby)
new 9255cb8 HDFS-3559. DFSTestUtil: use Builder class to construct DFSTestUtil instances. Contributed by Colin Patrick McCabe.
new 1d54e2b HDFS-3571. Allow EditLogFileInputStream to read from a remote URL. Contributed by Todd Lipcon.
new 19dd66a HDFS-3510. Editlog pre-allocation is performed prior to writing edits to avoid partial edits case disk out of space. Contributed by Collin McCabe.
new d8198d9 Fixed CHANGES.txt name typo
new 1a5978c HADOOP-8438. hadoop-validate-setup.sh refers to examples jar file which doesn't exist. Contributed by Devaraj K.
new d1f05ce Reverting MAPREDUCE-4371 to address test failures.
new cd9ce99 MAPREDUCE-4383. HadoopPipes.cc needs to include unistd.h. Contributed by Andy Isaacson
new 34605c9 HDS-3491. HttpFs does not set permissions correctly (tucu)
new 802f885 HDFS-3446. HostsFileReader silently ignores bad includes/excludes. Contributed by Matthew Jacobs.
new 5a8ea48 HDFS-3580. incompatible types; no instance(s) of type variable(s) V exist so that V conforms to boolean compiling HttpFSServer.java with OpenJDK (adi2 via tucu)
new 06d0109 HADOOP-8449. hadoop fs -text fails with compressed sequence files with the codec file extension. (harsh)
new e967e98 MAPREDUCE-4253. Tests for mapreduce-client-core are lying under mapreduce-client-jobclient. Contributed by Tsuyoshi Ozawa. (harsh)
new cb58675 HADOOP-6802. Remove FS_CLIENT_BUFFER_DIR_KEY = "fs.client.buffer.dir" from CommonConfigurationKeys.java (not used, deprecated). Contributed by Sho Shimauchi. (harsh)
new 511da10 HADOOP-3450. Add tests to Local Directory Allocator for asserting their URI-returning capability. Contributed by Sho Shimauchi. (harsh)
new dcc1d3b HADOOP-8538. CMake builds fail on ARM. Contributed by Trevor Robinson
new 28e8151 HDFS-3157. Fix a bug in the case that the generation stamps of the stored block in a namenode and the reported block from a datanode do not match. Contributed by Ashish Singhi
new 2b2344a HDFS-3575. HttpFS does not log Exception Stacktraces (brocknoland via tucu)
new 7accbab HDFS-3573. Supply NamespaceInfo when instantiating JournalManagers. Contributed by Todd Lipcon.
new eff5abb MAPREDUCE-4371. Check for cyclic dependencies in Jobcontrol job DAG (madhukara phatak via bobby)
new 72a5f92 HADOOP-8548. test-patch.sh shows an incorrect link in Jekins builds (Kihwal Lee via bobby)
new 22822df HADOOP-8533. Remove parallel call ununsed capability in RPC. Contributed by Brandon Li.
new 161ed29 HADOOP-8463. hadoop.security.auth_to_local needs a key definition and doc. Contributed by Madhukara Phatak
new 8dd3148 HDFS-3190. Simple refactors in existing NN code to assist QuorumJournalManager extension. Contributed by Todd Lipcon.
new 4b2e0e1 Moving HADOOP-8533 to release 2.0 section
new f5186da HADOOP-8434. Add tests for Configuration setter methods. Contributed by Madhukara Phatak.
new 3c2101a HADOOP-8110. Fix trash checkpoint collisions (Jason Lowe via daryn)
new b8389e4 HDFS-3343. Improve metrics for DN read latency. Contributed by Andrew Wang.
new 3728d16 HDFS-3574. Fix small race and do some cleanup in GetImageServlet. Contributed by Todd Lipcon.
new 8188c1c HADOOP-8547. Package hadoop-pipes examples/bin directory (again). Contributed by Colin Patrick McCabe
new 359b4ef HDFS-3581. FSPermissionChecker#checkPermission sticky bit check missing range check. Contributed by Eli Collins
new 4d0cab2 HDFS-3601. Add BlockPlacementPolicyWithNodeGroup to support block placement with 4-layer network topology. Contributed by Junping Du
new 72fb517 MAPREDUCE-4355. Add RunningJob.getJobStatus() (kkambatl via tucu)
new c1bf8a3 MAPREDUCE-4392. Counters.makeCompactString() changed behavior from 0.20 (Jason Lowe via bobby)
new 9a43f05 HADOOP-8563. don't package hadoop-pipes examples/bin (Colin Patrick McCabe via tgraves)
new 3d5a44f MAPREDUCE-4384. Race conditions in IndexCache (Kihwal Lee via tgraves)
new e0ef844 HDFS-3170. Add more useful metrics for write latency. Contributed by Matthew Jacobs.
new 0722922 MAPREDUCE-4387. RM gets fatal error and exits during TestRM (Kihwal Lee via tgraves)
new 0e7204c MAPREDUCE-4379. Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts (Devaraj K via bobby)
new fb95fce Fix issue with NN/DN re-registration.
new 1411276 HADOOP-8523. test-patch.sh doesn't validate patches before building (Jack Dintruff via jeagles)
new 0a2252b HADOOP-8566. AvroReflectSerializer.accept(Class) throws a NPE if the class has no package (primitive types and arrays). (tucu)
new 535b039 HDFS-3604. Add dfs.webhdfs.enabled to hdfs-default.xml. Contributed by Eli Collins
new e5b00f1 HDFS-2988. Improve error message when storage directory lock fails. Contributed by Miomir Boljanovic. (harsh)
new 52a4678 MAPREDUCE-2220. Fix new API FileOutputFormat-related typos in mapred-default.xml. Contributed by Rui Kubo. (harsh)
new d4fb882 HDFS-3541. Deadlock between recovery, xceiver and packet responder. Contributed by Vinay.
new 6dcf422 HDFS-3603. Decouple TestHDFSTrash from TestTrash. Contributed by Jason Lowe
new 9bebba6 Fixup CHANGES.txt
new 52f5c70 HDFS-711. hdfsUtime does not handle atime = 0 or mtime = 0 correctly. Contributed by Colin Patrick McCabe
new 0729526 HDFS-3482. hdfs balancer throws ArrayIndexOutOfBoundsException if option is specified without values. Contributed by Madhukara Phatak.
new 21fdf16 HDFS-3548. NamenodeFsck.copyBlock fails to create a Block Reader. Contributed by Colin Patrick McCabe
new 5952c7b HDFS-3614. Revert unused MiniDFSCluster constructor from HDFS-3049. Contributed by Arun Murthy
new 9facccf Update CHANGES.txt for 2391 merge.
new c3b0bed MAPREDUCE-3907. Document entries mapred-default.xml for the jobhistory server. Contributed by Eugene Koontz. (harsh)
new 8087515 MAPREDUCE-3906. Fix inconsistency in documentation regarding mapreduce.jobhistory.principal. Contributed by Eugene Koontz. (harsh)
new 832ba3b MAPREDUCE-4402. TestFileInputFormat fails intermittently (Jason Lowe via bobby)
new 1153780 MAPREDUCE-2739. Update installation docs (remove YarnClientFactory) (bowang via tucu)
new b6a9d38 Move CHANGES.txt entry for HDFS-3067 to branch-2 instead of trunk.
new 820be7c MAPREDUCE-3993. Graceful handling of codec errors during decompression (kkambatl via tucu)
new 11782dd MAPREDUCE-4300. OOM in AM can turn it into a zombie. (Robert Evans via tgraves)
new e0f96aa HDFS-3555. idle client socket triggers DN ERROR log (should be INFO or DEBUG). Contributed by Andy Isaacson. (harsh)
new 6804ef3 MAPREDUCE-4252. MR2 job never completes with 1 pending task (Tom White via bobby)
new 0b7139d HADOOP-8525. Provide Improved Traceability for Configuration (bobby)
new 408d189 HADOOP-8525. Provide Improved Traceability for Configuration (bobby)
new fb4a6ac HDFS-3568. fuse_dfs: add support for security. Contributed by Colin McCabe.
new caf9fe2 HADOOP-8423. MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data. Contributed by Todd Lipcon. (harsh)
new 58a8826 HADOOP-8573. Configuration tries to read from an inputstream resource multiple times (Robert Evans via tgraves)
new 9a2c19e HADOOP-8584. test-patch.sh should not immediately exit when no tests are added or modified. Contributed by Colin Patrick McCabe
new 8c37dcb Fixup CHANGES.txt
new 3b5ea87 HDFS-3629. Fix the typo in the error message about inconsistent storage layout version. Contributed by Brandon Li. (harsh)
new 3bfb26a MAPREDUCE-3940. ContainerTokens should have an expiry interval. Contributed by Siddharth Seth and Vinod Kumar Vavilapalli.
new c81aed0 HDFS-3613. GSet prints some INFO level values, which aren't really very useful to all. Contributed by Andrew Wang. (harsh)
new 2c27b58 HDFS-3611. NameNode prints unnecessary WARNs about edit log normally skipping a few bytes. Contributed by Colin Patrick McCabe. (harsh)
new c41b978 HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins
new 151a1b0 Revert previous commit, accidentally included HADOOP-8587.
new 43e37b9 HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins
new e5ea2aa HADOOP-3886. Error in javadoc of Reporter, Mapper and Progressable. Contributed by Jingguo Yao. (harsh)
new 9c87911 HADOOP-8521. Port StreamInputFormat to new Map Reduce API (madhukara phatak via bobby)
new 664ca6b HDFS-3615. Two BlockTokenSecretManager findbugs warnings. Contributed by Aaron T. Myers.
new cdae695 HDFS-3582. Hook daemon process exit for testing. Contributed by Eli Collins
new 9729f84 Branch for snapshot related work
new 4c13b6f HADOOP-8587. HarFileSystem access of harMetaCache isn't threadsafe. Contributed by Eli Collins
new 8ced738 HDFS-3639. JspHelper#getUGI should always verify the token if security is enabled. Contributed by Eli Collins
new 96d77c1 HADOOP-8585. Fix initialization circularity between UserGroupInformation and HadoopConfiguration. Contributed by Colin Patrick McCabe.
new b5b0ac6 HADOOP-8541. Better high-percentile latency metrics. Contributed by Andrew Wang.
new 26910fd MAPREDUCE-4416. Some tests fail if Clover is enabled (Kihwal Lee via bobby)
new 4a5ba3b HDFS-3641. Move server Util time methods to common and use now instead of System#currentTimeMillis. Contributed by Eli Collins
new 6a59f08 HDFS-3630 Modify TestPersistBlocks to use both flush and hflush (sanjay)
new e2318c2 HDFS-3633. libhdfs: hdfsDelete should pass JNI_FALSE or JNI_TRUE. Contributed by Colin Patrick McCabe
new 0f3ba48 HDFS-799. libhdfs must call DetachCurrentThread when a thread is destroyed. Contributed by Colin Patrick McCabe
new 1ef64e6 MAPREDUCE-3451. Port Fair Scheduler to MR2 (pwendell via tucu)
new bfa51a3 HDFS-3306. fuse_dfs: don't lock release operations. Contributed by Colin Patrick McCabe
new d9911e9 HDFS-3612. Single namenode image directory config warning can be improved. Contributed by Andy Isaacson. (harsh)
new 48c1a2b MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration. Contributed by Ahmed Radwan. (harsh)
new bea60b6 Reverting MAPREDUCE-4422 from trunk until all comments are addressed
new af0e0b1 MAPREDUCE-4432. Confusing warning message when GenericOptionsParser is not used. Contributed by Gabriel Reid. (harsh)
new 9dcd317 MAPREDUCE-4441. Fix build issue caused by MR-3451 (kkambatl via tucu)
new 228736a MAPREDUCE-4419. ./mapred queue -info <queuename> -showJobs displays all the jobs irrespective of <queuename> (Devaraj K via bobby)
new 17de78a MAPREDUCE-4299. Terasort hangs with MR2 FifoScheduler (Tom White via bobby)
new 27b5f5a MAPREDUCE-3451. Amendment, excluding findbugs warnings (tucu)
new bf34f62 HADOOP-8499. Lower min.user.id to 500 for the tests. Contributed Colin Patrick McCabe
new dcf0ac7 HDFS-3606. libhdfs: create self-contained unit test. Contributed by Colin Patrick McCabe
new 8c2a2f9 HDFS-470. libhdfs should handle 0-length reads from FSInputStream correctly. Contributed by Colin Patrick McCabe
new 06d635c HDFS-3492. fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe
new cfd692b HDFS-3609. libhdfs: don't force the URI to look like hdfs://hostname:port. Contributed by Colin Patrick McCabe
new f5dd458 HDFS-3539. libhdfs code cleanups. Contributed by Colin Patrick McCabe
new 32d4c14 HDFS-3654. TestJspHelper#testGetUgi fails with NPE. Contributed by Eli Collins
new 3e5e100 Amend HDFS-799. Remove unnecessary tls check. Contributed by Colin Patrick McCabe
new 2eb39c5 HDFS-3610. fuse_dfs: Provide a way to use the default (configured) NN URI. Contributed by Colin Patrick McCabe
new 385f31a HADOOP-8362. Improve exception message when Configuration.set() is called with a null key or value. Contributed by Madhukara Phatak and Suresh Srinivas (harsh)
new 7351a01 HADOOP-7818. DiskChecker#checkDir should fail if the directory is not executable. Contributed by Madhukara Phatak. (harsh)
new 64fc2cb HDFS-3663. MiniDFSCluster should capture the code path that led to the first ExitException. Contributed by Eli Collins
new ae6cc14 MAPREDUCE-4427. Added an 'unmanaged' mode for AMs so as to ease development of new applications. Contributed by Bikas Saha.
new 0e8e499 HDFS-3659. Add missing @Override to methods across the hadoop-hdfs project. Contributed by Brandon Li. (harsh)
new 0f122c2 HADOOP-8531. SequenceFile Writer can throw out a better error if a serializer or deserializer isn't available. Contributed by Madhukara Phatak. (harsh)
new 6124439 MAPREDUCE-4395. Possible NPE at ClientDistributedCacheManager#determineTimestamps (Bhallamudi via bobby)
new 69f7a32 HDFS-3537. Move libhdfs and fuse-dfs source to native subdirectories. Contributed by Colin Patrick McCabe
new cc1ee72 HADOOP-8552. Conflict: Same security.log.file for multiple users. (kkambatl via tucu)
new 572823c HDFS-3665. Add a test for renaming across file systems via a symlink. Contributed by Eli Collins
new 6df36b5 HDFS-3625. Fix TestBackupNode by properly initializing edit log during startup. Contributed by Junping Du.
new 18f1feb MAPREDUCE-4447. Remove aop from cruft from the ant build. Contributed by Eli Collins
new e1c5e7d MAPREDUCE-4437. Race in MR ApplicationMaster can cause reducers to never be scheduled (Jason Lowe via bobby)
new 527933f HDFS-3666. Plumb more exception messages to terminate. Contributed by Eli Collins
new 4b51921 Amend HDFS-3666, applied earlier version of the patch.
new 2799d96 HADOOP-8593. Add missed @Override annotations in Metric/Metrics2 package. Contributed by Brandon Li.
new 30099ef HADOOP-8599. Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file. Contributed by Andrey Klochkov.
new 7f2b1ea MAPREDUCE-4440. Changed SchedulerApp and SchedulerNode to be a minimal interface to allow schedulers to maintain their own.
new 177f6fe MAPREDUCE-4449. Incorrect MR_HISTORY_STORAGE property name in JHAdminConfig (Ahmed Radwan via bobby)
new 8e57657 MAPREDUCE-4283. Display tail of aggregated logs by default (Jason Lowe via bobby)
new 603418c MAPREDUCE-4380. Empty Userlogs directory is getting created under logs directory (Devaraj K via bobby)
new e9aa5aa MAPREDUCE-4448. Fix NM crash during app cleanup if aggregation didn't init. (Jason Lowe via daryn)
new 2e00d28 MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration. (ahmed via tucu)
new 28ebdea HADOOP-8537. Fix TFile tests to pass even when native zlib support is not compiled. Contributed by Todd Lipcon.
new c700642 MAPREDUCE-4406. Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports. (ahmed via tucu)
new e2253b5 HDFS-3583. Convert remaining tests to Junit4. Contributed by Andrew Wang.
new 6981b14 Revert HDFS-3654. TestJspHelper#testGetUgi fails with NPE.
new d61c5bc Revert HDFS-3639. JspHelper#getUGI should always verify the token if security is enabled.
new 6e56376 HDFS-3577. In DatanodeWebHdfsMethods, use MessageBodyWriter instead of StreamingOutput, otherwise, it will fail to transfer large files.
new 1efd2e1 MAPREDUCE-4157. ResourceManager should not kill apps that are well behaved (Jason Lowe via bobby)
new 1297957 MAPREDUCE-4407. Add hadoop-yarn-server-tests-<version>-tests.jar to hadoop dist package. (ahmed via tucu)
new 0a6806c HDFS-3646. LeaseRenewer can hold reference to inactive DFSClient instances forever (Kihwal Lee via daryn)
new 23b6ed9 HDFS-3605. Block mistakenly marked corrupt during edit log catchup phase of failover. Contributed by Todd Lipcon and Brahma Reddy Battula.
new 52c8271 HADOOP-8551. fs -mkdir creates parent directories without the -p option (Daryn Sharp and John George via bobby)
new 8e69f88 MAPREDUCE-4423. Potential infinite fetching of map output (Robert Evans via tgraves)
new 15eec42 HDFS-3673. libhdfs: fix some compiler warnings. Contributed by Colin Patrick McCabe
new 7d5d63c HDFS-3675. libhdfs: follow documented return codes. Contributed by Colin Patrick McCabe
new 5d5a838 HDFS-1249. With fuse-dfs, chown which only has owner (or only group) argument fails with Input/output error. Contributed by Colin Patrick McCabe
new 4c51dac Reverting HADOOP-8551. fs -mkdir creates parent directories without the -p option
new 370c65f Revert MAPREDUCE-3868. Reenable Raid.
new 6383679 HDFS-3690. BlockPlacementPolicyDefault incorrectly casts LOG. Contributed by Eli Collins
new 23af049 Create branch for HDFS-3077
new 74d4573 HDFS-3077. Quorum-based protocol for reading and writing edit logs. Contributed by Todd Lipcon based on initial work from Brandon Li and Hari Mankude.
new 9833468 HDFS-3597. SNN fails to start after DFS upgrade. Contributed by Andy Isaacson.
new 02a5551 HDFS-3608. fuse_dfs: detect changes in UID ticket cache. Contributed by Colin Patrick McCabe.
new d45922d svn merge --change -1363454 for reverting MAPREDUCE-4423
new decd9e1 Move entry for HDFS-3583 in CHANGES.txt to be under branch-2.
new 80e2b41 HADOOP-8609. IPC server logs a useless message when shutting down socket. Contributed by Jon Zuanich.
new 9c9f29a MAPREDUCE-987. Exposing MiniDFS and MiniMR clusters as a single process command-line. (ahmed via tucu)
new b7b8db5 HDFS-3697. Enable fadvise readahead by default. Contributed by Todd Lipcon.
new 97ed48e MAPREDUCE-3893. allow capacity scheduler configs max-apps and max-am-pct per queue (tgraves via bobby)
new 1fd2107 HDFS-3709. TestStartup tests still binding to the ephemeral port. Contributed by Eli Collins
new d8f3913 HDFS-3711. Manually convert remaining tests to JUnit4. Contributed by Andrew Wang.
new 3ef19e9 MAPREDUCE-4438. Add a simple, generic client to run 'easy' AMs in YARN. Contributed by Bikas Saha.
new a2d5603 HADOOP-8606. FileSystem.get may return the wrong filesystem (Daryn Sharp via bobby)
new cdef126 MAPREDUCE-4467. IndexCache failures due to missing synchronization (Kihwal Lee via tgraves)
new 515a332 MAPREDUCE-4465. Update description of yarn.nodemanager.address property. (bowang via tucu)
new 0bfa7d7 HADOOP-8551. fs -mkdir creates parent directories without the -p option (John George via bobby)
new 56b0912 HDFS-3720. hdfs.h must get packaged. Contributed by Colin Patrick McCabe.
new 939f4a9 HDFS-3694. Fix getEditLogManifest to fetch httpPort if necessary. Contributed by Todd Lipcon.
new d2d0736 HDFS-3692. Support purgeEditLogs() call to remotely purge logs on JNs. Contributed by Todd Lipcon.
new b17018e HDFS-3693. JNStorage should read its storage info even before a writer becomes active. Contributed by Todd Lipcon.
new 972953b HDFS-3626. Creating file with invalid path can corrupt edit log. Contributed by Todd Lipcon.
new 06b394d Amend previous commit of HDFS-3626: accidentally included a hunk from HADOOP-8621 in svn commit. Reverting that hunk
new 8f395c2 HDFS-3696. Set chunked streaming mode in WebHdfsFileSystem write operations to get around a Java library bug causing OutOfMemoryError.
new 9d16c93 MAPREDUCE-4417. add support for encrypted shuffle (tucu)
new 4d45601 HDFS-3113. httpfs does not support delegation tokens. (tucu)
new c5fe08e HDFS-3113 amendment, removing incorrectly committed files
new 109735f HADOOP-8623. hadoop jar command should respect HADOOP_OPTS. Contributed by Steven Willis.
new 2f478ac HADOOP-8642. ProtobufRpcEngine should log all RPCs if TRACE logging is enabled. Contributed by Todd Lipcon.
new c1ea9b4 HDFS-3650. Use MutableQuantiles to provide latency histograms for various operations. Contributed by Andrew Wang.
new d87b545 MAPREDUCE-4423. Potential infinite fetching of map output (Robert Evans via tgraves)
new 9c5bd76 HADOOP-8626. Typo in default setting for hadoop.security.group.mapping.ldap.search.filter.user. Contributed by Jonathan Natkins.
new b3b7248 HADOOP-8613. AbstractDelegationTokenIdentifier#getUser() should set token auth type. (daryn)
new cbd59c1 HDFS-3553. Hftp proxy tokens are broken (daryn)
new 0c4e670 HDFS-3679. fuse_dfs notrash option sets usetrash. Contributed by Conrad Meyer.
new e4eec26 HDFS-3667. Add retry support to WebHdfsFileSystem.
new 98f1523 HADOOP-8627. FS deleteOnExit may delete the wrong path (daryn via bobby)
new d8584fd HADOOP-8634. Ensure FileSystem#close doesn't squawk for deleteOnExit paths (daryn via bobby)
new aeade62 HDFS-3732. fuse_dfs: incorrect configuration value checked for connection expiry timer period. Contributed by Colin Patrick McCabe.
new 48a2e2b HADOOP-8550. hadoop fs -touchz automatically created parent directories (John George via bobby)
new 7226dea HADOOP-8635. Cannot cancel paths registered deleteOnExit (daryn via bobby)
new 8a61579 Fix typo in CHANGES.txt: wrote HADOOP-8642 instead of HADOOP-8624.
new 56c7662 svn ignoring hadoop-yarn-applications-unmanaged-am-launcher target directory (tucu)
new e217a05 MAPREDUCE-4342. Distributed Cache gives inconsistent result if cache files get deleted from tasktracker. (mayank_bansal via tucu)
new e1dff3d Merge trunk into QJM branch
new e086049 HDFS-3725. Fix QJM startup when individual JNs have gaps. Contributed by Todd Lipcon.
new 556be2a svn merge -c -1366601 for reverting HDFS-3667.
new a3e695a MAPREDUCE-4375. Show Configuration Tracability in MR UI (bobby via tgraves)
new e9bf6c5 MAPREDUCE-4456. LocalDistributedCacheManager can get an ArrayIndexOutOfBounds when creating symlinks (Robert Evans via tgraves)
new a37272e MAPREDUCE-4496. AM logs link is missing user name (Jason Lowe via bobby)
new 75be1e0 HADOOP-8637. FilterFileSystem#setWriteChecksum is broken (daryn via bobby)
new 735b50e MAPREDUCE-4493. Distibuted Cache Compatability Issues (Robert Evans via tgraves)
new 89c59bb MAPREDUCE-4492. Configuring total queue capacity between 100.5 and 99.5 at perticular level is sucessfull (Mayank Bansal via bobby)
new 27eb14c MAPREDUCE-4483. 2.0 build does not work (John George via bobby)
new c298510 HADOOP-8370. Native build failure: javah: class file for org.apache.hadoop.classification.InterfaceAudience not found (Trevor Robinson via tgraves)
new 9d42fb2 MAPREDUCE-4457. mr job invalid transition TA_TOO_MANY_FETCH_FAILURE at FAILED (Robert Evans via tgraves)
new 123c4f5 MAPREDUCE-4444. nodemanager fails to start when one of the local-dirs is bad (Jason Lowe via bobby)
new 5938c86 MAPREDUCE-4234. SortValidator.java is incompatible with multi-user or parallel use (due to a /tmp file with static name) (Robert Evans via jeagles)
new cb78796 HDFS-3667. Add retry support to WebHdfsFileSystem.
new 8ea7112 HDFS-3738. TestDFSClientRetries#testFailuresArePerOperation sets incorrect timeout config. Contributed by Aaron T. Myers.
new 12d0e02 HADOOP-8633. Interrupted FsShell copies may leave tmp files (Daryn Sharp via tgraves)
new 1264b8e HADOOP-8620. Add -Drequire.fuse and -Drequire.snappy. Contributed by Colin Patrick McCabe
new ade55f9 HADOOP-8480. The native build should honor -DskipTests. Contributed by Colin Patrick McCabe
new 28320c5 MAPREDUCE-4504. SortValidator writes to wrong directory (Robert Evans via tgraves)
new fe17d87 HDFS-3513. HttpFS should cache filesystems. (tucu)
new 08e8966 HDFS-3724. add InterfaceAudience annotations to HttpFS classes and making inner enum static. (tucu)
new 3eb0cb2 MAPREDUCE-3289. Make use of fadvise in the NM's shuffle handler. (Contributed by Todd Lipcon and Siddharth Seth)
new 42d071a HDFS-3756. DelegationTokenFetcher creates 2 HTTP connections, the second one not properly configured. (tucu)
new 7278933 MAPREDUCE-4503. Should throw InvalidJobConfException if duplicates found in cacheArchives or cacheFiles (Robert Evans via jeagles)
new 294b514 HDFS-3719. Re-enable append-related tests in TestFileConcurrentReader. Contributed by Andrew Wang.
new 117145f MAPREDUCE-4498. Remove hsqldb jar from Hadoop runtime classpath. (rkanter via tucu)
new f7b37c0 HDFS-3579. libhdfs: fix exception handling. Contributed by Colin Patrick McCabe.
new b4545bf Add two new files missed by last commit of HDFS-3579.
new 5383694 HADOOP-8644. AuthenticatedURL should be able to use SSLFactory. (tucu)
new c2cac27 MAPREDUCE-4494. TestFifoScheduler failing with Metrics source QueueMetrics,q0=default already exists. (ahmed.radwan via tucu)
new 1799046 MAPREDUCE-4484. Incorrect IS_MINI_YARN_CLUSTER property name in YarnConfiguration. (ahmed.radwan via tucu)
new 9b4a790 HDFS-3637. Add support for encrypting the DataTransferProtocol. Contributed by Aaron T. Myers.
new 754fd7b HDFS-3291. add test that covers HttpFS working w/ a non-HDFS Hadoop filesystem (tucu)
new c12e994 HDFS-3754. BlockSender doesn't shutdown ReadaheadPool threads. Contributed by Eli Collins
new 3a53ef4 HDFS-3741. Exhaustive failure injection test for skipped RPCs. Contributed by Todd Lipcon.
new 34554d1 HDFS-3760. primitiveCreate is a write, not a read. Contributed by Andy Isaacson.
new e1fdf62 YARN-1. Promote YARN to be a sub-project of Apache Hadoop.
new b568321 YARN-1. Fixed message in CHANGES.txt
new b6080a9 HADOOP-8660. TestPseudoAuthenticator failing with NPE. (tucu)
new bc88c7b HDFS-3773. TestNNWithQJM fails after HDFS-3741. Contributed by Aaron T. Myers.
new 4920387 YARN-12. Fix findbugs warnings in FairScheduler. Contributed by Junping Du.
new b587af4 HDFS-3710. libhdfs misuses O_RDONLY/WRONLY/RDWR. Contributed by Andy Isaacson.
new 6dcf2e4 HDFS-3755. Creating an already-open-for-write file with overwrite=true fails. Contributed by Todd Lipcon.
new ffb4d5b Adding hadoop-yarn-project/target to svn:ignore
new ac31ae6 HDFS-3768. Exception in TestJettyHelper is incorrect. Contributed by Eli Reisman.
new fb970f3 HDFS-3634. Add self-contained, mavenized fuse_dfs test. Contributed by Colin Patrick McCabe.
new 201d0ec MAPREDUCE-3782. teragen terasort jobs fail when using webhdfs:// (Jason Lowe via bobby)
new 82910ec YARN-14. Symlinks to peer distributed cache files no longer work (Jason Lowe via bobby)
new 9ea7c06 HDFS-3721. hsync support broke wire compatibility. Contributed by Todd Lipcon and Aaron T. Myers.
new 0733adf HADOOP-8659. Native libraries must build with soft-float ABI for Oracle JVM on ARM. Contributed by Trevor Robinson.
new 9d0f879 HDFS-3695. Genericize format() to non-file JournalManagers. Contributed by Todd Lipcon.
new 302f1e9 Merge trunk into branch.
new 4bca220 HADOOP-8681. add support for HTTPS to the web UIs. (tucu)
new bcb7154 HDFS-3758. TestFuseDFS test failing. Contributed by Colin Patrick McCabe
new bbe0e82 Revert HDFS-3719. See discussion there and HDFS-3770 for more info.
new 7aacfd5 HDFS-3789. JournalManager#format() should be able to throw IOException. Contributed by Ivan Kelly.
new 783a0f4 Amend HADOOP-8659. Native libraries must build with soft-float ABI for Oracle JVM on ARM.
new c9ed834 Move HDFS-2330 and HDFS-3190 to branch-2 section, since they have been backported from trunk.
new c93185d HDFS-3276. initializeSharedEdits should have a -nonInteractive flag. Contributed by Todd Lipcon.
new 4b67401 Merge trunk into branch
new dfad16f MAPREDUCE-4053. Counters group names deprecation is wrong, iterating over group names deprecated names don't show up (Robert Evans via tgraves)
new d71ea73 HADOOP-8581 Amendment to CHANGES.txt setting right JIRA number, add support for HTTPS to the web UIs. (tucu)
new c959c1a HADOOP-8687. Upgrade log4j to 1.2.17. Contributed by Eli Collins
new 4139298 HDFS-3790. test_fuse_dfs.c doesn't compile on centos 5. Contributed by Colin Patrick McCabe.
new ab3ab17 HDFS-3792. Fix two findbugs introduced by HDFS-3695. Contributed by Todd Lipcon.
new 0c27c77 HDFS-3658. Fix bugs in TestDFSClientRetries and add more tests.
new b38bd55 HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon.
new f46b6ea HDFS-3718. Datanode won't shutdown because of runaway DataBlockScanner thread (Kihwal Lee via daryn)
new f98d8eb HDFS-3150. Add option for clients to contact DNs via hostname. Contributed by Eli Collins
new f026d8b HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao.
new 231a52a Reverting previous incomplete change r1373170 for HDFS-3723
new 28e8774 HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao
new 6c96039 HDFS-3803. Change BlockPoolSliceScanner chatty INFO log to DEBUG. Contributed by Andrew Purtell
new f765fdb HDFS-3793. Implement genericized format() in QJM. Contributed by Todd Lipcon.
new 160bfcd HDFS-3795. QJM: validate journal dir at startup. Contributed by Todd Lipcon.
new 4a9b3c6 HDFS-3798. Avoid throwing NPE when finalizeSegment() is called on invalid segment. Contributed by Todd Lipcon.
new c95a167 HDFS-3799. QJM: handle empty log segments during recovery. Contributed by Todd Lipcon.
new f41497c HDFS-3794. WebHDFS OPEN returns the incorrect Content-Length in the HTTP header when offset is specified and length is omitted. Contributed by Ravi Prakash
new fd8ce04 HADOOP-8699. some common testcases create core-site.xml in test-classes making other testcases to fail. (tucu)
new 5aeabcd HADOOP-7754. Expose file descriptors from Hadoop-wrapped local FileSystems (todd and ahmed via tucu)
new 9dff787 HDFS-3802. StartupOption.name in HdfsServerConstants should be final. Contributed by Jing Zhao
new 89153a9 HDFS-3796. Speed up edit log tests by avoiding fsync(). Contributed by Todd Lipcon.
new 42cdc1b HDFS-3797. QJM: add segment txid as a parameter to journal() RPC. Contributed by Todd Lipcon.
new d5abe22 Merge trunk into branch
new 4e09b48 HADOOP-8278. Make sure components declare correct set of dependencies.
new 6167123 HADOOP-8703. distcpV2: turn CRC checking off for 0 byte size (Dave Thompson via bobby)
new 5789de8 HDFS-3800. improvements to QJM fault testing. Contributed by Todd Lipcon.
new 7cc88f0 Fix a merge mistake from last trunk merge.
new b05c70b HADOOP-8703: Fix formatting issue.
new f75deca HDFS-3048. Small race in BlockManager#close. Contributed by Andy Isaacson
new 8fcad7e MAPREDUCE-4511. Add IFile readahead (ahmed via tucu)
new ed1bcf5 Add .classpath, .project and .settings to svn:ignore.
new f661d91 Add .classpath, .project and .settings to svn:ignore.
new 3cab01b HADOOP-8700. Use enum to define the checksum constants in DataChecksum.
new 0e0208b Move HADOOP-8700 to branch-2 in CHANGES.txt.
new 3204b1f MAPREDUCE-4562. Support for "FileSystemCounter" legacy counter group name for compatibility reasons is creating incorrect counter name. Contributed by Jarek Jarcec Cecho.
new 2926ae6 HADOOP-8654. TextInputFormat delimiter bug (Gelesh and Jason Lowe via bobby)
new 4524655 HDFS-3194. DataNode block scanner is running too frequently. Contributed by Andy Isaacson
new cf93dfb HDFS-2963. Console Output is confusing while executing metasave (dfsadmin command). Contributed by Andrew Wang
new 9b6dc1c HADOOP-8390. TestFileSystemCanonicalization fails with JDK7 (Trevor Robinson via tgraves)
new bbe4584 HDFS-3808. fuse_dfs: postpone libhdfs intialization until after fork. Contributed by Colin Patrick McCabe.
new 87d87b0 HDFS-3788. ByteRangeInputStream should not expect HTTP Content-Length header when chunked transfer-encoding is used.
new ffbadbd HDFS-2421. Improve the concurrency of SerialNumberMap in NameNode. Contributed by Jing Zhao and Weiyan Wang
new 8fa10b1 HADOOP-7967. Need generalized multi-token filesystem support (daryn)
new fb60303 HADOOP-8692. TestLocalDirAllocator fails intermittently with JDK7 (Trevor Robinson via tgraves)
new 8bd4a22 HADOOP-8693. TestSecurityUtil fails intermittently with JDK7 (Trevor Robinson via tgraves)
new 9c060fe HADOOP-8697. TestWritableName fails intermittently with JDK7 (Trevor Robinson via tgraves)
new fccace6 HDFS-3672. Expose disk-location information for blocks to enable better scheduling. Contributed by Andrew Wang.
new 7fc6ad6 YARN-25. remove old aggregated logs (Robert Evans via tgraves)
new 31cb5a7 HADOOP-8695. TestPathData fails intermittently with JDK7 (Trevor Robinson via tgraves)
new 18c5bc8 HADOOP-8689. Make trash a server side configuration option. Contributed by Eli Collins
new 54621c3 HADOOP-8710. Remove ability for users to easily run the trash emptire. Contributed by Eli Collins
new 086c855 HDFS-3816. Invalidate work percentage default value should be 0.32f. Contributed by Jing Zhao
new b0ea773 HADOOP-8240. Add a new API to allow users to specify a checksum type on FileSystem.create(..). Contributed by Kihwal Lee
new bc538e1 YARN-27. Failed refreshQueues due to misconfiguration prevents further refreshing of queues (Arun Murthy via tgraves)
new ea7af8f YARN-27. Fixed location of ms.start call
new df5e2b8 MAPREDUCE-4323. NM leaks filesystems (Jason Lowe via jeagles)
new f58941f HADOOP-8614. IOUtils#skipFully hangs forever on EOF. Contributed by Colin Patrick McCabe
new d5f0808 HADOOP-8611. Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails (Robert Parker via bobby)
new 357e990 HADOOP-8686. Fix warnings in native code. Contributed by Colin Patrick McCabe
new 643608e HDFS-3823. QJM: TestQJMWithFaults fails occasionally because of missed setting of HTTP port. Contributed by Todd Lipcon and Aaron T. Myers.
new 97bb7b1 HDFS-3707. TestFSInputChecker: improper use of skip. Contributed by Colin Patrick McCabe
new f9a0d78 HDFS-3826. QJM: Some trivial logging / exception text improvements. Contributed by Todd Lipcon and Aaron T. Myers.
new a626243 HDFS-2727. libhdfs should get the default block size from the server. Contributed by Colin Patrick McCabe
new f2dd818 HADOOP-8239. Add subclasses of MD5MD5CRC32FileChecksum to support file checksum with CRC32C. Contributed by Kihwal Lee
new 0c2887b MAPREDUCE-3506. Calling getPriority on JobInfo after parsing a history log with JobHistoryParser throws a NullPointerException (Jason Lowe via bobby)
new ca2dc3e MAPREDUCE-4570. ProcfsBasedProcessTree#constructProcessInfo() prints a warning if procfsDir/<pid>/stat is not found. (Ahmed Radwan via bobby)
new e847775 HADOOP-8711. IPC Server supports adding exceptions for which the message is printed and the stack trace is not printed to avoid chatter. Contributed by Brandon Li.
new 6c0ccb5 HDFS-2686. Remove DistributedUpgrade related code. Contributed by Suresh Srinivas
new 557b937 HDFS-3827. TestHASafeMode#assertSafemode method should be made static. Contributed by Jing Zhao
new 6767322 YARN-22. Fix ContainerLogs to work if the log-dir is specified as a URI. (Contributed by Mayank Bansal)
new a99cfe3 HDFS-3817. Avoid printing SafeModeException stack trace in RPC server. Contributed by Brandon Li.
new 2b030c6 HDFS-3830. test_libhdfs_threaded: use forceNewInstance. Contributed by Colin Patrick McCabe
new 6316b06 HADOOP-8720. TestLocalFileSystem should use test root subdirectory. Contributed by Vlad Rozov
new 89e16be HDFS-3837. Fix DataNode.recoverBlock findbugs warning. Contributed by Eli Collins
new 380870d HDFS-3832. Remove protocol methods related to DistributedUpgrade. Contributed by Suresh Srinivas.
new 30bd8ef Moving HDFS-2686 and HDFS-3832 to branch-2 section in CHANGES.txt
new 901b173 HDFS-3819. Should check whether invalidate work percentage default value is not greater than 1.0f. Contributed by Jing Zhao.
new aa6f18e HDFS-3839. QJM: hadoop-daemon.sh should be updated to accept "journalnode". Contributed by Eli Collins
new de8b34a HDFS-3835. Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens. Contributed by Aaron T. Myers.
new d66223fd HADOOP-8721. ZKFC should not retry 45 times when attempting a graceful fence during a failover. Contributed by Vinayakumar B.
new dc33a07 MAPREDUCE-4068. Jars in lib subdirectory of the submittable JAR are not added to the classpath (rkanter via tucu)
new 0555a21 MAPREDUCE-4577. HDFS-3672 broke TestCombineFileInputFormat.testMissingBlocks() test. Contributed by Aaron T. Myers.
new 5b790ab HADOOP-8075. Lower native-hadoop library log from info to debug. Contributed by Hızır Sefa İrken
new f909a1d MAPREDUCE-4470. Fix TestCombineFileInputFormat.testForEmptyFile (ikatsov via tucu)
new 42beb56 HADOOP-8632. Configuration leaking class-loaders (Costin Leau via bobby)
new 34bd979 HADOOP-8655. Fix TextInputFormat for large deliminators. (Gelesh via bobby)
new aeb364d HADOOP-8225. DistCp fails when invoked by Oozie (daryn via bobby)
new 9ef3b2e MAPREDUCE-2374. "Text File Busy" errors launching MR tasks. Contributed by Andy Isaacson.
new 4f8e1f7 HADOOP-8709. globStatus changed behavior from 0.20/1.x (Jason Lowe via bobby)
new 6885d03 HDFS-3715. Fix TestFileCreation#testFileCreationNamenodeRestart. Contributed by Andrew Whang
new 26c259a Ammend previous commit to remove TestFileCreationNamenodeRestart.
new c10a733 Revert HDFS-3837. Fix DataNode.recoverBlock findbugs warning.
new fc1fab9 HADOOP-4572. Can not access user logs - Jetty is not configured by default to serve aliases/symlinks (ahmed via tucu)
new bbf1f55 HADOOP-8031. Configuration class fails to find embedded .jar resources; should use URL.openStream() (genman via tucu)
new c46de83 HDFS-3177. Update DFSClient and DataXceiver to handle different checkum types in file checksum computation. Contributed by Kihwal Lee
new cffee55 HADOOP-8725. MR is broken when security is off (daryn via bobby)
new 7a1dc1a HDFS-3834. Remove unused static fields NAME, DESCRIPTION and Usage from Command. Contributed by Jing Zhao.
new 8c8d679 Correcting the jira number from HDFS-3834 to HDFS-3844 for the commit 1377001
new a95bbb1 Correcting the jira number back to HDFS-3834 from HDFS-3844. I should pay better attention.
new 92cb6b0 HDFS-3678. Edit log files are never being purged from 2NN. Contributed by Aaron T. Myers.
new a8ff292 Merge trunk into HDFS-3077 branch.
new a110423 HDFS-3731. 2.0 release upgrade must handle blocks being written from 1.0. Contributed by Colin Patrick McCabe
new 7b541d6 MAPREDUCE-4408. allow jobs to set a JAR that is in the distributed cached (rkanter via tucu)
new deead78 HDFS-3844. Add @Override and remove {@inheritdoc} and unnecessary imports. Contributed by Jing Zhao.
new ffd2e01 YARN-39. RM-NM secret-keys should be randomly generated and rolled every so often. (Contributed by Vinod Kumar Vavilapalli and Siddharth Seth)
new 56285e1 HDFS-3683. Edit log replay progress indicator shows >100% complete. Contributed by Plamen Jeliazkov.
new 735046e HDFS-3851. DFSOutputStream class code cleanup. Contributed by Jing Zhao.
new 10e704c YARN-29. Add a yarn-client module. (Contributed by Vinod Kumar Vavilapalli)
new 0ec6cda YARN-37. Change TestRMAppTransitions to use the DrainDispatcher. (Contributed by Mayank Bansal)
new 1e68d47 HDFS-3845. Fixes for edge cases in QJM recovery protocol. Contributed by Todd Lipcon.
new cb540cd HADOOP-8719. Workaround for kerberos-related log errors upon running any hadoop command on OSX. Contributed by Jianbin Wei. (harsh)
new 24e47eb MAPREDUCE-4580. Change MapReduce to use the yarn-client module. (Contributed by Vinod Kumar Vavilapalli)
new b29cb2d HDFS-3856. TestHDFSServerPorts failure is causing surefire fork failure. Contributed by Colin Patrick McCabe
new 36c5388 Fixup CHANGELOG for HDFS-3856.
new cfe25b8 MAPREDUCE-4579. Split TestTaskAttempt into two so as to pass tests on jdk7. Contributed by Thomas Graves.
new 7fff7b4 YARN-31. Fix TestDelegationTokenRenewer to not depend on test order so as to pass tests on jdk7. Contributed by Thomas Graves.
new e7b12c8 HADOOP-8619. WritableComparator must implement no-arg constructor. Contributed by Chris Douglas.
new 54d4630 HADOOP-8738. junit JAR is showing up in the distro (tucu)
new 8d724dd HDFS-3860. HeartbeatManager#Monitor may wrongly hold the writelock of namesystem. Contributed by Jing Zhao.
new 963d01a MAPREDUCE-4600. TestTokenCache.java from MRV1 no longer compiles (daryn via bobby)
new d4d2bf7 HDFS-3849. When re-loading the FSImage, we should clear the existing genStamp and leases. Contributed by Colin Patrick McCabe.
new b2d186d HDFS-3864. NN does not update internal file mtime for OP_CLOSE when reading from the edit log. Contributed by Aaron T. Myers.
new e5b1b7d HADOOP-8737. cmake: always use JAVA_HOME to find libjvm.so, jni.h, jni_md.h. Contributed by Colin Patrick McCabe
new 8449526 Moved MAPREDUCE-4323 to YARN-58 and updated CHANGES.txt to reflect this.
new a310557 HADOOP-8747. Syntax error on cmake version 2.6 patch 2 in JNIFlags.cmake. (cmccabe via tucu)
new 95af351 MAPREDUCE-4608. hadoop-mapreduce-client is missing some dependencies. Contributed by Alejandro Abdelnur.
new ec94ea2 HADOOP-8748. Refactor DFSClient retry utility methods to a new class in org.apache.hadoop.io.retry. Contributed by Arun C Murthy
new 2f1a133 MAPREDUCE-4610. Support deprecated mapreduce.job.counters.limit property in MR2.
new bb64f86 HDFS-3861. Deadlock in DFSClient (Kihwal Lee via daryn)
new 6f6e170 HADOOP-8726. The Secrets in Credentials are not available to MR tasks (daryn and Benoy Antony via bobby)
new 65e447c MAPREDUCE-4569. Fixed TestHsWebServicesJobsQuery to pass on JDK7 by not depending on test order. Contributed by Thomas Graves.
new 34d1e73 HDFS-3837. Fix DataNode.recoverBlock findbugs warning. Contributed by Eli Collins
new 7d1c8d9 HDFS-3733. Audit logs should include WebHDFS access. Contributed by Andy Isaacson
new 4cdc854 HADOOP-8722. Update BUILDING.txt with latest snappy info. Contributed by Colin Patrick McCabe
new d8ce3be YARN-63. RMNodeImpl is missing valid transitions from the UNHEALTHY state (Jason Lowe via bobby)
new e5a9d67 HADOOP-8684. Deadlock between WritableComparator and WritableComparable. Contributed by Jing Zhao
new 2fd49f5 HDFS-3833. TestDFSShell fails on windows due to concurrent file read/write. Contributed by Brandon Li
new 38d003a HADOOP-8727. Gracefully deprecate dfs.umaskmode in 2.x onwards (Harsh J via bobby)
new 45a8e8c YARN-60. Fixed a bug in ResourceManager which causes all NMs to get NPEs and thus causes all containers to be rejected. Contributed by Vinod Kumar Vavilapalli.
new 27cfde7 YARN-60: Fix minor merge conflict (bobby)
new 60b8c6e YARN-66. aggregated logs permissions not set properly (tgraves via bobby)
new 0152565 MAPREDUCE-4612. job summary file permissions not set when its created (tgraves via bobby)
new 63f941d MAPREDUCE-4614. Simplify debugging a job's tokens (daryn via bobby)
new 25e96e4 MAPREDUCE-4611. MR AM dies badly when Node is decommissioned (Robert Evans via tgraves)
new 3819c96 HDFS-3873. Hftp assumes security is disabled if token fetch fails (daryn)
new 94129df MAPREDUCE-4604. In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker. (Ravi Prakash via jeagles)
new 94c69f2 HDFS-3852. TestHftpDelegationToken is broken after HADOOP-8225 (daryn)
new c76a789 HDFS-3466. Get HTTP kerberos principal from the web authentication keytab. (omalley)
new 4911d9b HADOOP-8736. Add Builder for building RPC server. Contributed by Brandon Li
new 6f5ae49 HDFS-3877. QJM: Provide defaults for dfs.journalnode.*address. Contributed by Eli Collins
new 50222ff HDFS-3871. Change NameNodeProxies to use RetryUtils. Contributed by Arun C Murthy
new 54e612b HDFS-2580. NameNode#main(...) can make use of GenericOptionsParser. Contributed by harsh. (harsh)
new da3bd67 HDFS-3880. Use Builder to build RPC server in HDFS. Contributed by Brandon Li.
new 3969bcb HDFS-3469. start-dfs.sh will start zkfc, but stop-dfs.sh will not stop zkfc similarly. Contributed by Vinay
new ab986d7 MAPREDUCE-2786. Add compression option for TestDFSIO. Contributed by Plamen Jeliazkov.
new b1632b4 YARN-10. Fix DistributedShell module to not have a dependency on hadoop-mapreduce-client-core. Contributed by Hitesh Shah.
new f5943c1 Updated CHANGES.txt for 0.23.4
new 60af999 YARN-84. Use Builder to build RPC server. Contributed by Brandon Li
new 4244c14 HDFS-3866. HttpFS POM should have property where to download tomcat from (zero45 via tucu)
new f392759 HDFS-3887. Remove redundant chooseTarget methods in BlockPlacementPolicy. Contributed by Jing Zhao
new 658e7b5 HDFS-3888. Clean up BlockPlacementPolicyDefault. Contributed by Jing Zhao
new ab74b1a YARN-79. Implement close on all clients to YARN so that RPC clients don't throw exceptions on shut-down. Contributed by Vinod Kumar Vavilapalli.
new 65b308f YARN-42. Modify NM's non-aggregating logs' handler to stop properly so that NMs don't get NPEs on startup errors. Contributed by Devaraj K.
new 8021d91 HDFS-3863. Track last "committed" txid in QJM. Contributed by Todd Lipcon.
new 72485f3 HDFS-3869. Expose non-file journal manager details in web UI. Contributed by Todd Lipcon.
new f6b7f06 HDFS-3884. Journal format() should reset cached values. Contributed by Todd Lipcon.
new 13daca1 HDFS-3870. Add metrics to JournalNode. Contributed by Todd Lipcon.
new c334cc8 HDFS-2793. Add an admin command to trigger an edit log roll. Contributed by Todd Lipcon.
new 6669fea HADOOP-8764. CMake: HADOOP-8737 broke ARM build. Contributed by Trevor Robinson
new 31142aa HDFS-1490. TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay.
new 99ec5bd Merge trunk into QJM branch
new 87c5d24 YARN-83. Change package of YarnClient to org.apache.hadoop. Contributed by Bikas Saha.
new e57843e HDFS-3054. distcp -skipcrccheck has no effect. Contributed by Colin Patrick McCabe.
new aa04939 Fix MAPREDUCE-4580 build breakage.
new 726b48f YARN-68. NodeManager will refuse to shutdown indefinitely due to container log aggregation (daryn via bobby)
new 91e832e HADOOP-8770. NN should not RPC to self to find trash defaults. Contributed by Eli Collins
new eebbeb5 HADOOP-8648. libhadoop: native CRC32 validation crashes when io.bytes.per.checksum=1. Contributed by Colin Patrick McCabe
new 4d26534 HADOOP-8766. FileContextMainOperationsBaseTest should randomize the root dir. Contributed by Colin Patrick McCabe.
new 02c0317 YARN-87. NM ResourceLocalizationService does not set permissions of local cache directories (Jason Lowe via tgraves)
new 01db4d2 HDFS-3828. Block Scanner rescans blocks too frequently. Contributed by Andy Isaacson
new 437948e HDFS-3891. Make selectInputStreams throw IOE instead of RTE. Contributed by Todd Lipcon.
new cae8116 HDFS-3726. If a logger misses an RPC, don't retry that logger until next segment. Contributed by Todd Lipcon.
new 82b981c HDFS-3890. filecontext mkdirs doesn't apply umask as expected (Tom Graves via daryn)
new 5dcb594 MAPREDUCE-4633. history server doesn't set permissions on all subdirs (tgraves via bobby)
new 8b88542 Amend HDFS-3726. Add previously missing file JournalOutOfSyncException.java
new 6fd7df7 HDFS-3809. Make BKJM use protobufs for all serialization with ZK. Contributed by Ivan Kelly
new 0654590 Removed unnecessary .org files added in previous commit HDFS-3809
new 11312ad HADOOP-8749. HADOOP-8031 changed the way in which relative xincludes are handled in Configuration. (ahmed via tucu)
new 9da626a HDFS-3895. hadoop-client must include commons-cli (tucu)
new df80107 HDFS-3893. QJM: Make QJM work with security enabled. Contributed by Aaron T. Myers.
new 09038b7 MAPREDUCE-4641. Exception in commitJob marks job as successful in job history (Jason Lowe via bobby)
new d093dcc YARN-15. Updated default classpath for YARN applications to reflect split of YARN into a sub-project. Contributed by Arun C Murthy.
new d3224af YARN-15. Fixing CHANGES.txt
new 3a4e87e YARN-75. Modified ResourceManager's RMContainer to handle a valid RELEASE event at RUNNING state. Contributed by Siddharth Seth.
new 68ad171 YARN-75. Removing spurious file from the previous commit.
new e9411ae YARN-75. Added file missing from previous commit. Bad day with svn.
new e4679b5 YARN-75. Missing test. Ugh.
new 404ab8e HADOOP-8431. Running distcp wo args throws IllegalArgumentException. Contributed by Sandy Ryza
new 16234cb HDFS-3897. QJM: TestBlockToken fails after HDFS-3893. Contributed by Aaron T. Myers.
new e8c193b HADOOP-8754. Deprecate all the RPC.getServer() variants. Contributed by Brandon Li
new 0056914 MAPREDUCE-4638. MR AM supplies MapReduce jars in classpath rather than rely on YARN. Contributed by Arun C Murthy.
new 56d72df YARN-80. Add support for delaying rack-local containers in CapacityScheduler. Contributed by Arun C. Murthy.
new a1aa1b9 YARN-57. Allow process-tree based resource calculation et al. to be pluggable to support it on multiple platforms. Contributed by Radim Kolar.
new 77805c7 MAPREDUCE-4629. Remove JobHistory.DEBUG_MODE (Karthik Kambatla via bobby)
new a799892 MAPREDUCE-4642. MiniMRClientClusterFactory should not use job.setJar() (rkanter via tucu)
new 6ba9ff9 HADOOP-8775. MR2 distcp permits non-positive value to -bandwidth option which causes job never to complete. Contributed by Sandy Ryza.
new 7851676 Preparing for hadoop-2.0.2-alpha release.
new 681408f Set date for hadoop-2.0.2-alpha
new 3a4dcfb HDFS-2757. Cannot read a local block that's being written to when using the local read short circuit. Contributed by Jean-Daniel Cryans
new 009235f HDFS-2656. Add libwebhdfs, a pure C client based on WebHDFS. Contributed by Jaimin D Jetly and Jing Zhao
new 1cea56d Merge trunk into QJM branch
new e1ffefa HDFS-3907. Allow multiple users for local block readers. Contributed by Eli Collins
new aa65777 HDFS-3898. QJM: enable TCP_NODELAY for IPC. Contributed by Todd Lipcon.
new ca45822 HDFS-3885. QJM: optimize log sync when JN is lagging behind. Contributed by Todd Lipcon.
new 60c20e5 HDFS-3900. QJM: avoid validating log segments on log rolls. Contributed by Todd Lipcon.
new 959afc0 HDFS-3901. QJM: send 'heartbeat' messages to JNs even when they are out-of-sync. Contributed by Todd Lipcon.
new 729ec86 HDFS-3899. Add client side metrics for QJM. Contributed by Todd Lipcon.
new 1d42944 HADOOP-8781. hadoop-config.sh should add JAVA_LIBRARY_PATH to LD_LIBRARY_PATH. (tucu)
new c5199ca HDFS-3914. QJM: acceptRecovery should abort current segment. Contributed by Todd Lipcon.
new c859e87 HDFS-3915. QJM: Failover fails with auth error in secure cluster. Contributed by Todd Lipcon.
new 8a8c9c1 HDFS-3906. QJM: quorum timeout on failover with large log segment. Contributed by Todd Lipcon.
new a93ba16 HDFS-3840. JournalNodes log JournalNotFormattedException backtrace error before being formatted. Contributed by Todd Lipcon.
new bdcbc2d HADOOP-8786. HttpServer continues to start even if AuthenticationFilter fails to init. Contributed by Todd Lipcon.
new 3b46295 MAPREDUCE-4607. Race condition in ReduceTask completion can result in Task being incorrectly failed. Contributed by Bikas Saha.
new c406e65 Update CHANGES.txt for MAPREDUCE-4607 commit.
new aa4c3fc HADOOP-8789. Tests setLevel(Level.OFF) should be Level.ERROR. Contributed by Andy Isaacson
new 043a27a HADOOP-8767. Secondary namenode is started on slave nodes instead of master nodes. Contributed by Giovanni Delussu.
new de2efbe HADOOP-8597. Permit FsShell's text command to read Avro files. Contributed by Ivan Vladimirov.
new dc1fd84 HDFS-3910. DFSTestUtil#waitReplication should timeout. Contributed by Eli Collins
new 11cf00b YARN-78. Changed UnManagedAM application to use YarnClient. Contributed by Bikas Saha.
new 229a79b MAPREDUCE-4646. Fixed MR framework to send diagnostic information correctly to clients in case of failed jobs also. Contributed by Jason Lowe.
new 414abe6 HDFS-3664. BlockManager race when stopping active services. Contributed by Colin Patrick McCabe
new f0c3ed7 HDFS-3919. MiniDFSCluster:waitClusterUp can hang forever. Contributed by Andy Isaacson
new 80a8d57 HDFS-3925. Prettify PipelineAck#toString() for printing to a log. Contributed by Andrew Wang.
new 2ba149f HDFS-3902. TestDatanodeBlockScanner#testBlockCorruptionPolicy is broken. Contributed by Andy Isaacson
new 4f312cf HDFS-3928. MiniDFSCluster should reset the first ExitException on shutdown. Contributed by Eli Collins
new 7c49188 YARN-93. Fixed RM to propagate diagnostics from applications that have finished but failed Contributed by Jason Lowe.
new d543140 HDFS-3703. Datanodes are marked stale if heartbeat is not received in configured timeout and are selected as the last location to read from. Contributed by Jing Zhao.
new eb7f8a7 HADOOP-8801. ExitUtil#terminate should capture the exception stack trace. Contributed by Eli Collins
new cae6885 HADOOP-8795. BASH tab completion doesn't look in PATH, assumes path to executable is specified. Contributed by Sean Mackrory.
new 40d56f1 HDFS-3894. QJM: testRecoverAfterDoubleFailures can be flaky due to IPC client caching. Contributed by Todd Lipcon.
new 853db9e HDFS-3926. QJM: Add user documentation for QJM. Contributed by Aaron T. Myers.
new 8663516 HDFS-3924. Multi-byte id in HdfsVolumeId. Contributed by Andrew Wang.
new d8e386f HADOOP-8755. Print thread dump when tests fail due to timeout. Contributed by Andrey Klochkov.
new d898285 HADOOP-8780. Update DeprecatedProperties apt file. Contributed by Ahmed Radwan
new 0de9642 HDFS-3938. remove current limitations from HttpFS docs. (tucu)
new 0c53ed4 HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum and TFileDumper. Contributed by Brandon Li.
new 5d37911 HADOOP-8821. Fix findbugs warning related concatenating string in a for loop in Configuration#dumpDeprecatedKeys(). Contributed by Suresh Srinivas.
new 6afabd7 HADOOP-8819. Incorrectly & is used instead of && in some file system implementations. Contributed by Brandon Li.
new 8a9debd HADOOP-8806. libhadoop.so: dlopen should be better at locating libsnappy.so, etc. Contributed by Colin Patrick McCabe
new 4d2e77b Revert previous commit - accidentally included two changes.
new d720ebc HADOOP-8806. libhadoop.so: dlopen should be better at locating libsnappy.so, etc. Contributed by Colin Patrick McCabe
new 2526a96 YARN-108. FSDownload can create cache directories with the wrong permissions (Jason Lowe via bobby)
new 83c14fb HDFS-3943. QJM: remove currently-unused md5sum field. Contributed by Todd Lipcon.
new 37d5618 YARN-28. Fixed TestCompositeService to not depend on test-order and thus made it pass on JDK7. Contributed by Thomas Graves.
new c419b13 HDFS-3944. Httpfs resolveAuthority() is not resolving host correctly. (tucu)
new 7e3776c HDFS-3936. MiniDFSCluster shutdown races with BlocksMap usage. Contributed by Eli Collins
new ea6a36e HADOOP-8812. ExitUtil#terminate should print Exception#toString. Contributed by Eli Collins
new a8e4bb8 HDFS-3939. NN RPC address cleanup. Contributed by Eli Collins
new 9f6cfe3 HADOOP-8805. Move protocol buffer implementation of GetUserMappingProtocol from HDFS to Common. (bowang via tucu)
new e9f4de5 Merge trunk into branch
new 7fb42f8 HDFS-3951. datanode web ui does not work over HTTPS when datanode is started in secure mode. (tucu)
new 8bf6b80 Reverting HADOOP-8805
new 663e748 HDFS-3950. QJM: misc TODO cleanup, improved log messages, etc. Contributed by Todd Lipcon.
new 3ccd905 HDFS-3955. QJM: Make acceptRecovery() atomic. Contributed by Todd Lipcon.
new f26c63d Amend HFDS-3955. Forgot an import of ImmutableList in previous patch.
new 8a3e64c HDFS-3956. QJM: purge temporary files when no longer within retention period. Contributed by Todd Lipcon.
new d26f05b HDFS-3949. NameNodeRpcServer#join should join on both client and server RPC servers. Contributed by Eli Collins
new 4c56bcc HADOOP-8814. Replace string equals by String#isEmpty(). Contributed by Brandon Li.
new 7dee7f1 HDFS-3932. NameNode Web UI broken if the rpc-address is set to the wildcard. Contributed by Colin Patrick McCabe
new 3ea3508 HDFS-3931. TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken. Contributed by Andy Isaacson
new fa6d519 HDFS-3964. Make NN log of fs.defaultFS debug rather than info. Contributed by Eli Collins
new f4c336d YARN-82. Change the default local and log dirs to be based on hadoop.tmp.dir and yarn.log.dir. (Contributed by Hemanth Yamijala)
new ff7b818 YARN-82. Correct the fix version in CHANGES.txt
new 52fc15a Moving HADOOP-8736 to release 2.0.3 section
new bfe3816 YARN-88. DefaultContainerExecutor can fail to set proper permissions. (Contributed by Jason Lowe)
new eb547be MAPREDUCE-4674. Hadoop examples secondarysort has a typo "secondarysrot" in the usage. Contributed by Robert Justice
new bd76d9a HADOOP-8833. fs -text should make sure to call inputstream.seek(0) before using input stream. Contributed by Tom White and Harsh J. (harsh)
new 28023b7 HADOOP-7256. Resource leak during failure scenario of closing of resources. Contributed by Ramkrishna S. Vasudevan. (harsh)
new 2837907 HADOOP-8588. SerializationFactory shouldn't throw a NullPointerException if the serializations list is empty. Contributed by Sho Shimauchi. (harsh)
new ac31d6a HADOOP-8151. Error handling in snappy decompressor throws invalid exceptions. Contributed by Matt Foley. (harsh)
new 9c9b3f0 HADOOP-8158. Interrupting hadoop fs -put from the command line causes a LeaseExpiredException. Contributed by Daryn Sharp. (harsh)
new d524942 YARN-53. Added the missing getGroups API to ResourceManager. Contributed by Bo Wang.
new 0187553 Fix the length of the secret key.
new 248756e Moving HDFS-234 from trunk to Release 2.0.0-alpha section
new b26ed9d MAPREDUCE-4645. Provide a random seed to Slive to make the sequence of file names deterministic. Contributed by Ravi Prakash.
new 78fa84a Move MAPREDUCE-4645 under 0.23.4 release section in CHANGES.txt
new 5308a0e HADOOP-8813. Add InterfaceAudience and InterfaceStability annotations to RPC Server and Client classes. Contributed by Brandon Li.
new 44ae25a HADOOP-8815. RandomDatum needs to override hashCode(). Contributed by Brandon Li.
new d50e06d HADOOP-7930. Kerberos relogin interval in UserGroupInformation should be configurable. Contributed by Robert Kanter. (harsh)
new a7e450c HADOOP-8436. NPE In getLocalPathForWrite ( path, conf ) when the required context item is not configured. Contributed by Brahma Reddy Battula. (harsh)
new 1a06694 HADOOP-8838. Colorize the test-patch output sent to JIRA (Harsh J via bobby)
new c4bbbb7 HADOOP-8791. Fix rm command documentation to indicte it deletes files and not directories. Contributed by Jing Zhao.
new 15ac5e1 HADOOP-8840. Fix the test-patch colorizer to cover all sorts of +1 lines. (Harsh J via bobby)
new d9c6b1f HADOOP-8822. relnotes.py was deleted post mavenization (bobby)
new 33a3efc MAPREDUCE-4651. Benchmarking random reads with DFSIO.
new b1ceaac Merge trunk into branch
new 9270635 HADOOP-3957. Change MutableQuantiles to use a shared thread for rolling over metrics. Contributed by Andrew Wang.
new 8912aac YARN-9. Rename YARN_HOME to HADOOP_YARN_HOME. Contributed by Vinod K V.
new 296ee45 HADOOP-8794. Rename YARN_HOME to HADOOP_YARN_HOME. Contributed by Vinod K V.
new 1eedee1 MAPREDUCE-4649. Ensure MapReduce JobHistory Daemon doens't assume HADOOP_YARN_HOME and HADOOP_MAPRED_HOME are the same. Contributed by Vinod K V.
new 2610acf MAPREDUCE-4685. DBCount should not use ACCESS. Contributed by Viji. (harsh)
new 462ba6a MAPREDUCE-4686. hadoop-mapreduce-client-core fails compilation in Eclipse due to missing Avro-generated classes. Contributed by Chris Nauroth. (harsh)
new a7bcdcc HDFS-3373. Change DFSClient input stream socket cache to global static and add a thread to cleanup expired cache entries. Contributed by John George
new 050fd3a MAPREDUCE-4647. We should only unjar jobjar if there is a lib directory in it. (Robert Evans via tgraves)
new 6ddbb22 HADOOP-8843. Old trash directories are never deleted on upgrade from 1.x. Contributed by Jason Lowe
new 036530f Reverted MAPREDUCE-4253.
new 47dfcf4 HDFS-3972. Trash emptier fails in secure HA cluster. Contributed by Todd Lipcon
new 40062e1 Fix NodeManager to verify the application's user-name.
new a33ae40 HADOOP-8855. SSL-based image transfer does not work when Kerberos is disabled. Contributed by Todd Lipcon
new 01c0dc9 HDFS-3831. Failure to renew tokens due to test-sources left in classpath (jlowe via bobby)
new 802ccaf Fix some spurious whitespace changes in branch (per Suresh's review)
new b0b03d4 HADOOP-8864. Addendum to HADOOP-8840: Add a coloring case for +0 results too. Contributed by Harsh J. (harsh)
new 6d77365 MAPREDUCE-3223. Remove MR1 configs from mapred-default.xml. Contributed by Todd Lipcon (harsh)
new e45b103 MAPREDUCE-4678. Running the Pentomino example with defaults throws java.lang.NegativeArraySizeException. Contributed by Chris McConnell. (harsh)
new 41ebf4f YARN-106. Nodemanager needs to set permissions of local directories (jlowe via bobby)
new 03b7ad0 MAPREDUCE-4691. Historyserver can report "Unknown job" after RM says job has completed. Contributed by Robert Joseph Evans.
new b897d6c MAPREDUCE-4689. JobClient.getMapTaskReports on failed job results in NPE (jlowe via bobby)
new e8dc3b3 HDFS-3896. Add descriptions for dfs.namenode.rpc-address and dfs.namenode.servicerpc-address to hdfs-default.xml. Contributed by Jeff Lord.
new 1ced82c HADOOP-8866. SampleQuantiles#query is O(N^2) instead of O(N). Contributed by Andrew Wang.
new 648ba4a HDFS-3992. Method org.apache.hadoop.hdfs.TestHftpFileSystem.tearDown() sometimes throws NPEs. Contributed by Ivan A. Veselovsky.
new 34becbb HADOOP-8386. hadoop script doesn't work if 'cd' prints to stdout (default behavior in Ubuntu). Contributed by Christopher Berner and Andy Isaacson. (harsh)
new af647bb Preparing for release 0.23.4
new ab52567 HADOOP-8839. test-patch's -1 on @author tag presence doesn't cause a -1 to the overall result. Contributed by Harsh J. (harsh)
new 39f1557 YARN-116. Add the ability to change the RM include/exclude file without a restart. (Contributed by xieguiming and Harsh J)
new 70c295d YARN-137. Change the default YARN scheduler to be the CapacityScheduler. Contributed by Siddharth Seth.
new 92f1f2c YARN-138. Ensure default values for minimum/maximum container sizes is sane. Contributed by Harsh J and Siddharth Seth.
new 1c29c78 Release notes.
new 57807d5 MAPREDUCE-4681. Fix unit tests broken by HDFS-3910. Contributed by Arun C. Murthy.
new 7137503 MAPREDUCE-4695. Fix LocalRunner on trunk after MAPREDUCE-3223 broke it. Contributed by Harsh J. (harsh)
new c908f96 HADOOP-8851. Use -XX:+HeapDumpOnOutOfMemoryError JVM option in the forked tests. Contributed by Ivan A. Veselovsky.
new b146f9f HADOOP-8738. Reverted since it broke MR based system tests.
new 2cfe241 Updated release notes for 2.0.2-alpha.
new d1f4ec4 HADOOP-8616. ViewFS configuration requires a trailing slash. Contributed by Sandy Ryza.
new c808cae Revert an errant commit of HADOOP-8616.
new ccabb68 HADOOP-8616. ViewFS configuration requires a trailing slash. Contributed by Sandy Ryza.
new f8f79a0 HDFS-3753. Tests don't run with native libraries. Contributed by Colin Patrick McCabe
new fc54f57 HADOOP-8756. Fix SEGV when libsnappy is in java.library.path but not LD_LIBRARY_PATH. Contributed by Colin Patrick McCabe
new db51b03 YARN-131. Fix incorrect ACL properties in capacity scheduler documentation. (Contributed by Ahmed Radwan)
new a7d4f30 HADOOP-8783. Improve RPC.Server's digest auth (daryn)
new 247a5ee YARN-102. Move the apache header to the top of the file in MemStore.java. (Contributed by Devaraj K)
new 803828b MAPREDUCE-4123. Remove the 'mapred groups' command, which is no longer supported. (Contributed by Devaraj K)
new 43ae847 HDFS-3996. Add debug log removed in HDFS-3873 back. Contributed by Eli Collins
new 5c19b6b Amend HDFS-3753 to ignore TestHdfsNativeCodeLoader. To be fixed in HDFS-4003.
new 10a0eaa HDFS-4004. TestJournalNode#testJournal fails because of test case execution order. Contributed by Chao Shi.
new 2c66a9f HDFS-2127. Add a test that ensure AccessControlExceptions contain a full path. Contributed by Stephen Chu
new 3894364 HDFS-4000. TestParallelLocalRead fails with "input ByteBuffers must be direct buffers". Contributed by Colin Patrick McCabe
new ee13fb4 HDFS-3916. libwebhdfs (C client) code cleanups. Contributed by Colin Patrick McCabe
new 50b2047 HADOOP-8881. FileBasedKeyStoresFactory initialization logging should be debug not info. (tucu)
new 016b868 HDFS-3999. HttpFS OPEN operation expects len parameter, it should be length. (tucu)
new b8f81d7 YARN-23. FairScheduler: FSQueueSchedulable#updateDemand() - potential redundant aggregation. (kkambatl via tucu)
new 6582da0 HDFS-3813. Log error message if security and WebHDFS are enabled but principal/keytab are not configured. Contributed by Stephen Chu.
new a41f808 HDFS-3995. Use DFSTestUtil.createFile() for file creation and writing in test cases. Contributed by Jing Zhao.
new dfb8369 HDFS-3735. NameNode WebUI should allow sorting live datanode list by fields Block Pool Used, Block Pool Used(%) and Failed Volumes. Contributed by Brahma Reddy Battula.
new d35169d HDFS-3829. TestHftpURLTimeouts fails intermittently with JDK7 (Trevor Robinson via tgraves)
new 353958d HDFS-3483. Better error message when hdfs fsck is run against a ViewFS config. Contributed by Stephen Fritz.
new d974127 HADOOP-8889. Upgrade to Surefire 2.12.3. Contributed by Todd Lipcon.
new e32af60 HDFS-3682. MiniDFSCluster#init should provide more info when it fails. Contributed by Todd Lipcon
new 5a5473b HDFS-4006. TestCheckpoint#testSecondaryHasVeryOutOfDateImage occasionally fails due to unexpected exit. Contributed by Todd Lipcon
new 3a4cf1c HDFS-4008. TestBalancerWithEncryptedTransfer needs a timeout. Contributed by Eli Collins
new c50033d HADOOP-8804. Improve Web UIs when the wildcard address is used. Contributed by Senthil Kumar
new 5dcdc8a HDFS-4003. test-patch should build the common native libs before running hdfs tests. Contributed by Colin Patrick McCabe
new 2a32ba9 HADOOP-8884. DEBUG should be WARN for DEBUG util.NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError. Contributed by Anthony Rojas.
new a047fa9 MAPREDUCE-4712. mr-jobhistory-daemon.sh doesn't accept --config (Vinod Kumar Vavilapalli via tgraves)
new 70fc5cf HDFS-4017. Unclosed FileInputStream in GetJournalEditServlet. Contributed by Chao Shi.
new 17b32bb HDFS-4007. Rehabilitate bit-rotted unit tests under hadoop-hdfs-project/hadoop-hdfs/src/test/unit/. Contributed by Colin Patrick McCabe.
new 49b20c2 MAPREDUCE-4554. Job Credentials are not transmitted if security is turned off (Benoy Antony via bobby)
new 494e210 YARN-127. Move RMAdmin tool to its correct location - the client module. Contributed by Vinod Kumar Vavilapalli.
new 2b49b39 Revert initial commit of HADOOP-8884 per feedback from Todd.
new 331b112 YARN-40. Provided support for missing YARN commands Contributed by Devaraj K and Vinod Kumar Vavilapalli.
new 38e1a5a YARN-40. Fixed CHANGES.txt from previous commit.
new 2115bd2 HADOOP-8886. Remove KFS support. Contributed by Eli Collins
new 03c96ef HDFS-4018. TestDataNodeMultipleRegistrations#testMiniDFSClusterWithMultipleNN is missing some cluster cleanup. Contributed by Eli Collins
new ad9bcb9 HADOOP-8894. GenericTestUtils.waitFor should dump thread stacks on timeout. Contributed by Todd Lipcon.
new c074cfd YARN-134. Fixes ClientToAMSecretManager creates keys without checking for validity of the appID. (Contributed by Vinod Kumar Vavilapalli)
new 1e30e49 YARN-33. Change LocalDirsHandlerService to validate the configured local and log dirs. (Contributed by Mayank Bansal)
new 8ac3910 MAPREDUCE-4705. Fix a bug in job history lookup, which makes older jobs inaccessible despite the presence of a valid history file. (Contributed by Jason Lowe)
new 5c3a331 MAPREDUCE-4574. Fix TotalOrderParitioner to work with non-WritableComparable key types. Contributed by Harsh J. (harsh)
new 0aa8188 MAPREDUCE-3678. The Map tasks logs should have the value of input split it processed. Contributed by Harsh J. (harsh)
new aa93461 MAPREDUCE-4654. TestDistCp is ignored. Contributed by Sandy Ryza.
new bca57d4 YARN-94. Modify DistributedShell to point to main-class by default, clean up the help message, and hard-code the AM class. Contributed by Hitesh Shah.
new a5ebccd YARN-30. Fixed tests verifying web-services to work on JDK7. Contributed by Thomas Graves.
new 0e2d935 YARN-150. Fixes AppRejectedTransition does not unregister a rejected app-attempt from the ApplicationMasterService (Contributed by Bikas Saha)
new a0a96eb HDFS-3824. TestHftpDelegationToken fails intermittently with JDK7 (Trevor Robinson via tgraves)
new c9a1d4d HDFS-4020. TestRBWBlockInvalidation may time out. Contributed by Eli Collins
new 08f35a0 HDFS-3224. Bug in check for DN re-registration with different storage ID. Contributed by Jason Lowe
new 8078e16 HDFS-4021. Misleading error message when resources are low on the NameNode. Contributed by Christopher Conner.
new 33c16f2 HADOOP-8913. hadoop-metrics2.properties should give units in comment for sampling period. Contributed by Sandy Ryza.
new ff8f84c Merge trunk into branch
new bfce95d HADOOP-8878. Uppercase namenode hostname causes hadoop dfs calls with webhdfs filesystem and fsck to fail when security is on. Contributed by Arpit Gupta.
new adb50a3 Merge HDFS-3077 into trunk
new 3d76be9 YARN-146. Add unit tests for computing fair share in the fair scheduler. Contributed by Sandy Ryza.
new f174adf MAPREDUCE-4616. Improve javadoc for MultipleOutputs. Contributed by Tony Burton.
new 2887bbb HDFS-3912. Detect and avoid stale datanodes for writes. Contributed by Jing Zhao
new 8114457 HADOOP-8909. Hadoop Common Maven protoc calls must not depend on external sh script. Contributed by Chris Nauroth.
new 7ca007b Merge CHANGES for HDFS-3077 into the main CHANGES.txt file
new 4e64e6f HDFS-4041. Hadoop HDFS Maven protoc calls must not depend on external sh script. Contributed by Chris Nauroth.
new e8693d0 HADOOP-8918. test-patch.sh is parsing modified files wrong. Contributed by Raja Aluri.
new 94ed14c HADOOP-8911. CRLF characters in source and text files. Contributed Raja Aluri.
new 1dd6522 HADOOP-8912. Add .gitattributes file to prevent CRLF and LF mismatches for source and text files. Contributed by Raja Aluri.
new 62c70a2 HADOOP-8912. Adding missing CHANGES.txt changes in the previous commit 1397437.
new 89b66da HDFS-4044. Duplicate ChecksumType definition in HDFS .proto files. Contributed by Binglin Chang.
new 22ef03b HADOOP-8784. Improve IPC.Client's token use (daryn)
new 611ff4e HADOOP-8910. Add examples to GlobExpander#expand method. Contributed by Suresh Srinivas.
new f8bdac0 HADOOP-8906. paths with multiple globs are unreliable. Contributed by Daryn Sharp.
new ad06a08 HDFS-4037. Rename the getReplication() method in BlockCollection to getBlockReplication().
new 698fa50 HDFS-4036. Remove "throw UnresolvedLinkException" from FSDirectory.unprotectedAddFile(..). Contributed by Jing Zhao
new 73e9366 HADOOP-8901. GZip and Snappy support may not work without unversioned libraries. Contributed by Colin Patrick McCabe.
new ded304e HDFS-4049. Fix hflush performance regression due to nagling delays. Contributed by Todd Lipcon.
new f5f763e Update CHANGES.txt to have HDFS-3678 under release 2.0.3 instead of 3.0.0.
new 557ffe2 HDFS-2946. HA: Put a cap on the number of completed edits files retained by the NN. Contributed by Aaron T. Myers.
new a75673c HDFS-4058. DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order. Contributed by Eli Collins
new b7887f3 HDFS-4052. BlockManager#invalidateWork should print log outside the lock. Contributed by Jing Zhao.
new 41eec8a HADOOP-8920. Add more javadoc to metrics2 related classes. Contributed by Suresh Srinivas.
new e0db1e9 HADOOP-8929. Add toString, other improvements for SampleQuantiles. Contributed by Todd Lipcon.
new b245adb HDFS-3985. Add timeouts to TestMulitipleNNDataBlockScanner. Contributed by Todd Lipcon
new 9757f74 HADOOP-8923. JNI-based user-group mapping modules can be too chatty on lookup failures. Contributed by Kihwal Lee.
new ec43a33 HADOOP-8883. Anonymous fallback in KerberosAuthenticator is broken. (rkanter via tucu)
new 6a059dc HADOOP-8922. Provide alternate JSONP output for JMXJsonServlet to allow javascript in browser dashboard (Damien Hardy via bobby)
new 0ef9c6f HDFS-4059. Add number of stale DataNodes to metrics. Contributed by Jing Zhao.
new be2b9d0 HADOOP-8931. Add Java version to startup message. Contributed by Eli Collins
new 224de4f HADOOP-8926. hadoop.util.PureJavaCrc32 cache hit-ratio is low for static data (Gopal V via bobby)
new e074b58 HDFS-4061. TestBalancer and TestUnderReplicatedBlocks need timeouts. Contributed by Eli Collins
new 0e9f40d MAPREDUCE-4521. mapreduce.user.classpath.first incompatibility with 0.20/1.x (Ravi Prakash via bobby)
new 21b8d7b YARN-161. Fix multiple compiler warnings for unchecked operations in YARN common. Contributed by Chris Nauroth.
new 4028364 HDFS-3997. OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED element. Contributed by Mithun Radhakrishnan.
new ab727f4 YARN-43. Fix TestResourceTrackerService to not depend on test order and thus pass on JDK7. Contributed by Thomas Graves.
new 24015b7 HDFS-4055. TestAuditLogs is flaky. Contributed by Binglin Chang
new a258263 HDFS-4029. GenerationStamp should use an AtomicLong. Contributed by Eli Collins
new c638117 MAPREDUCE-4721. Task startup time in JHS is same as job startup time. (Ravi Prakash via bobby)
new 6f79fff HADOOP-8900. BuiltInGzipDecompressor throws IOException - stored gzip size doesn't match decompressed size. Contributed by Slavik Krassovsky.
new f91a2cb HADOOP-8930. Cumulative code coverage calculation (Andrey Klochkov via bobby)
new 4d5600f HDFS-4068. DatanodeID and DatanodeInfo member should be private. Contributed by Eli Collins
new 6cfa710 YARN-32. Fix TestApplicationTokens to not depend on test order and thus pass on JDK7. Contributed by Vinod Kumar Vavilapalli.
new 865c67a HADOOP-8776. Provide an option in test-patch that can enable/disable compiling native code. Contributed by Chris Nauroth.
new c1bd54d HDFS-4073. Two minor improvements to FSDirectory. Contributed by Jing Zhao
new 4af8761 HDFS-4074. Remove the unused default constructor from INode. Contributed by Brandon Li
new 57ee22e HADOOP-8925. Remove the packaging. Contributed by Eli Collins
new 53c598a HADOOP-8887. Use a Maven plugin to build the native code using CMake. (cmccabe via tucu)
new 7da5d03 HDFS-4053. Increase the default block size. Contributed by Eli Collins
new d5d2628 Merge r1360400 through r1399945 from trunk.
new adcf7d1 MAPREDUCE-4735. Make arguments in TestDFSIO case insensitive. Contributed by Brandon Li.
new 0603447 HDFS-4072. On file deletion remove corresponding blocks pending replications. Contributed by Jing Zhao.
new a4f30ff reverting commit 1399898 (HADOOP-8887)
new 022f7b4 MAPREDUCE-4596. Split StateMachine state from states seen by MRClientProtocol for Job, Task and TaskAttempt. Contributed by Siddarth Seth.
new ae15ad6 YARN-163. Retrieving container log via NM webapp can hang with multibyte characters in log (jlowe via bobby)
new a234472 MAPREDUCE-4479. Fix parameter order in assertEquals() in TestCombineInputFileFormat.java (Mariappan Asokan via bobby)
new 5c1a7b9 HDFS-4076. Support snapshot of single files. (szetszwo)
new e754245 HDFS-4082. Add editlog opcodes for snapshot create and delete operations. Contributed by suresh
new 1195f84 MAPREDUCE-4733. Reducer can fail to make progress during shuffle if too many reducers complete consecutively. Contributed by Jason Lowe via.
new f79ae91 YARN-136. Make ClientToAMTokenSecretManager part of RMContext (Contributed by Vinod Kumar Vavilapalli)
new 4cccdc2 Moving HDFS-2802 related changes to a separate CHANGES.txt
new 40f8b7d Reverting the change r1400285 since it included unrelated changes
new 79e7257 Moving HDFS-2802 related changes to a separate CHANGES.txt
new ecffab6 HDFS-4086. Add editlog opcodes to allow and disallow snapshots on a directory. Contributed by Brandon Li.
new c195ce4 MAPREDUCE-4736. Remove obsolete option [-rootDir] from TestDFSIO. Contributed by Brandon Li.
new 5be6e23 Moved MAPREDUCE-4736 jira from trunk to Release 2.0.3 section
new f5c4def HDFS-4083. Protocol changes for snapshots. Contributed by Suresh Srinivas.
new af130d4 HDFS-4077. Add support for Snapshottable Directory. Contributed by Nicholas.
new efd798b HADOOP-8948. TestFileUtil.testGetDU fails on Windows due to incorrect assumption of line separator. Contributed by Chris Nauroth.
new d0a2d55 YARN-140. Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler. (ahmed via tucu)
new 661a8d1 HDFS-4088. Remove "throws QuotaExceededException" from an INodeDirectoryWithQuota constructor.
new 5d94cd9 Add target, .classpath, .project and .settings to svn:ignore.
new a2d837b HDFS-4077. Adding a file missed in the commit r1400318.
new d9a9dae Merge r1399946 through r1400349 from trunk.
new 85b1589 Change incorrect jira number HADOOP-8923 to HADOOP-8932 introduced in commit r1398883.
new 35ec20b HDFS-4022. Replication not happening for appended block. Contributed by Vinay.
new 625d7cf HDFS-4087. Protocol changes for listSnapshots functionality. Contributed by Brandon Li.
new 820b549 HDFS-4079. Add SnapshotManager which maintains a list for all the snapshottable directories and supports snapshot methods such as setting a directory to snapshottable and creating a snapshot.
new f297249 Merging trunk changes
new 9a0651b HDFS-4078. Handle replication in snapshots.
new 0dc2681 HADOOP-8951. RunJar to fail with user-comprehensible error message if jar missing. Contributed by Steve Loughran.
new b69605e Moved HADOOP-8951 from trunk to release 2.0.3 section in CHANGES.txt
new 75cdb5b HDFS-4099. Clean up replication code and add more javadoc.
new 49beea5 MAPREDUCE-4740. only .jars can be added to the Distributed Cache classpath. Contributed by Robert Joseph Evans
new 4da8e26 YARN-174. Modify NodeManager to pass the user's configuration even when rebooting. Contributed by Vinod Kumar Vavilapalli.
new a4a01c9 HADOOP-8900. I had mistakenly not credited the patch to the right person. Changing the contributor to Andy Isaacson.
new a92313f HDFS-4090. getFileChecksum() result incompatible when called against zero-byte files. (Kihwal Lee via daryn)
new 1342246 HADOOP-8811. Compile hadoop native library in FreeBSD (Radim Kolar via bobby)
new b73903f HADOOP-8962. RawLocalFileSystem.listStatus fails when a child filename contains a colon (jlowe via bobby)
new aa42e21 HDFS-2434. TestNameNodeMetrics.testCorruptBlock fails intermittently. Contributed by Jing Zhao.
new 4fde5c0 HDFS-4084. Provide CLI support to allow and disallow snapshot on a directory. Contributed by Brondon Li.
new 464edf2 Moving HDFS-2434 from Release 2.0.3 section to trunk section.
new def0b94 MAPREDUCE-4229. Intern counter names in the JT (bobby via daryn)
new 61ffa3a MAPREDUCE-4229. Intern counter names in the JT (bobby via daryn)
new 382b565 MAPREDUCE-4637. Handle TaskAttempt diagnostic updates while in the NEW and UNASSIGNED states. (Contributed by Mayank Bansal)
new 88d326f YARN-179. Fix some unit test failures. (Contributed by Vinod Kumar Vavilapalli)
new aaa07fc Updating credits for MAPREDUCE-4229.
new ca4bc1a YARN-181. Fixed eclipse settings broken by capacity-scheduler.xml move via YARN-140. Contributed by Siddharth Seth.
new cc52368 YARN-177. CapacityScheduler - adding a queue while the RM is running has wacky results (acmurthy vai tgraves)
new 244ec4a YARN-178. Fix custom ProcessTree instance creation (Radim Kolar via bobby)
new 90ba993 YARN-180. Capacity scheduler - containers that get reserved create container token to early (acmurthy and bobby)
new 614a743 YARN-139. Interrupted Exception within AsyncDispatcher leads to user confusion. Contributed by Vinod Kumar Vavilapalli
new 1e45b1f MAPREDUCE-4741. WARN and ERROR messages logged during normal AM shutdown. Contributed by Vinod Kumar Vavilapalli
new b897bb8 HDFS-4091. Add snapshot quota to limit the number of snapshots allowed.
new 14d8d0a Merge r1400738 through r1401868 from trunk.
new 895029b MAPREDUCE-4730. Fix Reducer's EventFetcher to scale the map-completion requests slowly to avoid HADOOP-8942. Contributed by Jason Lowe.
new 2d53349 HDFS-4097. Provide CLI support for createSnapshot. Contributed by Brandon Li.
new 611684e HDFS-4110. Refine a log printed in JNStorage. Contributed by Liang Xie.
new 163577f HDFS-4067. TestUnderReplicatedBlocks intermittently fails due to ReplicaAlreadyExistsException. Contributed by Jing Zhao.
new ba2ee1d HDFS-4107. Add utility methods for casting INode to INodeFile and INodeFileUnderConstruction.
new 2d74f68 HDFS-3948. Do not use hflush in TestWebHDFS.testNamenodeRestart() since the out stream returned by WebHdfsFileSystem does not support it. Contributed by Jing Zhao
new 40d2b6f Merge r1401869 through r1402273 from trunk.
new 719279e HDFS-4092. Update file deletion logic for snapshot so that the current inode is removed from the circular linked list; and if some blocks at the end of the block list no longer belong to any other inode, collect them and update the block list.
new 0e796b6 HDFS-4112. A few improvements on INodeDirectory include adding a utility method for casting; avoiding creation of new empty lists; cleaning up some code and rewriting some javadoc.
new b5355e5 Merge r1402274 through r1402603 from trunk.
new 3335e50 HDFS-3616. Fix a ConcurrentModificationException bug that BP actor threads may not be shutdown properly in DataNode. Contributed by Jing Zhao
new b54e794 YARN-145. Add a Web UI to the fair share scheduler. Contributed by Sandy Ryza.
new 286c171 MAPREDUCE-4748. Invalid event: T_ATTEMPT_SUCCEEDED at SUCCEEDED. Contributed by Jason Lowe
new a577f75 HADOOP-8713. TestRPCCompatibility fails intermittently with JDK7 Trevor Robinson via tgraves)
new 9e26fdc HDFS-4111. Support snapshot of subtrees. Contributed by Tsz Wo (Nicholas), Sze.
new cd2e9d2 HDFS-4121. Add namespace declarations in hdfs .proto files for languages other than java. Contributed by Binglin Chang.
new b6d09f6 Moving HDFS-4121 from trunk to Release 2.0.3 section.
new 22377eb HADOOP-8985. Add namespace declarations in .proto files for languages other than java. Thank you Binglin Chan.
new abe3676 HDFS-4115. TestHDFSCLI.testAll fails one test due to number format. Contributed by Trevor Robinson.
new fd7de4c HDFS-4106. BPServiceActor#lastHeartbeat, lastBlockReport and lastDeletedReport should be volatile. Contributed by Jing Zhao.
new f60a844 HDFS-4119. Complete the allowSnapshot code and add a test for it.
new cea7bbc HDFS-4122. Cleanup HDFS logs and reduce the size of logged messages. Contributed by Suresh Srinivas.
new 4bcf516 HDFS-3920. libwebdhfs string processing and using strerror consistently to handle all errors. Contributed by Jing Zhao.
new 564adec Merging trunk to HDFS-2802 branch.
new 1b3b09d HDFS-4124. Refactor INodeDirectory#getExistingPathINodes() to enable returningmore than INode array. Contributed by Jing Zhao.
new 7831244 Merging changes from trunk to pick HDFS-4124 changes.
new ba7a2e3 Moved HDFS-4122 to Release 2.0.3 section. It is also moved to Incompatible Changes section.
new 16e21df MAPREDUCE-1806. CombineFileInputFormat does not work with paths not on default FS. (Gera Shegalov via tucu)
new 7604a27 HDFS-4127. Log message is not correct in case of short of replica. Contributed by Junping Du.
new deef03c HADOOP-8994. TestDFSShell creates file named "noFileHere", making further tests hard to understand (Andy Isaacson via daryn)
new 1e07fec Moved HDFS-3573 entry in CHANGES.txt from trunk to 2.0.3-alpha section
new 12eb3b8 HADOOP-8986. Server$Call object is never released after it is sent (bobby)
new 52df4b3 Moved HDFS-3695 entry in CHANGES.txt from trunk to 2.0.3-alpha section
new 7ccdb67 Moved HDFS-3789 entry in CHANGES.txt from trunk to 2.0.3-alpha section
new b2822e3 Moved HDFS-3809 entry in CHANGES.txt from trunk to 2.0.3-alpha section
new cd0d206 HDFS-3916. libwebhdfs testing code cleanup. Contributed by Jing Zhao.
new 07e0d77 HDFS-4129. Add utility methods to dump NameNode in memory tree for testing. Contributed by Tsz Wo (Nicholas), SZE.
new f3b9963 HDFS-4118. Change INodeDirectory.getExistingPathINodes(..) to work with snapshots. Contributed by Jing Zhao.
new aac5c14 MAPREDUCE-4752. Reduce MR AM memory usage through String Interning (Robert Evans via tgraves)
new c15c192 YARN-165. RM should point tracking URL to RM web page for app when AM fails (jlowe via bobby)
new 9f55dd3 YARN-159. RM web ui applications page should be sorted to display last app first (tgraves via bobby)
new ab8fa65 YARN-166. capacity scheduler doesn't allow capacity < 1.0 (tgraves via bobby)
new e341184 Merge r1403306 through r1404284 from trunk.
new 50993e9 MAPREDUCE-4724. job history web ui applications page should be sorted to display last app first (tgraves via bobby)
new a124297 YARN-189. Fixed a deadlock between RM's ApplicationMasterService and the dispatcher. Contributed by Thomas Graves.
new 8b71399 HDFS-4133. Add testcases for testing basic snapshot functionalities. Contributed by Jing Zhao.
new 04b2adc Merging trunk to HDFS-2802 branch.
new b50a3c5 MAPREDUCE-4746. The MR Application Master does not have a config to set environment variables (Rob Parker via bobby)
new 42d1eaf MAPREDUCE-4729. job history UI not showing all job attempts. Contributed by Vinod Kumar Vavilapalli
new 98c0f13 HDFS-4116. Add auditlog for some snapshot operations. Contributed by Jing Zhao.
new 77fe43a HDFS-4095. Add some snapshot related metrics. Contributed by Jing Zhao.
new 19befa0 HDFS-3804. TestHftpFileSystem fails intermittently with JDK7 (Trevor Robinson via daryn)
new 1783f20 MAPREDUCE-4763 repair test TestUmbilicalProtocolWithJobToken (Ivan A. Veselovsky via bobby)
new a9e4b08 HDFS-4132. When libwebhdfs is not enabled, nativeMiniDfsClient frees uninitialized memory. Contributed by Colin Patrick McCabe.
new d174f57 HDFS-4143. Change blocks to private in INodeFile and renames isLink() to isSymlink() in INode.
new e5a7b3d HDFS-4141. Support directory diff - the difference between the current state and a previous snapshot of an INodeDirectory.
new 554fb4d Merge r1404624 through r1405251 from trunk.
new deaf979 HDFS-4146. Use getter and setter in INodeFileWithLink to access blocks and initialize root directory as snapshottable.
new f840009 HDFS-4149. Implement the disallowSnapshot(..) in FSNamesystem and add resetSnapshottable(..) to SnapshotManager.
new b3bc2fb HDFS-4147. When there is a snapshot in a subtree, deletion of the subtree should fail. Contributed by Jing Zhao
new 05b6dc6 Localization update
new 8303175 HADOOP-9009. Add SecurityUtil methods to get/set authentication method (daryn via bobby)
new b1aa62a HADOOP-9010. Map UGI authenticationMethod to RPC authMethod (daryn via bobby)
new 0eadfcf MAPREDUCE-4771. KeyFieldBasedPartitioner not partitioning properly when configured (jlowe via bobby)
new 7ee5ce3 HDFS-4151. Change the methods in FSDirectory to pass INodesInPath instead of INode[] as a parameter.
new e0ce1b2 HDFS-4046. Rename ChecksumTypeProto enum NULL since it is illegal in C/C++. Contributed by Binglin Chang.
new 159e507 HDFS-4046. Adding the missed file in revision 1406011
new 34413c2 svn merge -c 1406006 from trunk for HDFS-4151. Change the methods in FSDirectory to pass INodesInPath instead of INode[] as a parameter.
new dca8dd7 Add HDFS-4046 to Release 2.0.3 section
new 5605b54 HADOOP-9012. IPC Client sends wrong connection context (daryn via bobby)
new 3a698e6 HDFS-1331. dfs -test should work like /bin/test (Andy Isaacson via daryn)
new b13a5cd HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu.
new b68bd47 YARN-202. Log Aggregation generates a storm of fsync() for namenode (Kihwal Lee via bobby)
new 54b70db HDFS-4075. Reduce recommissioning overhead (Kihwal Lee via daryn)
new 1734215 HDFS-4152. Add a new class BlocksMapUpdateInfo for the parameter in INode.collectSubtreeBlocksAndClear(..). Contributed by Jing Zhao
new 92c440c Merge r1406007 through r1406326 from trunk.
new a3f3a6c HDFS-4155. libhdfs implementation of hsync API. Contributed by Liang Xie.
new 251230a HADOOP-9004. Reverting the commit r1406202 to address patch issue
new 1e7010c HDFS-3979. For hsync, datanode should wait for the local sync to complete before sending ack. Contributed by Lars Hofhansl
new c013142 HADOOP-9004. Allow security unit tests to use external KDC. Contributed by Stephen Chu.
new 7160c01 Merge r1406327 through r1406414 from trunk.
new 817a26b HDFS-4153. Add START_MSG/SHUTDOWN_MSG for JournalNode. Contributed by liang xie.
new 8d483ff MAPREDUCE-4777. In TestIFile, testIFileReaderWithCodec relies on testIFileWriterWithCodec. Contributed by Sandy Ryza
new cb293a6 HADOOP-9013. UGI should not hardcode loginUser's authenticationType (daryn via bobby)
new 3c02237 HADOOP-9014. Standardize creation of SaslRpcClients (daryn via bobby)
new 1ab9737 HDFS-4138. BackupNode startup fails due to uninitialized edit log. Contributed by Kihwal Lee.
new c44f37a Move HDFS-3625 under 0.23.5
new 8a577a1 HDFS-4150. Update the inode in the block map when a snapshotted file or a snapshot file is deleted. Contributed by Jing Zhao
new b94cf83 HDFS-4159. Rename should fail when the destination directory is snapshottable and has snapshots. Contributed by Jing Zhao
new fb5b96d YARN-201. Fix CapacityScheduler to be less conservative for starved off-switch requests. Contributed by Jason Lowe.
new 1594dd6 HADOOP-9015. Standardize creation of SaslRpcServers (daryn via bobby)
new 76d43a0 HADOOP-8589 ViewFs tests fail when tests and home dirs are nested (sanjay Radia)
new 5a324b1 YARN-169. Update log4j.appender.EventCounter to use org.apache.hadoop.log.metrics.EventCounter. Contributed by Anthony Rojas.
new 6ee6eb8 MAPREDUCE-4772. Fetch failures can take way too long for a map to be restarted (bobby)
new 8a1f333 YARN-186. Coverage fixing LinuxContainerExecutor (Aleksey Gorshkov via bobby)
new f1fe91e HDFS-3810. Implement format() for BKJM. Contributed by Ivan Kelly.
new d511052 Move HDFS-3625 and HDFS-4138 under 2.0.3
new 1813fb0 HADOOP-8974. TestDFVariations fails on Windows. Contributed by Chris Nauroth.
new 0f7a433 HDFS-4165. Faulty sanity check in FsDirectory.unprotectedSetQuota. Contributed by Binglin Chang.
new be94bf6 HDFS-3990. NN's health report has severe performance problems (daryn)
new 312eb23 HDFS-4048. Use ERROR instead of INFO for volume failure logs. Contributed by Stephen Chu
new 933a6d2 YARN-183. Clean up fair scheduler code. Contributed by Sandy Ryza.
new 1f40b8b MAPREDUCE-4782. NLineInputFormat skips first line of last InputSplit (Mark Fuhs via bobby)
new ca1c683 MAPREDUCE-4266. remove Ant remnants from MR (tgraves via bobby)
new c7ab977 HDFS-4162. Some malformed and unquoted HTML strings are returned from datanode web ui. Contributed by Darek Dagit.
new db71de2 HDFS-4080. Add a separate logger for block state change logs to enable turning off those logs. Contributed by Kihwal Lee.
new a4b1c67 Moving HDFS-4080 to Incompatible Change section.
new f8c486fb HADOOP-7115. Add a cache for getpwuid_r and getpwgid_r calls (tucu)
new 9e3af0c YARN-206. TestApplicationCleanup.testContainerCleanup occasionally fails. (jlowe via jeagles)
new de1f33d HADOOP-9020. Add a SASL PLAIN server (daryn via bobby)
new 9d5205a HADOOP-8860. Split MapReduce and YARN sections in documentation navigation. (tomwhite via tucu)
new e8d7891 HADOOP-8860. Amendment to CHANGES.txt (tucu)
new 3ccc76c MAPREDUCE-4666. JVM metrics for history server. (jlowe via jeagles)
new 7c9778e MAPREDUCE-4774. JobImpl does not handle asynchronous task events in FAILED state (jlowe via bobby)
new 5120bfc HDFS-4170. Add snapshot information to INodesInPath.
new 40fe1ff Merge r1406415 through r1407703 from trunk.
new 42f4691 Add new files missed from HADOOP-8860 commit.
new dd72ca3 MAPREDUCE-4751. AM stuck in KILL_WAIT for days (vinodkv via bobby)
new 1a45b7e MAPREDUCE-4787. TestJobMonitorAndPrint is broken (Rob Parker via bobby)
new c493d06 MAPREDUCE-4425. Speculation + Fetch failures can lead to a hung job (jlowe via bobby)
new 7ff7f67 HDFS-4172. namenode does not URI-encode parameters when building URI for datanode request (Derek Dagit via bobby)
new cf6ab9b MAPREDUCE-4786. Job End Notification retry interval is 5 milliseconds by default (Ravi Prakash via bobby)
new 4755ef9 HADOOP-9021. Enforce configured SASL method on the server (daryn via bobby)
new c1a2098 HDFS-4164. fuse_dfs: add -lrt to the compiler command line on Linux. Contributed by Colin Patrick McCabe
new 416c7de HADOOP-9022. Hadoop distcp tool fails to copy file if -m 0 specified (Jonathan Eagles vai bobby)
new b3e42a1 HDFS-3921. NN will prematurely consider blocks missing when entering active state while still in safe mode. Contributed by Aaron T. Myers.
new 3492ab6 HDFS-1322. Document umask in DistributedFileSystem#mkdirs javadocs. Contributed by Colin Patrick McCabe
new 1ebe1d8 HADOOP-9025. org.apache.hadoop.tools.TestCopyListing failing. Contributed by Jonathan Eagles
new 4741064 HDFS-4181. LeaseManager tries to double remove and prints extra messages (Kihwal Lee via daryn)
new 6db6e00 YARN-212. NM state machine ignores an APPLICATION_CONTAINER_FINISHED event when it shouldn't. Contributed by Nathan Roberts
new fe8f635 HADOOP-8999. SASL negotiation is flawed (daryn)
new 099762a HDFS-4177. Add a snapshot parameter to INodeDirectory.getChildrenList() for selecting particular snapshot children list views.
new 2a9f450 Merge r1407704 through r1408926 from trunk.
new 2116d05 HDFS-4148. Disallow write/modify operations on files and directories in a snapshot. Contributed by Brandon Li.
new b2f7a66 MAPREDUCE-4517. Too many INFO messages written out during AM to RM heartbeat (Jason Lowe via tgraves)
new a5976be Moving HDFS-4106 to Release 2.0.3 section in CHANGES.txt.
new 0800aa9 HDFS-4038. Override toString() for BookKeeperEditLogInputStream. Contributed by Vinay.
new 368f628 HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu)
new a780f0a HDFS-4139. fuse-dfs RO mode still allows file truncation. Contributed by Colin Patrick McCabe
new ec8ed4e HADOO-8998. set Cache-Control no-cache header on all dynamic content. (tucu)
new b2456ca svn merge -r 1409087:1409086 reverting HDFS-4171 until test failures can be fixed.
new 9b9edd9 HADOOP-9037. Bug in test-patch.sh and precommit build process. Contributed by Kihwal Lee
new 59e4199 HDFS-4182. SecondaryNameNode leaks NameCache entries (bobby)
new 397c261 YARN-216. Remove jquery theming support. Contributed by Robert Joseph Evans.
new 316c23d MAPREDUCE-4797. LocalContainerAllocator can loop forever trying to contact the RM (jlowe via bobby)
new 7e2ecff MAPREDUCE-4720. Browser thinks History Server main page JS is taking too long (Ravi Prakash via bobby)
new 905b178 MAPREDUCE-4723. Fix warnings found by findbugs 2. Contributed by Sandy Ryza
new 423cb2a HADOOP-9042. Add a test for umask in FileSystemContractBaseTest. Colin Patrick McCabe
new d158dae Updated CHANGES.txt in preparation for 0.23.5 release
new 1dedca8 YARN-188. Coverage fixing for CapacityScheduler (Aleksey Gorshkov via bobby)
new 97e52dd HDFS-4104. dfs -test -d prints inappropriate error on nonexistent directory (Andy Isaacson via daryn)
new 03bf9d6 Revert HADOOP-9042.
new 8a2de21 HDFS-3623. BKJM: zkLatchWaitTimeout hard coded to 6000. Make use of ZKSessionTimeout instead. Contributed by Uma Maheswara Rao G.
new ce2067f HADOOP-6607. Add different variants of non caching HTTP headers. (tucu)
new 298eb42 HDFS-4186. logSync() is called with the write lock held while releasing lease (Kihwal Lee via daryn)
new 96f28d8 HDFS-4100. Fix all findbug security warings. Contributed by Liang Xie
new 86ce5f6 HADOOP-9035. Generalize setup of LoginContext (daryn via bobby)
new 8ca8687 HDFS-4188. Add Snapshot.ID_COMPARATOR for comparing IDs and fix a bug in ReadOnlyList.Util.binarySearch(..).
new b5a2dd1 HDFS-4187. Add tests for replication handling in snapshots. Contributed by Jing Zhao
new f13da26 MAPREDUCE-4801. ShuffleHandler can generate large logs due to prematurely closed channels (jlowe via bobby)
new d2b9a60 MAPREDUCE-4802. Takes a long time to load the task list on the AM for large jobs (Ravi Prakash via bobby)
new ab5039d YARN-214. RMContainerImpl does not handle event EXPIRE at state RUNNING (jeagles via bobby)
new a23e8b0 YARN-151. Browser thinks RM main page JS is taking too long (Ravi Prakash via bobby)
new 51ca2fd HDFS-3935. Add JournalNode to the start/stop scripts. Contributed by Andy Isaacson.
new 320c32a HDFS-3507. DFS#isInSafeMode needs to execute only on Active NameNode. Contributed by Vinay.
new 1cbc38a HDFS-4105. The SPNEGO user for secondary namenode should use the web keytab. Contributed by Arpit Gupta.
new 0f0caed MAPREDUCE-4800. Cleanup o.a.h.mapred.MapTaskStatus - remove unused code. (kkambatl via tucu)
new ecbb419 HDFS-4156. Seeking to a negative position should throw an IOE. Contributed by Eli Reisman
new 6f80a2a HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu)
new 576f96f YARN-184. Remove unnecessary locking in fair scheduler, and address findbugs excludes. (sandyr via tucu)
new 9bed64a HDFS-4196. Support renaming of snapshots. Contributed by Jing Zhao
new d66f9e8 HDFS-4206. Change the fields in INode and its subclasses to private.
new d8ffea5 Merge r1408927 through r1410997 from trunk
new c944d06 HDFS-4178. Shell scripts should not close stderr (Andy Isaacson via daryn)
new e464607 YARN-129. Simplify classpath construction for mini YARN tests.
new f0a6d06 YARN-219. NM should aggregate logs when application finishes. (bobby)
new c271f3c MAPREDUCE-4723 amendment. Fix JobHistory Event handling. (Contributed by Sandy Ryza)
new e9f01ac HADOOP-6616. Improve documentation for rack awareness. Contributed by Adam Faris.
new 1253e02 HDFS-4175. Additional snapshot tests for more complicated directory structure and modifications. Contributed by Jing Zhao.
new 573c41c HDFS-4179. BackupNode: allow reads, fix checkpointing, safeMode. (shv)
new f83f230 HDFS-4175. Add the jira to CHANGES.HDFS-2802.txt.
new c3f13a7 HADOOP-9042. Add a test for umask in FileSystemContractBaseTest. Contributed by Colin McCabe
new 7dff42e HADOOP-9072. Hadoop-Common-0.23-Build Fails to build in Jenkins (Robert Parker via tgraves)
new 506938f HDFS-4215. Remove locking from addToParent(..) since it is used in image loading, and add INode.isFile().
new c24bc56 HADOOP-9075. FileContext#FSLinkResolver should be made static. Contributed by Arpit Agarwal.
new d6af507 HADOOP-9049. DelegationTokenRenewer needs to be Singleton and FileSystems should register/deregister to/from. Contributed by Karthik Kambatla.
new 0f1899e HDFS-4216. Do not ignore QuotaExceededException when adding symlinks.
new 3dd84fc Merge r1410998 through r1412282 from trunk.
new 6c5f37e MAPREDUCE-4811. JobHistoryServer should show when it was started in WebUI About page. Contributed by Ravi Prakash
new 481f451 MAPREDUCE-4764. repair TestBinaryTokenFile (Ivan A. Veselovsky via bobby)
new 0d92f54 HADOOP-8992. Enhance unit-test coverage of class HarFileSystem (Ivan A. Veselovsky via bobby)
new 68bc61a HADOOP-9038. unit-tests for AllocatorPerContext.PathIterator (Ivan A. Veselovsky via bobby)
new 7e56bfe HDFS-4200. Reduce the size of synchronized sections in PacketResponder. Contributed by Suresh Srinivas.
new 3b3a72e HADOOP-9093. Move all the Exception in PathExceptions to o.a.h.fs package. Contributed by Suresh Srinivas.
new 966e20f YARN-204. test coverage for org.apache.hadoop.tools (Aleksey Gorshkov via bobby)
new f6230b1 HADOOP-9084. Augment DelegationTokenRenewer API to cancel the tokens on calls to removeRenewAction. (kkambatl via tucu)
new d67cdb1 HADOOP-9064. Ameding CHANGES.txt with correct JIRA ID, wrongfully used HADOOP-9084 before (tucu)
new 9047eb5 HDFS-4209. Clean up the addNode/addChild/addChildNoQuotaCheck methods in FSDirectory and INodeDirectory.
new 1ce3274 Merge r1412283 through r1414454 from trunk.
new 2b88248 HDFS-4214. OfflineEditsViewer should print out the offset at which it encountered an error. Contributed by Colin Patrick McCabe.
new d9050e1 YARN-224. Fair scheduler logs too many nodeUpdate INFO messages. Contributed by Sandy Ryza.
new fcbd55d YARN-222. Fair scheduler should create queue for each user by default. Contributed by Sandy Ryza.
new dd0ba9c MAPREDUCE-4778. Fair scheduler event log is only written if directory exists on HDFS. Contributed by Sandy Ryza.
new b43deb9 MAPREDUCE-4825. JobImpl.finished doesn't expect ERROR as a final job state (jlowe via bobby)
new 5caef48 MAPREDUCE-4817. Hardcoded task ping timeout kills tasks localizing large amounts of data (tgraves)
new 1634e98 HDFS-3495. Update Balancer to support new NetworkTopology with NodeGroup. Contributed by Junping Du
new 833b928 HDFS-3495. Update Balancer to support new NetworkTopology with NodeGroup. Contributed by Junping Du
new 1943fdb YARN-229. Remove old unused RM recovery code. Contributed by Bikas Saha.
new 6b08d7d HDFS-4242. Map.Entry is incorrectly used in LeaseManager since the behavior of it is undefined after the iteration or modifications of the map.
new ae6f112 YARN-187. Add hierarchical queues to the fair scheduler. Contributed by Sandy Ryza.
new 1573c11 YARN-251. Proxy URI generation fails for blank tracking URIs. Contributed by Tom White
new bf7d772 HADOOP-8958. ViewFs:Non absolute mount name failures when running multiple tests on Windows. Contributed by Chris Nauroth.
new a85a029 HDFS-3680. Allow customized audit logging in HDFS FSNamesystem. Contributed by Marcelo Vanzin.
new d866f81 Reverting initial commit of HDFS-3680 pending further comments.
new 571da54 HDFS-4213. Add an API to hsync for updating the last block length at the namenode. Contributed by Jing Zhao
new 6ad4752 Merge r1414455 through r1415803 from trunk.
new fdcfef0 MAPREDUCE-4836. Elapsed time for running tasks on AM web UI tasks page is 0. (Ravi Prakash via jeagles)
new 64fe19e HDFS-4247. saveNamespace should be tolerant of dangling lease (daryn)
new 88eea21 HDFS-4248. Renaming directories may incorrectly remove the paths in leases under the tree. Contributed by daryn
new 5954e4f HDFS-3358. Specify explicitly that the NN UI status total is talking of persistent objects on heap. Contributed by Harsh J. (harsh)
new cbed126 HDFS-4231. BackupNode: Introduce BackupState. Contributed by Konstantin Shvachko.
new 235749a YARN-72. NM should handle cleaning up containers when it shuts down. Contributed by Sandy Ryza.
new e5d54ac HADOOP-9090. Support on-demand publish of metrics. Contributed by Mostafa Elhemali.
new d500d59 Merging trunk to HDFS-2802 branch.
new 8f7c920 HDFS-4240. For nodegroup-aware block placement, when a node is excluded, the nodes in the same nodegroup should also be excluded. Contributed by Junping Du
new c0a8957 HDFS-4243. When replacing an INodeDirectory, the parent pointers of the children of the child have to be updated to the new child. Contributed by Jing Zhao
new 9821af9 Reverting the previous merge r1416603 which committed some extra changes
new 1f4b135 HDFS-4234. Use generic code for choosing datanode in Balancer.
new 6cc49f1 HDFS-4199. Provide test for HdfsVolumeId. Contributed by Ivan A. Veselovsky.
new d6c50b4 Move QJM-related backports into 2.0.3 release section in CHANGES.txt after backport to branch-2
new bd239a8 HADOOP-9103. UTF8 class does not properly decode Unicode characters outside the basic multilingual plane. Contributed by Todd Lipcon.
new adb8941 HDFS-4238. Standby namenode should not do purging of shared storage edits. Contributed by Todd Lipcon.
new 3337588 HADOOP-9070. Kerberos SASL server cannot find kerberos key. Contributed by Daryn Sharp.
new 8bb0dc3 HDFS-4268. Remove redundant enum NNHAStatusHeartbeat.State. Contributed by Konstantin Shvachko.
new 2d1237c YARN-258. RM web page UI shows Invalid Date for start and finish times. Contributed by Ravi Prakash
new a5331ee HADOOP-9121. InodeTree.java has redundant check for vName while throwing exception. Contributed by Arup Malakar.
new df2fb00 HDFS-3680. Allow customized audit logging in HDFS FSNamesystem. Contributed by Marcelo Vanzin.
new b096f61 MAPREDUCE-4049. Experimental api to allow for alternate shuffle plugins. Contributed by Anver BenHanoch.
new 6681523 HDFS-4282. TestEditLog.testFuzzSequences FAILED in all pre-commit test. Contributed by Todd Lipcon.
new e1ba3f8 HDFS-4236. Remove artificial limit on username length introduced in HDFS-4171. Contributed by Alejandro Abdelnur.
new ad619d3 HDFS-4260 Fix HDFS tests to set test dir to a valid HDFS path as opposed to the local build path (Chris Nauroth via Sanjay)
new 0b11245 HADOOP-9054. Add AuthenticationHandler that uses Kerberos but allows for an alternate form of authentication for browsers. (rkanter via tucu)
new e7cb3fd HDFS-4279. NameNode does not initialize generic conf keys when started with -recover. Contributed by Colin Patrick McCabe.
new bcaba93 HADOOP-8418. Update UGI Principal classes name for running with IBM JDK on 64 bits Windows. (Yu Gao via eyang)
new 8f5bd5f HDFS-4261. Fix bugs in Balancer that it does not terminate in some cases and it checks BlockPlacementPolicy instance incorrectly. Contributed by Junping Du
new f4a7232 Merge r1415804 through r1419190 from trunk.
new 054270c MAPREDUCE-4703. Add the ability to start the MiniMRClientCluster using the configurations used before it is being stopped. (ahmed.radwan via tucu)
new 103eff1 HDFS-4130. BKJM: The reading for editlog at NN starting using bkjm is not efficient. Contributed by Han Xiao.
new 8114bcc HDFS-4291. edit log unit tests leave stray test_edit_log_file around. Contributed by Colin Patrick McCabe.
new cb9f516 HDFS-4292. Sanity check not correct in RemoteBlockReader2.newBlockReader. Contributed by Binglin Chang.
new 7ba12a6 HADOOP-6762. Exception while doing RPC I/O closes channel. Contributed by Sam Rash and Todd Lipcon.
new 22a78a7 HADOOP-9126. FormatZK and ZKFC startup can fail due to zkclient connection establishment delay. Contributed by Rakesh R and Todd Lipcon.
new 64cbb3c HDFS-4295. Using port 1023 should be valid when starting Secure DataNode. Contributed by Stephen Chu.
new 6e82da0 HDFS-4294. Backwards compatibility is not maintained for TestVolumeId. Contributed by Ivan A. Veselovsky and Robert Parker.
new 39d25fb HDFS-4293. Fix TestSnapshot failure. Contributed by Jing Zhao.
new 47ae683 HDFS-2264. NamenodeProtocol has the wrong value for clientPrincipal in KerberosInfo annotation. Contributed by Aaron T. Myers.
new 99d072d svn -c -1419192 . for reverting HDFS-4261 since TestBalancerWithNodeGroup failed in the recent Jenkins builds.
new b72b360 YARN-266. RM and JHS Web UIs are blank because AppsBlock is not escaping string properly. Contributed by Ravi Prakash
new c5080ef MAPREDUCE-4861. Cleanup: Remove unused mapreduce.security.token.DelegationTokenRenewal. (kkambatl via tucu)
new ea3af26 HADOOP-9131. Turn off TestLocalFileSystem#testListStatusWithColons on Windows. Contributed by Chris Nauroth.
new 8c28465 HADOOP-9113. o.a.h.fs.TestDelegationTokenRenewer is failing intermittently. Contributed by Karthik Kambatla
new f31b827 HDFS-4269. Datanode rejects all datanode registrations from localhost in single-node developer setup on Windows. Contributed by Chris Nauroth.
new 4993314 MAPREDUCE-4856. TestJobOutputCommitter uses same directory as TestJobCleanup. Contributed by Sandy Ryza.
new aa20894 HDFS-4296. Reserve layout version for release 1.2.0. Contributed by Suresh Srinivas.
new 618fa6c YARN-267. Fix fair scheduler web UI. Contributed by Sandy Ryza.
new cd80628 HADOOP-8957 AbstractFileSystem#IsValidName should be overridden for embedded file systems like ViewFs (Chris Nauroth via Sanjay)
new 0e7e20d HADOOP-9135. JniBasedUnixGroupsMappingWithFallback should log at debug rather than info during fallback. Contributed by Colin Patrick McCabe.
new 23586e1 HDFS-4310. fix test org.apache.hadoop.hdfs.server.datanode.TestStartSecureDataNode Contributed by Ivan A. Veselovsky.
new f6f7152 HDFS-4307. SocketCache should use monotonic time. Contributed by Colin Patrick McCabe.
new be8ef2e YARN-264. y.s.rm.DelegationTokenRenewer attempts to renew token even after removing an app. (kkambatl via tucu)
new 4bc4daa HADOOP-9127. Update documentation for ZooKeeper Failover Controller. Contributed by Daisuke Kobayashi.
new 8aee71d HDFS-4274. BlockPoolSliceScanner does not close verification log during shutdown. Contributed by Chris Nauroth.
new 3363c45 HDFS-4275. MiniDFSCluster-based tests fail on Windows due to failure to delete test namenode directory. Contributed by Chris Nauroth.
new 803e515 MAPREDUCE-4809. Change visibility of classes for pluggable sort changes. (masokan via tucu)
new 8329fae MAPREDUCE-4807. Allow MapOutputBuffer to be pluggable. (masokan via tucu)
new db09dba HADOOP-8561. Introduce HADOOP_PROXY_USER for secure impersonation in child hadoop client processes. (Yu Gao via llu)
new 3689933 HADOOP-9041. FsUrlStreamHandlerFactory could cause an infinite loop in FileSystem initialization. (Yanbo Liang and Radim Kolar via llu)
new 9886394 Update CHANGES.txt separately for clean cherry-picks.
new 34f9461 Move to the right section in CHANGES.txt
new cbbaa93 HDFS-4317. Change INode and its subclasses to support HDFS-4103.
new 7210954 HDFS-4315. DNs with multiple BPs can have BPOfferServices fail to start due to unsynchronized map access. Contributed by Aaron T. Myers.
new aa4fe26 HADOOP-9140 Cleanup rpc PB protos (sanjay Radia)
new ebcc708 Move HADOOP-9004 to 2.0.3 section after backport
new a1279e6 HDFS-4140. fuse-dfs handles open(O_TRUNC) poorly. Contributed by Colin Patrick McCabe.
new 7d80577 HADOOP-9147. Add missing fields to FIleStatus.toString. Contributed by Jonathan Allen.
new 9c73fce Moved HADOOP-9147 to release 2.0.3-alpha section
new 9189917 MAPREDUCE-4845. ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2. Contributed by Sandy Ryza.
new 371abd6 HADOOP-9152. HDFS can report negative DFS Used on clusters with very small amounts of data. Contributed by Brock Noland.
new 5032a69 YARN-3. Add support for CPU isolation/monitoring of containers. (adferguson via tucu)
new 595d52c YARN-254. Update fair scheduler web UI for hierarchical queues. (sandyr via tucu)
new 6cd0736 YARN-230. RM Restart phase 1 - includes support for saving/restarting all applications on an RM bounce. Contributed by Bikas Saha.
new 834e941 HADOOP-9153. Support createNonRecursive in ViewFileSystem. Contributed by Sandy Ryza.
new 4e73119 HDFS-4326. bump up Tomcat version for HttpFS to 6.0.36. (tucu)
new aa30056 MAPREDUCE-4887. Add RehashPartitioner, to smooth distributions with poor implementations of Object#hashCode(). Contributed by Radim Kolar.
new 1a49c85 YARN-223. Update process tree instead of getting new process trees. (Radim Kolar via llu)
new a28fac4 Update CHANGES.txt separately for clean cherry-picks.
new b324a61 HADOOP-8427. Convert Forrest docs to APT, incremental. (adi2 via tucu)
new 557b022 HADOOP-9105. FsShell -moveFromLocal erroneously fails (daryn via bobby)
new b9f965d HDFS-4103. Support O(1) snapshot creation.
new ee007d3 YARN-271. Fair scheduler hits IllegalStateException trying to reserve different apps on same node. Contributed by Sandy Ryza.
new 39ec437 YARN-272. Fair scheduler log messages try to print objects without overridden toString methods. (sandyr via tucu)
new f121d1e YARN-278. Fair scheduler maxRunningApps config causes no apps to make progress. (sandyr via tucu)
new 5014a4b YARN-282. Fair scheduler web UI double counts Apps Submitted. (sandyr via tucu)
new a276f68 YARN-283. Fair scheduler fails to get queue info without root prefix. (sandyr via tucu)
new 9277433 MAPREDUCE-4842. Shuffle race can hang reducer. Contributed by Mariappan Asokan
new a806a2a YARN-280. RM does not reject app submission with invalid tokens (Daryn Sharp via tgraves)
new 92692c8 MAPREDUCE-4833. Task can get stuck in FAIL_CONTAINER_CLEANUP. Contributed by Robert Parker
new 40c3b7f MAPREDUCE-4793. Problem with adding resources when using both -files and -file to hadoop streaming. Contributed by Jason Lowe
new 02e940d MAPREDUCE-4272. SortedRanges.Range#compareTo was not spec compliant. (Yu Gao via llu)
new 5a408bd YARN-285. Added a temporary plugin interface for RM to be able to redirect to JobHistory server for apps that it no longer tracks. Contributed by Derek Dagit.
new 04db3ce MAPREDUCE-4890. Invalid TaskImpl state transitions when task fails while speculating. Contributed by Jason Lowe
new dae6f0b MAPREDUCE-4899. Implemented a MR specific plugin for tracking finished applications that YARN's ResourceManager doesn't keep track off anymore. Contributed by Derek Dagit.
new 47c5957 Fixing CHANGES.txt for YARN-285.
new 9ad8639 HADOOP-9162. Add utility to check native library availability. Contributed by Binglin Chang.
new 30cb35b Reverting HDFS-4326 since it caused 'mvn package' to break.
new 8a576d6 HDFS-4326. bump up Tomcat version for HttpFS to 6.0.36. Contributed by Alejandro Abdelnur.
new a7d444d MAPREDUCE-4902. Fix typo "receievd" should be "received" in log output. Contributed by Albert Chu
new 0fa9c7a HDFS-4334. Add a unique id to INode. Contributed by Brandon Li
new c82961b HDFS-4330. Support snapshots up to the snapshot limit.
new 4b9f044 YARN-225. Proxy Link in RM UI thows NPE in Secure mode (Devaraj K via bobby)
new 402eb18 MAPREDUCE-4813. AM timing out during job commit (jlowe via bobby)
new fc10579 HDFS-4308. addBlock() should persist file blocks once. Contributed by Plamen Jeliazkov.
new df09a85 HDFS-4347. Avoid infinite waiting checkpoint to complete in TestBackupNode. Contributed by Plamen Jeliazkov.
new 7b70a68 HDFS-4349. Add test for reading files from BackupNode. Contributed by Konstantin Shvachko.
new 1f41061 MAPREDUCE-4884. Streaming tests fail to start MiniMRCluster due to missing queue configuration. Contributed by Chris Nauroth.
new 16cf201 YARN-293. Node Manager leaks LocalizerRunner object for every Container. Contributed by Robert Joseph Evans
new 6f0eb6f HDFS-4338. TestNameNodeMetrics#testCorruptBlock is flaky. Contributed by Andrew Wang.
new 36c5fe9 HDFS-4346. Add SequentialNumber as a base class for INodeId and GenerationStamp.
new ba90c9c YARN-192. Node update causes NPE in the fair scheduler. Contributed by Sandy Ryza
new 19a291a YARN-288. Fair scheduler queue doesn't accept any jobs when ACLs are configured. Contributed by Sandy Ryza.
new 0768f96 YARN-300. After YARN-271, fair scheduler can infinite loop and not schedule any application. Contributed by Sandy Ryza.
new 8cd026d YARN-301. Fair scheduler throws ConcurrentModificationException when iterating over app's priorities. Contributed by Sandy Ryza.
new e229e25 MAPREDUCE-4279. getClusterStatus() fails with null pointer exception when running jobs in local mode (Devaraj K via bobby)
new 0a61990 YARN-103. Add a yarn AM-RM client module. Contributed by Bikas Saha.
new 0af8890 Add file which was accidentally missed during commit of HDFS-4346.
new 228de3c HDFS-4302. Fix fatal exception when starting NameNode with DEBUG logs. Contributed by Eugene Koontz.
new 32052a1 HDFS-4352. Encapsulate arguments to BlockReaderFactory in a class. Contributed by Colin Patrick McCabe.
new 2c15726 HDFS-4270. Introduce soft and hard limits for max replication so that replications of the highest priority are allowed to choose a source datanode that has reached its soft limit but not the hard limit. Contributed by Derek Dagit
new f96d0a3 HDFS-4357. Fix a bug that if an inode is replaced, further INode operations should apply to the new inode. Contributed by Jing Zhao
new d6143a5 YARN-286. Add a YARN ApplicationClassLoader.
new 6083e9c HADOOP-9173. Add security token protobuf definition to common and use it in hdfs. Contributed by Suresh Srinivas.
new 251b485 HADOOP-9173. Add security token protobuf definition to common and use it in hdfs. Contributed by Suresh Srinivas.
new 78ab699 MAPREDUCE-4832. MR AM can get in a split brain situation. Contributed by Jason Lowe
new dd8fc7e YARN-50. Implement renewal / cancellation of Delegation Tokens(Siddharth Seth via tgraves)
new e17cecf MAPREDUCE-4894. Renewal / cancellation of JobHistory tokens (Siddharth Seth via tgraves
new 64e4fb9 MAPREDUCE-4819. AM can rerun job after reporting final job status to the client (bobby and Bikas Saha via bobby)
new bbc426f MAPREDUCE-4913. TestMRAppMaster#testMRAppMasterMissingStaging occasionally exits (Jason Lowe via tgraves)
new 93872b5 HDFS-4230. Support listing of all the snapshottable directories. Contributed by Jing Zhao
new 6a76ec1 HDFS-4351. In BlockPlacementPolicyDefault.chooseTarget(..), numOfReplicas needs to be updated when avoiding stale nodes. Contributed by Andrew Wang
new 81222ad YARN-217. Fix RMAdmin protocol description to make it work in secure mode also. Contributed by Devaraj K.
new 917ff03 YARN-315. Using the common security token protobuf definition from hadoop common. Contributed by Suresh Srinivas.
new b8a7a17 MAPREDUCE-4920. Use security token protobuf definition from hadoop common. Contributed by Suresh Srinivas.
new 2cd4185 YARN-170. Change NodeManager stop to be reentrant. Contributed by Sandy Ryza.
new f6ae596 HADOOP-9181. Set daemon flag for HttpServer's QueuedThreadPool. Contributed by Liang Xie.
new e76b9c2 Add target, .classpath, .project and .settings to svn:ignore.
new d394905 HDFS-3970. Fix bug causing rollback of HDFS upgrade to result in bad VERSION file. Contributed by Vinay and Andrew Wang.
new 18e7310 HDFS-4362. GetDelegationTokenResponseProto does not handle null token. Contributed by Suresh Srinivas.
new 9385dd5 YARN-253. Fixed container-launch to not fail when there are no local resources to localize. Contributed by Tom White.
new 0f1f549 MAPREDUCE-4278. Cannot run two local jobs in parallel from the same gateway. Contributed by Sandy Ryza.
new 54221aa HADOOP-9119. Add test to FileSystemContractBaseTest to verify integrity of overwritten files. Contributed by Steve Loughran.
new 43295b9 HDFS-4030. BlockManager excessBlocksCount and postponedMisreplicatedBlocksCount should be AtomicLongs. Contributed by Eli Collins
new db99f7f HDFS-4031. Update findbugsExcludeFile.xml to include findbugs 2 exclusions. Contributed by Eli Collins
new 239b274 HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes. Contributed by Colin Patrick McCabe.
new 5cdb7e5 HDFS-4033. Miscellaneous findbugs 2 fixes. Contributed by Eli Collins
new 7c91f59 Updated CHANGES.txt to add HDFS-4033.
new 6d4a091 HDFS-4034. Remove redundant null checks. Contributed by Eli Collins
new 4ca58bd HDFS-4035. LightWeightGSet and LightWeightHashSet increment a volatile without synchronization. Contributed by Eli Collins
new 837e17b svn merge -c -1430507 . for reverting HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes
new fab2cbc svn merge -c -1428729 . for reverting HDFS-4352. Encapsulate arguments to BlockReaderFactory in a class
new 4539263 YARN-2. Enhanced CapacityScheduler to account for CPU alongwith memory for multi-dimensional resource scheduling. Contributed by Arun C. Murthy.
new 2c5c8fd MAPREDUCE-4520. Added support for MapReduce applications to request for CPU cores along-with memory post YARN-2. Contributed by Arun C. Murthy.
new 5f7d4d2 MAPREDUCE-4810. Added new admin command options for MR AM. Contributed by Jerry Chen.
new eae2a30 HDFS-4261. Fix bugs in Balaner causing infinite loop and TestBalancerWithNodeGroup timeing out. Contributed by Junping Du
new 0ba7078 MAPREDUCE-1700. User supplied dependencies may conflict with MapReduce system JARs.
new 2d40978 HDFS-4244. Support snapshot deletion. Contributed by Jing Zhao
new f6c2863 Branch for HDFS-347
new ba5b19f YARN-320. RM should always be able to renew its own tokens. Contributed by Daryn Sharp
new 106e2e2 YARN-325. RM CapacityScheduler can deadlock when getQueueInfo() is called and a container is completing (Arun C Murthy via tgraves)
new 3cd17b6 HDFS-4363. Combine PBHelper and HdfsProtoUtil and remove redundant methods. Contributed by Suresh Srinivas.
new c9db06f HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes. Contributed by Colin Patrick McCabe.
new d94621a HDFS-4354. Create DomainSocket and DomainPeer and associated unit tests. Contributed by Colin Patrick McCabe.
new 3555e7c HDFS-4306. PBHelper.convertLocatedBlock miss convert BlockToken. Contributed by Binglin Chang.
new b16dfc1 MAPREDUCE-4848. TaskAttemptContext cast error during AM recovery. Contributed by Jerry Chen
new 7e599d9 HADOOP-9155. FsPermission should have different default value, 777 for directory and 666 for file. Contributed by Binglin Chang.
new 59d9d8b MAPREDUCE-4907. TrackerDistributedCacheManager issues too many getFileStatus calls. (sandyr via tucu)
new 6449f52 HDFS-4032. Specify the charset explicitly rather than rely on the default. Contributed by Eli Collins
new d863f7a HADOOP-9183. Potential deadlock in ActiveStandbyElector.
new 2bd35d8 HDFS-4367. GetDataEncryptionKeyResponseProto does not handle null response. Contributed by Suresh Srinivas.
new d7c4840 MAPREDUCE-4907. Ammendment, forgot to svn add testcase in original commit
new be5509c HDFS-4382. Fix typo MAX_NOT_CHANGED_INTERATIONS. Contributed by Ted Yu.
new a8d60f4 HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang)
new 8064849 HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang)
new 82b218c HDFS-4377. Some trivial DN comment cleanup. Contributed by Eli Collins
new 91c28d4 HDFS-4328. TestLargeBlock#testLargeBlockSize is timing out. Contributed by Chris Nauroth.
new bbc21ad HDFS-4381. Document fsimage format details in FSImageFormat class javadoc. Contributed by Jing Zhao.
new 6b3006c HADOOP-9139 improve killKdc.sh (Ivan A. Veselovsky via bobby)
new ca93aaf HADOOP-9192. Move token related request/response messages to common. Contributed by Suresh Srinivas.
new ebfa3ab HDFS-4384. test_libhdfs_threaded gets SEGV if JNIEnv cannot be initialized. Contributed by Colin Patrick McCabe
new c4976ae Update CHANGES.txt to move HDFS-4328.
new 12293f8 MAPREDUCE-4921. JobClient should acquire HS token with RM principal (daryn via bobby)
new 93c1b4b Merge r1414455:r1426018 from trunk
new ad1cd71 HDFS-4381. Merge change r1432149 from trunk
new e1a3043 Update CHANGES.txt to reflect HDFS-4274 merge.
new 9a4030e HDFS-4356. BlockReaderLocal should use passed file descriptors rather than paths. Contributed by Colin Patrick McCabe.
new 6f8ee86 HDFS-4388. DomainSocket should throw AsynchronousCloseException when appropriate. Contributed by Colin Patrick McCabe.
new d273757 HDFS-4390. Bypass UNIX domain socket unit tests when they cannot be run. Contributed by Colin Patrick McCabe.
new 06406d7 HDFS-1245. Plugable block id generation. Contributed by Konstantin Shvachko.
new 43f17f6 HDFS-1245. Change typo in Pluggable.
new bc0aff2 HDFS-4245. Include snapshot related operations in TestOfflineEditsViewer. Contributed by Jing Zhao
new 25116c2 HDFS-4098. Add FileWithLink, INodeFileUnderConstructionWithLink and INodeFileUnderConstructionSnapshot in order to support append to snapshotted files.
new 90d6d55 Merge r1426019 through r1432788 from trunk.
new 686e13d HDFS-4395. In INodeDirectorySnapshottable's constructor, the passed-in dir could be an INodeDirectoryWithSnapshot. Contributed by Jing Zhao
new ce9b0a0 YARN-334. Maven RAT plugin is not checking all source files (tgraves)
new e7aeb9d MAPREDUCE-4934. Maven RAT plugin is not checking all source files (tgraves)
new e26da77 HDFS-4385. Maven RAT plugin is not checking all source files (tgraves)
new ab0e94d HADOOP-9097. Maven RAT plugin is not checking all source files (tgraves)
new 337e066 HADOOP-9202. test-patch.sh fails during mvn eclipse:eclipse if patch adds a new module to the build (Chris Nauroth via bobby)
new 3052ad1 HDFS-3429. DataNode reads checksums even if client does not need them. Contributed by Todd Lipcon.
new 12bf674 Merge trunk into branch.
new d7f9f9d YARN-330. Fix flakey test: TestNodeManagerShutdown#testKillContainersOnShutdown. Contributed by Sandy Ryza
new d08b1af HDFS-4400. DFSInputStream#getBlockReader: last retries should ignore the cache. Contributed by Colin Patrick McCabe.
new 0671176 HDFS-4364. GetLinkTargetResponseProto does not handle null path. Contributed by Suresh Srinivas.
new 6dbc7e0 HDFS-4369. GetBlockKeysResponseProto does not handle null response. Contributed by Suresh Srinivas.
new 6d807fc HADOOP-9203. RPCCallBenchmark should find a random available port. Contributec by Andrew Purtell.
new 86825d8 MAPREDUCE-4938. Use token request messages defined in hadoop common. Contributed by Suresh Srinvias.
new 35a145d HDFS-4401. Fix bug in DomainSocket path validation. Contributed by Colin Patrick McCabe.
new bbfcc70 YARN-328. Use token request messages defined in hadoop common. Contributed by Suresh Srinivas.
new d79868d Add branch-specific CHANGES.txt file to RAT excludes list
new 8767a37 HDFS-4375. Use token request messages defined in hadoop common. Contributed by Suresh Srinivas.
new 2fd41b3 HDFS-4402. Some small DomainSocket fixes: avoid findbugs warning, change log level, etc. Contributed by Colin Patrick McCabe.
new 2f4e2c6 Merge trunk into branch
new e6dbad4 HADOOP-9178. src/main/conf is missing hadoop-policy.xml. Contributed by Sandy Ryza
new 5c82580 Add missing file from previous commit.
new 397835a svn merge -c -1432788 for reverting HDFS-4098. Add FileWithLink, INodeFileUnderConstructionWithLink and INodeFileUnderConstructionSnapshot in order to support append to snapshotted files.
new 00d3183 HDFS-4397. Fix a bug in INodeDirectoryWithSnapshot.Diff.combinePostDiff(..) that it may put the wrong node into the deleted list.
new 0b9a1f9 Moving MAPREDUCE-4678's changes line to 0.23 section to prepare for backport.
new d9a21df MAPREDUCE-4925. The pentomino option parser may be buggy. Contributed by Karthik Kambatla. (harsh)
new dd6aa0c MAPREDUCE-4936. JobImpl uber checks for cpu are wrong. Contributed by Arun C Murthy
new fabecd7 HDFS-4399. Fix RAT warnings by excluding images sub-dir in docs. Contributed by Thomas Graves.
new 8447557 YARN-335. Fair scheduler doesn't check whether rack needs containers before assigning to node. Contributed by Sandy Ryza.
new 72e6310 YARN-336. Fair scheduler FIFO scheduling within a queue only allows 1 app at a time. Contributed by Sandy Ryza.
new 8ab69eb HADOOP-8816. HTTP Error 413 full HEAD if using kerberos authentication. (moritzmoeller via tucu)
new 6a2f255 YARN-135. Client tokens should be per app-attempt, and should be unregistered on App-finish. Contributed by Vinod Kumar Vavilapalli
new 4a579d4 HDFS-4392. Use NetUtils#getFreeSocketPort in MiniDFSCluster. Contributed by Andrew Purtell.
new 2cee917 YARN-135. Add missing files from last commit.
new 347cf6e HADOOP-8712. Change default hadoop.security.group.mapping to JniBasedUnixGroupsNetgroupMappingWithFallback. Contributed by Robert Parker.
new 40a0ed4 HADOOP-9217. Print thread dumps when hadoop-common tests fail. Contributed by Andrey Klochkov.
new 06f086d HADOOP-9106. Allow configuration of IPC connect timeout. Contributed by Rober Parker.
new 26275e5 MAPREDUCE-4924. flakey test: org.apache.hadoop.mapred.TestClusterMRNotification.testMR. (rkanter via tucu)
new 27d068b HDFS-4288. NN accepts incremental BR as IBR in safemode. Contributed by Daryn Sharp.
new 5b0187d Revert r1433755: HDFS-4288. NN accepts incremental BR as IBR in safemode. Contributed by Daryn Sharp.
new 0d143ad HADOOP-9212. Potential deadlock in FileSystem.Cache/IPC/UGI.
new 7856221 HDFS-4407. Change INodeDirectoryWithSnapshot.Diff.combinePostDiff(..) to merge-sort like and keep the postDiff parameter unmodified.
new f266efc Preparing for release 0.23.6
new 74e86c0 HADOOP-8999. Move to incompatible section of changelog
new c0e7c58 HADOOP-9193. hadoop script can inadvertently expand wildcard arguments when delegating to hdfs script. Contributed by Andy Isaacson.
new e322e0a HADOOP-9215. when using cmake-2.6, libhadoop.so doesn't get created (only libhadoop.so.1.0.0). Contributed by Colin Patrick McCabe.
new db17fad HADOOP-9216. CompressionCodecFactory#getCodecClasses should trim the result of parsing by Configuration. Contributed by Tsuyoshi Ozawa.
new 8f70a25 HDFS-4393. Make empty request and responses in protocol translators can be static final members. Contributed by Brandon Li.
new 5c5e6ed HADOOP-8849. FileUtil#fullyDelete should grant the target directories +rwx permissions (Ivan A. Veselovsky via bobby)
new b3b9485 HDFS-4415. HostnameFilter should handle hostname resolution failures and continue processing. Contributed by Robert Kanter.
new 52c5b8e HDFS-4418. increase default FileInputStreamCache size. Contributed by Todd Lipcon.
new b71d386 HDFS-4098. Add FileWithSnapshot, INodeFileUnderConstructionWithSnapshot and INodeFileUnderConstructionSnapshot for supporting append to snapshotted files.
new c9dd4fa YARN-331. Fill in missing fair scheduler documentation. (sandyr via tucu)
new 1c30818 MAPREDUCE-4923. Add toString method to TaggedInputSplit. (sandyr via tucu)
new f85b583 YARN-302. Fair scheduler assignmultiple should default to false. (sandyr via tucu)
new d3d350e HDFS-4359. Slow RPC responses from NN can prevent metrics collection on DNs. Contributed by liang xie.
new 76f9af4 MAPREDUCE-4948. Fix a failing unit test - TestYARNRunner.testHistoryServerToken. Contributed by Junping Du
new 98db9f5 HADOOP-8924. Add maven plugin alternative to shell script to save package-info.java. Contributed by Alejandro Abdelnur and Chris Nauroth.
new f8cca2d HADOOP-8924. Revert r1435372 that missed some files
new ae270e7 HADOOP-8924. Add maven plugin alternative to shell script to save package-info.java. Contributed by Alejandro Abdelnur and Chris Nauroth.
new 88c7fdd MAPREDUCE-4458. Warn if java.library.path is used for AM or Task (Robert Parker via jeagles)
new c5b01ce HADOOP-8924. Add CHANGES.txt description missed in commit r1435380.
new 89bd149 HDFS-4416. Rename dfs.datanode.domain.socket.path to dfs.domain.socket.path. Contributed by Colin Patrick McCabe.
new cfae133 HDFS-4403. DFSClient can infer checksum type when not provided by reading first byte. Contributed by Todd Lipcon.
new 73fd247 MAPREDUCE-4808. Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations. (masokan via tucu)
new bb81a17 MAPREDUCE-4949. Enable multiple pi jobs to run in parallel. (sandyr via tucu)
new 74ffc7a MAPREDUCE-4946. Fix a performance problem for large jobs by reducing the number of map completion event type conversions. Contributed by Jason Lowe.
new 8535747 HADOOP-9231. Parametrize staging URL for the uniformity of distributionManagement. Contributed by Konstantin Boudnik.
new 937ab16 HADOOP-9231. Add missing CHANGES.txt
new f5551bf YARN-277. Use AMRMClient in DistributedShell to exemplify the approach. Contributed by Bikas Saha
new 29ddce9 YARN-231. RM Restart - Add FS-based persistent store implementation for RMStateStore. Contributed by Bikas Saha
new fe3584a HDFS-4126. Add reading/writing snapshot information to FSImage. Contributed by Jing Zhao.
new 345bcee YARN-319. Submitting a job to a fair scheduler queue for which the user does not have permission causes the client to wait forever. Contributed by shenhong.
new d12f465 HDFS-4417. Fix case where local reads get disabled incorrectly. Contributed by Colin Patrick McCabe.
new 7974658 Merge trunk into branch
new a1e6df6 HDFS-4426. Secondary namenode shuts down immediately after startup. Contributed by Arpit Agarwal.
new 4e74c52 HDFS-4433. Make TestPeerCache not flaky. Contributed by Colin Patrick McCabe.
new 2e9e760 YARN-354. WebAppProxyServer exits immediately after startup. Contributed by Liang Xie
new f5ab88b Fix trivial javadoc warning on branch
new 74d1e5c Merge r1432789 through r1437840 from trunk.
new cf7e9e7 Add .classpath, .project, .settings and target to svn:ignore.
new bb80f2f HDFS-4436. Change INode.recordModification(..) to return only the current inode and remove the updateCircularList parameter from some methods in INodeDirectoryWithSnapshot.Diff.
new 16acd69 HADOOP-9242. Duplicate surefire plugin config in hadoop-common. Contributed by Andrey Klochkov.
new e625e6d HADOOP-9245. mvn clean without running mvn install before fails. Contributed by Karthik Kambatla.
new 539153a MAPREDUCE-2264. Job status exceeds 100% in some cases. (devaraj.k and sandyr via tucu)
new 554774c HDFS-4438. TestDomainSocket fails when system umask is set to 0002. Contributed by Colin Patrick McCabe.
new c0e16ef HDFS-4440. Avoid annoying log message when dfs.domain.socket.path is not set. Contributed by Colin Patrick McCabe.
new 12e8ba8 HDFS-4429. When the latest snapshot exists, INodeFileUnderConstruction should be replaced with INodeFileWithSnapshot but not INodeFile.
new 569d63d Merge r1437841 through r1438305 from trunk.
new f7d333c HADOOP-8857. hadoop.http.authentication.signature.secret.file docs should not state that secret is randomly generated. (tucu)
new 804ae2a HADOOP-9247. Parametrize Clover generateXxx properties to make them re-definable via -D in mvn calls. Contributed by Ivan A. Veselovsky.
new a3bf208 HDFS-4441. Move INodeDirectoryWithSnapshot.Diff and the related classes to a package.
new 759a3fa Amending MR CHANGES.txt to reflect that MAPREDUCE-4049/4809/4807/4808 are in branch-2
new 86f6dfb HDFS-4443. Remove a trailing '`' character from the HTML code generated by NamenodeJspHelper.generateNodeData(..). Contributed by Christian Rohling
new 9639f37 HDFS-4259. Improve pipeline DN replacement failure message. Contributed by Harsh J. (harsh)
new 96d724b HADOOP-9241. DU refresh interval is not configurable. Contributed by Harsh J. (harsh)
new 7480aa8 Move HADOOP-9247 to release 0.23.7 section in CHANGES.txt
new 58c0c6f HDFS-4444. Add space between total transaction time and number of transactions in FSEditLog#printStatistics. Contributed by Stephen Chu.
new da4cab1 Revering MAPREDUCE-2264
new 32cc389 HADOOP-9255. relnotes.py missing last jira (tgraves)
new 8a5fadc MAPREDUCE-4803. Remove duplicate copy of TestIndexCache. Contributed by Mariappan Asokan
new 1137fb0 HADOOP-9246. Execution phase for hadoop-maven-plugin should be process-resources. Contributed by Karthik Kambatla and Chris Nauroth
new df10249 YARN-133. Update web services docs for RM clusterMetrics. Contributed by Ravi Prakash.
new 5988208 HDFS-4432. Support INodeFileUnderConstructionWithSnapshot in FSImage saving/loading. Contributed by Jing Zhao.
new c163dc2 MAPREDUCE-4838. Add additional fields like Locality, Avataar to the JobHistory logs. Contributed by Zhijie Shen
new 159b991 Reverting HADOOP-9241. To be fixed and reviewed.
new 203a9c0 Revert HADOOP-9241 properly this time. Left the core-default.xml in previous commit.
new 33cee25 HADOOP-9190. packaging docs is broken. Contributed by Andy Isaacson.
new 0f430e5 MAPREDUCE-2264. Job status exceeds 100% in some cases. (devaraj.k and sandyr via tucu)
new 66ea187 HDFS-4131. Add capability to namenode to get snapshot diff. Contributed by Jing Zhao.
new 8acfa66 HDFS-4288. NN accepts incremental BR as IBR in safemode. contributed by Daryn Sharp.
new 3e0bc28 HADOOP-9249. hadoop-maven-plugins version-info goal causes build failure when running with Clover. Contributed by Chris Nauroth.
new 6f4fe09 HDFS-4447. Refactor INodeDirectoryWithSnapshot for supporting general INode diff lists.
new f352b4c Merge r1438306 through r1440221 from trunk.
new 73066dc HADOOP-9221. Convert remaining xdocs to APT. Contributed by Andy Isaacson.
new d7ebb9f Move HADOOP-9221 to correct section of CHANGES.txt.
new 481b6cc HDFS-3598. WebHDFS support for file concat. Contributed by Plamen Jeliazkov.
new 6384684 YARN-343. Capacity Scheduler maximum-capacity value -1 is invalid (Xuan Gong via tgraves)
new dcd27ff Merge trunk into HDFS-347 branch.
new 28c308d MAPREDUCE-4893. Fixed MR ApplicationMaster to do optimal assignment of containers to get maximum locality. Contributed by Bikas Saha.
new e668c16 HADOOP-8981. Merge r1422279 from branch-trunk-win to trunk
new e7380b4 HDFS-4428. FsDatasetImpl should disclose what the error is when a rename fails. Contributed by Colin Patrick McCabe.
new ac21e15 MAPREDUCE-4969. TestKeyValueTextInputFormat test fails with Open JDK 7. Contributed by Arpit Agarwal.
new 6ecbb35 HDFS-4151. hdfs balancer command returns exit code 1 on success instead of 0. Contributed by Joshua Blatt.
new 01591b8 Change incorrect jira number HDFS-4151 to HDFS-4451 and move it to incompatible section.
new e6ef769 HADOOP-9264. Port change to use Java untar API on Windows from branch-1-win to trunk. Contributed by Chris Nauroth.
new b04586e HADOOP-9264. Reverting r1441164 and wait for Jenkins results before committing the patch.
new 71a57de HADOOP-9264. Port change to use Java untar API on Windows from branch-1-win to trunk. Contributed by Chris Nauroth.
new 2372e39 HDFS-4189. Renames the getMutableXxx methods to getXxx4Write and fix a bug that some getExistingPathINodes calls should be getINodesInPath4Write.
new 2710e96 HDFS-4361. When listing snapshottable directories, only return those where the user has permission to take snapshots. Contributed by Jing Zhao
new 40df526 Merge r1440222 through r1441205 from trunk.
new f811198 YARN-364. AggregatedLogDeletionService can take too long to delete logs. Contributed by Jason Lowe
new af8553b HADOOP-9124. SortedMapWritable violates contract of Map interface for equals() and hashCode(). Contributed by Surenkumar Nihalani
new bbdae83 HDFS-4456. Add concat to HttpFS and WebHDFS REST API docs. (plamenj2003 via tucu)
new 5c79194 HADOOP-9067. provide test for LocalFileSystem.reportChecksumFailure (Ivan A. Veselovsky via bobby)
new b1baf11 YARN-372. Move InlineDispatcher from hadoop-yarn-server-resourcemanager to hadoop-yarn-common. Contributed by Siddharth Seth.
new a04bee4 MAPREDUCE-4971. Minor extensibility enhancements to Counters & FileOutputFormat. Contributed by Arun C Murthy
new e7db60f HDFS-4464. Combine collectSubtreeBlocksAndClear with deleteDiffsForSnapshot and rename it to destroySubtreeAndCollectBlocks.
new 61a2627 HDFS-4452. getAdditionalBlock() can create multiple blocks if the client times out and retries. Contributed by Konstantin Shvachko.
new 24d96cb HDFS-4414. Add support for getting snapshot diff from DistributedFileSystem. Contributed by Jing Zhao.
new 8590564 HDFS-4350. Make enabling of stale marking on read and write paths independent. Contributed by Andrew Wang.
new 52e6f5a HDFS-4445. All BKJM ledgers are not checked while tailing, So failover will fail. Contributed Vinay.
new 114e23f HADOOP-9276. Allow BoundedByteArrayOutputStream to be resettable. Contributed by Arun Murthy
new a8e39fe HDFS-4462. 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS. Contributed by Aaron T. Myers.
new ef2ff99 HADOOP-9252. In StringUtils, humanReadableInt(..) has a race condition and the synchronization of limitDecimalTo2(double) can be avoided.
new 5d679c4 YARN-360. Allow apps to concurrently register tokens for renewal. Contributed by Daryn Sharp.
new 5a0b746 HDFS-4404. Create file failure when the machine of first attempted NameNode is down. Contributed by Todd Lipcon.
new ef8dd60 HDFS-4344. dfshealth.jsp throws NumberFormatException when dfs.hosts/dfs.hosts.exclude includes port number. Contributed by Andy Isaacson.
new bdb5342 MAPREDUCE-4953. HadoopPipes misuses fprintf. Contributed by Andy Isaacson.
new 9639887 HADOOP-9260. Hadoop version may be not correct when starting name node or data node. Contributed by Chris Nauroth
new 0b565a9 HADOOP-9278. Fix the file handle leak in HarMetaData.parseMetaData() in HarFileSystem. Contributed by Chris Nauroth
new e28edbf HDFS-4468. Use the new StringUtils methods added by HADOOP-9252 and fix TestHDFSCLI and TestQuota.
new 38bb4ad YARN-370. Fix SchedulerUtils to correctly round up the resource for containers. Contributed by Zhijie Shen.
new 7cc2050 Preparing for hadoop-2.0.3-alpha release.
new c52a277 YARN-3. Merged to branch-2.
new d272918 YARN-357. App submission should not be synchronized (daryn)
new 79b12f6 MAPREDUCE-4905. test org.apache.hadoop.mapred.pipes (Aleksey Gorshkov via bobby)
new 8159dad HADOOP-9289. FsShell rm -f fails for non-matching globs. Contributed by Daryn Sharp.
new ab16a37 YARN-355. Fixes a bug where RM app submission could jam under load. Contributed by Daryn Sharp.
new 17e72be MAPREDUCE-4977. Documentation for pluggable shuffle and pluggable sort. (tucu)
new 4525c4a HDFS-4340. Update addBlock() to inculde inode id as additional argument. Contributed Brandon Li.
new ea94b7b MAPREDUCE-4822. Unnecessary conversions in History Events. Contributed by Chu Tong
new 3d46863 HDFS-4473. Don't create domain socket unless we need it. Contributed by Colin Patrick McCabe.
new 90c3700 HDFS-4458. In DFSUtil.getNameServiceUris(..), convert default fs URI using NetUtils.createSocketAddr(..) for being consistent with other addresses. Contributed by Binglin Chang
new 411bb0b HADOOP-9283. Add support for running the Hadoop client on AIX. Contributed by Aaron T. Myers.
new 1eaf994 Move HDFS-4458 to 2.0.3-alpha in CHANGES.txt.
new 3583205 MAPREDUCE-4671. AM does not tell the RM about container requests which are no longer needed. Contributed by Bikas Saha.
new 54a9c6f HADOOP-9253. Capture ulimit info in the logs at service start time. Contributed by Arpit Gupta.
new bdfe232 YARN-383. AMRMClientImpl should handle null rmClient in stop(). Contributed by Hitesh Shah.
new 362da38 YARN-385. Add missing fields - location and #containers to ResourceRequestPBImpl's toString(). Contributed by Sandy Ryza.
new c3d0901 HADOOP-9277. Improve javadoc for FileContext. Contributed by Andrew Wang.
new 7114a61 HDFS-4470. Several HDFS tests attempt file operations on invalid HDFS paths when running on Windows. Contributed by Chris Nauroth.
new a63d50f YARN-377. Use the new StringUtils methods added by HADOOP-9252 and fix TestContainersMonitor. Contributed by Chris Nauroth
new 6f0c56c HDFS-4471. Namenode WebUI file browsing does not work with wildcard addresses configured. Contributed by Andrew Wang.
new 4f7d921 HDFS-4446. Support file snapshots with diff lists.
new d493124 YARN-362. Unexpected extra results when using webUI table search. Contributed by Ravi Prakash
new afe77ce HDFS-4480. Eliminate the file snapshot circular linked list.
new 1132f51 HDFS-4485. DN should chmod socket path a+w. Contributed by Colin Patrick McCabe.
new 6e72c67 HADOOP-9294. GetGroupsTestBase fails on Windows. Contributed by Chris Nauroth.
new fa8bafb Merge r1441206 through r1444434 from trunk.
new aa92072 HDFS-4453. Make a simple doc to describe the usage and design of the shortcircuit read feature. Contributed by Colin Patrick McCabe.
new 969e84d HDFS-4342. Directories configured in dfs.namenode.edits.dir.required but not in dfs.namenode.edits.dir are silently ignored. Contributed by Arpit Agarwal
new 7e615c7 MAPREDUCE-4994. -jt generic command line option does not work. (sandyr via tucu)
new c2d6407 MAPREDUCE-4989. JSONify DataTables input data for Attempts page. Contributed by Ravi Prakash
new 390d1fb MAPREDUCE-4992. AM hangs in RecoveryService when recovering tasks with speculative attempts. Contributed by Robert Parker
new 27e1583 HDFS-4496. DFSClient: don't create a domain socket unless we need it. Contributed by Colin Patrick McCabe.
new 576f789 HADOOP-9302. HDFS docs not linked from top level (Andy Isaacson via tgraves)
new 628922e HADOOP-9303. command manual dfsadmin missing entry for restoreFailedStorage option (Andy Isaacson via tgraves)
new 6666674 YARN-249. Capacity Scheduler web page should show list of active users per queue like it used to (in 1.x) (Ravi Prakash via tgraves)
new 43204f0 MAPREDUCE-5000. Fixes getCounters when speculating by fixing the selection of the best attempt for a task. Contributed by Jason Lowe.
new 7bc6040 YARN-391. Formatting fixes for LCEResourceHandler classes. Contributed by Steve Loughran)
new a3ddc8e HADOOP-9305. Add support for running the Hadoop client on 64-bit AIX. Contributed by Aaron T. Myers.
new 6bcbf49 HADOOP-9117. replace protoc ant plugin exec with a maven plugin. (tucu)
new a9974c7 HDFS-4495. Allow client-side lease renewal to be retried beyond soft-limit. Contributed by Kihwal Lee
new 02e6b72 HDFS-4481. Change fsimage to support snapshot file diffs.
new a96d228 Amending common CHANGES.txt
new ab330b3 MAPREDUCE-4994. Addendum fixing testcases failures. (sandyr via tucu)
new 4ad1279 HADOOP-9297. remove old record IO generation and tests. (tucu)
new c01827a HADOOP-9154. SortedMapWritable#putAll() doesn't add key/value classes to the map. Contributed by Karthik Kambatla.
new 0a8cfa9 HADOOP-9304. remove addition of avro genreated-sources dirs to build. (tucu)
new d42d086 HDFS-4500. Refactor snapshot INode methods.
new d9e2514 HDFS-4487. Fix snapshot diff report for HDFS-4446. Contributed by Jing Zhao
new 461e614 HADOOP-9218 Document the Rpc-wrappers used internally (sanjay Radia)
new a9f6a27 Merge trunk to HDFS-2802 branch
new 3a417cb HDFS-347: style cleanups. Contributed by Colin Patrick McCabe.
new f615815 Merge trunk into HDFS-347 branch.
new 14eaab6 HDFS-4431. Support snapshot in OfflineImageViewer. Contributed by Jing Zhao
new 1c49e77 MAPREDUCE-5012. Typo in javadoc for IdentityMapper class. Contributed by Adam Monsen.
new c8f35bc MAPREDUCE-5009. Killing the Task Attempt slated for commit does not clear the value from the Task commitAttempt member (Robert Parker via jeagles)
new efaaf58 YARN-400. RM can return null application resource usage report leading to NPE in client (Jason Lowe via tgraves)
new de73a65 HADOOP-9112. test-patch should -1 for @Tests without a timeout (Surenkumar Nihalani via bobby)
new fac3883 HDFS-4503. Update computeContentSummary(..), spaceConsumedInTree(..) and diskspaceConsumed(..) in INode for snapshot.
new 320f7bd YARN-236. RM should point tracking URL to RM web page when app fails to start (Jason Lowe via jeagles)
new 567ab43 HDFS-4502. JsonUtil.toFileStatus(..) should check if the fileId property exists. Contributed by Brandon Li
new f29fa9e HDFS-4499. Fix file/directory/snapshot deletion for file diff. Contributed by Jing Zhao
new 89d05b5 Merge r1446505 through r1448504 from trunk.
new 7555b4d MAPREDUCE-4846. Some JobQueueInfo methods are public in MR1 but protected in MR2. Contributed by Sandy Ryza.
new 87035a0 MAPREDUCE-5013. mapred.JobStatus compatibility: MR2 missing constructors from MR1. Contributed by Sandy Ryza.
new 0b73dde MAPREDUCE-4951. Container preemption interpreted as task failure. Contributed by Sandy Ryza.
new bf44d16 HDFS-4482. ReplicationMonitor thread can exit with NPE due to the race between delete and replication of same file. Contributed by Uma Maheswara Rao G.
new c529650 amendment to HADOOP-9112 fix return codes (Surenkumar Nihalani via bobby)
new cdb292f HDFS-4222. NN is unresponsive and loses heartbeats from DNs when configured to use LDAP and LDAP has issues. Contributed by Xiaobo Peng and Suresh Srinivas.
new 8271fae HADOOP-9267. hadoop -help, -h, --help should show usage instructions. Contributed by Andrew Wang.
new 019d6a2 HDFS-4304. Make FSEditLogOp.MAX_OP_SIZE configurable. Contributed by Colin Patrick McCabe.
new 0deff17 HDFS-4524. Update SnapshotManager#snapshottables when loading fsimage. Contributed by Jing Zhao
new 2552a77 HADOOP-9279. Document the need to build hadoop-maven-plugins for eclipse and separate project builds. Contributed by Tsuyoshi Ozawa.
new 5ddbbd9 HDFS-4520. Support listing snapshots under a snapshottable directory using ls. Contributed by Jing Zhao
new d8ccf4e Add the new test file by HDFS-4520.
new 63522b3 HADOOP-8569. CMakeLists.txt: define _GNU_SOURCE and _LARGEFILE_SOURCE. Contributed by Colin Patrick McCabe.
new 59e968a HDFS-4514. Add CLI for supporting snapshot rename, diff report, and snapshottable directory listing. Contributed by Jing Zhao
new aa82b03 Merge r1448505 through r1449957 from trunk.
new 4840775 HADOOP-9323. Fix typos in API documentation. Contributed by Suresh Srinivas.
new 10e1e31 YARN-390. ApplicationCLI and NodeCLI hard-coded platform-specific line separator causes test failures on Windows. Contributed by Chris Nauroth.
new 7e2d98d HDFS-4235. When outputting XML, OfflineEditsViewer can't handle some edits containing non-ASCII strings. Contributed by Colin Patrick McCabe.
new 93972604 HADOOP-7487. DF should throw a more reasonable exception when mount cannot be determined. Contributed by Andrew Wang.
new 7ea82ca YARN-365. Change NM heartbeat handling to not generate a scheduler event on each heartbeat. (Contributed by Xuan Gong)
new 70b1c5c HADOOP-9334. Upgrade netty version. Contributed by Nicolas Liochon.
new e2a618e HDFS-4523. Fix INodeFile replacement, TestQuota and javac errors from trunk merge.
new 9e87bcb HADOOP-8917. add LOCALE.US to toLowerCase in SecurityUtil.replacePattern. Contributed by Arpit Agarwal.
new 12985ea HADOOP-8917. Changed contributed by from Arpit Agarwal to Arpit Gupta.
new 42e987f MAPREDUCE-5033. mapred shell script should respect usage flags (--help -help -h). Contributed by Andrew Wang.
new 14089f1 MAPREDUCE-5008. Merger progress miscounts with respect to EOF_MARKER. Contributed by Sandy Ryza.
new 0057600 YARN-426. Failure to download a public resource prevents further downloads (Jason Lowe via bobby)
new 0b9ed23 MAPREDUCE-4892. Modify CombineFileInputFormat to not skew input slits' allocation on small clusters. Contributed by Bikas Saha.
new 979fb05 MAPREDUCE-4693. Historyserver should provide counters for failed tasks. Contributed by Xuan Gong.
new eb1cc86 HADOOP-9339. IPC.Server incorrectly sets UGI auth type. Contributed by Daryn Sharp
new dec30f2 Typo in CHANGES.txt for HADOOP-9339
new 5363d83 HADOOP-9342. Remove jline from distribution. (thw via tucu)
new c7cf85c HDFS-4507. Update quota verification for snapshots.
new 6401d5d HADOOP-9230. TestUniformSizeInputFormat fails intermittently. (kkambatl via tucu)
new 892846d MAPREDUCE-4871. AM uses mapreduce.jobtracker.split.metainfo.maxsize but mapred-default has mapreduce.job.split.metainfo.maxsize (Jason Lowe via jeagles)
new 27c8a87 YARN-269. Resource Manager not logging the health_check_script result when taking it out. Contributed by Jason Lowe
new 2e02b92 HDFS-4518. Finer grained metrics for HDFS capacity. Contributed by Suresh Srinivas.
new c536856 HADOOP-9336. Allow UGI of current connection to be queried. Contributed by Daryn Sharp.
new 62d70af YARN-406. Fix TestRackResolver to function in networks where "host1" resolves to a valid host. Contributed by Hitesh Shah.
new 892e088 HADOOP-9349. Confusing output when running hadoop version from one hadoop installation when HADOOP_HOME points to another. (sandyr via tucu)
new 5d6eca0 MAPREDUCE-4896. mapred queue -info spits out ugly exception when queue does not exist. (sandyr via tucu)
new 83d8065 YARN-376. Fixes a bug which would prevent the NM knowing about completed containers and applications. Contributed by Jason Lowe.
new 0b708ab YARN-380. Fix yarn node -status output to be better readable. Contributed by Omkar Vinit Joshi.
new 6680ee5 YARN-410. Fixed RM UI so that the new lines diagnostics for a failed app on the per-application page are translated to html line breaks. Contributed by Omkar Vinit Joshi.
new 38c4e17 MAPREDUCE-4794. DefaultSpeculator generates error messages on normal shutdown (Jason Lowe via jeagles)
new 84567fa HADOOP-9352. Expose UGI.setLoginUser for tests (daryn)
new ec13f1e MAPREDUCE-5043. Fetch failure processing can cause AM event queue to backup and eventually OOM (Jason Lowe via bobby)
new cfa86e6 HDFS-4128. 2NN gets stuck in inconsistent state if edit log replay fails in the middle (kihwal via daryn)
new d8ca9c6 HDFS-4532. RPC call queue may fill due to current user lookup (daryn)
new 3ea26d3 HDFS-4541. Set hadoop.log.dir and hadoop.id.str when starting secure datanode to write the logs to right dir by default. Contributed by Arpit Gupta.
new 9334dc2 YARN-448. Remove unnecessary hflush from log aggregation (Kihwal Lee via bobby)
new 5889f54 YARN-345. Many InvalidStateTransitonException errors for ApplicationImpl in Node Manager. Contributed by Robert Parker
new ead90cc HADOOP-9163 The rpc msg in ProtobufRpcEngine.proto should be moved out to avoid an extra copy (Sanjay Radia)
new cc15fff HADOOP-9337. org.apache.hadoop.fs.DF.getMount() does not work on Mac OS. Contributed by Ivan A. Veselovsky.
new b1333e5 HDFS-4545. With snapshots, FSDirectory.unprotectedSetReplication(..) always changes file replication but it may or may not changes block replication.
new 52703c2 HADOOP-9343. Allow additional exceptions through the RPC layer. (sseth)
new 97ccd64 HDFS-4542. Webhdfs doesn't support secure proxy users. Contributed by Daryn Sharp.
new a82e67a HDFS-4540. Namenode http server should use the web authentication keytab for spnego principal. Contributed by Arpit Gupta.
new 56c7e7a HDFS-4519. Support overriding jsvc binary and log file locations when launching secure datanode. Contributed by Chris Nauroth.
new 2106625 YARN-227. Application expiration difficult to debug for end-users (Jason Lowe via jeagles)
new e1062b8 MAPREDUCE-5027. Shuffle does not limit number of outstanding connections (Robert Parker via jeagles)
new df68c56 MAPREDUCE-3685. Fix bugs in MergeManager to ensure compression codec is appropriately used and that on-disk segments are correctly sorted on file-size. Contributed by Anty Rao and Ravi Prakash.
new 456064d HDFS-4544. Error in deleting blocks should not do check disk, for all types of errors. Contributed by Arpit Agarwal.
new 638801c HADOOP-8952. Enhancements to support Hadoop on Windows Server and Windows Azure environments. Contributed by Ivan Mitic, Chuan Liu, Ramya Sunil, Bikas Saha, Kanna Karanam, John Gordon, Brandon Li, Chris Nauroth, David Lao, Sumadhur Reddy Bolli, Arpit Agarwal, Ahmed El Baz, Mike Liddell, Jing Zhao, Thejas Nair, Steve Maine, Ganeshan Iyer, Raja Aluri, Giridharan Kesavan, Ramya Bharathi Nimmagadda.
new 2e4382b YARN-429. capacity-scheduler config missing from yarn-test artifact. Contributed by Siddharth Seth.
new 50d136f HADOOP-9373. Merge CHANGES.branch-trunk-win.txt to CHANGES.txt. Contributed by Suresh Srinivas.
new 85470f0 HADOOP-8462. Native-code implementation of bzip2 codec. Contributed by Govind Kamat
new b427fe9 HADOOP-9209. Add shell command to dump file checksums (Todd Lipcon via jeagles)
new 6942fd1 HADOOP-9372. Fix bad timeout annotations on tests. Contributed by Arpit Agarwal.
new 96fc01f HADOOP-9373. Remove empty files that should have been removed in the commit r1453599
new 3145cf1 Merge r1449958 through r1453659 from trunk.
new 97605f2 HADOOP-9376. TestProxyUserFromEnv fails on a Windows domain joined machine. Contributed by Ivan Mitic.
new 33b3bcd HADOOP-9365. TestHAZKUtil fails on Windows. Contributed by Ivan Mitic.
new 80c2cf5 Preparing for bug-fix 2.0.4-alpha release.
new 97c4668 HDFS-4560. Webhdfs cannot use tokens obtained by another user (daryn)
new 6d4ab86 HADOOP-9374. Add tokens from -tokenCacheFile into UGI (daryn)
new 301079b HDFS-4546. Use DFSUtil.getSpnegoKeytabKey() to get the spnego keytab key in secondary namenode and namenode http server. Contributed by Arpit Agarwal.
new 49b2c6a Change the jira number of commit 1454021 to HDFS-4565. Attribute it to the right contributor, Arpit Gupta
new 8a4f03c HDFS-4566. Webdhfs token cancelation should use authentication (daryn)
new a3c4488 HADOOP-9364. PathData#expandAsGlob does not return correct results for absolute paths on Windows. Contributed by Ivan Mitic.
new 8d95784 HDFS-4557. Fix FSDirectory#delete when INode#cleanSubtree returns 0. Contributed by Jing Zhao
new 7122cb5 MAPREDUCE-5023. History Server Web Services missing Job Counters (Ravi Prakash via tgraves)
new 21a1c8a HADOOP-9369. DNS#reverseDns() can return hostname with . appended at the end. Contributed by Karthik Kambatla.
new 06f27d8 Move CHANGES.txt entry for HADOOP-9369 to the correct place.
new 4909821 HDFS-4569. Small image transfer related cleanups. Contributed by Andrew Wang.
new 8223036 Merging trunk
new 5f2c518 YARN-443. allow OS scheduling priority of NM to be different than the containers it launches (tgraves)
new 94a2211 HDFS-4567. Webhdfs does not need a token for token operations. Contributed by Daryn Sharp.
new a549d6f HDFS-4571. WebHDFS should not set the service hostname on the server side. (tucu)
new 140076f HDFS-4577. Webhdfs operations should declare if authentication is required. Contributed by Daryn Sharp.
new a4c2008 HADOOP-9151 Include RPC error info in RpcResponseHeader instead of sending it separately (sanjay Radia)
new c1fabc5 HDFS-4573. Fix TestINodeFile on Windows. Contributed by Arpit Agarwal.
new d32fb8a HDFS-4579. Annotate snapshot tests. Contributed by Arpit Agarwal.
new f5227eb HADOOP-8973. DiskChecker cannot reliably detect an inaccessible disk on Windows with NTFS ACLs. Contributed by Chris Nauroth.
new 43f8d0b HDFS-4574. Move Diff to the util package.
new 5865ec1 HADOOP-9379. capture the ulimit info after printing the log to the console. Contributed by Arpit Gupta.
new 9d62cdd HDFS-4391. TestDataTransferKeepalive fails when tests are executed in a certain order. Contributed by Andrew Wang.
new 9daa958 HDFS-4572. Fix TestJournal failures on Windows. Contributed by Arpit Agarwal.
new f35cd45 Merge r1454237 through r1455388 from trunk.
new 3b3ea5c HDFS-4563. Update namespace/diskspace usage after deleting snapshots.
new f75592f HADOOP-9393. TestRPC fails with JDK7. Contributed by Andrew Wang.
new 1107720 HADOOP-9394. Port findHangingTest.sh from HBase to Hadoop. Contributed by Andrew Wang.
new d49c507 HDFS-4287. HTTPFS tests fail on Windows. Contributed by Chris Nauroth.
new ebf2e6b HADOOP-9099. NetUtils.normalizeHostName fails on domains where UnknownHost resolves to an IP address. Contributed by Ivan Mitic.
new 6a9ccd8 HADOOP-9388. TestFsShellCopy fails on Windows. Contributed by Ivan Mitic.
new 813e974 HDFS-4586. TestDataDirs.testGetDataDirsFromURIs fails with all directories in dfs.datanode.data.dir are invalid. Contributed by Ivan Mitic.
new 5780324 MAPREDUCE-5060. Fetch failures that time out only count against the first map task. Contributed by Robert Joseph Evans
new c5017c7 HDFS-4013. TestHftpURLTimeouts throws NPE. Contributed by Chao Shi.
new 7aa7575 HADOOP-9399. protoc maven plugin doesn't work on mvn 3.0.2. Contributed by Todd Lipcon.
new 86a940f HDFS-4592. Default values for access time precision are out of sync between hdfs-default.xml and the code. Contributed by Aaron T. Myers.
new 7c8419f HDFS-4522. LightWeightGSet expects incrementing a volatile to be atomic. Contributed by Colin Patrick McCabe.
new 06f711d HDFS-4484. libwebhdfs compilation broken with gcc 4.6.2. Contributed by Colin Patrick McCabe.
new 44eb4c3 YARN-198. Added a link to RM pages from the NodeManager web app. Contributed by Jian He.
new 719c313 HDFS-4144. Create test for all snapshot-related metrics. Contributed by Jing Zhao.
new b8f3133 Adding file missed in the revision 1455805
new 38a5a4e Move HADOP-7101 from 0.22 section to 0.23
new e4e1361 HDFS-4593. TestSaveNamespace fails on Windows. Contributed by Arpit Agarwal.
new 8c20a8f HDFS-4595. When short circuit read is fails, DFSClient does not fallback to regular reads. Contributed by Suresh Srinivas.
new c390683 HDFS-4583. TestNodeCount fails. Contributed by Ivan Mitic.
new 1f3a18f HDFS-4582. TestHostsFiles fails on Windows. Contributed by Ivan Mitic.
new 3bf09c5 HDFS-4591. HA clients can fail to fail over while Standby NN is performing long checkpoint. Contributed by Aaron T. Myers.
new 7987bcf HDFS-3344. Unreliable corrupt blocks counting in TestProcessCorruptBlocks. Contributed by Kihwal Lee.
new 6fbe717 HADOOP-9397. Incremental dist tar build fails. Contributed by Chris Nauroth
new 9ec88e8 YARN-468. coverage fix for org.apache.hadoop.yarn.server.webproxy.amfilter (Aleksey Gorshkov via bobby)
new 2c42337 HDFS-3367. WebHDFS doesn't use the logged in user when opening connections (daryn)
new 1b6f058 YARN-237. Refreshing the RM page forgets how many rows I had in my Datatables (jian he via bobby)
new bcabbcd HDFS-3277. fail over to loading a different FSImage if the first one we try to load is corrupt. Contributed by Colin Patrick McCabe and Andrew Wang.
new 807e083 HDFS-4596. Shutting down namenode during checkpointing can lead to md5sum error. Contributed by Andrew Wang.
new 4008b37 HADOOP-9405. TestGridmixSummary#testExecutionSummarizer is broken. Contributed by Andrew Wang.
new 20604b3 HADOOP-9407. commons-daemon 1.0.3 dependency has bad group id causing build issues. Contributed by Sangjin Lee.
new bc6cc3d HADOOP-9406. hadoop-client leaks dependency on JDK tools jar. (tucu)
new dfaa6b6 HADOOP-9301. hadoop client servlet/jsp/jetty/tomcat JARs creating conflicts in Oozie & HttpFS. (tucu)
new 70aa08f HADOOP-9408. misleading description for net.topology.table.file.name property in core-default.xml. Contributed by rajeshbabu.
new 2ba66a5 YARN-196. Nodemanager should be more robust in handling connection failure to ResourceManager when a cluster is started. Contributed by Xuan Gong.
new 9c7c2f4 HDFS-4603. TestMiniDFSCluster fails on Windows. Contributed by Ivan Mitic.
new d412a1a MAPREDUCE-4571. TestHsWebServicesJobs fails on jdk7. (tgraves via tucu)
new 8c8ff3f MAPREDUCE-4716. TestHsWebServicesJobsQuery.testJobsQueryStateInvalid fails with jdk7. (tgraves via tucu)
new 415d038 HDFS-4604. TestJournalNode fails on Windows. Contributed by Ivan Mitic.
new 7d7553c MAPREDUCE-5042. Reducer unable to fetch for a map task that was recovered (Jason Lowe via bobby)
new c2003ab HADOOP-9318. When exiting on a signal, print the signal name first. Contributed by Colin Patrick McCabe.
new 77f7bfa HDFS-4556. Add snapshotdiff and LsSnapshottableDir tools to hdfs script. Contributed by Arpit Agarwal
new a5a6633 Merge r1455389 through r1457712 from trunk.
new 7eb7b3b HADOOP-9299. kerberos name resolution is kicking in even when kerberos is not configured (daryn)
new 64741f4 HDFS-4521. Invalid network toploogies should not be cached. Contributed by Colin Patrick McCabe.
new 5ac6abe MAPREDUCE-4990. Construct debug strings conditionally in ShuffleHandler.Shuffle#sendMapOutput(). (kkambatl via tucu)
new 53e7aaa MAPREDUCE-5028. Maps fail when io.sort.mb is set to high value. (kkambatl via tucu)
new d2775d6 YARN-485. TestProcfsProcessTree#testProcessTree() doesn't wait long enough for the process to die. (kkambatl via tucu)
new 37eed0a YARN-481. Add AM Host and RPC Port to ApplicationCLI Status Output (Chris Riccomini via bikas)
new 9701555 HDFS-4534. Add INodeReference in order to support rename with snapshots.
new 523d3da MAPREDUCE-5053. java.lang.InternalError from decompression codec cause reducer to fail (Robert Parker via jeagles)
new c19633d Reverting MAPREDUCE-5028 (commit 1457918)
new 67699c2 YARN-200. yarn log does not output all needed information, and is in a binary format. Contributed by Ravi Prakash
new c92b59f HDFS-4614. FSNamesystem#getContentSummary should use getPermissionChecker helper method. Contributed by Aaron T. Myers.
new 718f0f9 MAPREDUCE-5075. DistCp leaks input file handles since ThrottledInputStream does not close the wrapped InputStream. Contributed by Chris Nauroth
new efe9334 Move MAPREDUCE-5075 to 2.0.5-beta in CHANGES.txt.
new f7df0cb MAPREDUCE-4972. Coverage fixing for org.apache.hadoop.mapreduce.jobhistory (Aleksey Gorshkov via bobby)
new 1bd345d YARN-396. Rationalize AllocateResponse in RM Scheduler API. Contributed by Zhijie Shen.
new 2703518 YARN-297. Improve hashCode implementations for PB records. Contributed by Xuan Gong.
new 3574720 HADOOP-9380 Add totalLength to rpc response (sanjay Radia)
new a10fbb9 HDFS-4246. The exclude node list should be more forgiving, for each output stream. Contributed by Harsh J. Chouraria.
new ca7c588 HDFS-4616. Update the FilesDeleted metric while deleting file/dir in the current tree. Contributed by Jing Zhao
new 92fb7cd YARN-488. TestContainerManagerSecurity fails on Windows. Contributed by Chris Nauroth.
new d6b33ee YARN-490. TestDistributedShell fails on Windows. Contributed by Chris Nauroth.
new 0cda826 YARN-491. TestContainerLogsPage fails on Windows. Contributed by Chris Nauroth.
new 6610212 MAPREDUCE-5078. TestMRAppMaster fails on Windows due to mismatched path separators. (Contributed by Chris Nauroth)
new cd2c5fa MAPREDUCE-3872. Fix an event handling races in ContainerLauncherImpl. (Contributed by Robert Kanter)
new 036c168 HDFS-4620. Documentation for dfs.namenode.rpc-address specifies wrong format. Contributed by Sandy Ryza.
new 28bac40 YARN-417. Create AMRMClient wrapper that provides asynchronous callbacks. (Sandy Ryza via bikas)
new 1b98d8d HDFS-4607. In TestGetConf.testGetSpecificKey(), use a platform-specific line separator; otherwise, it fails on Windows. Contributed by Ivan Mitic
new e976294 HDFS-4609. TestAuditLogs should release log handles between tests. Contributed by Ivan Mitic
new c2e186b HDFS-4615. Fix TestDFSShell failures on Windows. Contributed by Arpit Agarwal
new 7ed618e HDFS-4584. Skip TestNNWithQJM.testNewNamenodeTakesOverWriter() on Windows. Contributed by Arpit Agarwal
new 883601a HADOOP-9387. Fix DF so that it won't execute a shell command on Windows to compute the file system/mount point. Contributed by Ivan Mitic
new 92bee12 Move HADOOP-9387 to Trunk in CHANGES.txt.
new 6f92ad9 MAPREDUCE-5014. Extend Distcp to accept a custom CopyListing. Contributed by Srikanth Sundarrajan
new b8c74a8 MAPREDUCE-5083. MiniMRCluster should use a random component when creating an actual cluster. Contributed by Siddharth Seth.
new b15b44e YARN-470. Support a way to disable resource monitoring on the NodeManager. Contributed by Siddharth Seth.
new 7c325a5 YARN-417. Addendum patch to fix broken test (Sandy Ryza via bikas)
new 0f4cad5 HADOOP-9353. Activate native-win maven profile by default on Windows. Contributed by Arpit Agarwal
new 1186572 HADOOP-9431 TestSecurityUtil#testLocalHostNameForNullOrWild on systems where hostname contains capital letters (Chris Nauroth via sanjay)
new 993a76f HDFS-4627. Fix FSImageFormat#Loader NPE and synchronization issues. Contributed by Jing Zhao.
new 698e3f8 Merging trunk to branch HDFS-2802
new d357983 svn merge -c -1448745 and -1448285 for reverting HADOOP-9112: test-patch should -1 for @Tests without a timeout
new cc2f96f HDFS-4612. Not to use INode.getParent() when generating snapshot diff report. Contributed by Jing Zhao
new 90b063c HADOOP-9350 -add entry to BUILDING.TXT to say 'no java7 on OS/X
new a10055c HADOOP-9258 Add stricter tests to FileSystemContractTestBase (includes fixes for production code HADOOP-9261 & HADOOP-9265 and test enhancements HADOOP-9228, HADOOP-9227 & HADOOP-9259)
new c02dd9a YARN-109. .tmp file is not deleted for localized archives (Mayank Bansal via bobby)
new 6a482a8 YARN-71. Fix the NodeManager to clean up local-dirs on restart. Contributed by Xuan Gong.
new 18e08a8 YARN-439. Flatten NodeHeartbeatResponse. Contributed by Xuan Gong.
new 1acb805 YARN-497. Yarn unmanaged-am launcher jar does not define a main class in its manifest (Hitesh Shah via bikas)
new 0757364 YARN-378. Fix RM to make the AM max attempts/retries to be configurable per application by clients. Contributed by Zhijie Shen.
new 5e325d4 HADOOP-9433 TestLocalFileSystem#testHasFileDescriptor leaks file handle (Chris Nauroth via sanjay)
new 46315a2 MAPREDUCE-5062. Fix MR AM to read max-retries from the RM. Contributed by *Zhijie Shen.
new 2aed48a YARN-498. Unmanaged AM launcher does not set various constants in env for an AM, also does not handle failed AMs properly (Hitesh Shah via bikas)
new e74d1f0 YARN-469. Make scheduling mode in FS pluggable. (kkambatl via tucu)
new ca3e09b HDFS-4598. Fix the default value of ConcatSourcesParam and the WebHDFS doc.
new a0a8442 MAPREDUCE-4875. coverage fixing for org.apache.hadoop.mapred (Aleksey Gorshkov via bobby)
new d41e67b MAPREDUCE-5077. Remove mapreduce.util.ResourceCalculatorPlugin and related code. Contributed by Karthik Kambatla.
new 66e90b2 YARN-440. Flatten RegisterNodeManagerResponse. Contributed by Xuan Gong.
new af7b766 HADOOP-9430. TestSSLFactory fails on IBM JVM. Contributed by Amir Sanjar.
new fdf1e6e HDFS-4635. Move BlockManager#computeCapacity to LightWeightGSet. Contributed by Suresh Srinivas.
new 5319818 HADOOP-9194. RPC Support for QoS. (Junping Du via llu)
new d60c2fa YARN-474. Fix CapacityScheduler to trigger application-activation when am-resource-percent configuration is refreshed. Contributed by Zhijie Shen.
new 375584a MAPREDUCE-5006. Fix failing streaming tests due to MAPREDUCE-4994. Contributed by Sandy Ryza.
new c9f5052 HDFS-4581. DataNode.checkDiskError should not be called on network errors. Contributed by Rohit Kochar.
new 414458f YARN-496. Fair scheduler configs are refreshed inconsistently in reinitialize. Contributed by Sandy Ryza
new 8585931 HADOOP-8415. Add getDouble() and setDouble() in org.apache.hadoop.conf.Configuration (Jan van der Lugt via harsh) Merging into branch-2. Updating CHANGES.txt
new d0bbff6 YARN-209. Fix CapacityScheduler to trigger application-activation when the cluster capacity changes. Contributed by Zhijie Shen.
new 81192e4 HDFS-4621. Additional logging to help diagnose slow QJM syncs. Contributed by Todd Lipcon.
new 4809bfa HDFS-4618. Default transaction interval for checkpoints is too low. Contributed by Todd Lipcon.
new fc0a4de HADOOP-9358. "Auth failed" log should include exception string. Contributed by Todd Lipcon.
new 694a672 HDFS-4538. Allow use of legacy blockreader. Contributed by Colin Patrick McCabe.
new 0e6604a HDFS-4633 TestDFSClientExcludedNodes fails sporadically if excluded nodes cache expires too quickly (Chris Nauroth via Sanjay)
new fc5fd80 HADOOP-9125. LdapGroupsMapping threw CommunicationException after some idle time. Contributed by Kai Zheng.
new 967b62f YARN-24. Nodemanager fails to start if log aggregation enabled and namenode unavailable. (sandyr via tucu)
new 799e3c3 HADOOP-9357. Fallback to default authority if not specified in FileContext. Contributed by Andrew Wang
new 25aab42 HDFS-4636. Update quota usage when deleting files/dirs that were created after taking the latest snapshot. Contributed by Jing Zhao
new 520033b YARN-450. Define value for * in the scheduling protocol (Zhijie Shen via bikas)
new 1611b51 HADOOP-9150. Avoid unnecessary DNS resolution attempts for logical URIs. Contributed by Todd Lipcon.
new 1b87baa HADOOP-9444. Modify hadoop-policy.xml to replace unexpanded variables to a default value of '*'. Contributed by Roman Shaposhnik.
new 01aabf7 YARN-460. CS user left in list of active users for the queue even when application finished (tgraves)
new 2fd56e3 YARN-515. Node Manager not getting the master key. Contributed by Robert Joseph Evans
new bbb24fb Merge trunk into branch.
new f5bbc2d Merge r1460409 through r1462697 from trunk.
new 9602869 HDFS-4648. For snapshot deletion, when merging the diff from to-delete snapshot to the prior snapshot, make sure files/directories created after the prior snapshot get deleted. Contributed by Jing Zhao
new aa634e0 YARN-475. Remove a unused constant in the public API - ApplicationConstants.AM_APP_ATTEMPT_ID_ENV. Contributed by Hitesh Shah.
new 8ee6eca HDFS-4637. INodeDirectory#replaceSelf4Quota may incorrectly convert a newly created directory to an INodeDirectoryWithSnapshot. Contributed by Jing Zhao
new c45c8ee Complete commit of prior merge.
new b55756d MAPREDUCE-4974. Optimising the LineRecordReader initialize() method (Gelesh via bobby)
new 7c65dbb YARN-524 TestYarnVersionInfo failing if generated properties doesn't include an SVN URL
new 8060738 MAPREDUCE-5113. Streaming input/output types are ignored with java mapper/reducer. (sandyr via tucu)
new 1096917 HDFS-4611. Update FSImage for INodeReference.
new 7ca9fe7 YARN-309. Changed NodeManager to obtain heart-beat interval from the ResourceManager. Contributed by Xuan Gong.
new 329fb1f HDFS-4655. DNA_FINALIZE is logged as being an unknown command by the DN when received from the standby NN. Contributed by Aaron T. Myers.
new ef9e1ba HDFS-4656. DN heartbeat loop can be briefly tight. Contributed by Aaron T. Myers.
new 6f0c4dc Reverted MAPREDUCE-4974 because of test failures.
new 17be263 YARN-516. Fix failure in TestContainerLocalizer caused by HADOOP-9357. Contributed by Andrew Wang.
new bcce935 YARN-447. Move ApplicationComparator in CapacityScheduler to use comparator in ApplicationId. Contributed by Nemon Lou.
new 9c26c28 HDFS-4658. Standby NN will log that it has received a block report "after becoming active". Contributed by Aaron T. Myers.
new d40b154 YARN-382. SchedulerUtils improve way normalizeRequest sets the resource capabilities (Zhijie Shen via bikas)
new 8293e22 HDFS-4649. Webhdfs cannot list large directories. Contributed by Daryn Sharp.
new 75ef1b4 MAPREDUCE-4991. coverage for gridmix (Aleksey Gorshkov via tgraves)
new e67e3ff YARN-467. Modify public distributed cache to localize files such that no local directory hits unix file count limits and thus prevent job failures. Contributed by Omkar Vinit Joshi.
new 38678cc MAPREDUCE-5117. Changed MRClientProtocolPBClientImpl to be closeable and thus fix failures in renewal of HistoryServer's delegations tokens. Contributed by Siddharth Seth.
new 3e9200d YARN-101. Fix NodeManager heartbeat processing to not lose track of completed containers in case of dropped heartbeats. Contributed by Xuan Gong.
new dd2e87a YARN-381. Improve fair scheduler docs. Contributed by Sandy Ryza.
new d18cc69 MAPREDUCE-5088. MR Client gets an renewer token exception while Oozie is submitting a job (daryn)
new 2d02b77 Revert YARN-516 per HADOOP-9357.
new 0e9f61a Revert initial HADOOP-9357 patch.
new 2100e93 YARN-538. RM address DNS lookup can cause unnecessary slowness on every JHS page load. (sandyr via tucu)
new 3a089cf YARN-458. YARN daemon addresses must be placed in many different configs. (sandyr via tucu)
new 0709161 MAPREDUCE-5098. Fix findbugs warnings in gridmix. (kkambatl via tucu)
new da0e779 HADOOP-9401. CodecPool: Add counters for number of (de)compressors leased out. (kkambatl via tucu)
new fc75d3f MAPREDUCE-5086. MR app master deletes staging dir when sent a reboot command from the RM. Contributed by Jian He
new 1fd462b YARN-536. Removed the unused objects ContainerStatus and ContainerStatus from Container which also don't belong to the container. Contributed by Xuan Gong.
new ab85036 HADOOP-9451. Fault single-layer config if node group topology is enabled. (Junping Du via llu)
new d088d2d HDFS-4665. Move TestNetworkTopologyWithNodeGroup to common. (Junping Du via llu)
new 547d2b0 HDFS-4548. Webhdfs doesn't renegotiate SPNEGO token. Contributed by Daryn Sharp.
new 28c74a2 HADOOP-9429. TestConfiguration fails with IBM JAVA. Contributed by Amir Sanjar.
new 681312d Updated CHANGES.txt to reflect YARN-470 being merged into branch-2.0.4-alpha.
new 999ce49 HDFS-4625. Make TestNNWithQJM#testNewNamenodeTakesOverWriter work on Windows. Contributed by Ivan Mitic.
new 0836d68 YARN-532. Change RMAdmin and Localization client protocol PB implementations to implement closeable so that they can be stopped when needed via RPC.stopProxy(). Contributed by Siddharth Seth.
new ca848be HDFS-4647. Rename should call setLocalName after an inode is removed from snapshots. Contributed by Arpit Agarwal
new 07d7d92 Merge r1462698 through r1464807 from trunk.
new 18757c1 YARN-525. make CS node-locality-delay refreshable. Contributed by Thomas Graves
new a5734cd MAPREDUCE-5007. fix coverage org.apache.hadoop.mapreduce.v2.hs (Aleksey Gorshkov via tgraves)
new bc6777d YARN-193. Scheduler.normalizeRequest does not account for allocation requests that exceed maximumAllocation limits (Zhijie Shen via bikas)
new bcbe100 HDFS-4646. createNNProxyWithClientProtocol ignores configured timeout value. Contributed by Jagane Sundar
new a9d515a HDFS-1804. Add a new block-volume device choosing policy that looks at free space. Contributed by Aaron T. Myers.
new 7f13207 MAPREDUCE-5129. Allow tags to JobHistory for deeper analytics. Contributed by Billie Rinaldi.
new c5bb615 HDFS-4525. Provide an API for knowing that whether file is closed or not. Contributed by SreeHari.
new 16fedf5 YARN-479. NM retry behavior for connection to RM should be similar for lost heartbeats (Jian He via bikas)
new 087acf8 HDFS-3981. Fix handling of FSN lock in getBlockLocations. Contributed by Xiaobo Peng and Todd Lipcon.
new 1920162 HDFS-4339. Persist inode id in fsimage and editlog. Contributed by Brandon Li.
new f680865 HDFS-3940. Add Gset#clear method and clear the block map when namenode is shutdown. Contributed by Suresh Srinivas.
new b96d18b YARN-99. Modify private distributed cache to localize files such that no local directory hits unix file count limits and thus prevent job failures. Contributed by Omkar Vinit Joshi.
new 55865f4 YARN-557. Fix TestUnmanagedAMLauncher failure on Windows. Contributed by Chris Nauroth.
new b1b99bb YARN-524. Moving CHANGES.txt entry to the correct section.
new 425f495 HDFS-4676. TestHDFSFileSystemContract should set MiniDFSCluster variable to null to free up memory. Contributed by Suresh Srinivas.
new e73db45 HDFS-4674. TestBPOfferService fails on Windows due to failure parsing datanode data directory as URI. Contributed by Chris Nauroth.
new d959362 HDFS-4669. TestBlockPoolManager fails using IBM java. Contributed by Tian Hong Wang.
new 3a54a56 YARN-112. Fixed a race condition during localization that fails containers. Contributed by Omkar Vinit Joshi. MAPREDUCE-5138. Fix LocalDistributedCacheManager after YARN-112. Contributed by Omkar Vinit Joshi.
new 7d00d3d YARN-534. Change RM restart recovery to also account for AM max-attempts configuration after the restart. Contributed by Jian He.
new f035152 HDFS-4643. Fix flakiness in TestQuorumJournalManager. Contributed by Todd Lipcon.
new 2b19054 HADOOP-9437. TestNativeIO#testRenameTo fails on Windows due to assumption that POSIX errno is embedded in NativeIOException. Contributed by Chris Nauroth.
new 4edf48c HADOOP-9467. Metrics2 record filter should check name as well as tags. (Ganeshan Iyler via llu)
new 3209d4a Merge r1464808 through r1466652 from trunk.
new 4c00514 HDFS-4684. Use INode id for image serialization when writing INodeReference.
new fd1000b HDFS-4679. Namenode operation checks should be done in a consistent manner. Contributed by Suresh Srinivas.
new add00d6 YARN-487. Modify path manipulation in LocalDirsHandlerService to let TestDiskFailures pass on Windows. Contributed by Chris Nauroth.
new 2e3b56f YARN-495. Changed NM reboot behaviour to be a simple resync - kill all containers and re-register with RM. Contributed by Jian He.
new 4234bc8 YARN-539. Addressed memory leak of LocalResource objects NM when a resource localization fails. Contributed by Omkar Vinit Joshi.
new 3ddf831 HADOOP-9471. hadoop-client wrongfully excludes jetty-util JAR, breaking webhdfs. (tucu)
new 6a1c411 MAPREDUCE-5079. Changes job recovery to restore state directly from job history, instaed of simulating state machine events. Contributed by Jason Lowe and Robert Parker.
new 9e2a96a Undo the unnecessary changes to CHANGES.txt included in git-revision 06b93c7
new 972eb9b Additional fixes to CHANGES.txt to move jiras under the correct 2.x revision.
new d04e65b MAPREDUCE-5137. AM web UI: clicking on Map Task results in 500 error. Contributed by Thomas Graves
new 8e86ffd MAPREDUCE-5136. TestJobImpl->testJobNoTasks fails with IBM JAVA. Contributed by Amir Sanjar
new e4c55e1 YARN-486. Changed NM's startContainer API to accept Container record given by RM as a direct parameter instead of as part of the ContainerLaunchContext record. Contributed by Xuan Gong. MAPREDUCE-5139. Update MR AM to use the modified startContainer API after YARN-486. Contributed by Xuan Gong.
new 6d9c311 Preparing for release 0.23.7
new 3131636 HADOOP-9222. Cover package with org.apache.hadoop.io.lz4 unit tests. Contributed by Vadim Bondarev
new 21c14c0 MAPREDUCE-4981. Add WordMean, WordMedian, WordStandardDeviation to ExamplesDriver. Contributed by Plamen Jeliazkov.
new 390deff HADOOP-9233. Cover package org.apache.hadoop.io.compress.zlib with unit tests. Contributed by Vadim Bondarev
new 5fd460e MAPREUDUCE-5059. Change average merge time on Job overview page to be the time delta between the end of the shuffle and the start of the reduce. Contributed by Omkar Vinit Joshi.
new 3c8bd60 MAPREDUCE-5094. Disabled memory monitoring by default in MiniMRYarnCluster to avoid some downstream tests failing. Contributed by Siddharth Seth.
new 529170d Fixing CHANGES.txt entry for YARN-319.
new acb14d3 HADOOP-9471. Merged into 2.0.4-alpha. Fixing CHANGES.txt
new 8e838bd MAPREDUCE-4985. Add compression option to TestDFSIO usage. Contributed by Plamen Jeliazkov.
new 41c4cd08 MAPREDUCE-4885. Streaming tests have multiple failures on Windows. (Chris Nauroth via bikas)
new c259202 YARN-412. Fixed FifoScheduler to check hostname of a NodeManager rather than its host:port during scheduling which caused incorrect locality for containers. Contributed by Roger Hoover.
new f863543 HDFS-4477. Secondary namenode may retain old tokens. Contributed by Daryn Sharp.
new 2dfc42d HADOOP-9211. Set default max heap size in HADOOP_CLIENT_OPTS to 512m in order to avoid OOME. Contributed by Plamen Jeliazkov.
new 5e94420 YARN-412. Pushing to 2.0.5-beta only.
new b7aaa1b Merge trunk into the HDFS-347 branch.
new 242028a HDFS-4639. startFileInternal() should not increment generation stamp. Contributed by Plamen Jeliazkov.
new 801b484 HDFS-347. DFS read performance suboptimal when client co-located on nodes with data. Contributed by Colin Patrick McCabe.
new 9c6a7be HDFS-4675. Fix rename across snapshottable directories. Contributed by Jing Zhao
new e408d99 HADOOP-9473. Typo in FileUtil copy() method. Contributed by Glen Mazza.
new 108e0e0 HADOOP-9473. Add change description missed in previous commit 1467694
new 0f78c50 HDFS-4692. Use timestamp as default snapshot names.
new bf80706 Merging r1466653 through r1467712 from trunk.
new 947e97f MAPREDUCE-4974. Optimising the LineRecordReader initialize() method (Gelesh via bobby)
new d13f6eb HDFS-4666. Define ".snapshot" as a reserved inode name so that users cannot create a file/directory with ".snapshot" as the name. If ".snapshot" is used in a previous version of HDFS, it must be renamed before upgrade; otherwise, upgrade will fail.
new 0e01f26 YARN-444. Moved special container exit codes from YarnConfiguration to API where they belong. Contributed by Sandy Ryza. MAPREDUCE-5151. Updated MR AM to use standard exit codes from the API after YARN-444. Contributed by Sandy Ryza.
new 1822529 HDFS-4693. Some test cases in TestCheckpoint do not clean up after themselves. Contributed by Arpit Agarwal and Suresh.
new 9ea20fc MAPREDUCE-5015. Coverage fix for org.apache.hadoop.mapreduce.tools.CLI (Aleksey Gorshkov via tgraves)
new 2e789dd MAPREDUCE-5065. DistCp should skip checksum comparisons if block-sizes are different on source/target. Contributed by Mithun Radhakrishnan.
new 6bda1f2 HDFS-4700. Fix the undo section of rename with snapshots. Contributed by Jing Zhao
new 38bd7061 HDFS-4529. Disallow concat when one of the src files is in some snapshot.
new 9280468 HDFS-4550. Refactor INodeDirectory.INodesInPath to a standalone class.
new 9bebccc Fix HADOOP-9467 attribution.
new dbcda89 YARN-500. Fixed YARN webapps to not roll-over ports when explicitly asked to use non-ephemeral ports. Contributed by Kenji Kikushima.
new d090a3b HDFS-4695. TestEditLog leaks open file handles between tests. Contributed by Ivan Mitic.
new 2186912 Merge r1467713 through r1469041 from trunk.
new ef9f251 YARN-514.Delayed store operations should not result in RM unavailability for app submission (Zhijie Shen via bikas)
new 9e650d3 MAPREDUCE-5140. MR part of YARN-514 (Zhijie Shen via bikas)
new 014dc3a YARN-518. Fair Scheduler's document link could be added to the hadoop 2.x main doc page. (sandyr via tucu)
new de6d05c YARN-476. ProcfsBasedProcessTree info message confuses users. (sandyr via tucu)
new cd27afa MAPREDUCE-5128. mapred-default.xml is missing a bunch of history server configs. (sandyr via tucu)
new 0ad27ad HDFS-4707. Add snapshot methods to FilterFileSystem and fix findbugs warnings.
new 419fd39 HDFS-4706. Do not replace root inode for disallowSnapshot.
new 5003e8d HADOOP-9450. HADOOP_USER_CLASSPATH_FIRST is not honored; CLASSPATH is PREpended instead of APpended. Contributed by Chris Nauroth and Harsh J. (harsh)
new d219c90 YARN-585. Fix failure in TestFairScheduler#testNotAllowSubmitApplication caused by YARN-514. Contributed by Zhijie Shen.
new df55edd YARN-482. FS: Extend SchedulingMode to intermediate queues. (kkambatl via tucu)
new d12c463 MAPREDUCE-4898. FileOutputFormat.checkOutputSpecs and FileOutputFormat.setOutputPath incompatible with MR1. (rkanter via tucu)
new cb78a65 MAPREDUCE-5152. Make MR App to simply pass through the container from RM instead of extracting and populating information itself to start any container. Contributed by Vinod Kumar Vavilapalli.
new e222d1e MAPREDUCE-4932. mapreduce.job#getTaskCompletionEvents incompatible with Hadoop 1. (rkanter via tucu)
new 980e6c5 HDFS-4434. Provide a mapping from INodeId to INode. Contributed by Suresh Srinivas.
new 8e1c282 YARN-441. Removed unused utility methods for collections from two API records. Contributed by Xuan Gong. MAPREDUCE-5163. Update MR App to not use API utility methods for collections after YARN-441. Contributed by Xuan Gong.
new 9ab8fa3 HDFS-4717. Change the path parameter type of the snapshot methods in HdfsAdmin from String to Path.
new 44bf852 YARN-493. Fixed some shell related flaws in YARN on Windows. Contributed by Chris Nauroth. HADOOP-9486. Promoted Windows and Shell related utils from YARN to Hadoop Common. Contributed by Chris Nauroth.
new b10f1d3 Merge r1469042 through r1469643 from trunk.
new 16cc4a6 HDFS-4699. TestPipelinesFailover#testPipelineRecoveryStress fails sporadically. Contributed by Chris Nauroth.
new 7c66645 HADOOP-9488. FileUtil#createJarWithClassPath only substitutes environment variables from current process environment/does not support overriding when launching new process (Chris Nauroth via bikas)
new edcfd45 YARN-593. container launch on Windows does not correctly populate classpath with new process's environment variables and localized resources (Chris Nauroth via bikas)
new c1ce3c5 MAPREDUCE-4987. TestMRJobs#testDistributedCache fails on Windows due to classpath problems and unexpected behavior of symlinks (Chris Nauroth via bikas)
new febc52b MAPREDUCE-5147. Maven build should create hadoop-mapreduce-client-app-VERSION.jar directly (Robert Parker via tgraves)
new 7049c83 HADOOP-9469. mapreduce/yarn source jars not included in dist tarball (Robert Parker via tgraves)
new d5556cb YARN-586. Fixed a typo in ApplicationSubmissionContext#setApplicationId. Contributed by Zhijie Shen.
new c570309 YARN-547. Fixed race conditions in public and private resource localization which used to cause duplicate downloads. Contributed by Omkar Vinit Joshi.
new 9af0bab Merging trunk after fixing conflict with HDFS-4434.
new a91067f YARN-542. Changed the default global AM max-attempts value to be not one. Contributed by Zhijie Shen.
new 0b101bd HDFS-4434. Reverting change r1470089 that merges trunk to HDFS-2802.
new 794f9bb MAPREDUCE-5066. Added a timeout for the job.end.notification.url. Contributed by Ivan Mitic.
new 7e122e1 HADOOP-9443. Port winutils static code analysis change to trunk. Contributed by Chuan Liu.
new 27b3f84 Merge trunk to HDFS-2802 branch. This involves fixing many conflict with HDFS-4434.
new e24a9b83 YARN-594. Update test and add comments in YARN-534 (Jian He via bikas)
new cb229db HDFS-4708. Add snapshot user documentation.
new 009af54 MAPREDUCE-5146. application classloader may be used too early to load classes. Contributed by Sangjin Lee.
new 43bdc22 HDFS-4726. Fix test failures after merging the INodeId-INode mapping from trunk. Contributed by Jing Zhao
new 92e0416 HDFS-4727. Update inodeMap after deleting files/directories/snapshots. Contributed by Jing Zhao
new 10a2d82 HDFS-4719. Remove AbstractINodeDiff.Factory and move its methods to AbstractINodeDiffList. Contributed by Arpit Agarwal
new aa7dd50 Merge r1470195 through r1470759 from trunk.
new fd24c6e HDFS-4725. Fix HDFS file handle leaks in FSEditLog, NameNode, OfflineEditsBinaryLoader and some tests. Contributed by Chris Nauroth
new a1ee214 YARN-549. YarnClient.submitApplication should wait for application to be accepted by the RM (Zhijie Shen via bikas)
new ffd7dbb YARN-583. Moved application level local resources to be localized under the filecache sub-directory under application directory. Contributed by Omkar Vinit Joshi.
new 631be95 HDFS-4732. Fix TestDFSUpgradeFromImage which fails on Windows due to failure to unpack old image tarball that contains hard links. Chris Nauroth
new 27e8c86 YARN-561. Modified NodeManager to set key information into the environment of every container that it launches. Contributed by Xuan Gong. MAPREDUCE-5175. Updated MR App to not set envs that will be set by NMs anyways after YARN-561. Contributed by Xuan Gong.
new cd975d4 YARN-581. Added a test to verify that app delegation tokens are restored after RM restart. Contributed by Jian He.
new 65752c0 HDFS-4735. DisallowSnapshot throws IllegalStateException for nested snapshottable directories. Contributed by Jing Zhao
new 4c662fd HDFS-4737. JVM path embedded in fuse binaries. Contributed by Sean Mackrory.
new 3a812e9 HDFS-4738. Changes AbstractINodeDiff to implement Comparable<Integer>, and fix javadoc and other warnings.
new 5f1e3b5 Merge r1470760 through r1471228 from trunk.
new 0777474 MAPREDUCE-5069. add concrete common implementations of CombineFileInputFormat (Sangjin Lee via bobby)
new 40e78c2 MAPREDUCE-4737. Ensure that mapreduce APIs are semantically consistent with mapred API w.r.t Mapper.cleanup and Reducer.cleanup; in the sense that cleanup is now called even if there is an error. The old mapred API already ensures that Mapper.close and Reducer.close are invoked during error handling. Note that it is an incompatible change, however end-users can override Mapper.run and Reducer.run to get the old (inconsistent) behaviour. Contributed by Arun C. Murthy.
new a09c29b8 HDFS-4339. Add the missed entry CHANGES.txt from r1465835
new a2f97fd YARN-605. Fix failing unit test in TestNMWebServices when versionInfo has parantheses like when running on a git checkout. Contributed by Hitesh Shah.
new 0fa5cad HDFS-4686. Update quota computation for rename and INodeReference. Contributed by Jing Zhao
new e8b64d3 HDFS-4729. Fix OfflineImageViewer and permission checking for snapshot operations. Contributed by Jing Zhao
new e6b5b01 HDFS-4739. NN can miscalculate the number of extra edit log segments to retain. Contributed by Aaron T. Myers.
new daaa73b MAPREDUCE-5166. Fix ConcurrentModificationException due to insufficient synchronization on updates to task Counters. Contributed by Sandy Ryza.
new be256a1 YARN-579. Stop setting the Application Token in the AppMaster env, in favour of the copy present in the container token field. Contributed by Vinod Kumar Vavilapalli.
new e96077a MAPREDUCE-5181. RMCommunicator should not use AMToken from the env. Contributed by Vinod Kumar Vavilapalli.
new 16ef8dd HDFS-4745. TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure. Contributed by Chris Nauroth.
new 448df18 YARN-577. Add application-progress also to ApplicationReport. Contributed by Hitesh Shah. MAPREDUCE-5178. Update MR App to set progress in ApplicationReport after YARN-577. Contributed by Hitesh Shah.
new a43c344 YARN-595. Refactor fair scheduler to use common Resources. Contributed by Sandy Ryza.
new d10428c YARN-289. Fair scheduler allows reservations that won't fit on node. Contributed by Sandy Ryza.
new a89f8e4 Cleanup CHANGES.txt and move the jira to appropriate 2.x release section to make it consistent with branch-2
new 745bfa0 HDFS-4749. Use INodeId to identify the corresponding directory node in FSImage saving/loading. Contributed by Jing Zhao
new 36f43dc HDFS-4742. Fix appending to a renamed file with snapshot. Contributed by Jing Zhao
new e9c83b2 HADOOP-9503. Remove sleep between IPC client connect timeouts. Contributed by Varun Sharma
new 06fb184 HDFS-4757. Update FSDirectory#inodeMap when replacing an INodeDirectory while setting quota. Contributed by Jing Zhao
new a259e0b Merge r1471229 through r1476005 from trunk.
new 43ac073 svn merge -c -1476006 . for reverting the previous trunk merge.
new 76b80b4 HDFS-4755. Fix AccessControlException message and moves "implements LinkedElement" from INode to INodeWithAdditionalFields.
new fa50082 Merge r1471229 through r1476009 from trunk.
new 9da3865 HDFS-4650. Fix a bug in FSDirectory and add more unit tests for rename with existence of snapshottable directories and snapshots. Contributed by Jing Zhao
new fbb5578 YARN-562. Modified NM to reject any containers allocated by a previous ResourceManager. Contributed by Jian He. MAPREDUCE-5167. Update MR App after YARN-562 to use the new builder API for the container. Contributed by Jian He.
new 635f96e YARN-562. Missed files from previous commit.
new f0ac5a8 YARN-591. Moved RM recovery related records out of public API as they do not belong there. Contributed by Vinod Kumar Vavilapalli.
new 95fa3e8 YARN-363. Add webapps/proxy directory without which YARN proxy-server fails when started in stand-alone mode. Contributed by Kenji Kikushima.
new 5d2ffde HDFS-2576. Enhances the DistributedFileSystem's create API so that clients can specify favored datanodes for a file's blocks. Contributed by Devaraj Das and Pritam Damania.
new d2495d5 HDFS-4721. Speed up lease recovery by avoiding stale datanodes and choosing the datanode with the most recent heartbeat as the primary. Contributed by Varun Sharma
new a5ae562 HDFS-4650. When passing two non-existing snapshot names to snapshotDiff, it returns success if the names are the same. Contributed by Jing Zhao
new 75b4231 HDFS-4761. When resetting FSDirectory, the inodeMap should also be reset. Contributed by Jing Zhao
new 60341da Merge r1476010 through r1476452 from trunk.
new 5276f4e HDFS-4767. If a directory is snapshottable, do not replace it when clearing quota. Contributed by Jing Zhao
new fc45cbf HADOOP-9504. MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo. Contributed by Liang Xie
new 4e21c34 HDFS-4768. File handle leak in datanode when a block pool is removed. Contributed by Chris Nauroth.
new b7afde6 HDFS-4741. TestStorageRestore#testStorageRestoreFailure fails on Windows. Contributed by Arpit Agarwal.
new fe38534 HADOOP-9290. Some tests cannot load native library on windows. Contributed by Chris Nauroth.
new 90612f6 HDFS-4748. MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures. Contributed by Chris Nauroth.
new 0181ce0 HDFS-4743. TestNNStorageRetentionManager fails on Windows. Contributed by Chris Nauroth.
new fbf10b2 HDFS-4740. Fixes for a few test failures on Windows. Contributed by Arpit Agarwal.
new f55fd81 HDFS-4722. TestGetConf#testFederation times out on Windows. Contributed by Ivan Mitic.
new f5ef2db HADOOP-9500. TestUserGroupInformation#testGetServerSideGroups fails on Windows due to failure to find winutils.exe. Contributed by Chris Nauroth.
new e2d901f HADOOP-9490. LocalFileSystem#reportChecksumFailure not closing the checksum file handle before rename. Contributed by Ivan Mitic.
new 3e00835 HDFS-4705. Address HDFS test failures on Windows because of invalid dfs.namenode.name.dir. Contributed by Ivan Mitic.
new d9ce424 YARN-576. Modified ResourceManager to reject NodeManagers that don't satisy minimum resource requirements. Contributed by Kenji Kikushima.
new ae393ab MAPREDUCE-5179. Fix unit test in TestHSWebServices which fails when versionInfo has parantheses like when running on a git checkout. Contributed by Hitesh Shah.
new 293fb1e HADOOP-9524. Fix ShellCommandFencer to work on Windows. Contributed by Arpit Agarwal.
new e17d5a9 HDFS-4734. HDFS Tests that use ShellCommandFencer are broken on Windows. Contributed by Arpit Agarwal.
new 884cbb6 HDFS-4578. Restrict snapshot IDs to 24-bit wide. Contributed by Arpit Agarwal
new c06bbc2 HDFS-4733. Make HttpFS username pattern configurable. Contributed by Alejandro Abdelnur.
new ce73b3b HDFS-4687. TestDelegationTokenForProxyUser#testWebHdfsDoAs is flaky with JDK7. Contributed by Andrew Wang.
new ce7e556 HDFS-4305. Add a configurable limit on number of blocks per file, and min block size. Contributed by Andrew Wang.
new e097f84 HDFS-4773. Fix bugs in quota usage computation and OfflineImageViewer. Contributed by Jing Zhao
new 30b7a9c HADOOP-9413. Add common utils for File#setReadable/Writable/Executable & File#canRead/Write/Execute that work cross-platform. Contributed by Ivan Mitic.
new fb30240 HDFS-4610. Use common utils FileUtil#setReadable/Writable/Executable & FileUtil#canRead/Write/Execute. Contributed by Ivan Mitic.
new e209127 HDFS-4610. Reverting the patch Jenkins build is not run.
new 8f7ce62 MAPREDUCE-5177. Use common utils FileUtil#setReadable/Writable/Executable & FileUtil#canRead/Write/Execute. Contributed by Ivan Mitic.
new 27d4592 YARN-506. Move to common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute. Contributed by Ivan Mitic.
new 3704e09 HDFS-4610. Use common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute. Contrbitued by Ivan Mitic.
new 3dc9aa4 HADOOP-9322. LdapGroupsMapping doesn't seem to set a timeout for its directory search. Contributed by Harsh J. (harsh)
new 6de09af YARN-599. Refactoring submitApplication in ClientRMService and RMAppManager to separate out various validation checks depending on whether they rely on RM configuration or not. Contributed by Zhijie Shen.
new a02e376 Move the CHANGES.txt entry for HDFS-4305 to the incompatible changes section.
new bfef637 HADOOP-9338. FsShell Copy Commands Should Optionally Preserve File Attributes. Contributed by Nick White.
new 3a3e0f5 HDFS-4760. Update inodeMap after node replacement. Contributed by Jing Zhao
new 2542d69 HDFS-4778. Fixes some issues that the first patch on HDFS-2576 missed. Contributed by Devaraj Das.
new 7e7d99e HDFS-2576. Moved the commit message lines for HDFS-4778 and HDFS-2576 in CHANGES.txt to the right places.
new 98c0421 HDFS-4758. Disallow nested snapshottable directories and unwrap RemoteException.
new faca77f Merge r1476453 through r1477867 from trunk.
new 0728f00 HADOOP-8608. Add Configuration API for parsing time durations.
new 71be8ad MAPREDUCE-5145. Changed default max-attempts to be more than one for MR jobs inline with YARN. Contributed by Zhijie Shen.
new 6096cb3 HDFS-4659 Support setting execution bit for regular files (Brandon Li via sanjay)
new e43217d HADOOP-9455. HADOOP_CLIENT_OPTS appended twice causes JVM failures. Contributed by Chris Nauroth.
new 1ea3bda HADOOP-9532. HADOOP_CLIENT_OPTS is appended twice by Windows cmd scripts. Contributed by Chris Nauroth.
new 7c14f15 HDFS-4781. Fix a NullPointerException when listing .snapshot under a non-existing directory.
new 46b2898 YARN-618. Modified RM_INVALID_IDENTIFIER to be -1 instead of zero. Contributed by Jian He.
new ca2c38f MAPREDUCE-5193. A few MR tests use block sizes which are smaller than the default minimum block size. Contributed by Andrew Wang.
new 03ba436 HDFS-4785. Concat operation does not remove concatenated files from InodeMap. Contributed by Suresh Srinivas.
new a4bae51 HDFS-4784. NPE in FSDirectory.resolvePath(). Contributed by Brandon Li.
new 9b97df9 MAPREDUCE-5036. Default shuffle handler port should not be 8080. Contributed by Sandy Ryza.
new 6cec97b HDFS-4785 and HDFS-4784 are moved to 2.0.5 release section
new 1c762c0 HADOOP-9043. Disallow in winutils creating symlinks with forwards slashes. Contributed by Chris Nauroth.
new 76461d8 HADOOP-9043. Adding Arpit Agarwal as an additional contributor
new afa7860 HADOOP-9483. winutils support for readlink command. Contributed by Arpit Agarwal.
new fc275fe YARN-625. Move the utility method unwrapAndThrowException from YarnRemoteExceptionPBImpl to RPCUtil. Contributed by Siddharth Seth.
new 4b93035 HADOOP-9483. Adding a file missed in previous commit r1478592
new 776eb11 HADOOP-9523. Provide a generic IBM java vendor flag in PlatformName.java to support non-Sun JREs. Contributed by Tian Hong Wang.
new bfc7361 HADOOP-9511. Adding support for additional input streams (FSDataInputStream and RandomAccessFile) in SecureIOUtils so as to help YARN-578. Contributed by Omkar Vinit Joshi.
new 6e37a7e MAPREDUCE-5205. Fixed MR App to load tokens correctly. Contributed by Vinod Kumar Vavilapalli.
new c0fa9d2 YARN-645. Moved RMDelegationTokenSecretManager from yarn-server-common to yarn-server-resourcemanager where it really belongs. Contributed by Jian He.
new 7256235 HADOOP-9425 Add error codes to rpc-response (sanjay Radia)
new 72d7833 HDFS-4791. Update and fix deletion of reference inode. Contributed by Jing Zhao
new 424b270 HDFS-4798. Update computeContentSummary() for the reference nodes in snapshots.
new 92b7165 YARN-629. Make YarnRemoteException not be rooted at IOException. Contributed by Xuan Gong. MAPREDUCE-5204. Handling YarnRemoteException separately from IOException in MR app after YARN-629. Contributed by Xuan Gong.
new 0aab1ef HDFS-4800. Fix INodeDirectoryWithSnapshot#cleanDeletedINode. Contributed by Jing Zhao
new 98b416f HDFS-4801. lsSnapshottableDir throws IllegalArgumentException when root is snapshottable. Contributed by Jing Zhao
new 393188c Merge r1477868 through r1479732 from trunk.
new 674cf7f YARN-633. Changed RMAdminProtocol api to throw IOException and YarnRemoteException. Contributed by Xuan Gong.
new 9eb53b9 YARN-632. Changed ContainerManager api to throw IOException and YarnRemoteException. Contributed by Xuan Gong.
new 1f5ac02 YARN-45. Add protocol for schedulers to request containers back from ApplicationMasters. Contributed by Carlo Curino and Chris Douglas.
new fa56ccf HADOOP-9540. Expose the InMemoryS3 and S3N FilesystemStores implementations for Unit testing. Hari
new 41312ab HDFS-4802. Disallowing snapshot on / twice should throw SnapshotException but not IllegalStateException. Contributed by Jing Zhao
new 3ad40e9 HDFS-4804. WARN when users set the block balanced preference percent below 0.5 or above 1.0. Contributed by Stephen Chu.
new 01e3fa1 Move the CHANGES.txt entry for HDFS-4804 from BUG to IMPROVEMENT.
new 08ec505 HDFS-4806. In INodeDirectoryWithSnapshot, use isInLatestSnapshot() to determine if an added/removed child should be recorded in the snapshot diff. Contributed by Jing Zhao
new 33ed6e2 YARN-651. Changed PBClientImpls of ContainerManager and RMAdmin to throw IOExceptions also. Contributed by Xuan Gong.
new 74231f0 YARN-582. Changed ResourceManager to recover Application token and client tokens for app attempt so that RM can be restarted while preserving current applications. Contributed by Jian He.
new 8dee15a YARN-646. Fix two typos in Fair Scheduler user guide. Contributed by Dapeng Sun.
new 8888d3f MAPREDUCE-5159. Change ValueAggregatorJob to add APIs which can support binary compatibility with hadoop-1 examples. Contributed by Zhijie Shen.
new 37d6f14 Merge r1479733 through r1480439 from trunk.
new 67d7d8f MAPREDUCE-5209. Fix units in a ShuffleScheduler log message. Contributed by Tsuyoshi OZAWA
new f6167ef MAPREDUCE-5157. Bring back old sampler related code so that we can support binary compatibility with hadoop-1 sorter example. Contributed by Zhijie Shen.
new e5692ec Fixing release date for 2.0.4-alpha.
new 0727eca YARN-631. Changed ClientRMProtocol api to throw IOException and YarnRemoteException. Contributed by Xuan Gong. MAPREDUCE-5212. Handling YarnRemoteException separately from IOException in MR App after YARN-631. Contributed by Xuan Gong.
new 5980139 HDFS-4809. When a QuotaExceededException is thrown during rename, the quota usage should be subtracted back. Contributed by Jing Zhao
new 9c4f868 YARN-630. Changed AMRMProtocol api to throw IOException and YarnRemoteException. Contributed by Xuan Gong. MAPREDUCE-5226. Handling YarnRemoteException separately from IOException in MR App's use of AMRMProtocol after YARN-630. Contributed by Xuan Gong.
new d303f01 MAPREDUCE-4942. mapreduce.Job has a bunch of methods that throw InterruptedException so its incompatible with MR1. (rkanter via tucu)
new 505fe26 YARN-568. Add support for work preserving preemption to the FairScheduler. Contributed by Carlo Curino and Sandy Ryza
new f569c8a HADOOP-9550. Remove aspectj dependency. (kkambatl via tucu)
new c7bfd17 YARN-507. Add interface visibility and stability annotations to FS interfaces/classes. (kkambatl via tucu)
new e0562e3 YARN-637. FS: maxAssign is not honored. (kkambatl via tucu)
new 51ccb87 YARN-655. Fair scheduler metrics should subtract allocated memory from available memory. (sandyr via tucu)
new f19465f YARN-598. Add virtual cores to queue metrics. (sandyr via tucu)
new 3ecf94e Merge r1480440 through r1480820 from trunk.
new 6012f67 svn merge --reintegrate https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2802 for merging HDFS Snapshot feature branch.
new a18fd62 HDFS-4661. A few little code cleanups of some HDFS-347-related code. Contributed by Colin Patrick McCabe.
new 742707d Combine CHANGES.HDFS-2802.txt to CHANGES.txt.
new 7e5b63a HDFS-4810. several HDFS HA tests have timeouts that are too short. Contributed by Chris Nauroth.
new ae9a981 HADOOP-9556. disable HA tests on Windows that fail due to ZooKeeper client connection management bug. Contributed by Chris Nauroth.
new 146ccd7 HADOOP-9553. TestAuthenticationToken fails on Windows. Contributed by Arpit Agarwal.
new a967800 HADOOP-9549. WebHdfsFileSystem hangs on close(). Contributed by Daryn Sharp.
new 1161ceb HDFS-4799. Corrupt replica can be prematurely removed from corruptReplicas map. Contributed by Todd Lipcon.
new 4ed1fc5 HDFS-4698. Provide client-side metrics for remote reads, local reads, and short-circuit reads. Contributed by Colin Patrick McCabe.
new b9a0286 HDFS-4751. TestLeaseRenewer#testThreadName flakes. Contributed by Andrew Wang.
new b1603b4 HDFS-4533. start-dfs.sh ignores additional parameters besides -upgrade. Contributed by Fengdong Yu.
new b98b776 HADOOP-9481. Broken conditional logic with HADOOP_SNAPPY_LIBRARY. Contributed by Vadim Bondarev.
new 945cb2e HADOOP-9485. No default value in the code for hadoop.rpc.socket.factory.class.default. Contributed by Colin Patrick McCabe.
new 2638bc6 YARN-634. Modified YarnRemoteException to be not backed by PB and introduced a separate SerializedException record. Contributed by Siddharth Seth. MAPREDUCE-5239. Updated MR App to reflect YarnRemoteException changes after YARN-634. Contributed by Siddharth Seth.
new a35c7fd YARN-663. Changed ResourceTracker API and LocalizationProtocol API to throw YarnRemoteException and IOException. Contributed by Xuan Gong.
new 6814898 YARN-590. Added an optional mesage to be returned by ResourceMaanger when RM asks an RM to shutdown/resync etc so that NMs can log this message locally for better debuggability. Contributed by Mayank Bansal.
new 47d1ca4 MAPREDUCE-5208. Modified ShuffleHandler to use SecureIOUtils for reading local files. Contributed by Omkar Vinit Joshi.
new 7359dc3 MAPREDUCE-4067. Changed MRClientProtocol api to throw IOException only (Xuan Gong via vinodkv)
new 6521b5e HDFS-4765. Permission check of symlink deletion incorrectly throws UnresolvedLinkException. Contributed by Andrew Wang.
new 0959353 HDFS-4300. TransferFsImage.downloadEditsToStorage should use a tmp file for destination. Contributed by Andrew Wang.
new d027b94 HDFS-4805. Webhdfs client is fragile to token renewal errors. Contributed by Daryn Sharp.
new 2103c80 MAPREDUCE-5220. Setter methods in TaskCompletionEvent are public in MR1 and protected in MR2. (sandyr via tucu)
new 6f236b2 YARN-597. TestFSDownload fails on Windows due to dependencies on tar/gzip/jar tools. Contributed by Ivan Mitic.
new 14d856b MAPREDUCE-5240. Fix a bug in MRAppMaster because of which OutputCommitter could not access credentials set by the user. Contributed by Vinod Kumar Vavilapalli.
new 1a119f8 YARN-615. Rename ContainerLaunchContext.containerTokens to tokens. Contributed by Vinod Kumar Vavilapalli.
new febf951 MAPREDUCE-5222. Bring back some methods and constants in Jobclient for binary compatibility with mapred in 1.x. Contributed by Karthik Kambatla.
new 8a4ff65 HADOOP-9459. ActiveStandbyElector can join election even before Service HEALTHY, and results in null data at ActiveBreadCrumb. Contributed by Vinay and Todd Lipcon.
new d89fd7b HADOOP-9560. metrics2#JvmMetrics should have max memory size of JVM. Contributed by Tsuyoshi Ozawa.
new e29170e HADOOP-9307. BufferedFSInputStream.read returns wrong results after certain seeks. Contributed by Todd Lipcon.
new d5a6e76 HADOOP-9220. Unnecessary transition to standby in ActiveStandbyElector. Contributed by Tom White and Todd Lipcon.
new 3472800 MAPREDUCE-5244. Two functions changed their visibility in JobStatus. (zjshen via tucu)
new 4d8e350 MAPREDUCE-5232. Add a configuration to be able to log classpath and other system properties on mapreduce JVMs startup. Contributed by Sangjin Lee.
new 5c82a0c HDFS-4813. Add volatile to BlocksMap.blocks so that the replication thread can see the updated value. Contributed by Jing Zhao
new f7af4a0 HDFS-3180. Add socket timeouts to WebHdfsFileSystem. Contributed by Chris Nauroth
new c9ace69 HADOOP-9563. Fix incompatibility introduced by HADOOP-9523. Contributed by Tian Hong Wang.
new da05873 HDFS-4826. TestNestedSnapshots times out due to repeated slow edit log flushes when running on virtualized disk. Contributed by Chris Nauroth
new 065747e YARN-628. Fix the way YarnRemoteException is being unrolled to extract out the underlying exception. Contributed by Siddharth Seth.
new 2245fcc Move HDFS-347 and related JIRAs to 2.0.5 section of CHANGES.txt after backport
new 58e191f HDFS-4787. Create a new HdfsConfiguration before each TestDFSClientRetries testcases. Contributed by Tian Hong Wang.
new 3641f93 YARN-690. RM exits on token cancel/renew problems (daryn via bobby)
new 0cd0f64 HDFS-4830. Typo in config settings for AvailableSpaceVolumeChoosingPolicy in hdfs-default.xml. Contributed by Aaron T. Myers.
new 4e419b3 HADOOP-9566. Performing direct read using libhdfs sometimes raises SIGPIPE (which in turn throws SIGABRT) causing client crashes. Contributed by Colin Patrick McCabe.
new 9fdb117 HDFS-4824. FileInputStreamCache.close leaves dangling reference to FileInputStreamCache.cacheCleaner. Contributed by Colin Patrick McCabe.
new ca80246 YARN-617. Made ContainerTokens to be used for validation at NodeManager also in unsecure mode to prevent AMs from faking resource requirements in unsecure mode. Contributed by Omkar Vinit Joshi.
new 0b668c2 MAPREDUCE-5234. Change mapred.TaskReport and mapreduce.TaskReport for binary compatibility with mapred in 1.x but incompatible with 0.23.x. Contributed by Mayank Bansal.
new ca2265b MAPREDUCE-4927. Historyserver 500 error due to NPE when accessing specific counters page for failed job. Contributed by Ashwin Shankar
new 9cf436a MAPREDUCE-5257. Fix issues in TestContainerLauncherImpl after YARN-617. Contributed by Omkar Vinit Joshi.
new f9ab715 YARN-568. Followup; remove an unused field added to Allocation
new 6517c3f MAPREDUCE-5191. TestQueue#testQueue fails with timeout on Windows. (Contributed by Ivan Mitic)
new e5ed91a YARN-695. Remove masterContainer and status unused fields from ApplicationReportProto and fix bugs in ApplicationReportPBImpl. Contributed by Zhijie Shen.
new 98a692f HDFS-3875. Issue handling checksum errors in write pipeline. Contributed by Kihwal Lee.
new 6377bfc MAPREDUCE-5235. Bring back old fields and exceptions in Counters for binary compatibility with mapred in 1.x. Contributed by Mayank Bansal
new c665b0e YARN-706. Fixed race conditions in TestFSDownload. Contributed by Zhijie Shen.
new 4a4e42d MAPREDUCE-5261. Fix issues in TestRMContainerAllocator after YARN-617. Contributed by Omkar Vinit Joshi.
new 27e6673 MAPREDUCE-5156. Change hadoop examples ProgramDriver to be able to run 1.x examples jar on top of YARN. This change breaks 0.23.x direct usages of ProgramDriver. Contributed by Zhijie Shen.
new aa11e05 Move some of the jiras merged into branch-2 to appropriate 2.x section in CHANGES.txt
new 8c62c46 HDFS-4298. StorageRetentionManager spews warnings when used with QJM. Contributed by Aaron T. Myers.
new 1fac1ac YARN-708. Moved RecordFactory classes to hadoop-yarn-api, and put some miscellaneous fixes to the interfaces. Contributed by Siddharth Seth.
new 132e38e YARN-708. Deleting files that were supposed to removed in the previous commit.
new 9b28415 MAPREDUCE-5233. Add methods that are changed or removed from JobControl.Job when compared to 1.x. This breaks 0.23.x users of one API in Job. Contributed by Mayank Bansal.
new 8a430d0 YARN-716. Fixed unit test failures - TestDistributedShell and TestUnmanagedAMLauncher. Contributed by Vinod Kumar Vavilapalli.
new d1ff045 Fixed incorrect jira in CHANGES.txt (YARN-716 to YARN-715)
new 4387677 YARN-563. Add the concept of an application-type for each application. Contributed by Mayank Bansal. MAPREDUCE-5246. Specify application-type at the time of job submission after YARN-563. Contributed by Mayank Bansal.
new 10d21ac HADOOP-9593 stack trace printed at ERROR for all yarn clients without hadoop.home set
new 2ad7397 HDFS-4807. createSocketForPipeline() should not include timeout extension on connect. Contributed by Cristina Abad.
new 52cbb90 YARN-548. Add tests for YarnUncaughtExceptionHandler (Vadim Bondarev via jeagles)
new 359ea88 HDFS-4714. Log short messages in Namenode RPC server for exceptions meant for clients. Contributed by Kihwal Lee.
new 61885df YARN-711. Copied BuilderUtil methods in individual API records as BuilderUtils is going to be dismantled. Contributed by Jian He.
new a791527 MAPREDUCE-5230. Bring back NLineInputFormat.createFileSplit for binary compatibility with mapred in 1.x Contributed by Mayank Bansal.
new 259edf8 YARN-571. Remove user from ContainerLaunchContext. Contributed by Omkar Vinit Joshi.
new 643155c MAPREDUCE-5270. Migrated MR app from using BuilderUtil factory methods to individual record factory methods. Contributed by Jian He.
new e339d71 Update hadoop-common CHANGES.txt after merging HADOOP-8562
new e1d5aca HADOOP-8562. Fix CHANGES.txt to move 8562 and related tasks to 2.0.5 section
new a5d7b6e HADOOP-8562. Moved related jiras to 2.0.5 section in CHANGES.txt
new 9a43df8 HDFS-4825. webhdfs / httpfs tests broken because of min block size change. Contributed by Andrew Wang.
new 45b9d19 HDFS-4780. Use the correct relogin method for services. Contributed by Robert Parker.
new 4bb7221 HDFS-4827. Slight update to the implementation of API for handling favored nodes in DFSClient. Contributed by Devaraj Das.
new 0edae7a MAPREDUCE-5237. Add methods that were removed from ClusterStatus back into 2.x so as to be compatible with 1.x. Contributed by Zhijie Shen. Incompatible as ClusterStatus.UNINITIALIZED_MEMORY_VALUE is a long now and so breaks 0.23.x but it shouldn't be a big deal in reality.
new edc6d7d YARN-422. Add a NM Client library to help application-writers. Contributed by Zhijie Shen.
new 31c9682 YARN-512. Log aggregation root directory check is more expensive than it needs to be. Contributed by Maysam Yabandeh
new 5b1b197 HDFS-4865. Remove sub resource warning from httpfs log at startup time. (ywskycn via tucu)
new 973017c HDFS-4842. Identify the correct prior snapshot when deleting a snapshot under a renamed subtree. Contributed by Jing Zhao.
new 719034c HDFS-4846. Clean up snapshot CLI commands output stacktrace for invalid arguments. Contributed by Jing Zhao
new 01f27f5 HDFS-4857. Snapshot.Root and AbstractINodeDiff#snapshotINode should not be put into INodeMap when loading FSImage. Contributed by Jing Zhao
new 5420f28 YARN-578. Fixed NM to use SecureIOUtils for reading and aggregating logs. Contributed by Omkar Vinit Joshi.
new fdfedf4 HADOOP-9574. Added new methods in AbstractDelegationTokenSecretManager for helping YARN ResourceManager to reuse code for RM restart. Contributed by Jian He.
new a720a52 MAPREDUCE-5263. Bring back old methods and fields in filecache.DistributedCache for binary compatibility with mapred in 1.x. Contributed by Zhijie Shen.
new a0abed4 HDFS-4863. The root directory should be added to the snapshottable directory list while loading fsimage. Contributed by Jing Zhao
new 1858c7e YARN-714. Added NMTokens to be sent to AMs as part of heart-beat response. Contributed by Omkar Vinit Joshi.
new 29902cd YARN-638. Modified ResourceManager to restore RMDelegationTokens after restarting. Contributed by Jian He.
new 9ae713e HADOOP-9574. Fix for timing issues in the original patch's test-case.
new b16c563 YARN-719. Move RMIdentifier from Container to ContainerTokenIdentifier. Contributed by Vinod Kumar Vavilapalli.
new bf99961 HDFS-4848. copyFromLocal and renaming a file to .snapshot should output that .snapshot is a reserved name. Contributed by Jing Zhao
new 2fb2a5a HADOOP-9607. Fixes in Javadoc build. Contributed by Timothy St. Clair
new 9f551fa HADOOP-9605. Update junit dependency. Contributed by Timothy St. Clair.
new 982753d YARN-716. Making ApplicationID immutable. Contributed by Siddharth Seth. MAPREDUCE-5282. Updating MR App to use immutable ApplicationID after YARN-716. Contributed by Siddharth Seth.
new 131bfc9 MAPREDUCE-5261. Reverting the patch as it is no longer needed.
new 85623a2 HADOOP-9287. Parallel-testing hadoop-common. Contributed by Andrey Klochkov
new 4394e5e MAPREDUCE-5228. Bring back FileInputFormat.Counter and FileOuputFormat.Counter for binary compatibility with 1.x mapred APIs. Contributed by Mayank Bansal.
new 14da7b7 HADOOP-7391 Document Interface Classification from HADOOP-5073 (sanjay Radia)
new 2692675 YARN-684. ContainerManager.startContainer should use ContainerTokenIdentifier instead of the entire Container. Contributed by Vinod Kumar Vavilapalli.
new f3f7a11 MAPREDUCE-5286. Change MapReduce to use ContainerTokenIdentifier instead of the entire Container in the startContainer call - YARN-684. Contributed by Vinod Kumar Vavilapalli.
new e188287 Move snapshot JIRAs to 2.0.5 section in CHANGES.txt.
new 0a452a3 MAPREDUCE-5176. Add annotation for tagging tasks as responsive to preemption. Contributed by Carlo Curino, cdouglas
new 781e82c YARN-392. Make it possible to specify hard locality constraints in resource requests. (sandyr via tucu)
new 73b8895 MAPREDUCE-5275. Bring back a couple of APIs in mapreduce.security.TokenCache for binary compatibility with 1.x mapreduce APIs. Contributed by Mayank Bansal.
new b65e7ed MAPREDUCE-5231. Bring back a constructor in mapred's DBInputFormat.DBRecordReader for binary compatibility with 1.x mapred APIs. Contributed by Zhijie Shen.
new 39f019f YARN-735. Make ApplicationAttemptId, ContainerId and NodeId immutable. Contributed by Jian He.
new b8e9f06 MAPREDUCE-5273. Bring back a couple of protected variables in mapred and mapreduce CombineFileRecordReader for binary compatibility with 1.x APIs. Contributed by Mayank Bansal.
new a77030a MAPREDUCE-5280. Bring back removed constructor and a method in mapreduce ClusterMetrics for binary compatibility with 1.x APIs. Contributed by Mayank Bansal.
new 3492f5e YARN-660. Improve AMRMClient with matching requests (bikas)
new aba8b6e Adding 2.0.5-alpha release to CHANGES.txt files of trunk
new a2c4233 YARN-717. Put object creation factories for Token in the class itself and remove useless derivations for specific tokens. Contributed by Jian He. MAPREDUCE-5289. Updated MR App to use Token directly after YARN-717. Contributed by Jian He.
new 3dce234 YARN-733. Fixed TestNMClient from failing occasionally. Contributed by Zhijie Shen.
new 8267117 MAPREDUCE-5229. Put back FileOutputCommitter.TEMP_DIR_NAME in mapreduce for binary compatibility with 1.x APIs. Contributed by Zhijie Shen.
new 05cdca0 MAPREDUCE-5274. Bring back SecureShuffleUtils.toHex in mapreduce for binary compatibility with 1.x APIs. Contributed by Mayank Bansal.
new 97f9f49 Move HDFS-4826 to 2.1.0-beta.
new f27e484 YARN-749. Rename ResourceRequest.(get,set)HostName to ResourceRequest.(get,set)ResourceName. Contributed by Arun C. Murthy.
new a2205a3 YARN-720 and MAPREDUCE-5291. container-log4j.properties should not refer to mapreduce properties. Update MRApp to use YARN properties for log setup. Contributed by Zhijie Shen.
new 52b189d YARN-730. Fix NMClientAsync to remove completed containers. Contributed by Zhijie Shen.
new 22e9000 Move HADOOP-8469 and HADOOP-8470 to 2.1.0-beta in CHANGES.txt.
new 6c4f5e4 Move node group block placement JIRAs to 2.1.0-beta in CHANGES.txt.
new ac44e0a MAPREDUCE-5268. Improve history server startup performance. Contributed by Karthik Kambatla
new 15f9d90 Move HADOOP-9397 to 2.1.0-beta after merging it into branch-2.
new 9a3379f MAPREDUCE-5036. Default shuffle handler port should not be 8080. Contributed by Sandy Ryza.
new a7bfb25 HDFS-3934. duplicative dfs_hosts entries handled wrong. (cmccabe)
new 4c13c98 Add needed file for HDFS-3934 (cmccabe)
new c1b635e YARN-326. Add multi-resource scheduling to the fair scheduler. (sandyr via tucu)
new 4ee1ec2 Remove extra code that code erroneously committed in HDFS-3934 (cmccabe)
new 4a14264 YARN-398. Make it possible to specify hard locality constraints in resource requests for CapacityScheduler. Contributed by Arun C. Murthy.
new 8db62b0 HADOOP-9614. smart-test-patch.sh hangs for new version of patch (2.7.1) (Ravi Prakash via jeagles)
new 0add6b4 MAPREDUCE-5220. Fix backward incompatibility for TaskCompletionEvent by adding back setTaskID. Contributed by Zhijie Shen.
new 1caf3e3 MAPREDUCE-5296. Fix backward incompatibility for JobControl by adding the omitted addJob. Contributed by Zhijie Shen.
new 78331cf MAPREDUCE-5300. Fix backward incompatibility for o.a.h.mapreduce.filecache.DistributedCache. Contributed by Zhijie Shen.
new 03375f18 MAPREDUCE-5299. Changed jira number for the commit in CHANGES.txt.
new 561be84 MAPREDUCE-5300. Moved to INCOMPATIBLE CHANGES section in CHANGES.txt.
new 5cf48b4 YARN-726. Fix queue & finish time fields in web-ui for ResourceManager. Contributed by Mayank Bansal.
new 72e1568 MAPREDUCE-5245. Added back constants to JobConf to fix incompatibilities. Contributed by Zhijie Shen.
new d33534c YARN-748. Moved BuilderUtils from yarn-common to yarn-server-common for eventual retirement. Contributed by Jian He. MAPREDUCE-5297. Updated MR App since BuilderUtils is no longer public after YARN-748. Contributed by Jian He.
new 8962f5c Move HADOOP-9287 in CHANGES.txt after committing to branch-2
new cd0220f HADOOP-9481. Move from trunk to release 2.1.0 section
new c71fb19 YARN-757. Changed TestRMRestart to use the default scheduler to avoid test failures. Contributed by Bikas Saha.
new 78dacea MAPREDUCE-5283. Over 10 different tests have near identical implementations of AppContext. Committed by Sandy Ryza
new a83fb61 YARN-635. Renamed YarnRemoteException to YarnException. Contributed by Siddharth Seth. MAPREDUCE-5301. Updated MR code to work with YARN-635 changes of renaming YarnRemoteException to YarnException. Contributed by Siddharth Seth
new 5c097a1 YARN-635 and MAPREDUCE-5301. Bug fix as the committed patch ended up being stale.
new 28aabe0 YARN-756. Move Preemption* records to yarn.api where they really belong. Contributed by Jian He.
new 978012b YARN-755. Renamed AllocateResponse.reboot to AllocateResponse.resync. Contributed by Bikas Saha.
new 78063b3 YARN-742. Log aggregation causes a lot of redundant setPermission calls. Contributed by Jason Lowe.
new af65d6f YARN-756. Remnants from moving Preemption* records to yarn.api where they really belong. Contributed by Jian He.
new c4382e7 HDFS-4840. ReplicationMonitor gets NPE during shutdown. Contributed by Kihwal Lee.
new 707b310 YARN-753. Added individual factory methods for all api protocol records and converted the records to be abstract classes. Contributed by Jian He.
new 66de4cc YARN-724. Moved ProtoBase from api.records to api.records.impl.pb. Contributed by Jian He. MAPREDUCE-5303. Changed MR app after moving ProtoBase to package impl.pb via YARN-724. Contributed by Jian He.
new 8171203 HDFS-4815. TestRBWBlockInvalidation: Double call countReplicas() to fetch corruptReplicas and liveReplicas is not needed. Contributed by Tian Hong Wang.
new e00f828 HDFS-4876. Fix the javadoc of FileWithSnapshot and move FileDiffList to FileWithSnapshot.
new 5fc3c47 Updating release date for 0.23.8
new 496b80b HDFS-4850. Fix OfflineImageViewer to work on fsimages with empty files or snapshots. Contributed by Jing Zhao.
new 53b0dc7 HDFS-4053. Move the jira description to release 2.1.0 section
new 5f22320 HADOOP-9593. Changing CHANGES.txt to reflect merge to branch-2.1-beta.
new cda2564 Move HADOP-9131, HADOOP-8957 to release 2.0.1 section and HADOOP-9607, HADOOP-9605 to BUG FIXES
new 8f201a0 HADOOP-9526. TestShellCommandFencer and TestShell fail on Windows. Contributed by Arpit Agarwal.
new ba6bd09 HADOOP-8982. TestSocketIOWithTimeout fails on Windows. Contributed by Chris Nauroth.
new 98f5579 YARN-764. blank Used Resources on Capacity Scheduler page (Nemon Lou via tgraves)
new 2051fd5 YARN-750. Allow for black-listing resources in YARN API and Impl in CS (acmurthy via bikas)
new d46e160 HDFS-4877. Snapshot: fix the scenario where a directory is renamed under its prior descendant. Contributed by Jing Zhao.
new 8854c21 HDFS-4867. metaSave NPEs when there are invalid blocks in repl queue. Contributed by Plamen Jeliazkov and Ravi Prakash.
new 91a4da5 YARN-761. TestNMClientAsync fails sometimes (Zhijie Shen via bikas)
new 9fcfbf5 YARN-759. Create Command enum in AllocateResponse (bikas)
new 0e889e7 HDFS-4862. SafeModeInfo.isManual() returns true when resources are low even if it wasn't entered into manually. Contributed by Ravi Prakash.
new e44f5e4 HDFS-4586. Moved the jira to release 2.1.0 section
new a8c330f YARN-760. NodeManager throws AvroRuntimeException on failed start. Contributed by Niranjan Singh
new a764da1 HDFS-4880. Print the image and edits file loaded by the namenode in the logs. Contributed by Arpit Agarwal.
new 2a76cdd HDFS-4832. Namenode doesn't change the number of missing blocks in safemode when DNs rejoin or leave. Contributed by Ravi Prakash.
new af8514e YARN-686. Flatten NodeReport. (sandyr via tucu)
new 8ef140d HADOOP-9509. Implement ONCRPC and XDR. Contributed by Brandon Li
new 176315d YARN-777. Removed unreferenced objects from .proto files. Contributed by Jian He.
new 0b0be8d YARN-642. Removed health parameter from ResourceManager /nodes web-service and cleaned the behaviour of the status parameter. Contributed by Sandy Ryza.
new 74e8810 HADOOP-9599. hadoop-config.cmd doesn't set JAVA_LIBRARY_PATH correctly. Contributed by Mostafa Elhemali.
new d00d968 MAPREDUCE-5312. TestRMNMInfo is failing. (sandyr via tucu)
new cb11d68 HDFS-4677. Editlog should support synchronous writes. Contributed by Ivan Mitic.
new f3b322e Setting release date for 2.0.5-alpha release
new b088524 HADOOP-9581. hadoop --config non-existent directory should result in error. Contributed by Ashwin Shankar
new c0737b0 MAPREDUCE-5308. Shuffling to memory can get out-of-sync when fetching multiple compressed map outputs. Contributed by Nathan Roberts
new 8e23270 HDFS-4752. TestRBWBlockInvalidation fails on Windows due to file locking. Contributed by Chris Nauroth.
new 5ab67b5 HADOOP-9604. Javadoc of FSDataOutputStream is slightly inaccurate. Contributed by Jingguo Yao.
new 8e0f166 HDFS-4878. On Remove Block, block is not removed from neededReplications queue. Contributed by Tao Luo.
new a841be8 HADOOP-9630. [RPC v9] Remove IpcSerializationType. (Junping Du via llu)
new c6c41ab YARN-737. Throw some specific exceptions directly instead of wrapping them in YarnException. Contributed by Jian He.
new 59bd35d HADOOP-9625. HADOOP_OPTS not picked up by hadoop command. Contributed by Paul Han
new 723ef66 MAPREDUCE-5315. DistCp reports success even on failure. (mithun and jlowe via daryn)
new 6f59922 MAPREDUCE-5315. DistCp reports success even on failure. (mithun and jlowe via daryn)
new 0c88f38 HADOOP-9635. Fix potential stack overflow in DomainSocket.c (V. Karthik Kumar via cmccabe)
new 390eca2 HDFS-4873. callGetBlockLocations returns incorrect number of blocks for snapshotted files. Contributed by Jing Zhao.
new 25946da YARN-767. Initialize application metrics at RM bootup. Contributed by Jian He.
new 6d4d870 YARN-731. RPCUtil.unwrapAndThrowException should unwrap remote RuntimeExceptions. Contributed by Zhijie Shen.
new e75ee47 YARN-795. Fair scheduler queue metrics should subtract allocated vCores from available vCores. (ywskycn via tucu)
new f9186f3 HDFS-4819. Update Snapshot doc to clarify that nested snapshots are not allowed.
new b90755c YARN-427. Coverage fix for org.apache.hadoop.yarn.server.api.* (Aleksey Gorshkov via jeagles)
new c5821cf HADOOP-9638. Parallel test changes caused invalid test path for several HDFS tests on Windows. Contributed by Andrey Klochkov.
new c9fce67 MAPREDUCE-5304. mapreduce.Job killTask/failTask/getTaskCompletionEvents methods have incompatible signature changes. (kkambatl via tucu)
new b090bc1 MAPREDUCE-5259. TestTaskLog fails on Windows because of path separators missmatch. Contributed by Ivan Mitic.
new 80eb92a YARN-600. Hook up cgroups CPU settings to the number of virtual cores allocated. (sandyr via tucu)
new 1ed916f YARN-700. TestInfoBlock fails on Windows because of line ending missmatch. Contributed by Ivan Mitic.
new 1104c7d YARN-648. FS: Add documentation for pluggable policy. (kkambatl via tucu)
new 5244bf6 Port HDFS-4878 to branch-0.23.9.
new 0928502 YARN-530. Defined Service model strictly, implemented AbstractService for robust subclassing and migrated yarn-common services. Contributed by Steve Loughran. YARN-117. Migrated rest of YARN to the new service model. Contributed by Steve Louhran. MAPREDUCE-5298. Moved MapReduce services to YARN-530 stricter lifecycle. Contributed by Steve Loughran.
new 686ac31 YARN-746. Renamed Service.register() and Service.unregister() to registerServiceListener() & unregisterServiceListener() respectively. Contributed by Steve Loughran.
new 7e1744c HDFS-4902. DFSClient#getSnapshotDiffReport should use string path rather than o.a.h.fs.Path. Contributed by Binglin Chang.
new b64572b MAPREDUCE-5199. Removing ApplicationTokens file as it is no longer needed. Contributed by Daryn Sharp.
new 8dc0d5a MAPREDUCE-4019. -list-attempt-ids is not working. Contributed by Ashwin Shankar, Devaraj K, and B Anil Kumar
new c0cd68d YARN-773. Moved YarnRuntimeException from package api.yarn to api.yarn.exceptions. Contributed by Jian He.
new f0eb4bc YARN-692. Creating NMToken master key on RM and sharing it with NM as a part of RM-NM heartbeat. Contributed by Omkar Vinit Joshi.
new 4cd6054 HDFS-4845. FSNamesystem.deleteInternal should acquire write-lock before changing the inode map. Contributed by Arpit Agarwal
new e9f753a YARN-792. Moved NodeHealthStatus from yarn.api.record to yarn.server.api.record. Contributed by Jian He.
new aa14698 YARN-812. Set default logger for application summary logger to hadoop.root.logger. Contributed by Siddarth Seth.
new 2166fa2 MAPREDUCE-5319. Set user.name in job.xml. Contributed by Xuan Gong.
new 710a5ee YARN-782. vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way. (sandyr via tucu)
new fdc9412 YARN-806. Moved ContainerExitStatus from yarn.api to yarn.api.records. Contributed by Jian He.
new 0ef156a HDFS-4783. TestDelegationTokensWithHA#testHAUtilClonesDelegationTokens fails on Windows. Contributed by Chris Nauroth.
new 334de8d ARN-803. factor out scheduler config validation from the ResourceManager to each scheduler implementation. (tucu)
new 079ed1c MAPREDUCE-5310. MRAM should not normalize allocation request capabilities. (tucu)
new b9753e5 YARN-789. Enable zero capabilities resource requests in fair scheduler. (tucu)
new 0d1a994 HDFS-4904. Remove JournalService. Contributed by Arpit Agarwal.
new 65b225c HADOOP-9646: Inconsistent exception specifications in FileUtils#chmod
new 6bc12bc add CHANGES.txt description for HADOOP-9646. (Colin Patrick McCabe)
new 5e72bfc revert HADOOP-9646 to fix hadoop-streaming compile issue
new b503b6a YARN-639. Modified Distributed Shell application to start using the new NMClient library. Contributed by Zhijie Shen.
new 5694c34 HDFS-4866. Protocol buffer support cannot compile under C. Contributed by Arpit Agarwal.
new c2d0cf1 YARN-821. Renamed setFinishApplicationStatus to setFinalApplicationStatus in FinishApplicationMasterRequest for consistency. Contributed by Jian He.
new 29a3708 YARN-781. Exposing LOGDIR in all containers' environment which should be used by containers for logging purposes. Contributed by Jian He.
new 1a38930 MAPREDUCE-5192. Allow for alternate resolutions of TaskCompletionEvents. Contributed by Chris Douglas.
new 769a0bd YARN-693. Modified RM to send NMTokens on allocate call so that AMs can then use them for authentication with NMs. Contributed by Omkar Vinit Joshi.
new 18a4cb4 HADOOP-9632. TestShellCommandFencer will fail if there is a 'host' machine in the network. Contributed by Chuan Liu.
new 98d97d3 YARN-787. Removed minimum resource from RegisterApplicationMasterResponse. Contributed by Alejandro Abdelnur.
new 7f96128 MAPREDUCE-5184. Document compatibility for MapReduce applications in hadoop-2 vis-a-vis hadoop-1. Contributed by Zhijie Shen.
new e3769ea YARN-829. Renamed RMTokenSelector to be RMDelegationTokenSelector. Contributed by Zhijie Shen.
new 4aa7503 YARN-828. Removed the unsed YarnVersionAnnotation. Contributed by Zhijie Shen.
new ac0bbb7 YARN-823. Moved RMAdmin from yarn.client to yarn.client.cli and renamed it to be RMAdminCLI. Contributed by Jian He.
new 02f8768 YARN-752. In AMRMClient, automatically add corresponding rack requests for requested nodes. (sandyr via tucu)
new 789c034 MAPREDUCE-5171. Expose blacklisted nodes from the MR AM REST API. (sandyr via tucu)
new 77e134d YARN-387. Renamed YARN protocols for consistency. Contributed by Vinod K V.
new 6b75a5c YARN-831. Removed minimum resource from GetNewApplicationResponse as a follow-up to YARN-787. Contributed Jian He.
new ff70f91 YARN-824. Added static factory methods to hadoop-yarn-client interfaces. Contributed by Jian He.
new f5f8f3b YARN-825. Fixed javadoc and annotations for yarn-common module. Contributed by Vinod Kumar Vavilapalli.
new d4a811e YARN-826. Moved Clock and SystemClock into yarn.util package. Contributed by Zhijie Shen.
new b9efe6b HADOOP-9649. Promoted YARN service life-cycle libraries into Hadoop Common for usage across all Hadoop projects. Contributed by Zhijie Shen.
new 4662b8b YARN-833. Moved Graph and VisualizeStateMachine into yarn.state package. Contributed by Zhijie Shen.
new cd30058 YARN-837. Moved yarn.ClusterInfo into MapReduce project as it doesn't belong to YARN. Contributed by Zhijie Shen.
new 423f2b1 HADOOP-9517. Documented various aspects of compatibility for Apache Hadoop. Contributed by Karthik Kambatla.
new 7801a73 Fix hadoop-yarn-project/CHANGES.txt for YARN-759
new eff5e6d HDFS-4875. Add a test for testing snapshot file length. Contributed by Arpit Agarwal.
new 7d0c43d YARN-822. Renamed ApplicationToken to be AMRMToken, and similarly the corresponding TokenSelector and SecretManager. Contributed by Omkar Vinit Joshi.
new 4d63b7a0 HADOOP-9515. Add general interface for NFS and Mount. Contributed by Brandon Li
new cdfc555 CHANGES.txt change for HADOOP-9515
new b02dc5b YARN-839. TestContainerLaunch.testContainerEnvVariables fails on Windows. Contributed by Chuan Liu.
new 5d1b453 YARN-610. ClientToken is no longer set in the environment of the Containers. Contributed by Omkar Vinit Joshi.
new 52ebd9c HDFS-4626. ClientProtocol#getLinkTarget should throw an exception for non-symlink and non-existent paths. (Andrew Wang via cmccabe)
new 2b14656 YARN-805. Fix javadoc and annotations on classes in the yarn-api package. Contributed by Jian He.
new 7ef54fa YARN-834. Fixed annotations for yarn-client module, reorganized packages and clearly differentiated *Async apis. Contributed by Arun C Murthy and Zhijie Shen.
new 364b379 HDFS-4818. Several HDFS tests that attempt to make directories unusable do not work correctly on Windows. Contributed by Chris Nauroth.
new acc0d3e YARN-840. Moved ProtoUtils to yarn.api.records.pb.impl. Contributed by Jian He.
new f4d80e9 YARN-841. Move Auxiliary service to yarn-api, annotate and document it. Contributed by Vinod Kumar Vavilapalli.
new 6451288 YARN-799. Fix CgroupsLCEResourcesHandler to use /tasks instead of /cgroup.procs. Contributed by Chris Riccomini.
new 2fd7f28 YARN-846. Move pb Impl classes from yarn-api to yarn-common. Contributed by Jian He.
new 52fe4e6 MAPREDUCE-5316. job -list-attempt-ids command does not handle illegal task-state. Contributed by Ashwin Shankar
new 1c309f7 HDFS-4906. HDFS Output streams should not accept writes after being closed. Contributed by Aaron T. Myers.
new 40cab68 YARN-850. Rename getClusterAvailableResources to getAvailableResources in AMRMClients (Jian He via bikas)
new 3ab7f86 HADOOP-9582. Non-existent file to "hadoop fs -conf" doesn't throw error. Contributed by Ashwin Shankar
new 2e99da4 HADOOP-9637. Adding Native Fstat for Windows as needed by YARN. Contributed by Chuan Liu.
new 44b9959 HADOOP-9624. TestFSMainOperationsLocalFileSystem failed when the Hadoop test root path has "X" in its name. Contributed by Xi Fang.
new 243bcd3 YARN-694. Starting to use NMTokens to authenticate all communication with NodeManagers. Contributed by Omkar Vinit Joshi.
new ab647cf YARN-848. Fix NodeManager to register with RM using the fully qualified hostname. Contributed by Hitesh Shah.
new 57006e1 HDFS-4461. DirectoryScanner: volume prefix takes up memory for every block that is scanned (Colin Patrick McCabe)
new 16616f9 MAPREDUCE-5194. Heed interrupts during Fetcher shutdown.
new a1667e5 Move jiras to the right section in CHANGES.txt and make it consistent with branch-2
new 571aa39 HDFS-4917. Start-dfs.sh cannot pass the parameters correctly. Contributed by Fengdong Yu.
new d3198dd YARN-553. Replaced YarnClient.getNewApplication with YarnClient.createApplication which provides a directly usable ApplicationSubmissionContext to simplify the api. Contributed by Karthik Kambatla.
new 1ab4659 MAPREDUCE-5084. fix coverage org.apache.hadoop.mapreduce.v2.app.webapp and org.apache.hadoop.mapreduce.v2.hs.webapp (Aleksey Gorshkov via jeagles)
new 9550b1a Clean up an IPC error message. Contributed by Aaron T. Myers.
new 2bf1f47 HADOOP-9264. Change attribution of HADOOP-9264 from trunk to 2.1.0-beta. (cnauroth)
new ed2c564 YARN-597. Change attribution of YARN-597 from trunk to release 2.1.0-beta in CHANGES.txt. (cnauroth)
new 51c85ca YARN-852. TestAggregatedLogFormat.testContainerLogsFileAccess fails on Windows. Contributed by Chuan Liu.
new be3a8b6 Fix up a little test failure.
new 84862b5 MAPREDUCE-5334. Fix failing unit tests - TestContainerLauncher, TestContainerLauncherImpl. Contributed by Vinod Kumar Vavilapalli.
new d9021f8 Move HADOOP-8608 to branch-2.1
new 3843df8 Cleanup CHANGES.txt and move some of the jiras to the right section
new 3f80966 YARN-854. Fixing YARN bugs that are failing applications in secure environment. Contributed by Omkar Vinit Joshi.
new c68b1d1 HDFS-4914. Use DFSClient.Conf instead of Configuration.
new c02953d HDFS-4908. Reduce snapshot inode memory usage.
new 90fd863 YARN-478. fix coverage org.apache.hadoop.yarn.webapp.log (Aleksey Gorshkov via jeagles)
new 575495b YARN-861. TestContainerManager is failing. Contributed by Vinod Kumar Vavilapalli.
new 1a06175 YARN-851. Share NMTokens using NMTokenCache (api-based) between AMRMClient and NMClient instead of memory based approach which is used currently. Contributed by Omkar Vinit Joshi.
new 6ecf78a HDFS-4772. Add number of children in HdfsFileStatus. Contributed by Brandon Li
new 92cbba3 HDFS-4883. complete() should verify fileId. Contributed by Tao Luo.
new 3a06308 Move changes for HDFS-4883 to 2.1.0 section.
new 066f970 YARN-866. Add test for class ResourceWeights. (ywskycn via tucu)
new 37d7935 YARN-827. Need to make Resource arithmetic methods accessible^CJian He via bikas)
new b194cbc Update CHANGES.txt to move HDFS-4772 to 2.1.0 section
new 6cb5ad1 HADOOP-9619 Mark stability of .proto files (sanjay Radia)
new 5f9b4c1 HADOOP-9421. [RPC v9] Convert SASL to use ProtoBuf and provide negotiation capabilities (daryn)
new ba44df9 Deleting files missed for YARN-827
new 1087be1 HDFS-4205. fsck fails with symlinks. Contributed by Jason Lowe
new 87d67c8 MiniYARNCluster broken after YARN-827 (bikas)
new ca35235 HADOOP-9439. JniBasedUnixGroupsMapping: fix some crash bugs (Colin Patrick McCabe)
new e60fbbc YARN-736. Add a multi-resource fair sharing metric. (sandyr via tucu)
new 2c6a4e1 HADOOP-9661. Allow metrics sources to be extended. (sandyr via tucu)
new bf11465 HADOOP-9355. Abstract symlink tests to use either FileContext or FileSystem. (Andrew Wang via Colin Patrick McCabe)
new d74908b HDFS-4927. CreateEditsLog creates inodes with an invalid inode ID, which then cannot be loaded by a namenode. Contributed by Chris Nauroth.
new 8df9a8e HADOOP-9656. Gridmix unit tests fail on Windows and Linux. Contributed by Chuan Liu.
new 0360113 HADOOP-9355. Abstract Symlink tests to use either FileContext or FileSystem (Andrew Wang via Colin Patrick McCabe)
new b3a8d99 YARN-874. Making common RPC to switch to not switch to simple when other mechanisms are enabled and thus fix YARN/MR test failures after HADOOP-9421. Contributed by Daryn Sharp and Vinod Kumar Vavilapalli.
new 11bcd2e MAPREDUCE-5326. Added version to shuffle header. Contributed by Zhijie Shen.
new f3a893b YARN-869. Move ResourceManagerAdministrationProtocol out of main YARN api. Contributed by Vinod K V.
new c918b5c Preparing for hadoop-2.1.0-beta release.
new 84b28cb Release notes for hadoop-2.1.0-beta.
new ca1058b HDFS-4932. Avoid a wide line on the name node webUI if we have more Journal nodes. Contributed by Fengdong Yu.
new b6c7de68bc HADOOP-9673. NetworkTopology: When a node cannot be added, print out its location for diagnostic purposes
new 27a50a2 MAPREDUCE-5333. Add test that verifies MRAM works correctly when sending requests with non-normalized capabilities. (ywskycn via tucu)
new c221204 YARN-883. Expose Fair Scheduler-specific queue metrics. (sandyr via tucu)
new 1773893 HADOOP-9665. Fixed BlockDecompressorStream#decompress to return -1 rather than throw EOF at end of file. Contributed by Zhijie Shen.
new 28d5fa1 LF normalization according to .gitattributes
new 8eb3be6 YARN-877. Support resource blacklisting for FifoScheduler. (Junping Du via llu)
new 7504428 HDFS-4944. WebHDFS cannot create a file path containing characters that must be URI-encoded, such as space. Contributed by Chris Nauroth.
new feb5b96 HDFS-4797. BlockScanInfo does not override equals(..) and hashCode() consistently.
new aa7e148 Preparing for 0.23.9 release
new ead7fa0 HDFS-4888. Refactor and fix FSNamesystem.getTurnOffTip. Contributed by Ravi Prakash.
new 6735b70 HADOOP-9414. Refactor out FSLinkResolver and relevant helper methods.
new 805e9b5 HADOOP-9676. Make maximum RPC buffer size configurable (Colin Patrick McCabe)
new 4882305 HADOOP-9678. TestRPC#testStopsAllThreads intermittently fails on Windows. Contributed by Ivan Mitic.
new 05fd0a7 HDFS-4943. WebHdfsFileSystem does not work when original file path has encoded chars. Contributed by Jerry He
new 37f5875 HDFS-4762 Provide HDFS based NFSv3 and Mountd implementation. Contributed by Brandon Li
new 70e9e58 Add the missed file in commit r1499029
new 3628553 HADOOP-9681. FileUtil.unTarUsingJava() should close the InputStream upon finishing. Contributed by Chuan Liu.
new e846c98 MAPREDUCE-3193. FileInputFormat doesn't read files recursively in the input path dir. Contributed by Devaraj K
new a52d858 HADOOP-9660 [WINDOWS] Powershell / cmd parses -Dkey=value from command line as [-Dkey, value] which breaks GenericsOptionParser (enis)
new f047f9c MAPREDUCE-5355. MiniMRYarnCluster with localFs does not work on Windows. Contributed by Chuan Liu.
new 2c9e837 HDFS-4948. mvn site for hadoop-hdfs-nfs fails. Contributed by Brandon Li
new 06ea8ff MAPREDUCE-5359. JobHistory should not use File.separator to match timestamp in path. Contributed by Chuan Liu.
new 5b64e3c MAPREDUCE-5357. Job staging directory owner checking could fail on Windows.
new dda44d3 Add .classpath, .project, .settings and target to svn:ignore.
new cf4d0cf MAPREDUCE-5358. MRAppMaster throws invalid transitions for JobImpl. Contributed by Devaraj K
new 33fe54a HADOOP-9416. Add new symlink resolution methods in FileSystem and FileSystemLinkResolver. (awang via cmccabe)
new 5428bfb HDFS-4465. Optimize datanode ReplicasMap and ReplicaInfo. Contributed by Aaron T. Myers.
new eff5d9b YARN-845. RM crash with NPE on NODE_UPDATE (Mayank Bansal via bikas)
new ed70fb1 HDFS-4860. Add additional attributes to JMX beans. Contributed by Trevor Lorimer
new 81620ca HADOOP-8844. Add a plaintext fs -text test-case. Contributed by Akira AJISAKA. (harsh)
new e01cbda MAPREDUCE-5360. TestMRJobClient fails on Windows due to path format. Contributed by Chuan Liu.
new 6770de7 HDFS-4645. Move from randomly generated block ID to sequentially generated block ID. Contributed by Arpit Agarwal
new 4175e41 MAPREDUCE-5366. TestMRAsyncDiskService fails on Windows. Contributed by Chuan Liu.
new eb2a603 HADOOP-9688. Add globally unique Client ID to RPC requests. Contributed by Suresh Srinivas.
new c382945 HADOOP-9688. Adding a file missed in the commit 1500843
new e4e0499 MAPREDUCE-5187. Create mapreduce command scripts on Windows. Contributed by Chuan Liu.
new 5e4f6ad YARN-791. Changed RM APIs and web-services related to nodes to ensure that both are consistent with each other. Contributed by Sandy Ryza.
new 8fdd508 HDFS-4841. FsShell commands using secure webhfds fail ClientFinalizer shutdown hook. (rkanter via tucu)
new 31fff48 YARN-894. NodeHealthScriptRunner timeout checking is inaccurate on Windows. Contributed by Chuan Liu.
new 9b252b3 HADOOP-8440. HarFileSystem.decodeHarURI fails for URIs whose host contains numbers. Contributed by Ivan Mitic.
new 3ed7c6e HDFS-4951. FsShell commands using secure httpfs throw exceptions due to missing TokenRenewer. (rknater via tucu)
new e2cce7b YARN-727, MAPREDUCE-5325. ClientRMProtocol.getAllApplications should accept ApplicationType as a parameter. Contributed by Xuan Gong.
new 15ce82b YARN-369. Handle ( or throw a proper error when receiving) status updates from application masters that have not registered (Mayank Bansal & Abhishek Kapoor via bikas)
new 0a5f16a HADOOP-9691. RPC clients can generate call ID using AtomicInteger instead of synchronizing on the Client instance. Contributed by Chris Nauroth.
new 3a3109f HDFS-4887. TestNNThroughputBenchmark exits abruptly. Contributed by Kihwal Lee.
new 58d7557 HDFS-4962. Use enum for nfs constants. Contributed by Tsz Wo (Nicholas) SZE.
new 3ee5949 YARN-368. Fixed a typo in error message in Auxiliary services. Contributed by Albert Chu.
new dfe70f6 YARN-295. Fixed a race condition in ResourceManager RMAppAttempt state machine. Contributed by Mayank Bansal.
new c6eaa8b HDFS-4969. WebhdfsFileSystem expects non-standard WEBHDFS Json element. (rkanter via tucu)
new 36bd53a In CHANGES.txt, move HDFS-4908 and HDFS-4645 to 2.1.0-beta.
new 413bddf MAPREDUCE-4374. Fix child task environment variable config and add support for Windows. Contributed by Chuan Liu.
new 59a5ab9 updating CHANGES.txt after committing MAPREDUCE-5333,HADOOP-9661,HADOOP-9355,HADOOP-9673,HADOOP-9414,HADOOP-9416,HDFS-4797,YARN-866,YARN-736,YARN-883 to 2.1-beta branch
new 85f0efb YARN-569. Add support for requesting and enforcing preemption requests via a capacity monitor. Contributed by Carlo Curino, Chris Douglas
new da8e962 HDFS-4372. Track NameNode startup progress. Contributed by Chris Nauroth.
new 6ffe672 HADOOP-9432 Add support for markdown .md files in site documentation
new 7f42bef HADOOP-9720. Rename Client#uuid to Client#clientId. Contributed by Arpit Agarwal.
new 17420dc HDFS-4980. Incorrect logging.properties file for hadoop-httpfs. Contributed by Mark Grover.
new e1a1c33 HADOOP-9417. Support for symlink resolution in LocalFileSystem / RawLocalFileSystem. (Andrew Wang via Colin Patrick McCabe)
new 02f9eaa add HADOOP-9417 to CHANGES.txt
new 03c950d HADOOP-9186. test-patch.sh should report build failure to JIRA. (Binglin Chang via Colin Patrick McCabe)
new a834981 update CHANGES.txt to reflect the fact that HADOOP-9186 is only in trunk at the moment
new 19346d8 HDFS-4373. Add HTTP API for querying NameNode startup progress. Contributed by Chris Nauroth.
new 2409882 HDFS-4374. Display NameNode startup progress in UI. Contributed by Chris Nauroth.
new 8767e4c HADOOP-9418. Add symlink support to DistributedFileSystem (Andrew Wang via Colin Patrick McCabe)
new 1714932 YARN-333. Schedulers cannot control the queue-name of an application. (sandyr via tucu)
new 3630a23 HDFS-4978. Make disallowSnapshot idempotent. Contributed by Jing Zhao.
new b47df4e HDFS-4912. Cleanup FSNamesystem#startFileInternal. Contributed by Suresh Srinivas.
new 0880be2 HDFS-4982. JournalNode should relogin from keytab before fetching logs from other JNs. Contributed by Todd Lipcon.
new a038ec6 HADOOP-9703. org.apache.hadoop.ipc.Client leaks threads on stop (Tsuyoshi OZAWA via Colin Patrick McCabe)
new 2adee63 YARN-541. getAllocatedContainers() is not returning all the allocated containers (bikas)
new b980f2a YARN-763. AMRMClientAsync should stop heartbeating after receiving shutdown from RM (Xuan Gong via bikas)
new adfd2fa HADOOP-9241. DU refresh interval is not configurable. (harsh)
new fe735f2 YARN-654. AMRMClient: Perform sanity checks for parameters of public methods (Xuan Gong via bikas)
new 1db4319 YARN-909. Disable TestLinuxContainerExecutorWithMocks on Windows. Contributed by Chuan Liu.
new 37b2a96 HADOOP-9707. Fix register lists for crc32c inline assembly. Contributed by Todd Lipcon.
new 8a037ed MAPREDUCE-5317. Stale files left behind for failed jobs. Contributed by Ravi Prakash
new 1fe8e2d YARN-521. Augment AM - RM client module to be able to request containers only at specific locations (Sandy Ryza via bikas)
new 4466d86 YARN-523. Modified a test-case to validate container diagnostics on localization failures. Contributed by Jian He.
new 8f8be40 Trivial fix for minor refactor error for YARN-521
new afaec5f HDFS-4903. Print trash configuration and trash emptier state in namenode log. Contributed by Arpit Agarwal.
new 2d6049f HDFS-4992. Make balancer's mover thread count and dispatcher thread count configurable. Contributed by Max Lapan
new 44ea6e3 Back out revision 1503499 for MAPREDUCE-5317. Stale files left behind for failed jobs
new 3207613 HADOOP-9618. thread which detects GC pauses (Todd Lipcon via Colin Patrick McCabe)
new a3a9d72 HADOOP-9683. [RPC v9] Wrap IpcConnectionContext in RPC headers (daryn)
new badab7e HDFS-4657. Limit the number of blocks logged by the NN after a block report to a configurable value. (Aaron Twinning Meyers via Colin Patrick McCabe)
new 33b5a81 YARN-513. Create common proxy client for communicating with RM (Xuan Gong & Jian He via bikas)
new bf876f7 MAPREDUCE-5398. MR changes for YARN-513 (Jian He via bikas)
new af0d2fc YARN-661. Fixed NM to cleanup users' local directories correctly when starting up. Contributed by Omkar Vinit Joshi.
new 6d12709 YARN-820. Fixed an invalid state transition in NodeManager caused by failing resource localization. Contributed by Mayank Bansal.
new febc504 HADOOP-9734. Common protobuf definitions for GetUserMappingsProtocol, RefreshAuthorizationPolicyProtocol and RefreshUserMappingsProtocol. Contributed by Jason Lowe
new 865d902 MAPREDUCE-5380. Invalid mapred command should return non-zero exit code. Contributed by Stephen Chu
new 3520039 YARN-927. Change ContainerRequest to not have more than 1 container count and remove StoreContainerRequest (bikas)
new d26334b HDFS-4998. TestUnderReplicatedBlocks fails intermittently. Contributed by Kihwal Lee.
new 1b63242 HADOOP-9738. TestDistCh fails. Contributed by Jing Zhao.
new 8b9c1e6 YARN-62. Modified NodeManagers to avoid AMs from abusing container tokens for repetitive container launches. Contributed by Omkar Vinit Joshi.
new c6facfb YARN-912. Move client facing exceptions to yarn-api module. Contributed by Mayank Bansal.
new b767ee0 fix misspelling in CHANGES.txt
new 9f3e488 YARN-922. Change FileSystemRMStateStore to use directories (Jian He via bikas)
new 1c133ff YARN-865. RM webservices can't query based on application Types. Contributed by Xuan Gong.
new 68faa67 HDFS-5005. Move SnapshotException and SnapshotAccessControlException to o.a.h.hdfs.protocol. Contributed by Jing Zhao.
new a5cd4b9 HDFS-5003. TestNNThroughputBenchmark failed caused by existing directories. Contributed by Xi Fang.
new 7ec67c5 HADOOP-9716. Rpc retries should use the same call ID as the original call.
new 32bc200 YARN-701. Use application tokens irrespective of secure or non-secure mode. Contributed by Vinod K V.
new cc536fe MAPREDUCE-5265. History server admin service to refresh user and superuser group mappings. Contributed by Ashwin Shankar
new e2efe52 HDFS-4996. ClientProtocol#metaSave can be made idempotent by overwriting the output file instead of appending to it. Contributed by Chris Nauroth.
new ba3d29a HADOOP-9164. Print paths of loaded native libraries in NativeLibraryChecker. (Binglin Chang via llu)
new 8724ceb HADOOP-9717. Add retry attempt count to the RPC requests. Contributed by Jing Zhao.
new 7a29bcc YARN-814. Improving diagnostics when containers fail during launch due to various reasons like invalid env etc. Contributed by Jian He.
new ac914f7 YARN-918. Remove ApplicationAttemptId from RegisterApplicationMasterRequestProto. Contributed by Vinod K V.
new 87a0255 Fixed CHANGES.txt to reflect that all fixes in 2.1.1-beta are now in 2.1.0-beta.
new 31f29de Fixed CHANGES.txt to reflect that new content in branch-2 goes to hadoop-2.3.0.
new 7e2aba0 HDFS-5007. Replace hard-coded property keys with DFSConfigKeys fields. Contributed by Kousuke Saruta.
new 0dc5824 HDFS-4278. Log an ERROR when DFS_BLOCK_ACCESS_TOKEN_ENABLE config is disabled but security is turned on. Contributed by Kousuke Saruta. (harsh)
new aba3352 HADOOP-9748. Reduce blocking on UGI.ensureInitialized (daryn)
new 5b3e74e ADOOP-9643. org.apache.hadoop.security.SecurityUtil calls toUpperCase(Locale.getDefault()) as well as toLowerCase(Locale.getDefault()) on hadoop.security.authentication value. (markrmiller@gmail.com via tucu)
new 3c6e5b9 YARN-919. Document setting default heap sizes in yarn env.sh Contributed by Mayank Bansal.
new 9ff01d6 HADOOP-9751. Add clientId and retryCount to RpcResponseHeaderProto.
new 5b99672 YARN-897. Ensure child queues are ordered correctly to account for completed containers. Contributed by Djellel Eddine Difallah.
new 313dd02 HDFS-5010. Reduce the frequency of getCurrentUser() calls from namenode. Contributed by Kihwal Lee.
new 731a583 HDFS-4602. TestBookKeeperHACheckpoints fails. Contributed by Uma Maheswara Rao G.
new febcf4d HDFS-5018. Misspelled DFSConfigKeys#DFS_NAMENODE_STALE_DATANODE_INTERVAL_DEFAULT in javadoc of DatanodeInfo#isStale(). Contributed by Ted Yu.
new 3eb61be HADOOP-9754. Remove unnecessary "throws IOException/InterruptedException", and fix generic and other javac warnings.
new 7490621 HADOOP-9435. Support building the JNI code against the IBM JVM. (Tian Hong Wang via Colin Patrick McCabe)
new c1314eb HDFS-4817. Make HDFS advisory caching configurable on a per-file basis. (Colin Patrick McCabe)
new 11c0731 HDFS-5008. Make ClientProtocol#abandonBlock() idempotent. Contributed by Jing Zhao.
new 7727806 MAPREDUCE-5404. HSAdminServer does not use ephemeral ports in minicluster mode. Contributed by Ted Yu
new 65250d0 Fixing YARN CHANGES.txt. The general bug list got mixed up with HADOOP-8562 sub-tasks.
new 5b3bb05 YARN-853. Fixed CapacityScheduler's maximum-am-resource-percent to properly work beyond refreshing queues. Contributed by Devaraj K.
new ca35ed1 YARN-461. Fair scheduler should not accept apps with empty string queue name. (ywskycn via tucu)
new 9dbd2e7 HADOOP-9760. Move GSet and related classes to common from HDFS. Contributed by Suresh Srinivas.
new d35f66f HDFS-4974. Add Idempotent and AtMostOnce annotations to namenode protocol methods. Contributed by Suresh Srinivas.
new 0939c49 MAPREDUCE-5317. Stale files left behind for failed jobs. Contributed by Ravi Prakash
new a42e459 MAPREDUCE-5356. Ability to refresh aggregated log retention period and check interval. Contributed by Ashwin Shankar
new 77fa044 HADOOP-9759. Add support for NativeCodeLoader#getLibraryName on Windows. Contributed by Chuan Liu.
new 3ca3137 YARN-926. Modified ContainerManagerProtcol APIs to take in requests for multiple containers. Contributed by Jian He. MAPREDUCE-5412. Update MR app to use multiple containers API of ContainerManager after YARN-926. Contributed by Jian He.
new 3024030 HADOOP-9763. Extends LightWeightGSet to support eviction of expired elements. Contributed by Tsz Wo (Nicholas) SZE.
new 538653d HDFS-5020. Make DatanodeProtocol#blockReceivedAndDeleted idempotent. Contributed by Jing Zhao.
new a0a986d HADOOP-9762. RetryCache utility for implementing RPC retries. Contributed by Suresh Srinivas.
new 99416cc Fixing CHANGES.txt in hdfs
new 605fafb YARN-968. RM admin commands don't work. Contributed by Vinod Kumar Vavilapalli.
new ed65987 YARN-873. YARNClient.getApplicationReport(unknownAppId) returns a null report (Xuan Gong via bikas)
new 9c453d4 YARN-875. Application can hang if AMRMClientAsync callback thread has exception (Xuan Gong via bikas)
new c43c763 MAPREDUCE-5213. Re-assess TokenCache methods marked @Private. (kkambatl via tucu)
new cc0a0fc HADOOP-9701. mvn site ambiguous links in hadoop-common. (kkambatl via tucu)
new f138ae6 HDFS-5024. Make DatanodeProtocol#commitBlockSynchronization idempotent. Contributed by Arpit Agarwal.
new db1e0c1 YARN-688. Fixed NodeManager to properly cleanup containers when it is shut down. Contributed by Jian He.
new b9b2647 MAPREDUCE-5251. Reducer should not implicate map attempt if it has insufficient space to fetch map output. Contributed by Ashwin Shankar
new 8fa3ebd MAPREDUCE-5386. Ability to refresh history server job retention and job cleaner settings. Contributed by Ashwin Shankar
new 42e8cbf HADOOP-9773. TestLightWeightCache should not set size limit to zero when testing it.
new 1b531c1 HDFS-4979. Implement retry cache on Namenode. Contributed by Suresh Srinivas.
new 7723b13 HDFS-5016. Deadlock in pipeline recovery causes Datanode to be marked dead. Contributed by Suresh Srinivas.
new a690a21 HADOOP-9756. Remove the deprecated getServer(..) methods from RPC. Contributed by Junping Du
new 569e609 HDFS-5034. Remove debug prints from GetFileLinkInfo (Andrew Wang via Colin Patrick McCabe)
new 55dfade reverting HDFS-5034 because jenkins did not run on it
new ec18984 MAPREDUCE-1981. Improve getSplits performance by using listLocatedStatus. Contributed by Hairong Kuang and Jason Lowe
new e55d0ef MAPREDUCE-5421. Fixed TestNonExistentJob failure after YARN-873. Contributed by Junping Du.
new 07b0769 HDFS-5034. Remove debug prints from GetFileLinkInfo (Andrew Wang via Colin Patrick McCabe)
new b3d7442 HADOOP-9770. Make RetryCache#state non volatile. Contributed by Suresh Srinivas.
new 38adf46 HADOOP-9507. LocalFileSystem rename() is broken in some cases when destination exists. Contributed by Chris Nauroth.
new 7b5aa72 MAPREDUCE-5419. TestSlive is getting FileNotFound Exception. Contributed by Robert Parker
new 16fe97b HADOOP-9652. RawLocalFs#getFileLinkStatus does not fill in the link owner and mode. (Andrew Wang via Colin Patrick McCabe)
new 02d5830 HDFS-5035. getFileLinkStatus and rename do not correctly check permissions of symlinks (Andrew Wang via Colin Patrick McCabe)
new dc17bda HDFS-5004. Add additional JMX bean for NameNode status data. Contributed by Trevor Lorimer.
new 49d8dce Move YARN-84 to section 2.1.0-beta in CHANGES.txt.
new ac3c124 Move HDFS-3880 to section 2.1.0-beta in CHANGES.txt.
new ae8f07d YARN-960. Fixed ResourceManager to propagate client-submitted credentials irrespective of security. Contributed by Daryn Sharp.
new f179afc YARN-937. Fix unmanaged AM in non-secure/secure setup post YARN-701. (tucu)
new 13b526b YARN-347. Node CLI should show CPU info besides memory in node status. (Junping Du via llu)
new 65be212 HADOOP-9698. [RPC v9] Client must honor server's SASL negotiate response (daryn)
new 412e19f YARN-245. Fixed NodeManager to handle duplicate responses from ResourceManager. Contributed by Mayank Bansal.
new 215d633 HDFS-5027. On startup, DN should scan volumes in parallel. Contributed by Aaron T. Myers.
new 9eb06b3 YARN-932. TestResourceLocalizationService.testLocalizationInit can fail on JDK7. (Karthik Kambatla via Sandy Ryza)
new c23cf3c YARN-961. Changed ContainerManager to enforce Token auth irrespective of security. Contributed by Omkar Vinit Joshi.
new 8bb0355 MAPREDUCE-5411. Refresh size of loaded job cache on history server. Contributed by Ashwin Shankar
new 817a654 YARN-945. Removed setting of AMRMToken's service from ResourceManager and changed client libraries do it all the time and correctly. Contributed by Vinod Kumar Vavilapalli.
new f593d57 revert HADOOP-9652
new 3ca892d Reverting YARN-245 to fix a critical bug.
new f451228 HADOOP-9786. RetryInvocationHandler#isRpcInvocation should support ProtocolTranslator. Contributed by Suresh Srinivas and Jing Zhao.
new 33552b6 HADOOP-9768. chown and chgrp reject users and groups with spaces on platforms where spaces are otherwise acceptable. Contributed by Chris Nauroth.
new 3be4036 HADOOP-9792. Retry the methods that are tagged @AtMostOnce along with @Idempotent. Contributed by Suresh Srinivas.
new 8c7a7e6 HDFS-5025. Record ClientId and CallId in EditLog to enable rebuilding retry cache in case of HA failover. Contributed by Jing Zhao.
new 569a9bd Moved HADOOP-9509 & HADOOP-9515 to appropriate release of 2.1.0-beta.
new c70178e Updating release date for hadoop-2.1.0-beta.
new 8d5f65a Updating releasenotes for hadoop-2.1.0-beta.
new 5269434 HADOOP-9768. Moving from 2.1.0-beta to 2.1.1-beta in CHANGES.txt, because this patch did not make it into the 2.1.0-beta RC.
new 1d91523 MAPREDUCE-5385. Fixed a bug with JobContext getCacheFiles API. Contributed by Omkar Vinit Joshi.
new 48264f1 YARN-948. Changed ResourceManager to validate the release container list before actually releasing them. Contributed by Omkar Vinit Joshi.
new 813efd2 YARN-966. Fixed ContainerLaunch to not fail quietly when there are no localized resources due to some other failure. Contributed by Zhijie Shen.
new 4f68aa0 HDFS-5043. For HdfsFileStatus, set default value of childrenNum to -1 instead of 0 to avoid confusing applications. Contributed by Brandon Li
new 3ab5f46 HADOOP-9787. ShutdownHelper util to shutdown threads and threadpools. (Karthik Kambatla via Sandy Ryza)
new ba5925c YARN-502. Fixed a state machine issue with RMNode inside ResourceManager which was crashing scheduler. Contributed by Mayank Bansal.
new 9ad19ee HADOOP-9758. Provide configuration option for FS/FC symlink resolution. (Andrew Wang via Colin Patrick McCabe)
new 134557d HADOOP-9803. Add a generic type parameter to RetryInvocationHandler.
new 1f2d08f HDFS-4513. Clarify in the WebHDFS REST API that all JSON respsonses may contain additional properties.
new 1ff7043 YARN-758. Augment MockNM to use multiple cores (Karthik Kambatla via Sandy Ryza)
new 381a4c4 MAPREDUCE-5352. Optimize node local splits generated by CombineFileInputFormat. (sseth)
new 60be5fb HADOOP-9806 PortmapInterface should check if the procedure is out-of-range. Contributed by Brandon Li
new 4757963 YARN-573. Shared data structures in Public Localizer and Private Localizer are not Thread safe. Contributed by Omkar Vinit Joshi
new bfe5a52 MAPREDUCE-5428. HistoryFileManager doesn't stop threads when service is stopped. Contributed by Karthik Kambatla
new dc119ef HADOOP-9801. Configuration#writeXml uses platform defaulting encoding, which may mishandle multi-byte characters. Contributed by Chris Nauroth.
new 6ab50f8 create branch for HDFS-4949
new fac31fa Fix line endings of releasenotes.html.
new ef4f9b0 Correct fix versions for MAPREDUCE-5428 and YARN-573.
new ee350ee Update fix versions for JIRAs pulled from branch-2 into branch-2.1-beta.
new 5b7889f YARN-903. Changed ContainerManager to suppress unnecessary warnings when stopping already stopped containers. Contributed by Omkar Vinit Joshi.
new c04a7d9 HDFS-5028. LeaseRenewer throws ConcurrentModificationException when timeout. Contributed by zhaoyunjiong
new f216f22 HADOOP-9761. ViewFileSystem#rename fails when using DistributedFileSystem (Andrew Wang via Colin Patrick McCabe)
new e1d398b MAPREDUCE-5440. TestCopyCommitter Fails on JDK7. Contributed by Robert Parker
new ac93323 YARN-906. Fixed a bug in NodeManager where cancelling ContainerLaunch at KILLING state causes that the container to hang. Contributed by Zhijie Shen.
new 41e2518 YARN-994. HeartBeat thread in AMRMClientAsync does not handle runtime exception correctly (Xuan Gong via bikas)
new 34ae96f MAPREDUCE-5446. TestJobHistoryEvents and TestJobHistoryParsing have race conditions. Contributed by Jason Lowe.
new 6ea797d MAPREDUCE-5367. Local jobs all use same local working directory (Sandy Ryza)
new 390d689 HDFS-5061. Make FSNameSystem#auditLoggers an unmodifiable list. Contributed by Arpit Agarwal.
new 4404814 move HDFS-4659,HDFS-4762,HDFS-4948 to the right section in hadoop-hdfs/CHANGES.txt
new c4fb095 move HADOOP-9806,HDFS-5043,HDFS-4962 to the right section in CHANGES.txt
new ccdb978 HDFS-4366. Block Replication Policy Implementation May Skip Higher-Priority Blocks for Lower-Priority Blocks. Contributed by Derek Dagit.
new d9df191 Fix CHANGES.txt. Move HDFS-4366 from 2.3.0 to under 3.0.0.
new c8e200f HADOOP-9319. Update bundled LZ4 source to r99. (Binglin Chang via llu)
new f5312ae HADOOP-9816. RPC Sasl QOP is broken (daryn)
new ed2c620 HDFS-4905. Add appendToFile command to "hdfs dfs". Contributed by Arpit Agarwal.
new 63a1273 HADOOP-9832. Add RPC header to client ping (daryn)
new cc8c703 Update changes for HADOOP-9832.
new 95f9a51 HADOOP-9817. FileSystem#globStatus and FileContext#globStatus need to work with symlinks. (Colin Patrick McCabe via Andrew Wang)
new a00a729 MAPREDUCE-5399. Unnecessary Configuration instantiation in IFileInputStream slows down merge. (Stanislav Barton via Sandy Ryza)
new 0cb2fdc MAPREDUCE-434. LocalJobRunner limited to single reducer (Sandy Ryza and Aaron Kimball via Sandy Ryza)
new cb7c15c HADOOP-9821. ClientId should have getMsb/getLsb methods. Contributed by Tsuyoshi OZAWA.
new 3e0203a YARN-985. Nodemanager should log where a resource was localized (Ravi Prakash via jeagles)
new f294268 HADOOP-9527. Add symlink support to LocalFileSystem on Windows. Contributed by Arpit Agarwal.
new c5c90ff MAPREDUCE-5425. Junit in TestJobHistoryServer failing in jdk 7. Contributed by Robert Parker
new 54e1440 HDFS-4926. namenode webserver's page has a tooltip that is inconsistent with the datanode HTML link. Contributed by Vivek Ganesan.
new 84454c7 HDFS-5071 Change hdfs-nfs parent project to hadoop-project. Contributed by Brandon Li
new 6c65076 HDFS-4763 Add script changes/utility for starting NFS gateway
new 78cea88 fix hadoop-hdfs/CHANGES.txt for HDFS-4763
new c6ba793 HADOOP-9850. RPC kerberos errors don't trigger relogin. Contributed by Daryn Sharp.
new f702e1c HADOOP-9833 move slf4j to version 1.7.5
new 81f9786 HDFS-5047. Supress logging of full stack trace of quota and lease exceptions. Contributed by Robert Parker.
new e90afcc YARN-1043. Push all metrics consistently. Contributed by Jian He.
new c03c8fe HADOOP-9820. RPCv9 wire protocol is insufficient to support multiplexing. Contributed by Daryn Sharp.
new 7705d57 HADOOP-9831. Make checknative shell command accessible on Windows. Contributed by Chris Nauroth.
new 5b001e1 YARN-589. Expose a REST API for monitoring the fair scheduler (Sandy Ryza).
new 1784601 Amending YARN-589. Adding missing file from patch
new 52f11f7 HADOOP-9672. Upgrade Avro dependency to 1.7.4. Contributed by Sandy Ryza.
new e6c1f22 HADOOP-9789. Support server advertised kerberos principals (daryn)
new 4a774db HADOOP-9675. use svn:eol-style native for html to prevent line ending issues (Colin Patrick McCabe)
new d61827c add HADOOP-9675 to CHANGES.txt
new 2a40319 HDFS-5049. Add JNI mlock support. (Andrew Wang via Colin Patrick McCabe)
new 2f98813 HDFS-4993. Fsck can fail if a file is renamed or deleted. Contributed by Robert Parker.
new deec7ca HADOOP-9757. Har metadata cache can grow without limit (Cristina Abad via daryn)
new 6a0ba85 YARN-656. In scheduler UI, including reserved memory in Memory Total can make it exceed cluster capacity. (Sandy Ryza)
new 796ed24 Reverting 1512475 (labeled as YARN-656). Accidentally committed two patches together
new 49f2a44 YARN-656. In scheduler UI, including reserved memory in Memory Total can make it exceed cluster capacity. (Sandy Ryza)
new 109705f YARN-1046. Disable mem monitoring my default in MiniYARNCluster (Karthik Kambatla via Sandy Ryza)
new 49994dd update CHANGES.txt for HADOOP-8814
new 49e440c HADOOP-9857. Tests block and sometimes timeout on Windows due to invalid entropy source. Contributed by Chris Nauroth.
new 5726834 HDFS-5065. TestSymlinkHdfsDisable fails on Windows. Contributed by Ivan Mitic.
new 1fafb1e HADOOP-9802. Support Snappy codec on Windows. Contributed by Chris Nauroth.
new dedbd19 HADOOP-9583. test-patch gives +1 despite build failure when running tests. Contributed by Jason Lowe.
new d748123 TestGlobPath symlink tests fail to cleanup properly. (cmccabe via wang)
new 4744075 Fix CHANGES.txt for HADOOP-9847
new 19b36f0 HADOOP-9845. Update protobuf to 2.5 from 2.4.x. (tucu)
new 1d1ab58 HADOOP-9848. Create a MiniKDC for use with security testing. (ywskycn via tucu)
new a6ff227 MAPREDUCE-5454. TestDFSIO fails intermittently on JDK7 (Karthik Kambatla via Sandy Ryza)
new dede30c HADOOP-9848 Addendum fixing OK_JAVADOC_WARNINGS in test-patch
new 52ccc6c HDFS-5051. Propagate cache status information from the DataNode to the NameNode (Andrew Wang via Colin Patrick McCabe)
new 70527c8 merge trunk into HDFS-4949 branch
new 36cedca HADOOP-9740. Fix FsShell '-text' command to be able to read Avro files stored in HDFS. Contributed by Allan Yan.
new 228742a HADOOP-9446. Support Kerberos SPNEGO for IBM JDK. (Yu Gao via llu)
new 2bea314 HDFS-5091. Support for spnego keytab separate from the JournalNode keytab for secure HA. Contributed by Jing Zhao.
new dccdedc Create a new branch from trunk for HDFS-2832: Enable support for heterogeneous storages in HDFS.
new 88f6837 YARN-1060. Two tests in TestFairScheduler are missing @Test annotation (Niranjan Singh via Sandy Ryza)
new 8937fd5 YARN-337. RM handles killed application tracking URL poorly. Contributed by Jason Lowe
new 6390e64 HADOOP 9871. Fix intermittent findbugs warnings in DefaultMetricsSystem. (Junping Du via llu)
new 8451ab5 HADOOP-9872. Improve protoc version handling and detection. (tucu)
new fdba5fa HADOOP-9652. RawLocalFs#getFileLinkStatus does not fill in the link owner and mode. (Andrew Wang via Colin Patrick McCabe)
new 0cb5f08 HADOOP-9381. Document dfs cp -f option. Contributed by Keegan Witt and Suresh Srinivas.
new 49a8920 HDFS-4816. transitionToActive blocks if the SBN is doing checkpoint image transfer. (Andrew Wang)
new dd00bb7 merge trunk into HDFS-4949 branch
new b32ace1 HDFS-5051. nn fails to download checkpointed image from snn in some setups. Contributed by Vinay and Suresh Srinivas.
new 9cf82b6 HDFS-5068. Convert NNThroughputBenchmark to a Tool to allow generic options. Contributed by Konstantin Shvachko.
new 4c8db60 HDFS-5079. Cleaning up NNHAStatusHeartbeat.State from DatanodeProtocolProtos. Contributed by Tao Luo.
new 472d8bc YARN-1056. Remove dual use of string 'resourcemanager' in yarn.resourcemanager.connect.{max.wait.secs|retry_interval.secs}. Contributed by Karthik Kambatla.
new d0b61a1 HADOOP-9875. TestDoAsEffectiveUser can fail on JDK 7. (Aaron T. Myers via Colin Patrick McCabe)
new 0182ea1 HDFS-4898. BlockPlacementPolicyWithNodeGroup.chooseRemoteRack() fails to properly fallback to local rack.
new 97d04ae HDFS-4632. globStatus using backslash for escaping does not work on Windows. Contributed by Chuan Liu.
new b776bd4 YARN-1045. Improve toString implementation for PBImpls. Contributed by Jian He.
new 26c5a49 HDFS-5093. TestGlobPaths should re-use the MiniDFSCluster to avoid failure on Windows. Contributed by Chuan Liu.
new 8172215 HDFS-5080. BootstrapStandby not working with QJM when the existing NN is active. Contributed by Jing Zhao.
new 02b19e0 HDFS-5076. Add MXBean methods to query NN's transaction information and JournalNode's journal status. Contributed by Jing Zhao.
new d62bd71 Update CHANGES.txt to move YARN-1045 and MAPREDUCE-5352 to the correct version.
new 0e47ebb HADOOP-9868. Server must not advertise kerberos realm. Contributed by Daryn Sharp.
new a37d2fc Preparing for hadoop-2.1.0-beta rc2.
new 2fc7e14 HDFS-5099. Namenode#copyEditLogSegmentsToSharedDir should close EditLogInputStreams upon finishing. Contributed by Chuan Liu.
new 10ec8a2 HDFS-2994. If lease soft limit is recovered successfully the append can fail. Contributed by Tao Luo.
new 8df7e7d HADOOP-9865. FileContext#globStatus has a regression with respect to relative path. (Contributed by Chaun Lin)
new 99064ec HDFS-5100. TestNamenodeRetryCache fails on Windows due to incorrect cleanup. Contributed by Chuan Liu.
new d9de6a9 HDFS-5103. TestDirectoryScanner fails on Windows. Contributed by Chuan Liu.
new 1836ace Moving HDFS-5004 into 2.3.0 release section
new cae55de MAPREDUCE-5462. In map-side sort, swap entire meta entries instead of indexes for better cache performance. (Sandy Ryza)
new 45694cc Update CHANGES.txt to reflect merge of MR-1981 to branch-2.1-beta
new 8d21926 HDFS-5102. Snapshot names should not be allowed to contain slash characters. Contributed by Jing Zhao.
new 218ea73 HDFS-5105. TestFsck fails on Windows. (Contributed by Chuan Liu)
new 9ba9513 HDFS-5106. TestDatanodeBlockScanner fails on Windows due to incorrect path format. Contributed by Chuan Liu.
new 52f0259 HADOOP-9880. SASL changes from HADOOP-9421 breaks Secure HA NN. Contributed by Daryn Sharp.
new 1ad3fe4 YARN-107. Fixed ResourceManager and clients to better handle forceKillApplication on non-running and finished applications. Contributed by Xuan Gong.
new 214d437 HDFS-5104 Support dotdot name in NFS LOOKUP operation. Contributed by Brandon Li
new b7fb6fd HDFS-5107 Fix array copy error in Readdir and Readdirplus responses. Contributed by Brandon Li
new 79a1845 YARN-643. Fixed ResourceManager to remove all tokens consistently on app finish. Contributed by Xuan Gong.
new be0317e Add .classpath, .project and .settings to svn:ignore.
new c9b89de HDFS-5110 Change FSDataOutputStream to HdfsDataOutputStream for opened streams to fix type cast error. Contributed by Brandon Li
new 8f343e6 YARN-1006. Fixed broken rendering in the Nodes list web page on the RM web UI. Contributed by Xuan Gong.
new 23abbd8 HADOOP-9860. Remove class HackedKeytab and HackedKeytabEncoder from hadoop-minikdc once jira DIRSERVER-1882 solved. (ywskycn via tucu)
new ffdedf6 HADOOP-9866. convert hadoop-auth testcases requiring kerberos to use minikdc. (ywskycn via tucu)
new 172d0ce HADOOP-9487 Deprecation warnings in Configuration should go to their own log or otherwise be suppressible
new f6a1f4d HADOOP-9879. Move the version info of zookeeper dependencies to hadoop-project/pom (Karthik Kambatla via Sandy Ryza)
new f7ca7ec MAPREDUCE-5001. LocalJobRunner has race condition resulting in job failures. Contributed by Sandy Ryza
new 3015429 HDFS-2933. Improve DataNode Web UI Index Page. (Vivek Ganesan via Arpit Agarwal)
new 00afcdf HDFS-2933. Update CHANGES.txt
new 9718fd4 HDFS-5111. Remove duplicated error message for snapshot commands when processing invalid arguments. Contributed by Jing Zhao.
new 67f86ba HDFS-4953. Enable HDFS local reads via mmap. Contributed by Colin Patrick McCabe.
new a99edd1 Add CHANGES.txt for HDFS-4953
new b7a6c5e HADOOP-9877. Fix listing of snapshot directories in globStatus. (Binglin Chang via Andrew Wang)
new 2cd6064 HADOOP-9686. Easy access to final parameters in Configuration (Jason Lowe via jeagles)
new 5e68bc4 HDFS-4594. WebHDFS open sets Content-Length header to what is specified by length parameter rather than how much data is actually returned. Contributed by Chris Nauroth.
new a6ef933 HADOOP-9886. Turn warning message in RetryInvocationHandler to debug. Contributed by Arpit Gupta
new 782191f HADOOP-9784. Add a builder for HttpServer. (Junping Du via llu)
new 075995a Merge all changes from trunk to branch HDFS-2832
new 270eace HDFS-5069 Include hadoop-nfs and hadoop-hdfs-nfs into hadoop dist for NFS deployment. Contributed by Brandon Li
new 2499a86 HDFS-4994. Audit log getContentSummary() calls. Contributed by Robert Parker.
new 2d614a9 MAPREDUCE-5466. Changed MR AM to not promote history files of intermediate AMs in case they are exiting because of errors and thus help history-server pick up the right history file for the last successful AM. Contributed by Jian He.
new 5e27288 HDFS-4985. Add storage type to the protocol and expose it in block report and block locations
new 42a2846 YARN-881. Priority#compareTo method seems to be wrong. (Jian He via bikas)
new ad0011a YARN-1082. Create base directories on HDFS after RM login to ensure RM recovery doesn't fail in secure mode. Contributed by Vinod K V.
new 6fd8766 HDFS-5045. Add more unit tests for retry cache to cover all AtMostOnce methods. Contributed by Jing Zhao.
new 487ce6c YARN-1082. Addendum patch.
new ded91b4 MAPREDUCE-5468. Fix MR AM recovery for map-only jobs. Contributed by Vinod K. V.
new 148bf3e MAPREDUCE-5475. Ensure MRClientService verifies ACLs for users. Contributed by Jason Lowe.
new d2c70e3 Revert MAPREDUCE-5475
new d1dfa5f HADOOP-9887. globStatus does not correctly handle paths starting with a drive spec on Windows. Contributed by Chuan Liu.
new 200220e MAPREDUCE-5470. LocalJobRunner does not work on Windows. Contributed by Sandy Ryza.
new 740f4cb MAPREDUCE-5476. Changed MR AM recovery code to cleanup staging-directory only after unregistering from the RM. Contributed by Jian He.
new 6f699e8 HDFS-5115. Make StorageID a UUID.
new 920b4cc HDFS-5052. Add cacheRequest/uncacheRequest support to NameNode. (Contributed by Colin Patrick McCabe.)
new 7cfbfe5 HDFS-5124. DelegationTokenSecretManager#retrievePassword can cause deadlock in NameNode. Contributed by Daryn Sharp.
new e588ffe HDFS-4329. DFSShell issues with directories with spaces in name (Cristina L. Abad via jeagles)
new c41df25 Merge all changes from trunk to branch HDFS-2832
new 15632cd HDFS-4947 Add NFS server export table to control export by hostname or IP range. Contributed by Jing Zhao
new 9ee38f3 MAPREDUCE-5478. TeraInputFormat unnecessarily defines its own FileSplit subclass (Sandy Ryza)
new f1638fd YARN-707. Add user info in the YARN ClientToken. Contributed by Vinod Kumar Vavilapalli
new d912eea YARN-905. Add state filters to nodes CLI (Wei Yan via Sandy Ryza)
new 6f93f20 MAPREDUCE-5475. MRClientService does not verify ACLs properly. Contributed by Jason Lowe
new c660339 Revert MAPREDUCE-5475 and YARN-707
new e860366 YARN-1085. Modified YARN and MR2 web-apps to do HTTP authentication in secure setup with kerberos. Contributed by Omkar Vinit Joshi.
new b992219 HDFS-5050. Add DataNode support for mlock and munlock (contributed by Andrew Wang)
new 962da4d YARN-1074. Cleaned up YARN CLI application list to only display running applications by default. Contributed by Xuan Gong.
new 18e8056 YARN-1094. Fixed a blocker with RM restart code because of which RM crashes when try to recover an existing app. Contributed by Vinod Kumar Vavilapalli.
new 73d1431 HDFS-5000. DataNode configuration should allow specifying storage type
new 395f0ae HDFS-5000. DataNode configuration should allow specifying storage type (Adding file missed in last commit
new 942e2eb YARN-1008. MiniYARNCluster with multiple nodemanagers, all nodes have same key for allocations. (tucu)
new e7154d7 YARN-1093. Corrections to Fair Scheduler documentation (Wing Yew Poon via Sandy Ryza)
new f9f7b79 YARN-942. In Fair Scheduler documentation, inconsistency on which properties have prefix (Akira Ajisaka via Sandy Ryza)
new 5adba55 YARN-1085. Addendum patch to address issues with the earlier patch.
new 8a9db67 Merge all changes from trunk to branch HDFS-2832.
new 3925299 HDFS-3245. Add metrics and web UI for cluster version summary. Contributed by Ravi Prakash.
new 10a6236 HDFS-5128. Allow multiple net interfaces to be used with HA namenode RPC server. Contributed by Kihwal Lee.
new 1bfcab9 HDFS-5132. Deadlock in NameNode between SafeModeMonitor#run and DatanodeManager#handleHeartbeat. Contributed by Kihwal Lee.
new dfaa2e3 Adding the new test file for HDFS-3245 that was accidentally dropped
new 914a0e5 YARN-981. Fixed YARN webapp so that /logs servlet works like before. Contributed by Jian He.
new ca5de53 YARN-1083. Changed ResourceManager to fail when the expiry interval is less than the configured node-heartbeat interval. Contributed by Zhijie Shen.
new 4047ad7 YARN-602. Fixed NodeManager to not let users override some mandatory environmental variables. Contributed by Kenji Kikushima.
new 53f559d YARN-1081. Made a trivial change to YARN node CLI header to avoid potential confusion. Contributed by Akira AJISAKA.
new 5d9d702 HDFS-4987. Namenode changes to track multiple storages per datanode.
new 30b8ef9 HDFS-5078 Support file append in NFSv3 gateway to enable data streaming to HDFS. Contributed by Brandon Li
new 4d0df03 HADOOP-9910. proxy server start and stop documentation wrong. Contributed by Andre Kelpe. (harsh)
new 87f8c0a Addendum to HADOOP-9910 for trunk. Removed bad characters from CHANGES.txt note that was causing odd issues.
new f3c0074 HADOOP-9906. Move HAZKUtil to o.a.h.util.ZKUtil and make inner-classes public (Karthik Kambatla via Sandy Ryza)
new 82fc0f1 Adding and removing files missed for HADOOP-9906
new 56c1b9d YARN-1101. Active nodes can be decremented below 0 (Robert Parker via tgraves_
new 4ba7a5e HADOOP-9894. Race condition in Shell leads to logged error stream handling exceptions (Arpit Agarwal)
new b305f1f Update CHANGES_HDFS-2832.txt with HDFS-4985, HDFS-5115 and HDFS-5000.
new c13893d YARN-1034. Remove "experimental" in the Fair Scheduler documentation. (Karthik Kambatla via Sandy Ryza)
new febedd6 YARN-1080. Improved help message for "yarn logs" command. Contributed by Xuan Gong.
new a29714f0 MAPREDUCE-5483. revert MAPREDUCE-5357. (rkanter via tucu)
new 5d4b684 MAPREDUCE-5441. Changed MR AM to return RUNNING state if exiting when RM commands to reboot, so that client can continue to track the overall job. Contributed by xJian He.
new eef3212 HADOOP-9889. Refresh the Krb5 configuration when creating a new kdc in Hadoop-MiniKDC (Wei Yan via Sandy Ryza)
new eb484bb HDFS-5077. NPE in FSNamesystem.commitBlockSynchronization(). Contributed by Plamen Jeliazkov.
new 2cc851a MAPREDUCE-5484. YarnChild unnecessarily loads job conf twice (Sandy Ryza)
new 87e449f HADOOP-9909. org.apache.hadoop.fs.Stat should permit other LANG. (Shinichi Yamashita via Andrew Wang)
new 2088309 HADOOP-9774. RawLocalFileSystem.listStatus() return absolute paths when input path is relative on Windows. Contributed by Shanyu Zhao.
new 89fb4d8 YARN-707. Added user information also in the YARN ClientToken so that AMs can implement authorization based on incoming users. Contributed by Jason Lowe.
new daa0713 HDFS-5144. Document time unit to NameNodeMetrics. Contributed by Akira Ajisaka.
new 25d4c2f HDFS-5140. Too many safemode monitor threads being created in the standby namenode causing it to fail with out of memory error. Contributed by Jing Zhao.
new 28ac26b HADOOP-5144. Move change from 3.0 to 2.3.0 release section
new fc14a92 HDFS-5141. Add cache status information to datanode heartbeat. (Contributed by Andrew Wang)
new bafd302 YARN-771. AMRMClient support for resource blacklisting (Junping Du via bikas)
new 6d100eb YARN-1117. Improved help messages for "yarn application" and "yarn node" commands. Contributed by Xuan Gong.
new 236b853 HADOOP-9918. Add addIfService to CompositeService (Karthik Kambatla via Sandy Ryza)
new 76cb07e YARN-981. Fixed YARN webapp so that /logs servlet works like before. Addendum patch to fix bugs in the first patch. Contributed by Jian He.
new cbca166 HDFS-5136 MNT EXPORT should give the full group list which can mount the exports. Contributed by Brandon Li
new a759abc YARN-649. Added a new NM web-service to serve container logs in plain text over HTTP. Contributed by Sandy Ryza.
new 66841c2 YARN-1120. Made ApplicationConstants.Environment.USER definition OS neutral as the corresponding value is now set correctly end-to-end. Contributed by Chuan Liu.
new ff69557 YARN-1077. Fixed TestContainerLaunch test failure on Windows. Contributed by Chuan Liu.
new f7e3bc5 HDFS-5154. Fix TestBlockManager and TestDatanodeDescriptor after HDFS-4987. Contributed by Junping Du
new c28c964 HDFS-5150. Allow per NN SPN for internal SPNEGO. Contributed By Kihwal Lee.
new 3f070e8 HDFS-5009. Include storage information in the LocatedBlock.
new 336c034 Merge r1517887 through r1518850 from trunk.
new fde0e61 Add missing file from HDFS-5141
new 97b7267 HDFS-5121. Add RPCs for creating and manipulating cache pools. (Contributed by Colin Patrick McCabe)
new 2d52551 YARN-1124. Modified YARN CLI application list to display new and submitted applications together with running apps by default, following up YARN-1074. Contributed by Xuan Gong.
new ec57e30 Merge r1518851 from trunk (reconcile branch conflicts with the fix for HDFS-5077)
new f353769 Merging r1518852 through r1519883 from trunk to branch HDFS-2832
new b87bcbb HADOOP-9924. FileUtil.createJarWithClassPath() does not generate relative classpath correctly. Contributed by Shanyu Zhao.
new 0e0271b HADOOP-9916. Fix race in ipc.Client retry. (Binglin Chang via llu)
new d56d0b4 commit correct version of HDFS-5121
new cd663ba HADOOP-9932. Improper synchronization in RetryCache. Contributed by Kihwal Lee.
new 49afc64 YARN-1065. NM should provide AuxillaryService data to the container (Xuan Gong via bikas)
new 5540d77 MAPREDUCE-5475. MRClientService does not verify ACLs properly. Contributed by Jason Lowe
new 1e513bf YARN-957. Fixed a bug in CapacityScheduler because of which requests that need more than a node's total capability were incorrectly allocated on that node causing apps to hang. Contributed by Omkar Vinit Joshi.
new 4f46801 HADOOP-9915. o.a.h.fs.Stat support on Mac OS X (Contributed by Binglin Chang)
new ec135d5 CHANGES.txt: move HADOOP-9915 to branch-2.3 section
new e8f6f74 HADOOP-9908. Fix NPE when versioninfo properties file is missing. Contributed by Todd Lipcon.
new 8aea748 HDFS-5159. Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint. Contributed by Aaron T. Myers.
new bbce64c Merging r1519884 through r1520449 from trunk to branch HDFS-2832
new 5eb618e HDFS-4491. Parallel testing HDFS. Contributed by Andrey Klochkov.
new e10dbf4 HDFS-4491. Add/delete files missed in prior commit.
new a628391 HDFS-5164. DeleteSnapshot should check if OperationCategory.WRITE is possible before taking write lock (contributed by Colin Patrick McCabe)
new 36d0b82 HDS-5118. Provide testing support for DFSClient to drop RPC responses. Contributed by Jing Zhao.
new 4065c84 Move HDFS-5118 to 2.1.1-beta section.
new fc95998 Fixing CHANGES.txt for YARN-758 as it is now merged into branch-2.1-beta.
new f41f8b8 HDFS-5163. Miscellaneous cache pool RPC fixes (Contributed by Colin Patrick McCabe)
new 6431192 HDFS-4879. Add BlockedArrayList collection to avoid CMS full GCs (Contributed by Todd Lipcon)
new 6cfcd39 HADOOP-8704. add request logging to jetty/httpserver (jeagles)
new 7a74ca3 HDFS-5169. hdfs.c: translateZCRException: null pointer deref when translating some exceptions (Contributed by Colin Patrick McCabe)
new efc1048 Revert HADOOP-9877 because of breakage reported in HADOOP-9912
new f35983b YARN-1107. Fixed a bug in ResourceManager because of which RM in secure mode fails to restart. Contributed by Omkar Vinit Joshi.
new 03ae82a YARN-696. Changed RMWebservice apps call to take in multiple application states. Contributed by Trevor Lorimer.
new 40cf006 HADOOP-9924. Addendum patch to address issue with an empty classpath entry on Windows. Contributed by Shanyu Zhao.
new 282be1b HDFS-5134. Move blockContentsStale, heartbeatedSinceFailover and firstBlockReport from DatanodeDescriptor to DatanodeStorageInfo; and fix a synchronization problem in DatanodeStorageInfo.
new 4f2bf68 HDFS-5170. BlockPlacementPolicyDefault uses the wrong classname when alerting to enable debug logging. (Andrew Wang)
new b2af6c7 MAPREDUCE-5414. TestTaskAttempt fails in JDK7 with NPE. Contributed by Nemon Lou.
new 1cd7b06 YARN-1049. ContainerExistStatus should define a status for preempted containers. (tucu)
new f2e0a12 YARN-1144. Unmanaged AMs registering a tracking URI should not be proxy-fied. (tucu)
new 3a9cd79 HDFS-5120. Add command-line support for manipulating cache pools.
new 1a649aa YARN-1152. Fixed a bug in ResourceManager that was causing clients to get invalid client token key errors when an appliation is about to finish. Contributed by Jason Lowe.
new 0f91d84 YARN-910. Augmented auxiliary services to listen for container starts and completions in addition to application events. Contributed by Alejandro Abdelnur.
new 59b5490 YARN-292. Fixed FifoScheduler and FairScheduler to make their applications data structures thread safe to avoid RM crashing with ArrayIndexOutOfBoundsException. Contributed by Zhijie Shen.
new 11944e5 Amending yarn CHANGES.txt
new bcb8653 YARN-1098. Separate out RM services into Always On and Active (Karthik Kambatla via bikas)
new 23bf148 Merging r1520450 through r1521565 from trunk to branch HDFS-2832
new 75c31df MAPREDUCE-5020. Compile failure with JDK8 (Trevor Robinson via tgraves)
new 613979c HDFS-5085. Refactor o.a.h.nfs to support different types of authentications. Contributed by Jing Zhao.
new 220b217 YARN-1119. Add ClusterMetrics checks to tho TestRMNodeTransitions tests (Mit Desai via jeagles)
new b5c6ff1 YARN-1025. ResourceManager and NodeManager do not load native libraries on Windows. Contributed by Chris Nauroth.
new 1c1ebc1 MAPREDUCE-5497. Changed MRAppMaster to sleep only after doing everything else but just before ClientService to avoid race conditions during RM restart. Contributed by Jian He.
new b2976af HDFS-5157. Add StorageType to FsVolume. Contributed by Junping Du
new e4374d8 HDFS-4680. Audit logging of delegation tokens for MR tracing. (Andrew Wang)
new b6d9ef1 Move HDFS-4680 in CHANGES.txt
new c22091a YARN-1176. RM web services ClusterMetricsInfo total nodes doesn't include unhealthy nodes (Jonathan Eagles via tgraves)
new 02e0e15 HDFS-5158. Add command-line support for manipulating cache directives
new a202855 MAPREDUCE-5164. mapred job and queue commands omit HADOOP_CLIENT_OPTS. Contributed by Nemon Lou.
new f152a7e YARN-1078. TestNodeManagerResync, TestNodeManagerShutdown, and TestNodeStatusUpdater fail on Windows. Contributed by Chuan Liu.
new a98637e HADOOP-9958. Add old constructor back to DelegationTokenInformation to unbreak downstream builds. (Andrew Wang)
new ede10b8 HDFS-5067 Support symlink operations in NFS gateway. Contributed by Brandon Li
new 965ce20 HDFS-5192. NameNode may fail to start when dfs.client.test.drop.namenode.response.number is set. Contributed by Jing Zhao.
new 4857e76 HADOOP-9350. Hadoop not building against Java7 on OSX
new 2950c9f YARN-1194. TestContainerLogsPage fails with native builds. Contributed by Roman Shaposhnik
new 2f82972 HDFS-5198. NameNodeRpcServer must not send back DNA_FINALIZE in reply to a cache report.
new 1260d59 HDFS-4096. Add snapshot information to namenode WebUI. Contributed by Haohui Mai.
new 1a1f49f HDFS-5195. Prevent passing null pointer to mlock and munlock. Contributed by Chris Nauroth.
new 06eb46e Merging r1521566 through r1523108 from trunk to branch HDFS-2832
new a56a4b6 HDFS-5199 Add more debug trace for NFS READ and WRITE. Contributed by Brandon Li
new 40eb94a HDFS-5053. NameNode should invoke DataNode APIs to coordinate caching. (Andrew Wang)
new f4951e0 YARN-1116. Populate AMRMTokens back to AMRMTokenSecretManager after RM restarts (Jian He via bikas)
new e0e36bc HADOOP-9945. HAServiceState should have a state for stopped services. Contributed by Karthik Kambatla.
new 50af34f HDFS-5201. NativeIO: consolidate getrlimit into NativeIO#getMemlockLimit. (Contributed by Colin Patrick McCabe)
new 597c57b HADOOP-9960. Upgrade Jersey version to 1.9. Contributed by Karthik Kambatla.
new baea09b YARN-1189. NMTokenSecretManagerInNM is not being told when applications have finished. Contributed by Omkar Vinit Joshi
new 891e1b0 HADOOP-9557. hadoop-client excludes commons-httpclient. Contributed by Lohit Vijayarenu.
new 7bc9a5d HADOOP-9350: move entry in changes.txt to 2.1.2-beta section
new ec010a2 YARN-540. Race condition causing RM to potentially relaunch already unregistered AMs on RM restart (Jian He via bikas)
new d01caee HDFS-5188. In BlockPlacementPolicy, reduce the number of chooseTarget(..) methods; replace HashMap with Map in parameter declarations and cleanup some related code.
new 959635f Merge r1523109 through r1523401 from trunk.
new c4ea83c HADOOP-9935. set junit dependency to test scope. Contributed by André Kelpe.
new 68ec07c HDFS-5197. Document dfs.cachereport.intervalMsec in hdfs-default.xml. Contributed by Chris Nauroth.
new 89c7ee9 YARN-1137. Add support whitelist for system users to Yarn container-executor.c. (rvs via tucu)
new 27e7feb HADOOP-9961. versions of a few transitive dependencies diverged between hadoop subprojects. (rvs via tucu)
new 9fe18b5 HADOOP-9962. in order to avoid dependency divergence within Hadoop itself lets enable DependencyConvergence. (rvs via tucu)
new e60b057 MAPREDUCE-5379. Include token tracking ids in jobconf. (kkambatl via tucu)
new 60a1a70 YARN-1170. YARN & MapReduce proto definitions fixed to specify protobuf package as hadoop.yarn and hadoop.mapreduce respectively. Contibuted by Binglin Chang.
new 59587d9 MAPREDUCE-5493. Cleanup in-memory & on-disk segments to prevent leak on shuffle completion. Contributed by Jason Lowe.
new ead3dcc YARN-1027. Implement RMHAProtocolService (Karthik Kambatla via bikas)
new 85c2036 HDFS-5210. Fix some failing unit tests on HDFS-4949 branch. (Contributed by Andrew Wang)
new 3e3a454 Merging r1523402 through r1523803 from trunk to branch HDFS-2832
new ef62869 HADOOP-9935. Revert from trunk.
new 4ea2950 YARN-1001. Added a web-service to get statistics about per application-type per state for consumption by downstream projects. Contributed by Zhijie Shen.
new 90f43b1 YARN-1184. ClassCastException during preemption enforcement.
new f98c343 HDFS-5207. In BlockPlacementPolicy.chooseTarget(..), change the writer and the excludedNodes parameter types respectively to Node and Set. Contributed by Junping Du
new 0398943 Merge r1523804 through r1523877 from trunk.
new 877f7ad HADOOP-9944. Fix RpcRequestHeaderProto.callId to be sint32 rather than uint32 since ipc.Client.CONNECTION_CONTEXT_CALL_ID is signed (i.e. -3). Contributed by Arun C. Murthy.
new 492ecd3 Preparing for hadoop-2.1.1-beta release.
new 004e830 HADOOP-9350. Moving to appropriate section in CHANGES.txt
new ac618c6 Added ASL2 header to releasenotes.html.
new c16442c HADOOP-9669 Reduce the number of byte array creations and copies in XDR data manipulation. Contributed by Haohui Mai
new 5e18410 HDFS-5212. Refactor RpcMessage and NFS3Response to support different types of authentication information. Contributed by Jing Zhao.
new c09f007 MAPREDUCE-5487. In task processes, JobConf is unnecessarily loaded again in Limits (Sandy Ryza)
new abf09f0 HDFS-4990. Change BlockPlacementPolicy to choose storages instead of datanodes.
new f278a49 HDFS-5219. Add configuration keys for retry policy in WebHDFSFileSystem. Contributed by Haohui Mai.
new 22b4012 HDFS-5031. BlockScanner scans the block multiple times. (Vinay via Arpit Agarwal)
new e202d4d HDFS-5213. Separate PathBasedCacheEntry and PathBasedCacheDirectiveWithId. Contributed by Colin Patrick McCabe.
new 7a2443e HDFS-5122. Support failover and retry in WebHdfsFileSystem for NN HA. Contributed by Haohui Mai.
new f7eb75f Move HDFS-5122 from Release 2.1.1-beta to Release 2.3.0 in CHANGES.txt
new a80b826 Merging r1523878 through r1524586 from trunk to branch HDFS-2832
new 1c4f4a3 HADOOP-9929. Insufficient permission for a path reported as file not found. (Contributed by Colin Patrick McCabe)
new 3720956 HADOOP-9791. Add a test case covering long paths for new FileUtil access check methods. Contributed by Ivan Mitic.
new 3a87e8f HADOOP-9974: document setting mvn heap size
new 8de47fc HADOOP-9974: document setting mvn heap size - trailing space
new 8628c17 YARN-353. Add Zookeeper-based store implementation for RMStateStore. Contributed by Bikas Saha, Jian He and Karthik Kambatla.
new 6b1f507 MAPREDUCE-5504. mapred queue -info inconsistent with types (Kousuke Saruta via tgraves)
new af78fd7 MAPREDUCE-5488. Changed MR client to keep trying to reach the application when it sees that on attempt's AM is down. Contributed by Jian He.
new 13420d0 YARN-1203. Changed YARN web-app proxy to handle http and https URLs from AM registration and finish correctly. Contributed by Omkar Vinit Joshi. MAPREDUCE-5515. Fixed MR AM's webapp to depend on a new config mapreduce.ssl.enabled to enable https and disabling it by default as MR AM needs to set up its own certificates etc and not depend on clusters'. Contributed by Omkar Vinit Joshi.
new aae86e4 merge changes from trunk to HDFS-4949 branch
new d8d3d3e HDFS-5234 Move RpcFrameDecoder out of the public API. Contributed by Haohui Mai
new ab22245 HDFS-5231. Fix broken links in the document of HDFS Federation. Contributed by Haohui Mai.
new eb9f1b6 HDFS-5232. Protocol changes to transmit StorageUuid.
new a0d9a15 HDFS-5236. Change PathBasedCacheDirective APIs to be a single value rather than batch. (Contributed by Andrew Wang)
new 552e081 Delete a file for HDFS-5236.
new 9f6cf60 YARN-1128. FifoPolicy.computeShares throws NPE on empty list of Schedulables (Karthik Kambatla via Sandy Ryza)
new 4551da3 HDFS-5233. Use Datanode UUID to identify Datanodes.
new 5133d78 Merging r1524587 through r1525408 from trunk to branch HDFS-2832.
new 6d030ab YARN-1188. The context of QueueMetrics becomes default when using FairScheduler (Akira Ajisaka via Sandy Ryza)
new 3175cf1 Fix credit for YARN-1188
new 3dfadca HDFS-5239. Allow FSNamesystem lock fairness to be configurable (daryn)
new 7094738 HDFS-5240. Separate formatting from logging in the audit logger API (daryn)
new 0bdeb7d HADOOP-9977. Hadoop services won't start with different keypass and keystorepass when https is enabled. Contributed by Chris Nauroth.
new eef16da HDFS-5139. Remove redundant -R option from setrep.
new be56547 HDFS-5139. Remove redundant -R option from setrep (update CHANGES.txt).
new 743d8ae MAPREDUCE-5522. Incorrect oreder expected from JobQueueInfo (Jinghui Wang via bobby)
new 28e3d09 HDFS-4971. Move IO operations out of locking in OpenFileCtx. Contributed by Jing Zhao and Brandon Li.
new 114aa22 Merging r1525409 through r1525758 from trunk to branch HDFS-2832
new e3088e4 HDFS-5249. Fix dumper thread which may die silently. Contributed by Brandon Li
new b838ac8 HDFS-5251. Race between the initialization of NameNode and the http server. Contributed by Haohui Mai.
new 5827d16 HDFS-5228. The RemoteIterator returned by DistributedFileSystem.listFiles may throw NullPointerException. Contributed by szetszwo and cnauroth
new 78e995a YARN-1204. Added separate configuration properties for https for RM and NM without which servers enabled with https will also start on http ports. Contributed by Omkar Vinit Joshi. MAPREDUCE-5523. Added separate configuration properties for https for JHS without which even when https is enabled, it starts on http port itself. Contributed by Omkar Vinit Joshi.
new 9a361c5 HDFS-5191. Revisit zero-copy API in FSDataInputStream to make it more intuitive (Contributed by Colin Patrick McCabe)
new 10a4289 YARN-1229. Define constraints on Auxiliary Service names. Change ShuffleHandler service name from mapreduce.shuffle to mapreduce_shuffle. Contributed by Xuan Gong.
new 524dad1 MAPREDUCE-5505. Clients should be notified job finished only after job successfully unregistered (Zhijie Shen via bikas)
new 929f96e YARN-1214. Register ClientToken MasterKey in SecretManager after it is saved (Jian He via bikas)
new 43bb7c8 HADOOP-9776. HarFileSystem.listStatus() returns invalid authority if port number is empty. Contributed by Shanyu Zhao.
new c6d09d8 HDFS-5222. Move block schedule information from DatanodeDescriptor to DatanodeStorageInfo.
new 1a8b7eb Move CHANGES.txt entry for HADOOP-9761
new 464470e HADOOP-9981. globStatus should minimize its listStatus and getFileStatus calls. (Contributed by Colin Patrick McCabe)
new 3582026 HDFS-5246. Make Hadoop nfs server port and mount daemon port configurable. Contributed by Jinghui Wang
new 42c3cd3 YARN-49. Improve distributed shell application to work on a secure cluster. Contributed by Vinod Kumar Vavilapalli.
new fb48b6c MAPREDUCE-5503. Fixed a test issue in TestMRJobClient. Contributed by Jian He.
new 7785614 Merging r1525759 through r1526365 from trunk to branch HDFS-2832
new f2e6091 HDFS-5041. Add the time of last heartbeat to dead server Web UI. Contributed by Shinichi Yamashita
new db53226 YARN-1157. Fixed ResourceManager UI to behave correctly when apps like distributed-shell do not set tracking urls. Contributed by Xuan Gong.
new 476eca4 MAPREDUCE-5170. Fixed a wrong log message in CombineFileInputFormat class. Contributed by Sangjin Lee.
new 8a66e49 HADOOP-9998. Provide methods to clear only part of the DNSToSwitchMapping. (Junping Du via Colin Patrick McCabe)
new b8f4818 HADOOP-9948. Add a config value to CLITestHelper to skip tests on Windows. Contributed by Chuan Liu.
new 269eb42 HDFS-5258. Skip tests in TestHDFSCLI that are not applicable on Windows. Contributed by Chuan Liu.
new ae501ce HDFS-5186. TestFileJournalManager fails on Windows due to file handle leaks. Contributed by Chuan Liu.
new 7e73b9c MAPREDUCE-5525. Increase timeout of TestDFSIO.testAppend and TestMRJobsWithHistoryService.testJobHistoryData. Contributed by Chuan Liu.
new 5a15c39 YARN-819. ResourceManager and NodeManager should check for a minimum allowed version (Robert Parker via jeagles)
new 4402e2f HADOOP-9976. Different versions of avro and avro-maven-plugin (Karthik Kambatla via Sandy Ryza)
new 8f17d64 HDFS-5266. ElasticByteBufferPool#Key does not implement equals. Contributed by Chris Nauroth.
new cf3d8b2 MAPREDUCE-5513. ConcurrentModificationException in JobControl. Contributed by Robert Parker
new 8062d8c Merging r1526366 through r1526708 from trunk to branch HDFS-2832
new c263412 Delete the missed file in r1525104
new 96c11fe MAPREDUCE-5514. Fix TestRMContainerAllocator. Contributed by Zhijie Shen.
new 3caca92 HADOOP-8545. Filesystem Implementation for OpenStack Swift
new 46099ce HDFS-4988. Datanode must support all the volumes as individual storages.
new 6097044 Merging r1526709 through r1526970 from trunk to branch HDFS-2832
new 2627e35 MAPREDUCE-5332. Support token-preserving restart of history server. Contributed by Jason Lowe
new 89c147d HDFS-5266. Addendum for addressing Findbugs warnings for lack of hashCode method and lack of null check in equals. Contributed by Chris Nauroth.
new 58f40d3 MAPREDUCE-5531. Fix compat with hadoop-1 in mapreduce.(TaskID, TaskAttemptID) by re-introducing missing constructors. Contributed by Robert Kanter.
new 711abc3 MAPREDUCE-5545. org.apache.hadoop.mapred.TestTaskAttemptListenerImpl.testCommitWindow times out. Contributed by Robert Kanter
new a40810d MAPREDUCE-5529. Fix compat with hadoop-1 in mapred.TotalOrderPartitioner by re-introducing (get,set)PartitionFile which takes in JobConf. Contributed by Robert Kanter.
new 58b08e1 YARN-1021. Yarn Scheduler Load Simulator. (ywskycn via tucu)
new 0274198 HDFS-5268. NFS write commit verifier is not set in a few places. Contributed by Brandon Li
new b2e174c HDFS-5265. Namenode fails to start when dfs.https.port is unspecified. Contributed by Haohui Mai.
new eccdb9a HDFS-5260. Merge zero-copy memory-mapped HDFS client reads to trunk and branch-2. Contributed by Chris Nauroth.
new 42b6cad HADOOP-10006. Compilation failure in trunk for o.a.h.fs.swift.util.JSONUtil
new 990e494 HADOOP-8545 findbugs patches from the final -037 patch
new 4ce930e YARN-1246. Added application finish-status to ApplicationSummary for the sake of testing given ApplicationHistoryServer is not yet ready. Contributed by Arpit Gupta.
new aa12a79 MAPREDUCE-5538. Fixed MR AppMaster to send job-notification URL only after the job is really done - a bug caused by MAPREDUCE-5505. Contributed by Zhijie Shen.
new 1c5b49e YARN-899. Added back queue level administrator-acls so that there is no regression w.r.t 1.x. Contributed by Xuan Gong.
new e4154fc HDFS-5256. Use guava LoadingCache to implement DFSClientCache. Contributed by Haohui Mai
new d2e73b2 HADOOP-9964. Fix deadlocks in TestHttpServer by synchronize ReflectionUtils.printThreadInfo. (Junping Du via llu)
new 6331ff0 Merging r1526971 through r1527683 from trunk to branch HDFS-2832
new 25cdbdb HDFS-5230. Introduce RpcInfo to decouple XDR classes from the RPC API. Contributed by Haohui Mai
new 09bb12c YARN-1221. With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely (Siqi Li via Sandy Ryza)
new 6d5577f HDFS-4517. Cover class RemoteBlockReader with unit tests. Contributed by Vadim Bondarev and Dennis Y.
new 84e4e4b YARN-1247. test-container-executor has gotten out of sync with the changes to container-executor. (rvs via tucu)
new 74d2025 YARN-1070. Fixed race conditions in NodeManager during container-kill. Contributed by Zhijie Shen.
new 9c24615 MAPREDUCE-5551. Fix compat with hadoop-1 in SequenceFileAsBinaryOutputFormat.WritableValueBytes by re-introducing missing constructors. Contributed by Zhijie Shen.
new 4fe912d HDFS-4512. Cover package org.apache.hadoop.hdfs.server.common with tests. Contributed by Vadim Bondarev.
new ae05623 YARN-1010. FairScheduler: decouple container scheduling from nodemanager heartbeats. (Wei Yan via Sandy Ryza)
new cc8a0ca MAPREDUCE-5544. JobClient#getJob loads job conf twice. (Sandy Ryza)
new aa2745a YARN-1228. Clean up Fair Scheduler configuration loading. (Sandy Ryza)
new b2a7811 YARN-1215. Yarn URL should include userinfo. Contributed by Chuan Liu.
new db06f1b MAPREDUCE-4421. Run MapReduce framework via the distributed cache. Contributed by Jason Lowe
new 85a1bd1 YARN-1215. Correct CHANGES.txt.
new 4b9fa6a YARN-1262. TestApplicationCleanup relies on all containers assigned in a single heartbeat (Karthik Kambatla via Sandy Ryza)
new 82f4348f MAPREDUCE-5536. Fixed MR AM and JHS to respect mapreduce.jobhistory.webapp.https.address. Contributed by Omkar Vinit Joshi.
new 4e9c652 HADOOP-10003. HarFileSystem.listLocatedStatus() fails. Contributed by Jason Dere and suresh.
new b99d160 HDFS-5255. Distcp job fails with hsftp when https is enabled in insecure cluster.
new dd0fb6d move HADOOP-9758 to the branch-2.1.2 section
new c7cd620 HADOOP-8315. Support SASL-authenticated ZooKeeper in ActiveStandbyElector. Contributed by Todd Lipcon
new 703838c HADOOP-10012. Secure Oozie jobs fail with delegation token renewal exception in Namenode HA setup. Contributed by Daryn Sharp and Suresh Srinivas.
new fc5bd93 HDFS-5279. Guard against NullPointerException in NameNode JSP pages before initialization of FSNamesystem. Contributed by Chris Nauroth.
new cb44a4b YARN-1260. Added webapp.http.address to yarn-default.xml so that default install with https enabled doesn't have broken link on NM UI. Contributed by Omkar Vinit Joshi.
new 97a8ebe HADOOP-9063. enhance unit-test coverage of class org.apache.hadoop.fs.FileUtil. Contributed by Ivan A. Veselovsky
new d14584d YARN-677. Increase coverage to FairScheduler (Vadim Bondarev and Dennis Y via jeagles)
new 07ee205 MAPREDUCE-5530. Fix compat with hadoop-1 in mapred.lib.CombinFileInputFormat by re-introducing isSplittable(FileSystem, Path) api and ensuring semantic compatibility. Contributed by Robert Kanter.
new d9610d5 HADOOP-9254. Cover packages org.apache.hadoop.util.bloom, org.apache.hadoop.util.hash. Contributed by Vadim Bondarev
new 3c7813b MAPREDUCE-5459. Update documentation on how to run MRv1 examples on YARN. Contributed by Zhijie Shen.
new 0a6e275 YARN-1141. Updating resource requests should be decoupled with updating blacklist (Zhijie Shen via bikas)
new ed7278c YARN-425. coverage fix for yarn api (Aleksey Gorshkov via jeagles)
new 90a5dc3 MAPREDUCE-5554. hdfs-site.xml included in hadoop-mapreduce-client-jobclient tests jar is breaking tests for downstream components (Robert Kanter via Sandy Ryza)
new 86cc60c YARN-876. Node resource is added twice when node comes back from unhealthy. (Peng Zhang via Sandy Ryza)
new 65a55f2 HDFS-5289. Race condition in TestRetryCacheWithHA#testCreateSymlink causes spurious test failure. Contributed by Aaron T. Myers.
new 2db1d4d YARN-1213. Restore config to ban submitting to undeclared pools in the Fair Scheduler. (Sandy Ryza)
new dbdb8c6 Revert YARN-677. Increase coverage to FairScheduler (Vadim Bondarev and Dennis Y via jeagles)
new 7b687dd YARN-1199. Make NM/RM Versions Available (Mit Desai via jeagles)
new fb3f338 MAPREDUCE-5489. MR jobs hangs as it does not use the node-blacklisting feature in RM requests (Zhijie Shen via bikas)
new 79a11ce YARN-890. Ensure CapacityScheduler doesn't round-up metric for available resources. Contributed by Xuan Gong & Hitesh Shah.
new 1608d8b YARN-621. Changed YARN web app to not add paths that can cause duplicate additions of authenticated filters there by causing kerberos replay errors. Contributed by Omkar Vinit Joshi.
new ac2cdb5 YARN-1236. FairScheduler setting queue name in RMApp is not working. (Sandy Ryza)
new 8ebf37f YARN-1256. NM silently ignores non-existent service in StartContainerRequest (Xuan Gong via bikas)
new d3841bd YARN-1149. NM throws InvalidStateTransitonException: Invalid event: APPLICATION_LOG_HANDLING_FINISHED at RUNNING. Contributed by Xuan Gong.
new cc76f70 Addendum for missing file YARN-1256. NM silently ignores non-existent service in StartContainerRequest (Xuan Gong via bikas)
new d8ea364 YARN-1271. Text file busy errors launching containers again (Sandy Ryza)
new 6ff600d YARN-1131. logs command should return an appropriate error message if YARN application is still running. Contributed by Siddharth Seth.
new 65cd7bf MAPREDUCE-5442. $HADOOP_MAPRED_HOME/$HADOOP_CONF_DIR setting not working on Windows. Contributed by Yingda Chen.
new 6be30a7 YARN-1219. FSDownload changes file suffix making FileUtil.unTar() throw exception. Contributed by Shanyu Zhao.
new d4324ee MAPREDUCE-5533. Fixed MR speculation code to track any TaskAttempts that aren't heart-beating for a while, so that we can aggressively speculate instead of waiting for task-timeout. Contributed by Xuan Gong.
new af1ac9a HDFS-5119. Persist CacheManager state in the edit log. (Contributed by Andrew Wang)
new cbab047 YARN-1232. Configuration to support multiple RMs (Karthik Kambatla via bikas)
new 3c1f18d HDFS-5300. FSNameSystem#deleteSnapshot() should not check owner in case of permissions disabled. Contributed by Vinay.
new 8549c34 HADOOP-9225. Cover package org.apache.hadoop.compress.Snappy. Contributed by Vadim Bondarev, Andrey Klochkov and Nathan Roberts
new 80c5bff YARN-1253. Changes to LinuxContainerExecutor to run containers as a single dedicated user in non-secure mode. (rvs via tucu)
new eb2175d HDFS-5190. Move cache pool related CLI commands to CacheAdmin. (Contributed by Andrew Wang)
new f104665 YARN-1251. TestDistributedShell#TestDSShell failed with timeout. Contributed by Xuan Gong.
new fc23fd3 YARN-1167. Fixed Distributed Shell to not incorrectly show empty hostname on RM UI. Contributed by Xuan Gong.
new 0a887a0 YARN-1254. Fixed NodeManager to not pollute container's credentials. Contributed by Omkar Vinit Joshi.
new be3edcc YARN-1273. Fixed Distributed-shell to account for containers that failed to start. Contributed by Hitesh Shah.
new cae1ed9 HDFS-5308. Replace HttpConfig#getSchemePrefix with implicit schemes in HDFS JSP. Contributed by Haohui Mai.
new 54e54d4 YARN-1268. TestFairScheduer.testContinuousScheduling is flaky (Sandy Ryza)
new 25361d5 Fix location of YARN-1268 in CHANGES.txt
new d55f378 YARN-1032. Fixed NPE in RackResolver. Contributed by Lohit Vijayarenu.
new 5e2d93b YARN-1090. Fixed CS UI to better reflect applications as non-schedulable and not as pending. Contributed by Jian He.
new 52b0ce3 YARN-1274. Fixed NodeManager's LinuxContainerExecutor to create user, app-dir and log-dirs correctly even when there are no resources to localize for the container. Contributed by Siddharth Seth.
new 8e08046 HDFS-5306. Datanode https port is not available at the namenode. Contributed by Suresh Srinivas.
new cb5a515 HADOOP-10017. Fix NPE in DFSClient#getDelegationToken when doing Distcp from a secured cluster to an insecured cluster. Contributed by Haohui Mai.
new 633b693 HDFS-5309. Fix failing caching unit tests. (Andrew Wang)
new 44f7ee7 YARN-1278. Fixed NodeManager to not delete local resources for apps on resync command from RM - a bug caused by YARN-1149. Contributed by Hitesh Shah.
new 7317e97 HDFS-5299. DFS client hangs in updatePipeline RPC when failover happened. Contributed by Vinay.
new 21181b6 YARN-1277. Added a policy based configuration for http/https in common HttpServer and using the same in YARN - related to per project https config support via HADOOP-10022. Contributed by Suresh Srinivas and Omkar Vinit Joshi.
new f0799c5 MAPREDUCE-5562. Fixed MR App Master to perform pending tasks like staging-dir cleanup, sending job-end notification correctly when unregister with RM fails. Contributed by Zhijie Shen.
new caa4abd HDFS-5259. Support client which combines appended data with old data before sends it to NFS server. Contributed by Brandon Li
new 43c7a83 Preparing for hadoop-2.2.0 release.
new b8f1cf3 HDFS-4817. Moving changelog to Release 2.2.0 section to reflect the backport.
new bac6515 Release notes for hadoop-2.2.0.
new 267a606 HDFS-5307. Support both HTTP and HTTPS in jsp pages. Contributed by Haohui Mai
new b60e18d HDFS-5314. Do not expose CachePool type in AddCachePoolOp (Colin Patrick McCabe)
new 3de419a YARN-465. fix coverage org.apache.hadoop.yarn.server.webproxy. Contributed by Aleksey Gorshkov and Andrey Klochkov
new 4e46d20 HADOOP-10028. Malformed ssl-server.xml.example. Contributed by Haohui Mai.
new 1fe1942 HDFS-5291. Standby namenode after transition to active goes into safemode. Contributed by Jing Zhao.
new 61c1dd9 HDFS-5317. Go back to DFS Home link does not work on datanode webUI. Contributed by Haohui Mai
new 418773f Moving recent bug-fixes to hadoop-2.2.1.
new 0999874 HDFS-5316. Namenode ignores the default https port. Contributed by Haohui Mai
new db8bf2e HADOOP-9199. Cover package org.apache.hadoop.io with unit tests (Andrey Klochkov via jeagles)
new 54801ba Addenum for HDFS-5309, update binary edits again
new 5c02d2f HDFS-5281. COMMIT request should not block. Contributed by Brandon Li
new b7e8854 HADOOP-10030. FsShell -put/copyFromLocal should support Windows local path. Contributed by Chuan Liu.
new 726c353 YARN-1284. LCE: Race condition leaves dangling cgroups entries for killed containers. (Alejandro Abdelnur via Sandy Ryza)
new 5a87d89 Add missing file TestCgroupsLCEResourcesHandler for YARN-1284.
new 0038865 YARN-976. Document the meaning of a virtual core. (Sandy Ryza)
new 389d846 Fix position of YARN-461 in CHANGES.txt
new 643b1a4 YARN-1258. Allow configuring the Fair Scheduler root queue (Sandy Ryza)
new b858b81 HADOOP-9470. eliminate duplicate FQN tests in different Hadoop modules (Ivan A. Veselovsky via daryn)
new f6a2cac HDFS-4510. Cover classes ClusterJspHelper/NamenodeJspHelper with unit tests. Contributed by Andrey Klochkov.
new 7b7caa1 MAPREDUCE-5569. FloatSplitter is not generating correct splits. Contributed by Nathan Roberts
new a184fce Amending yarn CHANGES.txt moving YARN-1284 to 2.2.1
new 3fc8792 HDFS-5304. Expose if a block replica is cached in getFileBlockLocations. (Contributed by Andrew Wang)
new b8ae4e2 HDFS-5323. Remove some deadcode in BlockManager (Colin Patrick McCabe)
new 00395a0 MAPREDUCE-5102. fix coverage org.apache.hadoop.mapreduce.lib.db and org.apache.hadoop.mapred.lib.db. Contributed by Aleksey Gorshkov, Andrey Klochkov, and Nathan Roberts
new 9b9ddf2 YARN-1283. Fixed RM to give a fully-qualified proxy URL for an application so that clients don't need to do scheme-mangling. Contributed by Omkar Vinit Joshi.
new a757945 HADOOP-10031. FsShell -get/copyToLocal/moveFromLocal should support Windows local path. Contributed by Chuan Liu.
new 7429deb HDFS-5337. should do hsync for a commit request even there is no pending writes. Contributed by Brandon Li
new 22b332f YARN-879. Fixed tests w.r.t o.a.h.y.server.resourcemanager.Application. Contributed by Junping Du.
new 4f00896 HADOOP-10029. Specifying har file to MR job fails in secure cluster. Contributed by Suresh Srinivas.
new f218527 YARN-1265. Fair Scheduler chokes on unhealthy node reconnect (Sandy Ryza)
new f2f5cdb HDFS-5335. Hive query failed with possible race in dfs output stream. Contributed by Haohui Mai.
new 0387ec7 HADOOP-10039. Add Hive to the list of projects using AbstractDelegationTokenSecretManager. Contributed by Haohui Mai.
new 735d8b2 YARN-7. Support CPU resource for DistributedShell. (Junping Du via llu)
new d0aaa5b HDFS-5276. Remove volatile from LightWeightHashSet. (Junping Du via llu)
new 1d07c5c Move HDFS-5276 to 2.3.0 in CHANGES.txt
new 8111c3af HDFS-5224. Refactor PathBasedCache* methods to use a Path rather than a String. Contributed by Chris Nauroth.
new 156b9f2 YARN-1300. SLS tests fail because conf puts YARN properties in fair-scheduler.xml (Ted Yu via Sandy Ryza)
new 335923b Delete fair-scheduler-allocation.xml for YARN-1300
new f7eaacc HDFS-5322. HDFS delegation token not found in cache errors seen on secure HA clusters. Contributed by Jing Zhao.
new 5bed5bb YARN-1044. used/min/max resources do not display info in the scheduler page (Sangjin Lee via Sandy Ryza)
new 09e9e57 HDFS-5348. Fix error message when dfs.datanode.max.locked.memory is improperly configured. (Contributed by Colin Patrick McCabe)
new bbac0cf HADOOP-10040. hadoop.cmd in UNIX format and would not run by default on Windows. Contributed by Chris Nauroth.
new 0840906 Fix typo (HDFS-5276 -> HDFS-5267) in CHANGES.txt
new b83364d Workaround git eol hell
new 7cd044b HDFS-5329. Update FSNamesystem#getListing() to handle inode path in startAfter token. Contributed by Brandon Li
new f2745ba MAPREDUCE-5329. Allow MR applications to use additional AuxServices, which are compatible with the default MapReduce shuffle. Contributed by Avner BenHanoch.
new 2caa899 YARN-305. Fair scheduler logs too many "Node offered to app" messages. (Lohit Vijayarenu via Sandy Ryza)
new 6a1929f MAPREDUCE-5463. Deprecate SLOTS_MILLIS counters. (Tzuyoshi Ozawa via Sandy Ryza)
new 11716cf HADOOP-10040. Revert svn propset for CRLF line endings on Windows files. Contributed by Chris Nauroth.
new cb26a58 HADOOP-10040. svn propset to native line endings on Windows files. Contributed by Chris Nauroth.
new edabf89 HADOOP-10040. Correct merge error on native.vcxproj. Contributed by Chris Nauroth.
new 87d7fae HADOOP-9494. Excluded auto-generated and examples code from clover reports (Andrey Klochkov via jeagles)
new ed45d97 MAPREDUCE-5546. mapred.cmd on Windows set HADOOP_OPTS incorrectly. Contributed by Chuan Liu.
new cf0cf0a HDFS-5342. Provide more information in the FSNamesystem JMX interfaces. Contributed by Haohui Mai.
new cd7e7c3 YARN-1259. In Fair Scheduler web UI, queue num pending and num active apps switched. (Robert Kanter via Sandy Ryza)
new 989db9e YARN-1182. MiniYARNCluster creates and inits the RM/NM only on start() (Karthik Kambatla via Sandy Ryza)
new 15d08c4 HDFS-5349. DNA_CACHE and DNA_UNCACHE should be by blockId only (cmccabe)
new efe545b HDFS-5358. Add replication field to PathBasedCacheDirective. (Contributed by Colin Patrick McCabe)
new 86b5f80 HADOOP-10040. Correct native.vcxproj for inclusion of lz4hc.c. Contributed by Chris Nauroth.
new af89caf HDFS-5359. Allow LightWeightGSet#Iterator to remove elements. (Contributed by Colin Patrick McCabe)
new 258c181 HDFS-5352. Server#initLog() doesn't close InputStream in httpfs. Contributed by Ted Yu.
new 4407d5f MAPREDUCE-5518. Fixed typo "can't read paritions file". Contributed by Albert Chu.
new 0a5f0ef HDFS-5338. Add a conf to disable hostname check in datanode registration.
new 98b29a3 HADOOP-100046. Print a log message when SSL is enabled (David S. Wang via wang)
new 6a55ed3 YARN-1295. In UnixLocalWrapperScriptBuilder, using bash -c can cause Text file busy errors. (Sandy Ryza)
new a9befa6 HDFS-5330. fix readdir and readdirplus for large directories. Contributed by Brandon Li
new 2145486 HDFS-5130. Add test for snapshot related FsShell and DFSAdmin commands. Contributed by Binglin Chang.
new ffe3471 HDFS-5283. Under construction blocks only inside snapshots should not be counted in safemode threshhold. Contributed by Vinay
new c46525e Add TestOpenFilesWithSnapshot.java for HDFS-5283.
new 2cf5084 HDFS-5358: Add updated editsStored file for tests.
new 034039b MAPREDUCE-5585. TestCopyCommitter#testNoCommitAction Fails on JDK7 (jeagles)
new b468160 HADOOP-9897. Add method to get path start position without drive specifier in o.a.h.fs.Path. Contributed by Binglin Chang.
new 74a2191 MAPREDUCE-5586. TestCopyMapper#testCopyFailOnBlockSizeDifference fails when run from hadoop-tools/hadoop-distcp directory (jeagles)
new 8da82eb HDFS-5373. hdfs cacheadmin -addDirective short usage does not mention -replication parameter. Contributed by Chris Nauroth.
new f28f5ed HDFS-5370. Typo in Error Message: different between range in condition and range in error message. Contributed by Kousuke Saruta.
new dea1b2e HADOOP-10005. No need to check INFO severity level is enabled or not. Contributed by Jackie Chang.
new 168b133 Merging r1527684 through r1532876 from trunk to branch HDFS-2832
new a6076ad Merging r1532877 through r1532910 from trunk to branch HDFS-2832
new a0fc90e HDFS-5346. Avoid unnecessary call to getNumLiveDataNodes() for each block during IBR processing. Contributed by Ravi Prakash.
new 3cc7a38 HDFS-5096. Automatically cache new data added to a cached path (contributed by Colin Patrick McCabe)
new 40c97ca add missing file for HDFS-5096
new b838776 HADOOP-9078. enhance unit-test coverage of class org.apache.hadoop.fs.FileContext (Ivan A. Veselovsky via jeagles)
new e432b4f HDFS-5360. Improvement of usage message of renameSnapshot and deleteSnapshot. Contributed by Shinichi Yamashita.
new 1ba58e2 HDFS-4376. Fix race conditions in Balancer. Contributed by Junping Du
new 76c49b6 Move HDFS-5360 to 2.2.1 in CHANGES.txt
new 909ab36 HDFS-5334. Implement dfshealth.jsp in HTML pages. Contributed by Haohui Mai.
new 34f0894 merge trunk to branch HDFS-4949
new da1f441 merge the rest of trunk to branch HDFS-4949
new c4e57ee HDFS-5375. hdfs.cmd does not expose several snapshot commands. Contributed by Chris Nauroth.
new 9d24715 HDFS-5379. Update links to datanode information in dfshealth.html. Contributed by Haohui Mai.
new 1fde8bc HDFS-5336. DataNode should not output StartupProgress metrics. Contributed by Akira Ajisaka.
new f79cbb9 HADOOP-10055. FileSystemShell.apt.vm doc has typo "numRepicas". Contributed by Akira Ajisaka.
new f8d5755 Merging r1532911 through r1533207 from trunk to branch HDFS-2832
new dcb0b85 HDFS-5383. fix broken caching unit tests (Andrew Wang)
new 631ccbd HDFS-5374. Remove deadcode in DFSOutputStream. Contributed by Suresh Srinivas.
new a19b956 HDFS-4511. Cover package org.apache.hadoop.hdfs.tools with unit test (Andrey Klochkov via jeagles)
new 4d5a66f HDFS-5365. Fix libhdfs compile error on FreeBSD9. Contributed by Radim Kolar.
new f304337 HDFS-5365. Move attribution to 2.2.1 in CHANGES.txt.
new 1d96e36 HDFS-5388. Loading fsimage fails to find cache pools during namenode startup (Chris Nauroth via Colin Patrick McCabe)
new 7d637a3 MAPREDUCE-5457. Add a KeyOnlyTextOutputReader to enable streaming to write out text files without separators (Sandy Ryza)
new 2baa42d MAPREDUCE-5587. TestTextOutputFormat fails on JDK7 (jeagles)
new d61af97 HDFS-5203. Concurrent clients that add a cache directive on the same path may prematurely uncache each other. (Chris Nauroth via Colin Patrick McCabe)
new e86f4a2 HDFS-5276. FileSystem.Statistics should use thread-local counters to avoid multi-threaded performance issues on read/write. (Colin Patrick McCabe)
new 7f97fd1 YARN-1185. Fixed FileSystemRMStateStore to not leave partial files that prevent subsequent ResourceManager recovery. Contributed by Omkar Vinit Joshi.
new 7fd9148 HDFS-5331 make SnapshotDiff.java to a o.a.h.util.Tool interface implementation. Contributed by Vinay.
new 62f95b0 Merging r1533208 through r1534278 from trunk to branch HDFS-2832
new 65bda6d YARN-1258: Move to 2.2.1 in CHANGES.txt
new 881d1d5 Reverting "YARN-1258: Move to 2.2.1 in CHANGES.txt" because it contained unintended changes
new 65a9e3a YARN-1258: Move to 2.2.1 in CHANGES.txt
new dc523bd YARN-1288. Make Fair Scheduler ACLs more user friendly (Sandy Ryza)
new f9c08d0 HDFS-5378. In CacheReport, don't send genstamp and length on the wire (Contributed by Colin Patrick McCabe)
new 69e5f90 HDFS-5385. Caching RPCs are AtMostOnce, but do not persist client ID and call ID to edit log. (Chris Nauroth via Colin Patrick McCabe)
new fc99f3e HDFS-5382. Implement the UI of browsing filesystems in HTML 5 page. Contributed by Haohui Mai.
new 4380e48 HDFS-5347. Add HDFS NFS user guide. Contributed by Brandon Li
new 12ed24a HDFS-4885. Improve the verifyBlockPlacement() API in BlockPlacementPolicy. Contributed by Junping Du
new 40fec97 svn merge -c -1534417 . for reverting HDFS-4885, which should be committed to trunk.
new df87ed3 HDFS-4885. Improve the verifyBlockPlacement() API in BlockPlacementPolicy. Contributed by Junping Du
new 0ebab3a HDFS-5377. Heartbeats from Datandode should include one storage report per storage directory
new 8ad510b HADOOP-9291. enhance unit-test coverage of package o.a.h.metrics2 (Ivan A. Veselovsky via jeagles)
new 725e013 YARN-1331. yarn.cmd exits with NoClassDefFoundError trying to run rmadmin or logs. Contributed by Chris Nauroth.
new 755def8 YARN-1315. TestQueueACLs should also test FairScheduler (Sandy Ryza)
new d45ca49 HDFS-5400. DFS_CLIENT_MMAP_CACHE_THREAD_RUNS_PER_TIMEOUT constant is set to the wrong value (Colin Patrick McCabe)
new ef17685 Merging r1534279 through r1534706 from trunk to branch HDFS-2832
new 66aa806 YARN-1183. MiniYARNCluster shutdown takes several minutes intermittently (Andrey Klochkov via jeagles)
new 298bddf MAPREDUCE-5561. org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testcase failing on trunk. Contributed by Karthik Kambatla
new b884af7 HDFS-5398. NameNode changes to process storage reports per storage directory.
new 3baff29 YARN-1330. Fair Scheduler: defaultQueueSchedulingPolicy does not take effect (Sandy Ryza)
new 116b459 YARN-1305. RMHAProtocolService#serviceInit should handle HAUtil's IllegalArgumentException (Tsuyoshi Ozawa via bikas)
new 01f37e4 HDFS-5390. Send one incremental block report per storage directory.
new f794ef6 Merging r1534707 through r1534893 from trunk to branch HDFS-2832
new 776deaf HADOOP-9598. Improve code coverage of RMAdminCLI (Aleksey Gorshkov and Andrey Klochkov via jeagles)
new 82ed72d HDFS-5403. WebHdfs client cannot communicate with older WebHdfs servers post HDFS-5306. Contributed by Aaron T. Myers.
new f09c52b HADOOP-9016. HarFsInputStream.skip(long) must never return negative value. (Ivan A. Veselovsky via jeagles)
new b442fe9 Merge r1534894 through r1535121 from trunk.
new f39f8c5 HDFS-5401. Fix NPE in Directory Scanner.
new 1387fb1 HDFS-5363. Refactor WebHdfsFileSystem: move SPENGO-authenticated connection creation to URLConnectionFactory. Contributed by Haohui Mai.
new bf3271b HDFS-5341. Reduce fsdataset lock duration during directory scanning. Contributed by Qus-Jiawei.
new 4004a42 HDFS-5404 Resolve regressions in Windows compatibility on HDFS-4949 branch. Contributed by Chris Nauroth.
new b3195f1 HADOOP-10064. Upgrade to maven antrun plugin version 1.7 (Arpit Agarwal via jeagles)
new 222dbfe HDFS-5405. Fix possible RetryCache hang for caching RPC handlers in FSNamesystem. (Contributed by Andrew Wang)
new 1fcc24d Merging r1535122 through r1535532 from trunk to HDFS-2832
new e87b2a3 merge trunk into HDFS-4949 branch
new 6772d07 YARN-1335. Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication (Sandy Ryza)
new 05f3551 HDFS-5171. NFS should create input stream for a file and try to share it with multiple read requests. Contributed by Haohui Mai
new dc2ee20 HDFS-5419. Fixup test-patch.sh warnings on HDFS-4949 branch. (wang)
new 83609cd merge trunk to hdfs-4949 branch
new ec01db5 HDFS-5417. Fix storage IDs in PBHelper and UpgradeUtilities.
new 9043a92 Merge r1535533 through r1535791 from trunk.
new 5829029 HDFS-5257. addBlock() retry should return LocatedBlock with locations else client will get AIOBE. Contributed by Vinay.
new 025f171 YARN-1333. Support blacklisting in the Fair Scheduler (Tsuyoshi Ozawa via Sandy Ryza)
new b4a5476 YARN-1333: Add missing file SchedulerAppUtils
new 7e820b9 HADOOP-10072. TestNfsExports#testMultiMatchers fails due to non-deterministic timing around cache expiry check. Contributed by Chris Nauroth.
new b9d561c HDFS-5214. Fix NPEs in BlockManager and DirectoryScanner.
new 67b93d6 Merging r1535792 through r1536181 from trunk to HDFS-2832.
new b623e18 YARN-1022. Unnecessary INFO logs in AMRMClientAsync (haosdent via bikas)
new dc0b44a HDFS-5435. File append fails to initialize storageIDs. (Junping Du)
new 22593df YARN-1349. yarn.cmd does not support passthrough to any arbitrary class. Contributed by Chris Nauroth.
new a2d81e3 HDFS-5413. hdfs.cmd does not support passthrough to any arbitrary class. Contributed by Chris Nauroth.
new 84cec3c MAPREDUCE-4680. Job history cleaner should only check timestamps of files in old enough directories (Robert Kanter via Sandy Ryza)
new 1b48f44 Merge HDFS-4949 branch back into trunk
new defa7af YARN-1109. Demote NodeManager "Sending out status for container" logs to debug (haosdent via Sandy Ryza)
new e0c99b8 MAPREDUCE-5596. Allow configuring the number of threads used to serve shuffle connections. Contributed by Sandy Ryza
new c964379 MAPREDUCE-5598. TestUserDefinedCounters.testMapReduceJob is flakey. Contributed by Robert Kanter
new 16359ec Merging r1536182 through r1536558 from trunk to branch HDFS-2832
new 0ac867c move HDFS-4657 to branch-2.2.1
new 03510d0 YARN-1068. Add admin support for HA operations (Karthik Kambatla via bikas)
new c2495a7 Merging r1536572 from trunk to branch HDFS-2832
new 73cf16c Merging r1536573 through r1536889 from trunk to branch HDFS-2832
new 7dd201c Fix inadvertent file changes made via r1536888 (bikas)
new 68a79b0 HDFS-5436. Move HsFtpFileSystem and HFtpFileSystem into org.apache.hdfs.web. (Contributed by Haohui Mai)
new 87adffe YARN-1306. Clean up hadoop-sls sample-conf according to YARN-1228 (Wei Yan via Sandy Ryza)
new 75a162f HDFS-5433. When reloading fsimage during checkpointing, we should clear existing snapshottable directories. Contributed by Aaron T. Myers.
new 9c29b86 HDFS-5432. TestDatanodeJsp fails on Windows due to assumption that loopback address resolves to host name localhost. Contributed by Chris Nauroth.
new 6aeaef9 HDFS-5386. Add feature documentation for datanode caching. Contributed by Colin Patrick McCabe.
new 4eebf56 Merging r1536890 through r1537251 from trunk to branch HDFS-2832
new 218ef59 YARN-1357. TestContainerLaunch.testContainerEnvVariables fails on Windows. Contributed by Chuan Liu.
new fc2a13c YARN-1358. TestYarnCLI fails on Windows due to line endings. Contributed by Chuan Liu.
new ff549fa HDFS-5065. Change attribution in CHANGES.txt to version 2.2.1.
new b8f1d13 YARN-1321. Changed NMTokenCache to support both singleton and an instance usage. Contributed by Alejandro Abdelnur.
new e42b179 HDFS-4633. Change attribution in CHANGES.txt to version 2.2.1.
new 2af5083 HDFS-5437. Fix TestBlockReport and TestBPOfferService failures.
new 990dcae YARN-1343. NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs. (tucu)
new 9f4d4e2 YARN-891. Modified ResourceManager state-store to remember completed applications so that clients can get information about them post RM-restart. Contributed by Jian He.
new a891076 Merging r1537252 through r1537583 from trunk to branch HDFS-2832
new 9a204f8 YARN-1381. Same relaxLocality appears twice in exception message of AMRMClientImpl#checkLocalityRelaxationConflict() (Ted Yu via Sandy Ryza)
new 9aa2f51 HADOOP-9898. Set SO_KEEPALIVE on all our sockets. Contributed by Todd Lipcon.
new 30007fd YARN-1290. Let continuous scheduling achieve more balanced task assignment (Wei Yan via Sandy Ryza)
new da317f2 YARN-786. Expose application resource usage in RM REST API (Sandy Ryza)
new 86dc50c MAPREDUCE-5601. ShuffleHandler fadvises file regions as DONTNEED even when fetch fails (Sandy Ryza)
new 1606a76 MAPREDUCE-5604. TestMRAMWithNonNormalizedCapabilities fails on Windows due to exceeding max path length. Contributed by Chris Nauroth.
new 3b91b7d HDFS-5037. Active NN should trigger its own edit log rolls. Contributed by Andrew Wang.
new b7aca6b HADOOP-10079. log a warning message if group resolution takes too long (cmccabe)
new f607a8d Move HDFS-5035 to 2.2.1 in CHANGES.txt
new cbdeba2 HDFS-5447. Fix TestJspHelper in branch HDFS-2832.
new 833da65 HDFS-5344. Make LsSnapshottableDir as Tool interface implementation. Contributed by Sathish.
new 7abf7e8 HADOOP-9478. Fix race conditions during the initialization of Configuration related to deprecatedKeyMap (cmccabe)
new 26a1fda HDFS-5452. Fix TestReplicationPolicy and TestBlocksScheduledCounter.
new 7e46025 Merge r1537584 through r1538407 from trunk.
new 9660bfa HDFS-5448. Datanode should generate its ID on first registration
new 0091606 HDFS-5448. Fix break caused by previous checkin for HDFS-5448.
new 1d35736 HDFS-5455. NN should update storageMap on first heartbeat.
new d2b7b65 HDFS-5457. Fix TestDatanodeRegistration, TestFsck and TestAddBlockRetry. (Contributed by szetszwo)
new ee279fb YARN-1323. Set HTTPS webapp address along with other RPC addresses in HAUtil (Karthik Kambatla via Sandy Ryza)
new d12010e YARN-1388. Fair Scheduler page always displays blank fair share (Liyin Liang via Sandy Ryza)
new c47b3d7 HDFS-5456. NameNode startup progress creates new steps if caller attempts to create a counter for a step that doesn't already exist. Contributed by Chris Nauroth.
new a6250a4 HDFS-5427. Not able to read deleted files from snapshot directly under snapshottable dir after checkpoint and NN restart. Contributed by Vinay.
new 4550eac YARN-1374. Changed ResourceManager to start the preemption policy monitors as active services. Contributed by Karthik Kambatla.
new 8639ecb HDFS-5458. Datanode failed volume threshold ignored if exception is thrown in getDataDirsFromURIs. Contributed by Mike Mellenthin.
new 6990355 YARN-311. RM/scheduler support for dynamic resource configuration. (Junping Du via llu)
new 3e3fea7 HDFS-5466. Update storage IDs when the pipeline is updated. (Contributed by szetszwo)
new 103fd6c Merging r1538408 through r1539244 from trunk to branch HDFS-2832
new fa5ba6d HDFS-5439. Fix TestPendingReplication. (Contributed by Junping Du, Arpit Agarwal)
new ab33d54 HADOOP-9623. Update jet3t dependency to 0.9.0 (Amandeep Khurana via Colin Patrick McCabe)
new 98aa1ae move HADOOP-9623 to 2.2.1
new bee6822 MAPREDUCE-5451. MR uses LD_LIBRARY_PATH which doesn't mean anything in Windows. Contributed by Yingda Chen.
new 75777f1 HDFS-5470. Add back trunk's reportDiff algorithm to the branch.
new 87dc1b6 HADOOP-9660. Update CHANGES.txt.
new a604e3b HDFS-5472. Fix TestDatanodeManager, TestSafeMode and TestNNThroughputBenchmark. (Contributed by szetszwo)
new 2af29af Merging r1539245 through r1539736 from trunk to branch HDFS-2832
new 16c6755 HDFS-5252. Stable write is not handled correctly in someplace. Contributed by Brandon Li
new 9964a94 HDFS-5443. Delete 0-sized block when deleting an under-construction file that is included in snapshot. Contributed by Jing Zhao.
new 77afc60 HDFS-5468. CacheAdmin help command does not recognize commands (Stephen Chu via Colin Patrick McCabe)
new 3fccdec HDFS-5364. Add OpenFileCtx cache. Contributed by Brandon Li
new f79b3e6 HDFS-5326. add modifyDirective to cacheAdmin (cmccabe)
new 06d24ef HDFS-5475. NN incorrectly tracks more than one replica per DN.
new 6b0611e Merging r1539737 through r1539896 from trunk to branch HDFS-2832
new 97199ba HDFS-5394: Fix race conditions in DN caching and uncaching (cmccabe)
new f2ad787 HDFS-5476. Snapshot: clean the blocks/files/directories under a renamed file/directory while deletion. Contributed by Jing Zhao.
new a4bc1a6 HDFS-5371. Let client retry the same NN when dfs.client.test.drop.namenode.response.number is enabled. Contributed by Jing Zhao.
new 90d1b1b HDFS-5481. Fix TestDataNodeVolumeFailure in branch HDFS-2832. (Contributed by Junping Du)
new e28015e YARN-1121. Changed ResourceManager's state-store to drain all events on shut-down. Contributed by Jian He.
new 37bc8e0 HDFS-5325. Remove WebHdfsFileSystem#ConnRunner. Contributed by Haohui Mai.
new fccbb50 merge of r1535792 through r1540238 from trunk.
new 25ebe6b HDFS-5482. DistributedFileSystem#listPathBasedCacheDirectives must support relative paths. Contributed by Colin Patrick McCabe.
new fe08488 HADOOP-10088. copy-nativedistlibs.sh needs to quote snappy lib dir. Contributed by Raja Aluri.
new ec9ec00 HDFS-5469. Add configuration property for the sub-directroy export path. Contributed by Brandon Li
new 907fb15 HDFS-5480. Update Balancer for HDFS-2832. (Contributed by szetszwo)
new bb5bd30 Merging r1540239 through r1540547 from trunk to branch HDFS-2832
new a161ff8 HDFS-5486. Fix TestNameNodeMetrics for HDFS-2832.
new 9673baa HDFS-5320. Add datanode caching metrics. Contributed by Andrew Wang.
new 38a3b92 MAPREDUCE-5186. mapreduce.job.max.split.locations causes some splits created by CombineFileInputFormat to fail. Contributed by Robert Parker and Jason Lowe
new 2b3e1ab HDFS-5467. Remove tab characters in hdfs-default.xml. Contributed by Shinichi Yamashita.
new 5a5ba62 YARN-1395. Distributed shell application master launched with debug flag can hang waiting for external ls process. Contributed by Chris Nauroth.
new 72c6d62 YARN-1387. RMWebServices should use ClientRMService for filtering applications (Karthik Kambatla via Sandy Ryza)
new f10642a HDFS-5488. Clean up TestHftpURLTimeout. Contributed by Haohui Mai.
new 26f2bd6 HDFS-5491. Update editsStored for HDFS-2832.
new ec5eebc Merging r1540548 through r1540909 from trunk to branch HDFS-2832
new 646fcc8 HDFS-5495. Remove further JUnit3 usages from HDFS. Contributed by Jarek Jarcec Cecho.
new 455269c Move HDFS-5495 to 2.3.0 in CHANGES.txt
new e5b3171 HDFS-5494. Fix findbugs warnings for HDFS-2832.
new eeda370 MAPREDUCE-1176. FixedLengthInputFormat and FixedLengthRecordReader (Mariappan Asokan and BitsOfInfo via Sandy Ryza)
new 214fa10 YARN-1400. yarn.cmd uses HADOOP_RESOURCEMANAGER_OPTS. Should be YARN_RESOURCEMANAGER_OPTS. Contributed by Raja Aluri.
new 8162fdc HDFS-5425. Renaming underconstruction file with snapshots can make NN failure on restart. Contributed by Vinay and Jing Zhao.
new ce35e09 HDFS-5471. CacheAdmin -listPools fails when user lacks permissions to view all pools (Andrew Wang via Colin Patrick McCabe)
new 9d06631 HDFS-5450. better API for getting the cached blocks locations. Contributed by Andrew Wang.
new ba98e8f merge r1535792 through r1541341 from trunk.
new cccee53 HADOOP-10093. hadoop-env.cmd sets HADOOP_CLIENT_OPTS with a max heap size that is too small. Contributed by Shanyu Zhao.
new 46cbce9 HDFS-5508. Fix compilation error after merge. (Contributed by szetszwo)
new d06a782 HDFS-5501. Fix pendingReceivedRequests tracking in BPServiceActor.
new 656e859 YARN-1386. NodeManager mistakenly loses resources and relocalizes them (Jason Lowe via jeagles)
new 39def49 HDFS-5485. add command-line support for modifyDirective (cmccabe)
new e94ed91 MAPREDUCE-5613. DefaultSpeculator holds and checks hashmap that is alway empty (Gera Shegalov via Sandy Ryza)
new 744506f MAPREDUCE-5610. TestSleepJob fails in jdk7. Contributed by Jonathan Eagles
new bf9f851 Merging r1541342 through r1541617 from trunk to branch HDFS-2832
new 3c591aa HDFS-5366. recaching improvements (cmccabe)
new 1c211f6 HDFS-5440. Extract the logic of handling delegation tokens in HftpFileSystem to the TokenAspect class. Contributed by Haohui Mai.
new 70e4645 HADOOP-9594 commons-math
new 4a0f804 MAPREDUCE-5431 Missing pom dependency in MR-client
new ced740e HDFS-5474. Deletesnapshot can make Namenode in safemode on NN restarts. Contributed by Sathish.
new 1a38b48 HDFS-5075 httpfs-config.sh calls out incorrect env script name
new 01ccd4d MAPREDUCE-5624 Move grizzly-test and junit dependencies to test scope
new f22b512 Move HDFS-5325 and HDFS-5488 from BUG-FIX to IMPROVEMENT in CHANGES.txt.
new c02629f HADOOP-10078. KerberosAuthenticator always does SPNEGO. (rkanter via tucu)
new e432553 HADOOP-9956. RPC listener inefficiently assigns connections to readers (daryn)
new 732dc44 Move HADOOP-9956 to correct release in CHANGES.txt
new 3727ac9 HADOOP-10095. In CodecPool, synchronize pool and codecList separately in order to reduce lock contention. Contributed by Nicolas Liochon
new de92716 HDFS-5444. Choose default web UI based on browser capabilities. Contributed by Haohui Mai.
new 735aae3 HDFS-5504. In HA mode, OP_DELETE_SNAPSHOT is not decrementing the safemode threshold, leads to NN safemode. Contributed by Vinay.
new b771197 HDFS-5487. Introduce unit test for TokenAspect. Contributed by Haohui Mai.
new 3d95049 MAPREDUCE-5481. Enable uber jobs to have multiple reducers (Sandy Ryza)
new bd5b23f HADOOP-10067 Missing POM dependency on jsr305
new fe67e30 HDFS-4995. Make getContentSummary less expensive. Contributed by Kihwal Lee.
new 95a87ca HADOOP-10094. NPE in GenericOptionsParser#preProcessForWindows(). Contributed by Enis Soztutar.
new 797159b YARN-1222. Make improvements in ZKRMStateStore for fencing (Karthik Kambatla via bikas)
new 88c4d4a MAPREDUCE-5616. MR Client-AppMaster RPC max retries on socket timeout is too high. Contributed by Chris Nauroth.
new ea1c5ea HDFS-5510. Fix a findbug warning in DataStorage.java on HDFS-2832 branch. (Contributed by Junping Du)
new 43fa41f HDFS-5506. Use URLConnectionFactory in DelegationTokenFetcher. Contributed by Haohui Mai.
new 1a76ccb YARN-1401. With zero sleep-delay-before-sigkill.ms, no signal is ever sent (Gera Shegalov via Sandy Ryza)
new ceea91c HDFS-5438. Flaws in block report processing can cause data loss. Contributed by Kihwal Lee.
new ea83f79 add .classpath, .project and .settings to svn:ignore.
new 3858b90 YARN-1392. Allow sophisticated app-to-queue placement policies in the Fair Scheduler (Sandy Ryza)
new 6ac4ac0 YARN-1392: Add new files
new 1da8136 HADOOP-9955. RPC idle connection closing is extremely inefficient (daryn)
new 6141d2e HADOOP-10100. MiniKDC shouldn't use apacheds-all artifact. (rkanter via tucu)
new 132a8ff Merging r1541618 through r1542122 from trunk to branch HDFS-2832
new 620890f HDFS-5489. Use TokenAspect in WebHDFSFileSystem. Contributed by Haohui Mai.
new cd76848 HDFS-5515. Fix TestDFSStartupVersions for HDFS-2832.
new f7efa0b YARN-1411. HA config shouldn't affect NodeManager RPC addresses (Karthik Kambatla via bikas)
new a2200a6 HDFS-5519. COMMIT handler should update the commit status after sync. Contributed by Brandon Li
new fef8f49 HDFS-5502. Fix HTTPS support in HsftpFileSystem. Contributed by Haohui Mai.
new a02e60f MAPREDUCE-5373. TestFetchFailure.testFetchFailureMultipleReduces could fail intermittently (jeagles)
new fdad179 MAPREDUCE-5625. TestFixedLengthInputFormat fails in jdk7 environment (Mariappan Asokan via jeagles)
new e3d7ef3 HDFS-5372. In FSNamesystem, hasReadLock() returns false if the current thread holds the write lock (Contributed by Vinay)
new bd5ab41 Merging r1542123 through r1543110 from trunk to branch HDFS-2832
new e77aec0 YARN-1419. TestFifoScheduler.testAppAttemptMetrics fails intermittently under jdk7. Contributed by Jonathan Eagles
new 9bb9051 HADOOP-10110. hadoop-auth has a build break due to missing dependency. (Contributed by Chuan Liu)
new e68e3e4 HDFS-5393. Serve bootstrap and jQuery locally. Contributed by Haohui Mai.
new 4341562 YARN-709. Added tests to verify validity of delegation tokens and logging of appsummary after RM restart. Contributed by Jian He.
new 4f15d0a HDFS-5520. loading cache path directives from edit log doesnt update nextEntryId (cmccabe)
new 70234e2 HDFS-5512. CacheAdmin -listPools fails with NPE when user lacks permissions to view all pools (awang via cmccabe)
new c3c626d HDFS-5073. TestListCorruptFileBlocks fails intermittently.
new cfa7831 YARN-1210. Changed RM to start new app-attempts on RM restart only after ensuring that previous AM exited or after expiry time. Contributed by Omkar Vinit Joshi.
new 512475e YARN-674. Fixed ResourceManager to renew DelegationTokens on submission asynchronously to work around potential slowness in state-store. Contributed by Omkar Vinit Joshi.
new aa00234 HDFS-5428. Under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode. Contributed by Jing Zhao.
new 229472c HADOOP-10107. Server.getNumOpenConnections may throw NPE. Contributed by Kihwal Lee.
new 9ff520b YARN-584. In scheduler web UIs, queues unexpand on refresh. (Harshit Daga via Sandy Ryza)
new b96cc8f HADOOP-10047. Add a direct-buffer based apis for compression. Contributed by Gopal V.
new 3c9cbc6 Merging r1543111 through r1543509 from trunk to branch HDFS-2832
new a6acf72 Revert HADOOP-10047, wrong patch.
new d9ba056 HADOOP-10047. Add a direct-buffer based apis for compression. Contributed by Gopal V.
new c78c0e2 YARN-786: Addendum so that RMAppAttemptImpl#getApplicationResourceUsageReport won't return null
new 587f68b HDFS-1386. TestJMXGet fails in jdk7 (jeagles)
new 00d9b8e HDFS-5513. CacheAdmin commands fail when using . as the path. Contributed by Andrew Wang.
new 2f6b393 YARN-1407. RM Web UI and REST APIs should uniformly use YarnApplicationState (Sandy Ryza)
new efea68d HDFS-5511. improve CacheManipulator interface to allow better unit testing (cmccabe)
new 22b5352 Move YARN-1407 under 2.2.1 in CHANGES.txt
new 8caae1d YARN-744. Race condition in ApplicationMasterService.allocate .. It might process same allocate request twice resulting in additional containers getting allocated. (Omkar Vinit Joshi via bikas)
new 59393e0 Merging r1543613 through r1543709 from trunk to branch HDFS-2832
new f26d2ad HDFS-4516. Client crash after block allocation and NN switch before lease recovery for the same file can cause readers to fail forever. Contributed by Vinay.
new 04cf2a7 HDFS-5014. Process register commands with out holding BPOfferService lock. Contributed by Vinay.
new 2d9692a HDFS-5527. Fix TestUnderReplicatedBlocks on branch HDFS-2832.
new c131ae3 HDFS-5525. Inline dust templates for new Web UI. Contributed by Haohui Mai.
new 7574775 Merging r1543710 through r1543901 from trunk to branch HDFS-2832
new 8313697 YARN-1425. TestRMRestart fails because MockRM.waitForState(AttemptId) uses current attempt instead of the attempt passed as argument (Omkar Vinit Joshi via bikas)
new 916ab92 HDFS-5451. Add byte and file statistics to PathBasedCacheEntry. Contributed by Colin Patrick McCabe.
new 3cae2ba HDFS-3987. Support webhdfs over HTTPS. Contributed by Haohui Mai.
new d1fe9e4 YARN-1053. Diagnostic message from ContainerExitEvent is ignored in ContainerImpl (Omkar Vinit Joshi via bikas)
new 5f458ef HDFS-5531. Combine the getNsQuota() and getDsQuota() methods in INode.
new ad558cf YARN-1303. Fixed DistributedShell to not fail with multiple commands separated by a semi-colon as shell-command. Contributed by Xuan Gong.
new a802ef4 YARN-1303. Reverted the wrong patch committed earlier and committing the correct patch now. In one go.
new 39950ce HDFS-5532. Enable the webhdfs by default to support new HDFS web UI. Contributed by Vinay.
new 0aa088e HADOOP-10103 commons-lang->2.6
new 709b74e HADOOP-9114. After defined the dfs.checksum.type as the NULL, write file and hflush will through java.lang.ArrayIndexOutOfBoundsException. Contributed by Sathish.
new 18b53b7 HADOOP-10111. Allow DU to be initialized with an initial value (Kihwal Lee via jeagles)
new f91a45a HDFS-5473. Consistent naming of user-visible caching classes and methods (cmccabe)
new 0a5b049 MAPREDUCE-5631. TestJobEndNotifier.testNotifyRetries fails with Should have taken more than 5 seconds in jdk7. Contributed by Jonathan Eagles
new 16f7fb8 Merging r1543902 through r1544303 from trunk to branch HDFS-2832
new 9863cb1 HDFS-5543. Fix narrow race condition in TestPathBasedCacheRequests (cmccabe)
new b33ff7b HDFS-5547. Fix build break after merge from trunk to HDFS-2832.
new a379a7b HDFS-5288. Close idle connections in portmap. Contributed by Haohui Mai
new 82d0e82 HDFS-5407. Fix typos in DFSClientCache. Contributed by Haohui Mai
new 33a8234 YARN-1320. Fixed Distributed Shell application to respect custom log4j properties file. Contributed by Xuan Gong.
new ce68f41 HDFS-5285. Flatten INodeFile hierarchy: Replace INodeFileUnderConstruction and INodeFileUnderConstructionWithSnapshot with FileUnderContructionFeature. Contributed by jing9
new 8034d04 HDFS-5544. Adding Test case For Checking dfs.checksum.type as NULL value. Contributed by Sathish.
new 105a31e HDFS-5552. Fix wrong information of Cluster summay in dfshealth.html. Contributed by Haohui Mai.
new 4ef4425 Move HDFS-5444 and HDFS-5525 to branch 2.3.0 section in CHANGES.txt
new 97acde2 HDFS-5542. Fix TODO and clean up the code in HDFS-2832. (Contributed by szetszwo)
new f48ea1b Merging r1544304 through r1544665 from trunk to branch HDFS-2832
new 8121112 HDFS-5559. Fix TestDatanodeConfig in HDFS-2832. (Contributed by szetszwo)
new 38f94dc YARN-1423. Support queue placement by secondary group in the Fair Scheduler (Ted Malaska via Sandy Ryza)
new 65ee88b HDFS-5526. Datanode cannot roll back to previous layout version. Contributed by Kihwal Lee.
new eb3c160 HDFS-5533. Symlink delete/create should be treated as DELETE/CREATE in snapshot diff report. Contributed by Binglin Chang.
new b1d6574 HADOOP-10126. LightWeightGSet log message is confusing. Contributed by Vinay.
new 6c243fc YARN-1416. Fixed a few invalid transitions in RMApp, RMAppAttempt and in some tests. Contributed by Jian He.
new c4bddde YARN-1314. Fixed DistributedShell to not fail with multiple arguments for a shell command separated by spaces. Contributed by Xuan Gong.
new d8a2383 HDFS-5538. URLConnectionFactory should pick up the SSL related configuration by default. Contributed by Haohui Mai.
new 4a1acfc HDFS-5548. Use ConcurrentHashMap in portmap. Contributed by Haohui Mai
new 82ff2d3 HDFS-5286. Flatten INodeDirectory hierarchy: Replace INodeDirectoryWithQuota with DirectoryWithQuotaFeature.
new 740cf23 HDFS-5561. FSNameSystem#getNameJournalStatus() in JMX should return plain text instead of HTML. Contributed by Haohui Mai.
new 05a9a80 HDFS-5565. CacheAdmin help should match against non-dashed commands (wang via cmccabe)
new b6d483b HDFS-5568. Support includeSnapshots option with Fsck command. Contributed by Vinay
new 13edb39 HDFS-5556. Add some more NameNode cache statistics, cache pool stats (cmccabe)
new 2214871 HDFS-5545. Allow specifying endpoints for listeners in HttpServer. Contributed by Haohui Mai.
new 8df119d HDFS-5537. Remove FileWithSnapshot interface. Contributed by jing9
new eed47f2 HADOOP-10132. RPC#stopProxy() should log the class of proxy when IllegalArgumentException is encountered. Contributed by Ted Yu
new ec5c8a9 HDFS-5577. NFS user guide update. Contributed by Brandon Li
new 6369c8d YARN-1239. Modified ResourceManager state-store implementations to start storing version numbers. Contributed by Jian He.
new 5ea533c HDFS-5563. NFS gateway should commit the buffered data when read request comes after write to the same file. Contributed by Brandon Li
new bb11d47 HDFS-5562. TestCacheDirectives and TestFsDatasetCache should stub out native mlock. Contributed by Colin Patrick McCabe and Akira Ajisaka.
new 9da451c HDFS-5430. Support TTL on CacheDirectives. Contributed by Andrew Wang.
new 7545d8b YARN-1241. In Fair Scheduler, maxRunningApps does not work for non-leaf queues. (Sandy Ryza)
new 61b6ed7 YARN-1241: Include missing files
new 7b60e94 HADOOP-10135 writes to swift fs over partition size leave temp files and empty output file
new 13331a6 HDFS-5581. NameNodeFsck should use only one instance of BlockPlacementPolicy (vinay via cmccabe)
new 58f73ac move HDFS-5581 to 2.3
new 08d6213 HADOOP-10130. RawLocalFS pread does not track FileSystem Statistics (Binglin Chang via Colin Patrick McCabe)
new 18159be Merging r1544666 through r1547120 from trunk to branch HDFS-2832
new a4e473c Renamed releases. 2.2.1 -> 2.3.0 & 2.3.0 -> 2.4.0
new 7485153 MAPREDUCE-5640. Rename TestLineRecordReader in jobclient module (Jason Lowe via jeagles)
new eec0ec2 Add ACL check to JHS web-services.
new 38a04a3 HDFS-5557. Write pipeline recovery for the last packet in the block may cause rejection of valid replicas. Contributed by Kihwal Lee.
new c58ae26 YARN-1318. Promoted AdminService to an Always-On service and merged it into RMHAProtocolService. Contributed by Karthik Kambatla.
new 3e2c0cd Create branch HDFS-4685 for development of HDFS ACLs.
new 9b08654 HDFS-5560. Trash configuration log statements prints incorrect units. Contributed by Josh Elser.
new 7af12ab HDFS-5558. LeaseManager monitor thread can crash if the last block is complete but another block is not. Contributed by Kihwal Lee.
new a1aa183 HDFS-5484. StorageType and State in DatanodeStorageInfo in NameNode is not accurate. (Contributed by Eric Sirianni)
new 674d51e Merging r1547121 through r1547473 from trunk to branch HDFS-2832
new 9c95015 YARN-895. Changed RM state-store to not crash immediately if RM restarts while the state-store is down. Contributed by Jian He.
new 1234f99 HDFS-4685. Add CHANGES-HDFS-4685.txt.
new 5afc124 MAPREDUCE-5645. TestFixedLengthInputFormat fails with native libs (Mit Desai via jeagles)
new f7fe50d HADOOP-10127. Add ipc.client.connect.retry.interval to control the frequency of connection retries (Karthik Kambatla via Sandy Ryza)
new 61c45aa HDFS-4997. libhdfs does not return correct error code in most cases (cmccabe)
new 5dabc22 YARN-1332. In TestAMRMClient, replace assertTrue with assertEquals where possible (Sebastian Wong via Sandy Ryza)
new 7fe953e YARN-1454. Fixed test failure issue with TestRMRestart. Contributed by Karthik Kambatla.
new b7ce468 Merging r1547474 through r1547657 from trunk to branch HDFS-2832
new 59a2139 HADOOP-10102. Update commons IO from 2.1 to 2.4
new f791e29 HDFS-5555. CacheAdmin commands fail when first listed NameNode is in Standby (jxiang via cmccabe)
new d02baff HDFS-5536. Implement HTTP policy for Namenode and DataNode. Contributed by Haohui Mai.
new 9ba98e6 MAPREDUCE-5632. TestRMContainerAllocator#testUpdatedNodes fails (jeagles)
new f5e83a0 HDFS-4983. Numeric usernames do not work with WebHDFS FS. Contributed by Yongjun Zhang.
new 859e425 Revert HDFS-4983
new 950e064 HDFS-5626. dfsadmin report shows incorrect values (cmccabe)
new 6d5f8eb YARN-1403. Separate out configuration loading from QueueManager in the Fair Scheduler (Sandy Ryza)
new aa4fba6 HDFS-5587. add debug information when NFS fails to start with duplicate user or group names. Contributed by Brandon Li
new 6828337 HDFS-5514. FSNamesystem's fsLock should allow custom implementation (daryn)
new 99aed80 Neglected to add new file in HDFS-5514 (daryn)
new 9ea61e4 HADOOP-10129. Distcp may succeed when it fails (daryn)
new 419783d HADOOP-10081. Client.setupIOStreams can leak socket resources on exception or error. Contributed by Tsuyoshi OZAWA
new 13c5d3e Move HADOOP-10129 from 0.23.10 to 0.23.11 in CHANGES.txt
new 0f2ce45 MAPREDUCE-5409. MRAppMaster throws InvalidStateTransitonException: Invalid event: TA_TOO_MANY_FETCH_FAILURE at KILLED for TaskAttemptImpl. Contributed by Gera Shegalov
new ca9a32c HADOOP-10058. TestMetricsSystemImpl#testInitFirstVerifyStopInvokedImmediately fails on trunk (Chen He via jeagles)
new 55e5b06 HDFS-5630. Hook up cache directive and pool usage statistics. (wang)
new a5fce4f YARN-1447. Common PB type definitions for container resizing. (Wangda Tan via Sandy Ryza)
new 1cdeb83 YARN-1447: Forgot to add new files
new 00718c2 Merging r1547658 through r1548328 from trunk to branch HDFS-2832
new 368d976 YARN-1181. Augment MiniYARNCluster to support HA mode (kasha)
new ef1f556 YARN-1438. Ensure container diagnostics includes exception from container launch. Contributed by Steve Loughran.
new 6b45950 HDFS-5633. Improve OfflineImageViewer to use less memory. Contributed by Jing Zhao.
new eccd7b2 YARN-546. Allow disabling the Fair Scheduler event log. (Sandy Ryza)
new 9df84c3 HDFS-5590. Block ID and generation stamp may be reused when persistBlocks is set to false. Contributed by Jing Zhao.
new 7676641 Merge trunk to HDFS-4685.
new 8897b0c YARN-1450. Fixed test failure in TestUnmanagedAMLauncher by removing its dependency on distributed-shell. Contributed by Binglin Chang.
new 045dc88 HDFS-5312. Generate HTTP/HTTPS URL in DFSUtil#getInfoServer() based on the configured http policy. Contributed by Haohui Mai.
new 7f05910 HADOOP-10142. Avoid groups lookup for unprivileged users such as dr.who (vinay via cmccabe)
new 4c87a27 HDFS-5554. Flatten INodeFile hierarchy: Replace INodeFileWithSnapshot with FileWithSnapshotFeature. Contributed by jing9
new 91d0b47 HDFS-4983. Numeric usernames do not work with WebHDFS FS. Contributed by Yongjun Zhang.
new e1d3670 YARN-807. When querying apps by queue, iterating over all apps is inefficient and limiting (Sandy Ryza)
new 155020a HDFS-5353. Short circuit reads fail when dfs.encrypt.data.transfer is enabled. Contributed by Colin Patrick McCabe.
new 305ae48 YARN-1378. Implemented a cleaner of old finished applications from the RM state-store. Contributed by Jian He.
new 48fb53b YARN-1405. Fixed ResourceManager to not hang when init/start fails with an exception w.r.t state-store. Contributed by Jian He.
new 43c3349 Merging r1548329 through r1549625 from trunk to branch HDFS-2832
new 9c4168f YARN-1448. AM-RM protocol changes to support container resizing (Wangda Tan via Sandy Ryza)
new 87a6db4 HDFS-5629. Support HTTPS in JournalNode and SecondaryNameNode. Contributed by Haohui Mai.
new a6313b1 Merge trunk to HDFS-4685.
new 18d99c1 MAPREDUCE-5656. bzip2 codec can drop records when reading data in splits. Contributed by Jason Lowe
new a0c911a Move HDFS-4983 to 2.3 in CHANGES.txt
new ee5351b MAPREDUCE-5052. Job History UI and web services confusing job start time and job submit time (Chen He via jeagles)
new aff5be2 Merge trunk to HDFS-4685.
new b4d8aab HDFS-5594. FileSystem API for ACLs. Contributed by Chris Nauroth.
new f3cef1c Merging r1549626 through r1549948 from trunk to branch HDFS-2832
new 87734ec Move HDFS-5257,HDFS-5427,HDFS-5443,HDFS-5476,HDFS-5425,HDFS-5474,HDFS-5504,HDFS-5428 into branch-2.3 section.
new 512a18a HDFS-5074. Allow starting up from an fsimage checkpoint in the middle of a segment. Contributed by Todd Lipcon.
new e408ef3 Move entry for HDFS-5074 to correct section.
new 732975b Move HDFS-5283 to section branch-2.3.0
new 327a995 HDFS-5580. Fix infinite loop in Balancer.waitForMoveCompletion. (Binglin Chang via junping_du)
new d33d83b Create a branch for HDFS-5535 Rolling upgrade improvement.
new 94e2e78 YARN-1481. Move internal services logic from AdminService to ResourceManager. (vinodkv via kasha)
new f3db30c YARN-1491. Upgrade JUnit3 TestCase to JUnit 4 (Chen He via jeagles)
new 002840f HADOOP-10087. UserGroupInformation.getGroupNames() fails to return primary group first when JniBasedUnixGroupsMappingWithFallback is used (cmccabe)
new 4ff1a82 YARN-408. Change CapacityScheduler to not disable delay-scheduling by default. Contributed by Mayank Bansal.
new 709040c HDFS-5650. Remove AclReadFlag and AclWriteFlag in FileSystem API. Contributed by Haohui Mai.
new ed4d318 HDFS-5023. TestSnapshotPathINodes.testAllowSnapshot is failing with jdk7 (Mit Desai via jeagles)
new 9678020 HDFS-4201. NPE in BPServiceActor#sendHeartBeat (jxiang via cmccabe)
new cd083aa Merging r1549949 through r1550312 from trunk to branch HDFS-2832
new 8373c41 HDFS-5637. Try to refeatchToken while local read InvalidToken occurred. (Liang Xie via junping_du)
new c656562 Merging r1550313 through r1550355 from trunk to branch HDFS-2832
new fba994f HDFS-5648. Get rid of FsDatasetImpl#perVolumeReplicaMap.
new 9351125 Update CHANGES.txt in preparation for merging branch HDFS-2832 to trunk
new d887c6a svn merge --reintegrate https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-2832 for merging Heterogeneous Storage feature branch
new 329093a HDFS-2832: Update binary file editsStored for TestOfflineEditsViewer
new 5fd7230 HDFS-5647. Merge INodeDirectory.Feature and INodeFile.Feature. Contributed by Haohui Mai.
new ee0530e MAPREDUCE-5674. Missing start and finish time in mapred.JobStatus. Contributed by Chuan Liu.
new a4819e7 HADOOP-10044 Improve the javadoc of rpc code (sanjay Radia)
new 8a79be3 YARN-1325. Modified RM HA configuration validation to also ensure that multiple RMs are configured. Contributed by Xuan Gong.
new 9263f3b HDFS-5596. Implement RPC stubs. Contributed by Haohui Mai.
new 2885060 HADOOP-8753. LocalDirAllocator throws ArithmeticException: divide by zero when there is no available space on configured local dir. Contributed by Benoy Antony.
new 38c32ed YARN-1311. Fixed app specific scheduler-events' names to be app-attempt based. Contributed by Vinod Kumar Vavilapalli
new 791e43c Reverting YARN-1311. Fixed app specific scheduler-events' names to be app-attempt based. Contributed by Vinod Kumar Vavilapalli
new 28db28d YARN-1311. Fixed app specific scheduler-events' names to be app-attempt based. Contributed by Vinod Kumar Vavilapalli
new 8008929 Updated CHANGES.txt for YARN-1311.
new a31a3a6 HDFS-5652. Refactor invalid block token exception handling in DFSInputStream. (Liang Xie via junping_du)
new f24e0c1 Merge trunk to HDFS-4685.
new 1182ca0 YARN-1485. Modified RM HA configuration validation to also ensure that service-address configuration are configured for every RM. Contributed by Xuan Gong.
new d63cfdb YARN-1435. Modified Distributed Shell to accept either the command or the custom script. Contributed by Xuan Gong.
new 44a6560 HDFS-5632. Flatten INodeDirectory hierarchy: Replace INodeDirectoryWithSnapshot with DirectoryWithSnapshotFeature. Contributed by jing9
new 9385659 HDFS-5406. Send incremental block reports for all storages in a single call.
new 1211377 HDFS-5406. Add file missed in previous commit.
new 1dabd42 HDFS-5592. statechangeLog of completeFile should be logged only in case of success. Contributed by Vinay.
new 6c64133 HDFS-5665. Remove the unnecessary writeLock while initializing CacheManager in FsNameSystem Ctor. (Uma Maheswara Rao G via Andrew Wang)
new fc77ed1 MAPREDUCE-5623. TestJobCleanup fails because of RejectedExecutionException and NPE. Contributed by Jason Lowe
new 89a374a HDFS-5454. DataNode UUID should be assigned prior to FsDataset initialization. (Arpit Agarwal)
new 8e32e6a HDFS-5666. Fix inconsistent synchronization in BPOfferService (jxiang via cmccabe)
new d38fb71 YARN-1505. Fixed Webapplication proxy server to not hardcode its bind address. Contributed by Xuan Gong.
new 5a1b335 YARN-1145. Fixed a potential file-handle leak in the web interface for displaying aggregated logs. Contributed by Rohith Sharma.
new 740605c Merge trunk to HDFS-4685.
new 763f073 HADOOP-10106. Incorrect thread name in RPC log messages. Contributed by Ming Ma.
new 0d7b6df Fix CHANGES.txt for HADOOP-8753. Moved entry to correct 2.4.0 section.
new 49ad07a YARN-312. Introduced ResourceManagerAdministrationProtocol changes to support changing resources on node. Contributed by Junping Du.
new 0fc2929 HDFS-5350. Name Node should report fsimage transfer time as a metric. Contributed by Jimmy Xiang.
new a6754bb YARN-1451. TestResourceManager relies on the scheduler assigning multiple containers in a single node update. (Sandy Ryza via kasha)
new b774d7b YARN-1446. Changed client API to retry killing application till RM acknowledges so as to account for RM crashes/failover. Contributed by Jian He.
new 44429c4 MAPREDUCE-5679. TestJobHistoryParsing has race condition. Contributed by Liyin Liang
new 926a867 HADOOP-10168. fix javadoc of ReflectionUtils#copy. Contributed by Thejas Nair.
new 991c453 HDFS-5431. Support cachepool-based limit management in path-based caching. (awang via cmccabe)
new 5792d59 HDFS-5657. race condition causes writeback state error in NFS gateway. Contributed by Brandon Li
new 124e507 HDFS-5634. Allow BlockReaderLocal to switch between checksumming and not (cmccabe)
new 7f53e90 Move HDFS-5538, HDFS-5545, HDFS-5536, HDFS-5312, and HDFS-5629 from trunk to 2.4.0 section.
new 9218b4a MAPREDUCE-5197. Add a service for checkpointing task state. Contributed by Carlo Curino
new ca12515 YARN-1028. Added FailoverProxyProvider capability to ResourceManager to help with RM failover. Contributed by Karthik Kambatla.
new 9ca394d MAPREDUCE-5189. Add policies and wiring to respond to preemption requests from YARN. Contributed by Carlo Curino.
new d52bfde MAPREDUCE-5687. Fixed failure in TestYARNRunner caused by YARN-1446. Contributed by Jian He.
new 504bd0b HDFS-5674. Editlog code cleanup: remove @SuppressWarnings("deprecation") in FSEditLogOp; change FSEditLogOpCodes.fromByte(..) to be more efficient; and change Some fields in FSEditLog to final.
new af367d14 HADOOP-9611 mvn-rpmbuild against google-guice > 3.0 yields missing cglib dependency
new a5ec6df HADOOP-10171. TestRPC fails intermittently on jkd7 (Mit Desai via jeagles)
new 9184c4d MAPREDUCE-5687. Correcting the previous commit by ushing the right patch.
new c9d7413 HADOOP-10164. Allow UGI to login with a known Subject (bobby)
new 788fca4 HDFS-5496. Make replication queue initialization asynchronous. Contributed by Vinay.
new fc96646 HDFS-5662. Can't decommission a DataNode due to file's replication factor larger than the rest of the cluster size. Contributed by Brandon Li
new 90122f2 HDFS-5676. fix inconsistent synchronization of CachingStrategy (cmccabe)
new e07f3c8 YARN-1471. Preserve scheduler typeinfo in simulator to work with resource monitors. Contributed by Carlo Curino.
new a9d80ae HDFS-5661. Browsing FileSystem via web ui, should use datanode's fqdn instead of ip address. Contributed by Benoy Antony.
new 93907ba YARN-1307. Redesign znode structure for Zookeeper based RM state-store for better organization and scalability. Contributed by Tsuyoshi OZAWA.
new b0947f9 HDFS-5663 make the retry time and interval value configurable in openInfo()
new d4e1081 HDFS-5663 make the retry time and interval value configurable in openInfo()
new 42e7446 HDFS-5540. Fix intermittent failure in TestBlocksWithNotEnoughRacks. (Binglin Chang via junping_du)
new 011a7b2 HADOOP-10172. Cache SASL server factories (daryn)
new c7153e1 HDFS-5679. TestCacheDirectives should handle the case where native code is not available. (wang)
new 7730629 HADOOP-10141. Create KeyProvider API to separate encryption key storage from the applications. (omalley)
new c552d5d HDFS-5685. Implement ACL as a INode feature. Contributed by Haohui Mai.
new 72b0b18 Merge trunk to HDFS-4685.
new 04d139e HDFS-5681. renewLease should not hold fsn write lock. Contributed by Daryn Sharp.
new 74689ab YARN-1180. Update capacity scheduler docs to include types on the configs (Chen He via jeagles)
new 1b9b956 MAPREDUCE-5692. Add explicit diagnostics when a task attempt is killed due to speculative execution (Gera Shegalov via Sandy Ryza)
new 17a3d72 HDFS-5691. Fix typo in ShortCircuitLocalRead document. Contributed by Akira Ajisaka.
new 04dac63 MAPREDUCE-5550. Task Status message (reporter.setStatus) not shown in UI with Hadoop 2.0 (Gera Shegalov via Sandy Ryza)
new 71b4903 HADOOP-10169. Remove the unnecessary synchronized in JvmMetrics class. Contributed by Liang Xie.
new 86e5db3 HDFS-2933. Fix incorrect target version in CHANGES.txt
new b9ae308 HDFS-5636. Enforce a max TTL per cache pool (awang via cmccabe)
new 624703e YARN-1028. Addendum patch. Added FailoverProxyProvider capability to ResourceManager to help with RM failover.
new e8de319 HDFS-5690. DataNode fails to start in secure mode when dfs.http.policy equals to HTTP_ONLY. Contributed by Haohui Mai.
new 150440c HADOOP-10175. Har files system authority should preserve userinfo. Contributed by Chuan Liu.
new 25e9d2e HDFS-5618. NameNode: persist ACLs in fsimage. Contributed by Haohui Mai.
new c3b56ed HDFS-5619. NameNode: record ACL modifications to edit log. Contributed by Haohui Mai.
new eaa5321 Merge trunk to HDFS-4685.
new d841a0f YARN-1172. Convert SecretManagers in RM to services (Tsuyoshi OZAWA via kasha)
new 53bc888 HADOOP-10090. Jobtracker metrics not updated properly after execution of a mapreduce job. Contributed by Ivan Mitic.
new 3ee7f20 YARN-1527. Fixed yarn rmadmin command to print the correct usage info. Contributed by Akira AJISAKA.
new 839512a Update CHANGES-HDFS-4685.txt for several issues that have been converted to Hadoop Common sub-tasks of HADOOP-10184.
new 1c9ac9a YARN-1523. Use StandbyException instead of RMNotYetReadyException (kasha)
new abe13d6 HADOOP-10187. add getfacl and setfacl with minimal support for getting and setting ACLs. Contributed by Vinay.
new 29dac1d HADOOP-10192. FileSystem#getAclStatus has incorrect JavaDocs. Contributed by Chris Nauroth.
new defeef6 YARN-1481. Addendum patch to fix synchronization in AdminService
new 8f0bf54 YARN-1541. Changed ResourceManager to invalidate ApplicationMaster host/port information once an AM crashes. Contributed by Jian He.
new 1152e23 YARN-1463. Tests should avoid starting http-server where possible or creates spnego keytab/principals (vinodkv via kasha)
new cc4c74b MAPREDUCE-5694. Fixed MR AppMaster to shutdown the LogManager so as to avoid losing syslog in some conditions. Contributed by Mohammad Kamrul Islam.
new 47cca0c MAPREDUCE-5196. Add bookkeeping for managing checkpoints of task state. Contributed by Carlo Curino
new e712007 YARN-1481. Reverting addendum patch
new 5a54b91 HDFS-5675. Add Mkdirs operation to NNThroughputBenchmark. Contributed by Plamen Jeliazkov.
new c179d58 Add updated editsStored files missing from initial HDFS-5636 commit.
new e596f17 HDFS-5582. hdfs getconf -excludeFile or -includeFile always failed (satish via cmccabe)
new 7f86c81 HDFS-5701. Fix the CacheAdmin -addPool -maxTtl option name. Contributed by Stephen Chu.
new b524501 MAPREDUCE-5685. Fixed a bug with JobContext getCacheFiles API inside the WrappedReducer class. Contributed by Yi Song.
new 50480f8 YARN-1522. Fixed a race condition in the test TestApplicationCleanup that was causing it to randomly fail. Contributed by Liyin Liang.
new 460ac8c YARN-1121. Addendum patch. Fixed AsyncDispatcher hang issue during stop due to a race condition caused by the previous patch. Contributed by Jian He.
new 97e881b HDFS-5671. Fix socket leak in DFSInputStream#getBlockReader. Contributed by JamesLi
new 07e4fb1 HDFS-5708. The CacheManager throws a NPE in the DataNode logs when processing cache reports that refer to a block not known to the BlockManager. Contributed by Colin Patrick McCabe.
new 75d882b HADOOP-10147 HDFS-5678 Upgrade to commons-logging 1.1.3 to avoid potential deadlock in MiniDFSCluster
new fe458a1 HADOOP-10173. Remove UGI from DIGEST-MD5 SASL server creation. Contributed by Daryn Sharp.
new bb2e2fe YARN-1549. Fixed a bug in ResourceManager's ApplicationMasterService that was causing unamanged AMs to not finish correctly. Contributed by haosdent.
new 3a299fd HADOOP-10198. DomainSocket: add support for socketpair. Contributed by Colin Patrick McCabe.
new a44ddd6 Amend CHANGES.txt for HADOOP-10198
new b4eb963 HDFS-5659. dfsadmin -report doesn't output cache information properly. Contributed by Andrew Wang.
new a45017a YARN-1493. Changed ResourceManager and Scheduler interfacing to recognize app-attempts separately from apps. Contributed by Jian He.
new d85c017 HDFS-5651. Remove dfs.namenode.caching.enabled and improve CRM locking. Contributed by Colin Patrick McCabe.
new 498f967 Merge r1550130 through r1555020 from trunk.
new 551034d add CHANGES_HDFS-5535.txt.
new 1a8781f MAPREDUCE-5689. MRAppMaster does not preempt reducers when scheduled maps cannot be fulfilled. (lohit via kasha)
new 71e6ea4 HDFS-5695. Clean up TestOfflineEditsViewer and OfflineEditsViewerHelper. Contributed by Haohui Mai.
new b80343a HDFS-5705. TestSecondaryNameNodeUpgrade#testChangeNsIDFails may fail due to ConcurrentModificationException. Contributed by Ted Yu
new f8a9329 HDFS-5667. Include DatanodeStorage in StorageReport. (Arpit Agarwal)
new fb2406a HADOOP-10193. hadoop-auth's PseudoAuthenticationHandler can consume getInputStream. (gchanan via tucu)
new 410f3a9 HDFS-5667. Add test missed in previous checkin
new 76238b9 MAPREDUCE-3310. Custom grouping comparator cannot be set for Combiners (tucu)
new 2cddd21 YARN-1559. Race between ServerRMProxy and ClientRMProxy setting RMProxy#INSTANCE. (kasha and vinodkv via kasha)
new f342dbc YARN-1560. Fixed TestYarnClient#testAMMRTokens failure with null AMRM token. (Contributed by Ted Yu)
new 2a1ecd0 HDFS-5220. Expose group resolution time as metric (jxiang via cmccabe)
new 8deb7a6 HDFS-5589. Namenode loops caching and uncaching when data should be uncached. (awang via cmccabe)
new bfd227b HDFS-5719. FSImage#doRollback() should close prevState before return. Contributed by Ted Yu
new 0c591a6 MAPREDUCE-3310. Addendum fixing javadocs warnings (tucu)
new cbdad3d HADOOP-10201. Add listing to KeyProvider API. (Larry McCay via omalley)
new 5241aa4 HDFS-2832. Update CHANGES.txt to reflect merge to branch-2
new c658567 HDFS-5673. Implement logic for modification of ACLs. Contributed by Chris Nauroth.
new 2fbb3d6 Merge trunk to HDFS-4685.
new c3cc855 YARN-1029. Added embedded leader election in the ResourceManager. Contributed by Karthik Kambatla.
new 785c120 YARN-1409. NonAggregatingLogHandler can throw RejectedExecutionException. Contributed by Tsuyoshi OZAWA
new 332c270 YARN-1293. Fixed TestContainerLaunch#testInvalidEnvSyntaxDiagnostics failure caused by non-English system locale. Contributed by Tsuyoshi OZAWA.
new 70cff9e HDFS-5715. Use Snapshot ID to indicate the corresponding Snapshot for a FileDiff/DirectoryDiff. Contributed by Jing Zhao.
new 4931545 YARN-1482. Modified WebApplicationProxy to make it work across ResourceManager fail-over. Contributed by Xuan Gong.
new 53b27fc HDFS-5724. modifyCacheDirective logging audit log command wrongly as addCacheDirective (Uma Maheswara Rao G via Colin Patrick McCabe)
new 1be8ee2 HDFS-5649. Unregister NFS and Mount service when NFS gateway is shutting down. Contributed by Brandon Li
new 076ecf7 HDFS-5726. Fix compilation error in AbstractINodeDiff for JDK7. Contributed by Jing Zhao.
new 49ec397 YARN-1568. Rename clusterid to clusterId in ActiveRMInfoProto (kasha)
new f3ee35a Merge r1555021 through r1556550 from trunk.
new 963e174 HADOOP-10208. Remove duplicate initialization in StringUtils.getStringCollection. Contributed by Benoy Antony.
new 023c11e HDFS-5737. Replacing only the default ACL can fail to copy unspecified base entries from the access ACL. Contributed by Chris Nauroth.
new 21d4167 HDFS-5739. ACL RPC must allow null name or unspecified permissions in ACL entries. Contributed by Chris Nauroth.
new fbf1227 HADOOP-10207. TestUserGroupInformation#testLogin is flaky (jxiang via cmccabe)
new 17ab353 Merge trunk to HDFS-4685.
new 519d5d3 HADOOP-10214. Fix multithreaded correctness warnings in ActiveStandbyElector (Liang Xie via kasha)
new 7186000 HDFS-5721. sharedEditsImage in Namenode#initializeSharedEdits() should be closed before method returns. (Ted Yu via junping_du)
new b4d6c58 HDFS-5449. WebHdfs compatibility broken between 2.2 and 1.x / 23.x. Contributed by Kihwal Lee.
new 8b2c8a6 YARN-1138. yarn.application.classpath is set to point to etc., which does not work on Windows. Contributed by Chuan Liu.
new ed3f145 HADOOP-9420. Add percentile or max metric for rpcQueueTime, processing time. Contributed by Liang Xie.
new 3f98288 YARN-1579. ActiveRMInfoProto fields should be optional (kasha)
new 4563ba0 HDFS-5645. Support upgrade marker in editlog streams.
new 1c7aa44 Merge r1555021 through r1557038 from trunk.
new 1393581 YARN-1490. Introduced the ability to make ResourceManager optionally not kill all containers when an ApplicationMaster exits. Contributed by Jian He.
new a0ecb98a YARN-1033. Expose RM active/standby state to Web UI and REST API (kasha)
new 8e0ba42 HADOOP-10178. Configuration deprecation always emit "deprecated" warnings when a new key is used. Contributed by Shanyu Zhao.
new 7354547 HDFS-5756. hadoopRzOptionsSetByteBufferPool does not accept NULL argument, contrary to docs. Contributed by Colin Patrick McCabe.
new 6608b75 YARN-1574. RMDispatcher should be reset on transition to standby. (Xuan Gong via kasha)
new 9d382a4 HDFS-5747. Fix NPEs in BlockManager. (Arpit Agarwal)
new f065f58 HADOOP-10220. Add ACL indicator bit to FsPermission. Contributed by Chris Nauroth.
new c90211a Merge trunk to HDFS-4685.
new f677175 YARN-1166. Fixed app-specific and attempt-specific QueueMetrics to be triggered by accordingly app event and attempt event. Contributed by Zhijie Shen
new 25bc68d YARN-1041. Added the ApplicationMasterProtocol API for applications to use the ability in ResourceManager to optionally not kill containers when the ApplicationMaster exits. Contributed by Jian He.
new aa0c489 YARN-1566. Changed Distributed Shell to retain containers across application attempts. Contributed by Jian He.
new bc2a443 HADOOP-10223. MiniKdc#main() should close the FileReader it creates. (Ted Yu via tucu)
new 7c8b654 YARN-888. Cleaned up POM files so that non-leaf modules don't include any dependencies and thus compact the dependency list for leaf modules. Contributed by Alejandro Abdelnur.
new e06ae2d HDFS-5710. FSDirectory#getFullPathName should check inodes against null. Contributed by Uma Maheswara Rao G.
new e210519 HDFS-5579. Under construction files make DataNode decommission take very long hours. Contributed by zhaoyunjiong.
new 782a223 HADOOP-10228. FsPermission#fromShort() should cache FsAction.values(). Contributed by Haohui Mai.
new 0b6a236 Adding 2.0.6-alpha release to the CHANGES.txt
new 4b16c2b HDFS-5677. Need error checking for HA cluster configuration. Contributed by Vincent Sheffer.
new f4fd050 YARN-1567. In Fair Scheduler, allow empty queues to change between leaf and parent on allocation file reload (Sandy Ryza)
new d13c2ee YARN-1598. HA-related rmadmin commands don't work on a secure cluster (kasha)
new 578dae9 HDFS-5704. Change OP_UPDATE_BLOCKS with a new OP_ADD_BLOCK. Contributed by Jing Zhao.
new a913cdb HADOOP-10234. "hadoop.cmd jar" does not propagate exit code. Contributed by Chris Nauroth.
new 5fe73a9 HDFS-5752. Add a new DFSAdmin command to query, start and finalize rolling upgrade.
new 4a1abe5 Merge r1555021 through r1558254 from trunk.
new 5ed1772 YARN-1603. Remove two *.orig files which were unexpectedly committed. (Zhijie Shen via junping_du)
new 2400f79 svn merge -c -1558337 . for reverting YARN-1603, which only partly committed.
new 4d41335 YARN-1603. Remove two *.orig files which were unexpectedly committed. (Zhijie Shen via junping_du)
new 0ff3d63 YARN-1601. 3rd party JARs are missing from hadoop-dist output. (tucu)
new 349f25a HADOOP-10236. Fix typo in o.a.h.ipc.Client#checkResponse. Contributed by Akira Ajisaka.
new 037a89a HDFS-5762. BlockReaderLocal does not return -1 on EOF when doing zero-length reads (cmccabe)
new c3b236c HDFS-5766. In DFSInputStream, do not add datanode to deadNodes after InvalidEncryptionKeyException in fetchBlockByteRange (Liang Xie via Colin Patrick McCabe)
new d3cb721 HADOOP-10125. no need to process RPC request if the client connection has been dropped. Contributed by Min Ma
new 51a9755 Fix CHANGE.txt for the contributor's name
new 7274b5f YARN-1351. Invalid string format in Fair Scheduler log warn message (Konstantin Weitz via Sandy Ryza)
new ca5d73d HDFS-5768. Consolidate the serialization code in DelegationTokenSecretManager. Contributed by Haohui Mai
new a506df8 HDFS-5775. Consolidate the code for serialization in CacheManager. Contributed by Haohui Mai
new e02ded8 HDFS-5777. Update LayoutVersion for the new editlog op OP_ADD_BLOCK. Contributed by Jing Zhao.
new 3a6f8b8 MAPREDUCE-5724. JobHistoryServer does not start if HDFS is not running. (tucu)
new e05ff82 HADOOP-10177. Create CLI tools for managing keys. (Larry McCay via omalley)
new 7524414 YARN-1608. LinuxContainerExecutor has a few DEBUG messages at INFO level (kasha)
new 3928de2 YARN-1606. Fix the default value of yarn.resourcemanager.zk-timeout-ms in yarn-default.xml (kasha)
new 5421725 HADOOP-10146. Workaround JDK7 Process fd close bug (daryn)
new a6ea460 MAPREDUCE-5672. Provide optional RollingFileAppender for container log4j (syslog). Contributed by Gera Shegalov
new 7981908 backported HADOOP-10125 to branch2, update CHANGES.txt
new ccee5b3 Moving MR-5672 from bugs to improvements in CHANGES.txt
new a7ec44d HDFS-5784. Reserve space in edit log header and fsimage header for feature flag section (cmccabe)
new 67cbde3 YARN-1496. Protocol additions to allow moving apps between queues (Sandy Ryza)
new f667371 MAPREDUCE-5650. Job fails when hprof mapreduce.task.profile.map/reduce.params is specified (Gera Shegalov via Sandy Ryza)
new fb01200 HDFS-5794. Fix the inconsistency of layout version number of ADD_DATANODE_AND_STORAGE_UUIDS between trunk and branch-2. Contributed by Jing Zhao.
new ebb9a70 Move HDFS-5704 and HDFS-5777 to the correct section in CHANGES.txt
new cdc54c8 HADOOP-10235. Hadoop tarball has 2 versions of stax-api JARs. (tucu)
new 0fd646b MAPREDUCE-5717. Task pings are interpreted as task progress. Contributed by Jason Lowe
new 5300294 HDFS-5758. NameNode: complete implementation of inode modifications for ACLs. Contributed by Chris Nauroth.
new d7979b8 HADOOP-10240. Windows build instructions incorrectly state requirement of protoc 2.4.1 instead of 2.5.0. Contributed by Chris Nauroth.
new 6a52feb HDFS-5612. NameNode: change all permission checks to enforce ACLs in addition to permissions. Contributued by Chris Nauroth.
new 4b0ae92 Update hadoop-common/CHANGES.txt for HADOOP-10112 in branch2.3
new 09b8ce5 HDFS-5786. Support QUERY and FINALIZE actions of rolling upgrade.
new 1025121 Merge r1555021 through r1559304 from trunk.
new 8a9a6db Merge trunk to HDFS-4685.
new 602f71a HDFS-5800. Fix a typo in DFSClient.renewLease(). Contributed by Kousuke Saruta
new cae96df HADOOP-10213. Fix bugs parsing ACL spec in FsShell setfacl. Contributed by Vinay.
new 2fbe823 Merge trunk to HDFS-4685.
new 9df3387 HDFS-5613. NameNode: implement handling of ACLs in combination with symlinks. Contributed by Chris Nauroth.
new c5a241f MAPREDUCE-5729. mapred job -list throws NPE (kasha)
new 362e4fc MAPREDUCE-5725. Make explicit that TestNetworkedJob relies on the Capacity Scheduler (Sandy Ryza)
new e0ce554 YARN-1616. RMFatalEventDispatcher should log the cause of the event (kasha)
new d8bc523 HDFS-5753. Add new NN startup options for downgrade and rollback using upgrade marker.
new b2dd9d7 HBASE-10143 replace WritableFactories's hashmap with ConcurrentHashMap (Liang Xie via Stack)
new 2af05fb HDFS-5615. NameNode: implement handling of ACLs in combination with sticky bit. Contributed by Chris Nauroth.
new d1963ad MAPREDUCE-5693. Restore MRv1 behavior for log flush. Contributed by Gera Shegalov
new 21a5bc7 HADOOP-10241. Clean up output of FsShell getfacl. Contributed by Chris Nauroth.
new cc7cc5a HDFS-5748. Too much information shown in the dfs health page. Contributed by Haohui Mai
new 83280a4 HDFS-5434. Change block placement policy constructors from package private to protected. (Buddy Taylor via Arpit Agarwal)
new aa2d151 Move HADOOP-10143 to 2.4 section of CHANGES.txt
new ba6f1a2 HADOOP-10252. HttpServer can't start if hostname is not specified. Contributed by Jimmy Xiang.
new 1a7e158 YARN-1624. QueuePlacementPolicy format is not easily readable via a JAXB parser (Aditya Acharya via Sandy Ryza)
new 5e09ae1 HDFS-5703. Add support for HTTPS and swebhdfs to HttpFS. (tucu)
new 2de391d Move HDFS-4949 subtasks in CHANGES.txt to a new section under 2.4.0 release.
new 8ceddeb YARN-1607. TestRM relies on the scheduler assigning multiple containers in a single node update (Sandy Ryza)
new 1633487 YARN-1623. Include queue name in RegisterApplicationMasterResponse (Sandy Ryza)
new 1c602f7 HDFS-5806. Balancer should set soTimeout to avoid indefinite hangs. Contributed by Nathan Roberts.
new 122be11 MAPREDUCE-5723. MR AM container log can be truncated or empty. (Mohammad Kamrul Islam via kasha)
new 482993a YARN-1573. ZK store should use a private password for root-node-acls. (kasha)
new 824dcdb HDFS-5789. Some of snapshot APIs missing checkOperation double check in fsn. Contributed by Uma Maheswara Rao G.
new ff43021 HDFS-5788. listLocatedStatus response can be very large. Contributed by Nathan Roberts.
new a4e66e0 HDFS-5241. Provide alternate queuing audit logger to reduce logging contention (daryn)
new cd7cd94 HDFS-5799. Make audit logging consistent across ACL APIs. Contributed by Chris Nauroth.
new 738b076 Merge trunk to HDFS-4685.
new 4c197b5 HADOOP-10167. Mark hadoop-common source as UTF-8 in Maven pom files / refactoring. Contributed by Mikhail Antonov.
new 817be26 HADOOP-10248. Property name should be included in the exception where property value is null. Contributed by Akira AJISAKA.
new 2017684 Addendum patch for HADOOP-9652 to fix performance problems. Contributed by Andrew Wang
new 3497e76 YARN-1575. Public localizer crashes with "Localized unkown resource". Contributed by Jason Lowe
new dd1bc7e HDFS-5728. Block recovery will fail if the metafile does not have crc for all chunks of the block. Contributed by Vinay.
new befb254 HDFS-5343. When cat command is issued on snapshot files, getting unexpected result. Contributed by Sathish.
new edb6dc5 HDFS-5138. Support HDFS upgrade in HA. Contributed by Aaron T. Myers.
new cbee889 YARN-321. Merging YARN-321 branch to trunk. svn merge ../branches/YARN-321
new df000e6 YARN-1625. Fixed RAT warnings after YARN-321 merge. Contributed by Shinichi Yamashita.
new 9875656 YARN-1613. Fixed the typo with the configuration name YARN_HISTORY_SERVICE_ENABLED. Contributed by Akira Ajisaka.
new a9110e1 Merge r1555021 through r1561510 from trunk.
new 5e2d2dd HADOOP-10203. Connection leak in Jets3tNativeFileSystemStore#retrieveMetadata. Contributed by Andrei Savu.
new b98b344 HADOOP-10277. setfacl -x fails to parse ACL spec if trying to remove the mask entry. Contributed by Vinay.
new ad240d6 Merge trunk to HDFS-4685.
new 0be0174 HADOOP-10086. User document for authentication in secure cluster. (Contributed by Masatake Iwasaki)
new 4b61ff2 HDFS-5781. Use an array to record the mapping between FSEditLogOpCode and the corresponding byte value. Contributed by Jing Zhao.
new 70165d8 HDFS-5825. Use FileUtils.copyFile() to implement DFSTestUtils.copyFile(). (Contributed by Haohui Mai)
new e9f7f36 HADOOP-9982. Fix dead links in hadoop site docs. (Contributed by Akira Ajisaka)
new 55407fe Fix correct CHANGES.txt for HADOOP-10086 and HADOOP-9982.
new 746ffd9 HADOOP-10212. Incorrect compile command in Native Library document. (Contributed by Akira Ajisaka)
new c5286c7 HDFS-5297. Fix dead links in HDFS site documents. (Contributed by Akira Ajisaka)
new e21a03f HADOOP-10250. VersionUtil returns wrong value when comparing two versions. Contributed by Yongjun Zhang.
new 6016d7d HADOOP-10288. Explicit reference to Log4JLogger breaks non-log4j users. Contributed by Todd Lipcon.
new 07c004d HDFS-5830. WebHdfsFileSystem.getFileBlockLocations throws IllegalArgumentException when accessing another cluster. (Yongjun Zhang via Colin Patrick McCabe)
new 52372eb HADOOP-10274 Lower the logging level from ERROR to WARN for UGI.doAs method (Takeshi Miao via stack)
new b8776ee HDFS-5833. Fix incorrect javadoc in SecondaryNameNode. (Contributed by Bangtao Zhou)
new 917502e HDFS-5835. Add a new option for starting Namenode when rolling upgrade is in progress.
new efcdf81 Merge r1555021 through r1561943 from trunk.
new 87166f1 HADOOP-9830. Fix typo at http://hadoop.apache.org/docs/current/ (Contributed by Kousuke Saruta)
new 33a4774 HADOOP-10255. Rename HttpServer to HttpServer2 to retain older HttpServer in branch-2 for compatibility. Contributed by Haohui Mai.
new a99d420 HADOOP-10255. Adding missed CHANGES.txt from change 1561959.
new 8006467 YARN-1642. RMDTRenewer#getRMClient should use ClientRMProxy (kasha)
new 7f2b01a YARN-1629. IndexOutOfBoundsException in MaxRunningAppsEnforcer (Sandy Ryza)
new 2a20fe8 MAPREDUCE-5464. Add analogs of the SLOTS_MILLIS counters that jive with the YARN resource model (Sandy Ryza)
new 3f79e49 YARN-1630. Introduce timeout for async polling operations in YarnClientImpl (Aditya Acharya via Sandy Ryza)
new 874d3d4 HADOOP-10291. TestSecurityUtil#testSocketAddrWithIP fails due to test order dependency. (Contributed by Mit Desai)
new d9d8027 HDFS-5844. Fix broken link in WebHDFS.apt.vm (Contributed by Akira Ajisaka)
new 4de2bd3 YARN-1600. RM does not startup when security is enabled without spnego configured. Contributed by Haohui Mai
new f1cef4c YARN-1618. Fix invalid RMApp transition from NEW to FINAL_SAVING (kasha)
new e260377 Remove HADOOP-10112 from CHANGES.txt
new 8c505ad HDFS-5842. Cannot create hftp filesystem when using a proxy user ugi and a doAs on a secure cluster. Contributed by Jing Zhao.
new ed551ff Update HDFS and Common CHANGES.txt post branch-2.3 reswizzle.
new db80705 MAPREDUCE-5732. Report proper queue when job has been automatically placed (Sandy Ryza)
new f51c7eb Add missing file for MAPREDUCE-5732
new c96d078 HDFS-5845. SecondaryNameNode dies when checkpointing with cache pools.
new 799ad3d HDFS-5841. Update HDFS caching documentation with new changes. (wang)
new 504b0d6 Update CHANGES.txt to move HDFS-5842 to 2.3.0
new a3151a9 HADOOP-10305. Add rpc.metrics.quantile.enable and rpc.metrics.percentiles.intervals to core-default.xml. Contributed by Akira Ajisaka.
new 4b4241c HDFS-5702. FsShell Cli: Add XML based End-to-End test for getfacl and setfacl commands. Contributed by Vinay.
new 10ef8a4 Merge trunk to HDFS-4685.
new 0f3461e HDFS-5492. Port HDFS-2069 (Incorrect default trash interval in the docs) to trunk. (Contributed by Akira Ajisaka)
new 285854f HADOOP-10310. SaslRpcServer should be initialized even when no secret manager present. Contributed by Aaron T. Myers.
new 21f797e Updating YARN's CHANGES.txt to reflect the recent rebase of unreleased 2.3 to more latest branch-2.
new 95074f0 Updating trunk's MAPREDUCE CHANGES.txt to reflect the recent rebase of unreleased 2.3 to more latest branch-2.
new 3d9ad8e HDFS-5843. DFSClient.getFileChecksum() throws IOException if checksum is disabled. Contributed by Laurent Goujon.
new f874b20 HADOOP-10139. Update and improve the Single Cluster Setup document. (Contributed by Akira Ajisaka)
new d0b4c7d Updating branch-2's MAPREDUCE CHANGES.txt to reflect the recent rebase of unreleased 2.3 to more latest branch-2. Updating trunk's MAPREDUCE CHANGES.txt to fix more differences with branch-2's CHANGES.txt MAPREDUCE's CHANGES.txt is foobar'ed. There are still a bunch of misplaced CHANGES.txt entries - not fixing them now.
new 10f0901 Updating branch-2.3's YARN's CHANGES.txt to reflect the recent rebase of unreleased 2.3 to more latest branch-2. Fixing entry for MAPREDUCE-5732 in trunk and branch-2.
new 6ada3c7 Updating trunk's YARN CHANGES.txt after YARN-321 merge.
new fd2ba49 HDFS-5790. LeaseManager.findPath is very slow when many leases need recovery. Contributed by Todd Lipcon.
new 1cac66c YARN-1617. Remove ancient comment and surround LOG.debug in AppSchedulingInfo.allocate (Sandy Ryza)
new 7a03dc0 HDFS-5608. WebHDFS: implement ACL APIs. Contributed by Sachin Jose and Renil Joseph.
new 067d52b HADOOP-10295. Allow distcp to automatically identify the checksum type of source files and use it for the target. Contributed by Jing Zhao and Laurent Goujon.
new 981679e YARN-1498. Common scheduler changes for moving apps between queues (Sandy Ryza)
new f9699ce HADOOP-10317. Rename branch-2.3 release version from 2.4.0-SNAPSHOT to 2.3.0-SNAPSHOT.
new 0006789 HDFS-5754. Split LayoutVerion into NameNodeLayoutVersion and DataNodeLayoutVersion. Contributed by Brandon Li
new f297240 Merge r1555021 through r1563041 from trunk.
new edad2f6 HADOOP-10313. Script and jenkins job to produce Hadoop release artifacts. (tucu)
new ed097d2 Add .classpath, .project, .settings and target to svn:ignore.
new 7039b77 HDFS-5856. DataNode.checkDiskError might throw NPE. Contributed by Josh Elser.
new 5d4bd6a YARN-1632. TestApplicationMasterServices should be under org.apache.hadoop.yarn.server.resourcemanager package (Chen He via jeagles)
new 1e44917 YARN-1632. TestApplicationMasterServices should be under org.apache.hadoop.yarn.server.resourcemanager package (Chen He via jeagles)
new c654c2e HDFS-5849. Removing ACL from an inode fails if it has only a default ACL. Contributed by Chris Nauroth.
new d5f4f76 HADOOP-10270. getfacl does not display effective permissions of masked. Contributed by Chris Nauroth.
new 22c7344 HADOOP-10320. Javadoc in InterfaceStability.java lacks final </ul>. Contributed by René Nyffenegger.
new 5a2428d HADOOP-10311. Cleanup vendor names from the code base. (tucu)
new 5beeb30 HDFS-5153. Datanode should send block reports for each storage in a separate message. (Arpit Agarwal)
new 14f1f76 HDFS-5614. NameNode: implement handling of ACLs in combination with snapshots. Contributed by Chris Nauroth.
new 1f7dd78 HDFS-5804. HDFS NFS Gateway fails to mount and proxy when using Kerberos. Contributed by Abin Shahab.
new fa99a84 HDFS-5858. Refactor common ACL test cases to be run through multiple FileSystem implementations. Contributed by Chris Nauroth.
new 9e8cabf Merge trunk to HDFS-4685.
new f6bfe98 HDFS-5859. DataNode#checkBlockToken should check block tokens even if security is not enabled (cmccabe)
new 6e8c1bf YARN-1633. Defined user-facing entity, entity-info and event objects related to Application Timeline feature. Contributed by Zhijie Shen.
new 140246b HDFS-5746. Add ShortCircuitSharedMemorySegment (cmccabe)
new 1079c37 YARN-1504. RM changes for moving apps between queues (Sandy Ryza)
new 3fd9f29 HDFS-5860. Refactor INodeDirectory getDirectoryXFeature methods to use common getFeature helper method. Contributed by Jing Zhao.
new 0abf8e5 HDFS-5861. Add CLI test for Ls output for extended ACL marker. Contributed by Vinay.
new 4f92eb2 HDFS-5848. Add rolling upgrade status to heartbeat response.
new 35e59ee Merge r1555021 through r1563384 from trunk.
new 94b512b HDFS-5828. BlockPlacementPolicyWithNodeGroup can place multiple replicas on the same node group when dfs.namenode.avoid.write.stale.datanode is true. (Buddy via junping_du)
new 88d8ea9 HADOOP-10085. CompositeService should allow adding services while being inited. (Steve Loughran via kasha)
new ca72e11 YARN-1611. Introduced the concept of a configuration provider which can be used by ResourceManager to read configuration locally or from remote systems so as to help RM failover. Contributed by Xuan Gong.
new cb5e078 YARN-1498 addendum to fix findbugs warning
new 3e7d566 YARN-1639. Modified RM HA configuration handling to have a way of not requiring separate configuration files for each RM. Contributed by Xuan Gong.
new eac066b YARN-1659. Defined the ApplicationTimelineStore store as an abstraction for implementing different storage impls for storing timeline information. Contributed by Billie Rinaldi.
new eff1e80 YARN-1668. Modified RM HA handling of admin-acls to be available across RM failover by making using of a remote configuration-provider. Contributed by Xuan Gong.
new 24fa232 YARN-1667. Modified RM HA handling of super users (with proxying ability) to be available across RM failover by making using of a remote configuration-provider. Contributed by Xuan Gong.
new 60c0fe8 HADOOP-10244. TestKeyShell improperly tests the results of delete (Larry McCay via omalley)
new 6439cd0 HDFS-5767. NFS implementation assumes userName userId mapping to be unique, which is not true sometimes. Contributed by Yongjun Zhang
new dd7fa03 Fix YARN's CHANGES.txt issue caused during the commit for YARN-1667.
new a8c780d YARN-1673. Fix option parsing in YARN's application CLI after it is broken by YARN-967. Contributed by Mayank Bansal.
new 39ecc46 YARN-1285. Changed the default value of yarn.acl.enable in yarn-default.xml to be consistent with what exists (false) in the code and documentation. Contributed by Kenji Kikushima.
new 786d71b YARN-1684. Fixed history server heap size in yarn script. Contributed by Billie Rinaldi.
new cd1e8d2 HDFS-5791. TestHttpsFileSystem should use a random port to avoid binding error during testing. Contributed by Haohui Mai
new b812af9 YARN-1669. Modified RM HA handling of protocol level service-ACLS to be available across RM failover by making using of a remote configuration-provider. Contributed by Xuan Gong.
new 96578f0 YARN-1634. Added a testable in-memory implementation of ApplicationTimelineStore. Contributed by Zhijie Shen.
new 0aa09f6 HDFS-5399. Revisit SafeModeException and corresponding retry policies. Contributed by Haohui Mai.
new 747cce8 Correct CHANGES.txt entry for HDFS-5399 (contributed by Jing, not Haohui)
new ebe0c17 YARN-1461. Added tags for YARN applications and changed RM to handle them. Contributed by Karthik Kambatla.
new cec3691 HADOOP-10273. Fix 'mvn site'.
new d6bd920 HDFS-5709. Improve NameNode upgrade with existing reserved paths and path components. Contributed by Andrew Wang.
new 484faad YARN-1636. Augmented Application-history server's web-services to also expose new APIs for retrieving and storing timeline information. Contributed by Zhijie Shen.
new e6eccf2 YARN-1499. Fair Scheduler changes for moving apps between queues (Sandy Ryza)
new dcaaeef Addendum patch for HDFS-5709, add missing license header.
new 69dbf0b HDFS-5876. SecureDataNodeStarter does not pick up configuration in hdfs-site.xml. Contributed by Haohui Mai.
new d598b6e HDFS-5873. dfs.http.policy should have higher precedence over dfs.https.enable. Contributed by Haohui Mai.
new 996e25c HADOOP-10325. Improve Jenkins Javadoc warnings from test-patch.sh (cmccabe)
new b2ce764 HDFS-5890. Avoid NPE in Datanode heartbeat. Contributed by Vinay
new b36cc29 MAPREDUCE-5743. Fixed the test failure in TestRMContainerAllocator. Contributed by Vinod Kumar Vavilapalli.
new 24775c1 YARN-1628. Fixed the test failure in TestContainerManagerSecurity. Contributed by Vinod Kumar Vavilapalli.
new ab96a08 HDFS-5881. Fix skip() of the short-circuit local reader(legacy). Contributed by Kihwal Lee.
new 4594b74 MAPREDUCE-5699. Allow setting tags on MR jobs (kasha)
new c4b0ce0 HADOOP-10327. Trunk windows build broken after HDFS-5746. Contributed by Vinay.
new 6182e75 YARN-1661. Fixed DS ApplicationMaster to write the correct exit log. Contributed by Vinod Kumar Vavilapalli.
new b527a97 MAPREDUCE-5743. Fixed CHANGES.txt to give credit to Ted too.
new e0cda48 HDFS-4911. Reduce PeerCache timeout to be commensurate with dfs.datanode.socket.reuse.keepalive (cmccabe)
new 12c2582 HDFS-5895. HDFS cacheadmin -listPools has exit_code of 1 when the command returns 0 result. Contributed by Tassapol Athiapinya.
new 0001e39 HADOOP-10273. Update CHANGES.txt to reflect new target version is 2.3
new 914a970 MAPREDUCE-5744. Job hangs because RMContainerAllocator.preemptReduce() violates the comparator contract (Gera Shegalov via kasha)
new 943b219 YARN-1689. Made RMAppAttempt get killed when RMApp is at ACCEPTED. Contributed by Vinod Kumar Vavilapalli.
new fe2fb24 HDFS-5807. TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails intermittently. Contributed by Chen He.
new 0bf97bd HADOOP-10330. TestFrameDecoder fails if it cannot bind port 12345.
new c780454 HDFS-5869. When starting rolling upgrade or NN restarts, NN should create a checkpoint right before the upgrade marker.
new 30294a2 YARN-1665. Simplify the configuration of RM HA by having better default values. Contributed by Xuan Gong.
new ccf08d9 Merge r1555021 through r1565516 from trunk.
new 8b2336f YARN-1660. Simplified the RM HA configuration to accept and be able to simply depend just on configuration properties of the form yarn.resourcemanager.hostname.RMID and use the default ports for all service addresses. Contributed by Xuan Gong.
new 300e490 HDFS-5874. Should not compare DataNode current layout version with that of NameNode in DataStrorage.
new c79cc3a YARN-1497. Command line additions for moving apps between queues (Sandy Ryza)
new 7045214 YARN-1493,YARN-1490,YARN-1041, YARN-1166,YARN-1566,YARN-1689,YARN-1661 are reverted from branch-2.3. Updating YARN's CHANGES.txt.
new d01158a HDFS-5882. TestAuditLogs is flaky (jxiang via cmccabe)
new 60eca33 HDFS-5900. Cannot set cache pool limit of unlimited via CacheAdmin. Contributed by Andrew Wang.
new c89c516 HDFS-5616. NameNode: implement default ACL handling. Contributed by Chris Nauroth.
new d57c6e0 YARN-1672. YarnConfiguration is missing a default for yarn.nodemanager.log.retain-seconds (Naren Koneru via kasha)
new 23b2e43 YARN-1635. Implemented a Leveldb based ApplicationTimelineStore. Contributed by Billie Rinaldi.
new dd2eb97 HDFS-5899. Add configuration flag to disable/enable support for ACLs. Contributed by Chris Nauroth.
new c6505f0 Merge trunk to HDFS-4685.
new a2edb11 HDFS-5698. Use protobuf to serialize / deserialize FSImage. Contributed by Haohui Mai.
new 2ed075e Merging r1566042 through r1566364 from trunk.
new 204704a HDFS-5837. dfs.namenode.replication.considerLoad should consider decommissioned nodes. Contributed by Tao Luo.
new ff24753 HDFS-4370. Fix typo Blanacer in DataNode. Contributed by Chu Tong.
new c7e265b HDFS-5886. Potential null pointer deference in RpcProgramNfs3#readlink(). Contributed by Brandon Li
new 1c151c3 YARN-1497. Fix comment and remove accidental println
new bfd158f HADOOP-10333. Fix grammatical error in overview.html document. Contributed by René Nyffenegger.
new e74e117 YARN-1637. Implemented a client library for Java users to post timeline entities and events. Contributed by Zhijie Shen.
new 1fa6ab2 YARN-1459. Changed ResourceManager to depend its service initialization on the configuration-provider mechanism during startup too. Contributed by Xuan Gong.
new 5c978a4 HDFS-5915. Refactor FSImageFormatProtobuf to simplify cross section reads. Contributed by Haohui Mai.
new 666684e HDFS-5921. Cannot browse file system via NN web UI if any directory has the sticky bit set. Contributed by Aaron T. Myers.
new 7fce641 YARN-1698. Fixed default TimelineStore in code to match what is documented in yarn-default.xml. Contributed by Zhijie Shen.
new 5c7b27b HADOOP-10326. M/R jobs can not access S3 if Kerberos is enabled. Contributed by bc Wong.
new 3587b67 YARN-1706. Created an utility method to dump timeline records to JSON strings. Contributed by Zhijie Shen.
new 3bf2f04 Merge trunk to HDFS-4685.
new d03acc7 HDFS-5914. Incorporate ACLs with the changes from HDFS-5698. Contributed by Haohui Mai.
new c43c9dd Preparing to release hadoop-2.3.0
new 1b9cef0 Release notes for hadoop-2.3.0.
new dd03cd13 Merge trunk to HDFS-4685.
new 9024ad4 YARN-1697. NodeManager reports negative running containers (Sandy Ryza)
new 93eafc8 HDFS-5929. Add blockpool % usage to HDFS federated nn page. Contributed by Siqi Li.
new b0ab36a HDFS-5625. Write end user documentation for HDFS ACLs. Contributed by Chris Nauroth.
new ff0abf1 HDFS-5625. Add documentation example for setting a default ACL. Contributed by Chris Nauroth.
new 6d2a0aa HDFS-5925. ACL configuration flag must only reject ACL API calls, not ACLs present in fsimage or edits. Contributed by Chris Nauroth.
new 98f5da5 Move YARN-1496, YARN-1498, YARN-1504, YARN-1499, and YARN-1497 under 2.4 in CHANGES.txt
new 53fed66 HADOOP-10338. Cannot get the FileStatus of the root inode from the new Globber (cmccabe)
new 1b5254a YARN-1719. Fixed the root path related Jersey warnings produced in ATSWebServices. Contributed by Billie Rinaldi.
new fa78a7a HDFS-4858. HDFS DataNode to NameNode RPC should timeout. Contributed by Henry Wang.
new d82bc78 Fix YARN-1697 in CHANGES.txt
new 41ec3cc YARN-1641. ZK store should attempt a write periodically to ensure it is still Active. (kasha)
new 308f5fa MAPREDUCE-5746. Job diagnostics can implicate wrong task for a failed job. (Jason Lowe via kasha)
new 5efc997 HDFS-5879. Some TestHftpFileSystem tests do not close streams. Contributed by Gera Shegalov.
new beb0d25 HDFS-5810. Unify mmap cache and short-circuit file descriptor cache (cmccabe)
new b3af8ed HDFS-5938. Make BlockReaderFactory#BlockReaderPeer a static class to avoid a findbugs warning (cmccabe)
new ad6bc86 YARN-1531. True up yarn command documentation (Akira Ajisaka via kasha)
new fc14360 HDFS-5923. Do not persist the ACL bit in the FsPermission. Contributed by Haohui Mai.
new ea0b21a HDFS-5933. Optimize the FSImage layout for ACLs. Contributed by Haohui Mai.
new bc939f7 YARN-1692. ConcurrentModificationException in fair scheduler AppSchedulable (Sangjin Lee via Sandy Ryza)
new c6e2f4f Move YARN-1692 in CHANGES.txt
new 256adb2 HDFS-5891. webhdfs should not try connecting the DN during redirection. Contributed by Haohui Mai
new 2624b20 HDFS-5847. Consolidate INodeReference into a separate section. Contributed by Jing Zhao.
new 0185a57 YARN-1578. Fixed reading incomplete application attempt and container data in FileSystemApplicationHistoryStore. Contributed by Shinichi Yamashita.
new dab6359 YARN-1345. Remove FINAL_SAVING state from YarnApplicationAttemptState. Contributed by Zhijie Shen
new f0d64a0 HDFS-5940. Minor cleanups to ShortCircuitReplica, FsDatasetCache, and DomainSocketWatcher (cmccabe)
new 9ee7c2a HDFS-5932. Ls should display the ACL bit. Contributed by Chris Nauroth.
new 4f9bbaa HDFS-5889. When starting rolling upgrade, create a fs image for rollback so that the standby namenode can create checkpoints during upgrade. Contributed by szetszwo & jing9
new a4f152d Merge r1555021 through r1566358 from trunk.
new b045674 HDFS-5904. TestFileStatus fails intermittently. Contributed by Mit Desai.
new e291c79 HDFS-5937. Fix TestOfflineEditsViewer on HDFS-4685 branch. Contributed by Chris Nauroth.
new c17dc01 HDFS-5937. Update CHANGES-HDFS-4685.txt.
new a49dee0 Merge trunk to HDFS-4685.
new 8ffd3a9 HDFS-5941. add dfs.namenode.secondary.https-address and dfs.namenode.secondary.https-address in hdfs-default.xml. Contributed by Haohui Mai.
new 17e4813 HADOOP-10344. Fix TestAclCommands after merging HADOOP-10338 patch. Contributed by Chris Nauroth.
new 934011c Merge trunk to HDFS-4685.
new 2b916db YARN-1676. Modified RM HA handling of user-to-group mappings to be available across RM failover by making using of a remote configuration-provider. Contributed by Xuan Gong.
new 2417ca7 HADOOP-10343. Change info to debug log in LossyRetryInvocationHandler. Contributed by Arpit Gupta
new d0a5e43 YARN-1417. Modified RM to generate container-tokens not at creation time, but at allocation time so as to prevent RM from shelling out containers with expired tokens. Contributed by Omkar Vinit Joshi and Jian He.
new 983f11b HDFS-5913. Nfs3Utils#getWccAttr() should check attr parameter against null. Contributed by Brandon Li
new c122ef9 MAPREDUCE-5670. CombineFileRecordReader should report progress when moving to the next file. Contributed by Chen He
new 9d89fb8 HADOOP-10249. LdapGroupsMapping should trim ldap password read from file. Contributed by Dilli Armugam.
new 2ccc1da HDFS-5934. New Namenode UI back button doesn't work as expected. Contributed by Travis Thompson
new f4c339a HDFS-5901
new 84ae8a3 Move Flatten INode hierarchy jiras (HDFS-5531, HDFS-5285, HDFS-5286, HDFS-5537, HDFS-5554, HDFS-5647, HDFS-5632, HDFS-5715, HDFS-5726) to 2.4.0 section in CHANGES.txt
new 5df82fa HDFS-5907. BlockPoolSliceStorage trash to handle block deletions during rolling upgrade. (Arpit Agarwal)
new 72f63c8 HDFS-5943. 'dfs.namenode.https-address' property is not loaded from configuration in federation setup. Contributed by Suresh Srinivas.
new ba4b103 Merging r1566359 through r1568420 from trunk.
new d8fd23f Merge trunk to HDFS-4685.
new 990cffd YARN-1553. Modified YARN and MR to stop using HttpConfig.isSecure() and instead rely on the http policy framework. And also fix some bugs related to https handling in YARN web-apps. Contributed by Haohui Mai.
new a795bc4 HDFS-5494. Merge Protobuf-based-FSImage code from trunk - fix build break after merge. (Contributed by Jing Zhao)
new 1a68f13 HDFS-5585. Provide admin commands for data node upgrade. Contributed by Kihwal Lee.
new 9830ef0 HDFS-5585. Provide admin commands for data node upgrade. Contributed by Kihwal Lee. (missing file)
new 943d3f6 HADOOP-10342. Add a new method to UGI to use a Kerberos login subject to build a new UGI. (Larry McCay via omalley)
new 0488825 HDFS-3128. Unit tests should not use a test root in /tmp. (wang)
new 8741c3b HDFS-5907. Add test cases missed in previous checkin
new a575509 HDFS-5948. TestBackupNode flakes with port in use error. (Contributed by Haohui Mai)
new a0a5edb HDFS-5949. New Namenode UI when trying to download a file, the browser doesn't know the file name.Contributed by Haohui Mai
new ef90940 HDFS-5716. Allow WebHDFS to use pluggable authentication filter. Contributed by Haohui Mai
new 470d425 HDFS-5920. Support rollback of rolling upgrade in NameNode and JournalNodes. Contributed by Jing Zhao.
new 3f6a6c8 HDFS-5953. TestBlockReaderFactory fails in trunk. (Akira Ajisaka via wang)
new 8b63c41 HDFS-5749. Web UI does not show up during the period of loading FSImage. (Contributed by Haohui Mai)
new a04cb17 HDFS-5698. Update CHANGES.txt to move breakdown of tasks to correct release
new 08e6d31 MAPREDUCE-5757. ConcurrentModificationException in JobControl.toList. Contributed by Jason Lowe
new 2c7dfa2 Fix javadoc in OfflineImageViewer. Contributed by Akira Ajisaka.
new e288316 Merge trunk to HDFS-4685.
new 8d3ae4e Merge trunk to HDFS-4685.
new beb1770 HDFS-4685. Copying HDFS CHANGES.txt from trunk to remove erroneous double entry of HDFS-5698 changes.
new bf5971b HDFS-5959. Fix typo at section name in FSImageFormatProtobuf.java. Contributed by Akira Ajisaka.
new 1417803 Branching for hadoop-2.5 releases.
new 4aa664f HDFS-5780. TestRBWBlockInvalidation times out intemittently. Contributed by Mit Desai.
new 4fe4268 HADOOP-10346. Deadlock while logging tokens. Contributed by Jason Lowe
new 62b023c HDFS-5803. TestBalancer.testBalancer0 fails. Contributed by Chen He.
new e60f5b6 YARN-1721. When moving app between queues in Fair Scheduler, grab lock on FSSchedulerApp (Sandy Ryza)
new bbbe808 YARN-1724. Race condition in Fair Scheduler when continuous scheduling is turned on (Sandy Ryza)
new a845a18 HDFS-5893. HftpFileSystem.RangeHeaderUrlOpener uses the default URLConnectionFactory which does not import SSL certificates. Contributed by Haohui Mai.
new bc962d6 HDFS-5945. Add rolling upgrade information to fsimage; and disallow upgrade and rolling upgrade to be started simultaneously. Contributed by szetszwo & jing9
new 99b4caa Merge r1555021 through r1569522 from trunk.
new 6b03174 YARN-1590. Fixed ResourceManager, web-app proxy and MR JobHistoryServer to expand _HOST properly in their kerberos principles. Contributed by Mohammad Kamrul Islam.
new e408966 Update change description for HDFS-5953
new 3a7e7b3 YARN-1428. Fixed RM to write the final state of RMApp/RMAppAttempt to the application history store in the transition to the final state. (Contributed by Zhijie Shen)
new 7e8d85e HDFS-5961. OIV cannot load fsimages containing a symbolic link. Contributed by Kihwal Lee.
new 909eb7e Merge trunk to HDFS-4685.
new e472ffd HDFS-4685. Move attribution from CHANGES-HDFS-4685.txt to CHANGES.txt in hadoop-common and hadoop-hdfs.
new a9fb0a4 Merge trunk to HDFS-4685.
new 996acc8 YARN-1479. Invalid NaN values in Hadoop REST API JSON response (Chen He via jeagles)
new 3cee918 HDFS-4685. Move attribution to correct section of CHANGES.txt files.
new 9da9f7d YARN-1666. Modified RM HA handling of include/exclude node-lists to be available across RM failover by making using of a remote configuration-provider. Contributed by Xuan Gong.
new b20376d Merge trunk to HDFS-4685.
new b2832e8 HDFS-4685. Correct minor whitespace difference in FSImageSerialization.java in preparation for trunk merge.
new 2fc514b Merge HDFS-4685 to trunk.
new 377424e HDFS-5966. Fix rollback of rolling upgrade in NameNode HA setup. Contributed by jing9
new 72c214c Merge r1555021 through r1569889 from trunk.
new 62d791b YARN-1171. Add default queue properties to Fair Scheduler documentation (Naren Koneru via Sandy Ryza)
new 0e3e91a YARN-1718. Fix a couple isTerminals in Fair Scheduler queue placement rules (Sandy Ryza)
new d69985d HDFS-5974. Fix compilation error, NameNodeLayoutVersion and DataNodeLayoutVersion after merge from trunk.
new 06b504f HDFS-5973. add DomainSocket#shutdown method. (cmccabe)
new 2f34141 HDFS-5318. Support read-only and read-write paths to shared replicas. (Contributed by Eric Sirianni)
new 0369aff HDFS-5868. Make hsync implementation pluggable. (Contributed by Buddy Taylor)
new 5fd5c99 YARN-713. Fixed ResourceManager to not crash while building tokens when DNS issues happen transmittently. Contributed by Jian He.
new e891c55 HDFS-5963. TestRollingUpgrade#testSecondaryNameNode causes subsequent tests to fail. (Contributed by szetszwo)
new 0cd98fd HDFS-5963. Remove empty file TestEditLogUpgradeMarker.java
new 50a0bed HDFS-5976. Create unit tests for downgrade and finalize rolling upgrade. (Contributed by Haohui Mai)
new b952944 HDFS-5483. NN should gracefully handle multiple block replicas on same DN. (Arpit Agarwal)
new e2c0af8 HDFS-5742. DatanodeCluster (mini cluster of DNs) fails to start. (Arpit Agarwal)
new 077adb2 HDFS-5979. Typo and logger fix for fsimage PB code. (wang)
new 2088584 HDFS-5980. Rollback does not need to load edits. Contributed by jing9
new 55aec00 Merge r1569890 through r1570083 from trunk.
new b23f6cc HDFS-5962. Mtime and atime are not persisted for symbolic links. Contributed by Akira Ajisaka.
new 8b19681 HADOOP-10348. Deprecate hadoop.ssl.configuration in branch-2, and remove it in trunk. Contributed by Haohui Mai.
new 89cc2d3 move HADOOP-10348 to branch 2.4.0 section in CHANGES.txt
new 5a3460c Move HDFS-5768 and HDFS-5775 to Section 2.4.0 in CHANGES.txt
new 835484c HADOOP-10328. loadGenerator exit code is not reliable. Contributed by Haohui Mai.
new 12a8aa1 YARN-1736. FS: AppSchedulable.assignContainer's priority argument is redundant. (Naren Koneru via kasha)
new 016d3b8 HDFS-5984. Fix TestEditLog and TestStandbyCheckpoints. Contributed by jing9
new 0b51bdd HDFS-5985. SimulatedFSDataset#disableAndPurgeTrashStorage should not throw UnsupportedOperationException. Contributed by Jing Zhao.
new 7568e2f HDFS-5944. LeaseManager:findLeaseWithPrefixPath can't handle path like /a/b/ and cause SecondaryNameNode failed do checkpoint. Contributed by Yunjiong Zhao
new 329c705 HDFS-5987. Fix findbugs warnings in Rolling Upgrade branch. (Contributed by szetszwo)
new 37afb4d Merge r1569890 through r1570391 from trunk.
new 4da6de1 HDFS-5982. Need to update snapshot manager when applying editlog for deleting a snapshottable directory. Contributed by Jing Zhao.
new 772ead7 YARN-1398. Fixed a deadlock in ResourceManager between users requesting queue-acls and completing containers. Contributed by Vinod Kumar Vavilapalli.
new b00817b HDFS-5988. Bad fsimage always generated after upgrade. (wang)
new c316cd6 HADOOP-10355. Fix TestLoadGenerator#testLoadGenerator. Contributed by Haohui Mai.
new 327d2ce HADOOP-10352. Recursive setfacl erroneously attempts to apply default ACL to files. Contributed by Chris Nauroth.
new 4f8a487 HDFS-5981. loadGenerator exit code is not reliable. Contributed by Haohui Mai.
new da20095 YARN-1071. Enabled ResourceManager to recover cluster metrics numDecommissionedNMs after restarting. Contributed by Jian He.
new aa4cbcf MAPREDUCE-5671. NaN can be created by client and assign to Progress (Chen He via jeagles)
new ce63b04 MAPREDUCE-5671. NaN can be created by client and assign to Progress (Chen He via jeagles)
new 19f8708 MAPREDUCE-5688. TestStagingCleanup fails intermittently with JDK7 (Mit Desai via jeagles)
new 58fb83d HADOOP-10354. TestWebHDFS fails after merge of HDFS-4685 to trunk. Contributed by Chris Nauroth.
new c324f30 HDFS-5935. New Namenode UI FS browser should throw smarter error messages. Cotributed by Travis Thompson.
new 0ad6cdd HDFS-5992. Fix NPE in MD5FileUtils and update editsStored for TestOfflineEditsViewer.
new 78325b0 Merge r1569890 through r1570692 from trunk.
new d61d1c1 HADOOP-10278. Refactor to make CallQueue pluggable. (Contributed by Chris Li)
new 87dce7b YARN-1470. Add audience annotations to MiniYARNCluster. (Anubhav Dhoot via kasha)
new 3f7852b HDFS-5994. Fix TestDataNodeRollingUpgrade. Contributed by Arpit Agarwal
new e69614d HADOOP-10070. RPC client doesn't use per-connection conf to determine server's expected Kerberos principal name. Contributed by Aaron T. Myers.
new e804c92 Merge r1569890 through r1570786 from trunk.
new e062261 YARN-1732. Changed types of related-entities and primary-filters in the timeline-service to be sets instead of maps. Contributed by Billie Rinaldi.
new 84425fb YARN-1687. Renamed user-facing records for the timeline-service to be simply named after 'timeline' instead of 'apptimeline'. Contributed by Zhijie Shen.
new ec23bf4 HADOOP-9968. Makes ProxyUsers to work with NetGroups. Contributed by Benoy Antony.
new e167e58 YARN-1749. Updated application-history related configs to reflect the latest reality and to be consistently named. Contributed by Zhijie Shen.
new db5150b YARN-1742. Fixed javadoc of configuration parameter DEFAULT_NM_MIN_HEALTHY_DISKS_FRACTION. Contributed by Akira Ajisaka.
new 8e7a2b8 HDFS-5999. Do not create rollback fsimage when it already exists. Contributed by Jing Zhao.
new dbf1432 HDFS-6005. Simplify Datanode rollback and downgrade. (Contributed by Suresh Srinivas)
new c066cef HDFS-6004. Change DFSAdmin for rolling upgrade commands. (Contributed by szetszwo)
new 17db74a HDFS-5776 Support 'hedged' reads in DFSClient
new 036af54 HDFS-5776 Support 'hedged' reads in DFSClient
new 1ab2f5a YARN-1678. Fair scheduler gabs incessantly about reservations (Sandy Ryza)
new d07f855 YARN-1686. Fixed NodeManager to properly handle any errors during re-registration after a RESYNC and thus avoid hanging. Contributed by Rohith Sharma.
new 1c6b5d2 HDFS-5583. Make DN send an OOB Ack on shutdown before restarting. Contributed by Kihwal Lee.
new 8c4d805 HDFS-5778. Add rolling upgrade user document.
new 0809f32 Merge r1569890 through r1571508 from trunk.
new ae29d9e MAPREDUCE-5761. Added a simple log message to denote when encrypted shuffle is on in the shuffle-handler. Contributed by Jian He.
new ad70f26 YARN-1734. Fixed ResourceManager to update the configurations when it transits from standby to active mode so as to assimilate any changes that happened while it was in standby mode. Contributed by Xuan Gong.
new 440c3cd HDFS-5922. DN heartbeat thread can get stuck in tight loop. (Arpit Agarwal)
new 98db64d Merge r1569890 through r1571553 from trunk.
new d5639c8 HADOOP-10361. Correct alignment in CLI output for ACLs. Contributed by Chris Nauroth.
new 2c8a6f5 HDFS-6003. Add the new -rollingUpgrade startup option to the namenode usage message. Contributed by Vinayakumar B
new 6c9c314 HDFS-5623. NameNode: add tests for skipping ACL enforcement when permission checks are disabled, user is superuser or user is member of supergroup. Contributed by Chris Nauroth.
new 5a42e1b YARN-1760. TestRMAdminService assumes CapacityScheduler. (kasha)
new df6e1ab HDFS-5939. WebHdfs returns misleading error code and logs nothing if trying to create a file with no DNs in cluster. Contributed by Yongjun Zhang.
new f52fe68 HDFS-6014. Fix findbug warnings introduced by HDFS-5583. Contributed by Kihwal Lee.
new 6780b08 HDFS-6015. Fix TestBlockRecovery#testRaceBetweenReplicaRecoveryAndFinalizeBlock. Contributed by Kihwal Lee.
new 57b2869 HDFS-5924. Utilize OOB upgrade message processing for writes. Contributed by Kihwal Lee.
new fa6e598 HDFS-5498. Improve datanode startup time. Contributed by Kihwal Lee.
new 39c09c4 HDFS-6006. Remove duplicate code in FSNameSystem#getFileInfo. Contributed by Akira Ajisaka.
new abc9a6d Merge r1569890 through r1571813 from trunk.
new e3d2e4c HDFS-6000. Avoid saving namespace when starting rolling upgrade. Contributed by Jing Zhao.
new 9df1c53 HDFS-6017. Query the status of rolling upgrade in the preparation stage in TestRollingUpgrade and TestRollingUpgradeRollback. (Contributed by Haohui Mai)
new 4449247 HDFS-6008. Namenode dead node link is giving HTTP error 500. Contributed by Benoy Antony.
new c7142e7 YARN-1561. Fix a generic type warning in FairScheduler. (Chen He via junping_du)
new 7be2c00 HDFS-5908. Change AclFeature to capture list of ACL entries in an ImmutableList. Contributed by Chris Nauroth.
new 5f9cdbd HDFS-5936. MiniDFSCluster does not clean data left behind by SecondaryNameNode. Contributed by Binglin Chang.
new c8182ea HDFS-6020. Fix the five findbugs warnings. Contributed by Kihwal Lee.
new dedcc09 HDFS-6019. Standby NN might not checkpoint when processing the rolling upgrade marker. Contributed by Haohui Mai.
new 4ba2bdf HDFS-6018. Exception recorded in LOG when IPCLoggerChannel#close is called. Contributed by Jing Zhao.
new 8542c1f HDFS-4685. Move to 2.4.0 in CHANGES.txt in preparation for merge.
new fe3f757 HADOOP-10184. Move to 2.4.0 in CHANGES.txt in preparation for merge.
new abe9c4e HADOOP-10368. InputStream is not closed in VersionInfo ctor. Contributed by Tsuyoshi OZAWA
new 0fbc7fe YARN-1588. Enhanced RM and the scheduling protocol to also send NMTokens of transferred containers from previous app-attempts to new AMs after YARN-1490. Contributed by Jian He.
new 4dfdee0 HADOOP-9454. Support multipart uploads for s3native. Contributed by Jordan Mendelson and Akira AJISAKA.
new 9cc0d5d Merge r1569890 through r1572250 from trunk.
new 658b1bf MAPREDUCE-5754. Preserve Job diagnostics in history. Contributed by Gera Shegalov
new c080fec HDFS-3969. Small bug fixes and improvements for disk locations API. Contributed by Todd Lipcon and Andrew Wang.
new ccf0744 HDFS-6023. Test whether the standby NN continues to checkpoint after the prepare stage. Contributed by Haohui Mai.
new aee7b44 HDFS-6024. Test whether the NN will reject the downgrade if it has a fsimage from a newer release. Contributed by Haohui Mai.
new cd67d5a MAPREDUCE-5766. Moved ping messages from TaskAttempts to be at DEBUG level inside the ApplicationMaster log. Contributed by Jian He.
new faddccc YARN-1301. Added the INFO level log of the non-empty blacklist additions and removals inside ApplicationMasterService. Contributed by Tsuyoshi Ozawa.
new 44c3bbf YARN-1429. *nix: Allow a way for users to augment classpath of YARN daemons. (Jarek Jarcec Cecho via kasha)
new 9a114be HDFS-6026. Fix TestDFSUpgrade and TestDataNodeRollingUpgrade. Contributed by jing9
new 58bccdb Merge r1569890 through r1572417 from trunk.
new e108473 Add TestRollingUpgradeDowngrade.java for HDFS-6024
new 0369e56 HDFS-6025. Update findbugsExcludeFile.xml.
new e5ccaa5 HADOOP-10353. FsUrlStreamHandlerFactory is not thread safe. Contributed by Tudor Scurtu.
new 0d03b29 HADOOP-10353. Correct CHANGES.txt.
new 94b29b3 MAPREDUCE-5770. Fixed MapReduce ApplicationMaster to correctly redirect to the YARN's web-app proxy with the correct scheme prefix. Contributed by Jian He.
new 9b81883 Merge r1569890 through r1572722 from trunk.
new 1fe2bd5 HDFS-6028. Print clearer error message when user attempts to delete required mask entry from ACL. Contributed by Chris Nauroth.
new d7aa12e HADOOP-10374. InterfaceAudience annotations should have RetentionPolicy.RUNTIME. (Contributed by Enis Soztutar)
new 9bdd272 MAPREDUCE-5665. Add audience annotations to MiniMRYarnCluster and MiniMRCluster. (Anubhav Dhoot via kasha)
new e9a17c8 HDFS-6029. Secondary NN fails to checkpoint after -rollingUpgrade prepare. Contributed by Jing Zhao.
new 5409908 HDFS-6032. -rollingUpgrade query hits NPE after the NN restarts. Contributed by Haohui Mai.
new 1ba26e3 YARN-1528. Allow setting auth for ZK connections. (kasha)
new 5c381ad HDFS-5339. WebHDFS URI does not accept logical nameservices when security is enabled. Contributed by Haohui Mai.
new 2333388 HDFS-6030. Remove an unused constructor in INode.java (yzhang via cmccabe)
new 77910d4 MAPREDUCE-5768. TestMRJobs.testContainerRollingLog fails on trunk. Contributed by Gera Shegalov
new 1bab14b HDFS-6031. Add back the "-rollingUpgrade started" namenode startup option; otherwise, namenode cannot start when the layout version is changed.
new ee663fa Merge r1569890 through r1573042 from trunk.
new 3965d65 Move HDFS-4200 to branch-2.4.0 section in CHANGES.txt
new 8e809b8 HDFS-6033. PBImageXmlWriter incorrectly handles processing cache directives. Contributed by Aaron T. Myers.
new d00605f HADOOP-10285. Admin interface to swap callqueue at runtime. (Contributed by Chris Li)
new 21d921a Update target version to 2.4.0 for HADOOP-10278 and HADOOP-10285 in CHANGES.txt
new 44c5c77 HDFS-5821. TestHDFSCLI fails for user names with the dash character. (Contributed by Gera Shegalov)
new fec1e2e HDFS-5956. A file size is multiplied by the replication factor in 'hdfs oiv -p FileDistribution' option. Contributed by Akira Ajisaka.
new c69cc31 HDFS-6034. Use DataNodeLayoutVersion for DN registration check and do not verify layout version if there is a rolling upgrade in progress.
new 0a7db7f Merge r1569890 through r1573119 from trunk.
new 8caeb0a YARN-1760. Addendum patch. TestRMAdminService assumes Capacity Scheduler.
new dd049a2 HDFS-5950. The DFSClient and DataNode should use shared memory segments to communicate short-circuit information (cmccabe)
new 6465b0b add missing file for HDFS-5950
new 2626d37 HADOOP-10314. The ls command help still shows outdated 0.16 format. Contributed by Rushabh S Shah.
new 146bf6c HDFS-5866. '-maxSize' and '-step' option fail in OfflineImageViewer. Contributed by Akira Ajisaka.
new a604343 YARN-1758. Fixed ResourceManager to not mandate the presence of site specific configuration files and thus fix failures in downstream tests. Contributed by Xuan Gong.
new aa8a6e4 HDFS-6013. add rollingUpgrade information to latest UI. Contributed by Vinayakumar B.
new 43f9bf2 YARN-1704. Modified LICENSE and NOTICE files to reflect newly used levelDB related libraries. Contributed by Billie Rinaldi.
new b35051c YARN-1765. Added test cases to verify that killApplication API works across ResourceManager failover. Contributed by Xuan Gong.
new c26bddd YARN-1675. Added the previously missed new file.
new a756de9 MAPREDUCE-5773. Provide dedicated MRAppMaster syslog length limit. Contributed by Gera Shegalov
new 1690856 HADOOP-10378. Typo in help printed by hdfs dfs -help. Contributed by Mit Desai.
new 98983b2 HDFS-6042. Fix rolling upgrade documentation and error messages. (Contributed by szetszwo)
new 5bf449e YARN-1748. Excluded core-site.xml from hadoop-yarn-server-tests package's jar and thus avoid breaking downstream tests. Contributed by Sravya Tirukkovalur.
new 9ad8dd1 Merge r1569890 through r1573813 from trunk.
new 33714d9 YARN-1729. Made TimelineWebServices deserialize the string primary- and secondary-filters param into the JSON-compatible object. Contributed by Billie Rinaldi.
new 5d29338 HDFS-6041. Downgrade/Finalize should rename the rollback image instead of purging it. Contributed by Jing Zhao.
new 2cfe554 HDFS-6039. Uploading a File under a Dir with default acls throws "Duplicated ACLFeature". Contributed by Chris Nauroth.
new 33500fd HDFS-6040. fix DFSClient issue without libhadoop.so and some other ShortCircuitShm cleanups (cmccabe)
new c94e43c HDFS-6046. add dfs.client.mmap.enabled (cmccabe)
new 40464fb YARN-1730. Implemented simple write-locking in the LevelDB based timeline-store. Contributed by Billie Rinaldi.
new f9ebdea Merging r1573814 through r1574170 from trunk.
new 88245b6 YARN-986. Changed client side to be able to figure out the right RM Delegation token for the right ResourceManager when HA is enabled. Contributed by Karthik Kambatla.
new c0a903da HDFS-6047 TestPread NPE inside in DFSInputStream hedgedFetchBlockByteRange (stack)
new 1da076f HDFS-6051. HDFS cannot run on Windows since short-circuit memory segment changes (cmccabe)
new 82e8c8b YARN-1766. Fixed a bug in ResourceManager to use configuration loaded from the configuration-provider when booting up. Contributed by Xuan Gong.
new 291dbc3 svn merge --reintegrate https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-5535 back to trunk.
new 53768ec HADOOP-8691. FsShell can print "Found xxx items" unnecessarily often. Contributed By Daryn Sharp.
new e90687f HDFS-5321. Clean up the HTTP-related configuration in HDFS. Contributed by Haohui Mai.
new 95ebf9e HADOOP-10379. Protect authentication cookies with the HttpOnly and Secure flags. Contributed by Haohui Mai.
new 240b4e9 YARN-1768. Fixed error message being too verbose when killing a non-existent application. Contributed by Tsuyoshi Ozawa
new e1162eb HDFS-5167. Add metrics about the NameNode retry cache. Contributed by Tsuyoshi OZAWA.
new 2e7c512 YARN-1785. FairScheduler treats app lookup failures as ERRORs. (bc Wong via kasha)
new 8e84ded HDFS-6043. Give HDFS daemons NFS3 and Portmap their own OPTS. Contributed by Brandon Li
new 206e2b0 HDFS-6044. Add property for setting the NFS look up time for users. Contributed by Brandon Li
new 8cd23c5 YARN-1752. Fixed ApplicationMasterService to reject unregister request if AM did not register before. Contributed by Rohith Sharma.
new d963b3c YARN-1761. Modified RMAdmin CLI to check whether HA is enabled or not before it executes any of the HA admin related commands. Contributed by Xuan Gong.
new b46fbd0 HDFS-5857. TestWebHDFS#testNamenodeRestart fails intermittently with NPE. Contributed By Mit Desai.
new 6adf7a0 HDFS-5898. Allow NFS gateway to login/relogin from its kerberos keytab. Contributed by Abin Shahab.
new 097e8b2 HADOOP-10211. Enable RPC protocol to negotiate SASL-QOP values between clients and servers. (Contributed by Benoy Antony)
new ad61eec HADOOP-10386. Log proxy hostname in various exceptions being thrown in a HA setup. Contributed by Haohui Mai.
new 95e0f61 HDFS-6057. DomainSocketWatcher.watcherThread should be marked as a daemon thread (cmccabe)
new 9192f84 HDFS-6058. Fix TestHDFSCLI failures after HADOOP-8691 change. Contributed by Akira Ajisaka and Haohui Mai.
new 5a3f614 HDFS-6061. Allow dfs.datanode.shared.file.descriptor.path to contain multiple entries and fall back when needed (cmccabe)
new e65084b HDFS-6062. TestRetryCacheWithHA#testConcat is flaky. Contributed by Jing Zhao.
new 115e60b HDFS-6059. TestBlockReaderLocal fails if native library not available (ajisakaa via cmccabe)
new 8955f71 HDFS-6060. NameNode should not check DataNode layout version. Contributed by Brandon Li
new 278d40f Fix CHANGES.txt for HDFS-6060
new 8d49acf MAPREDUCE-5780. SliveTest should use the specified path to get the particular FileSystem instead of using the default FileSystem.
new 90b1e25 HDFS-6084. DFSConfigKeys.DFS_BLOCKREPORT_INTERVAL_MSEC_DEFAULT is not updated with latest block report interval of 6 hrs. Contributed by Vinayakumar B.
new 591be56 HDFS-6067. TestPread.testMaxOutHedgedReadPool is flaky (cmccabe)
new 173c115 HDFS-6065. HDFS zero-copy reads should return null on EOF when doing ZCR (cmccabe)
new f4eb6dd YARN-1780. Improved logging in the Timeline client and server. Contributed by Zhijie Shen.
new 9b15c5b YARN-1525. Web UI should redirect to active RM when HA is enabled. (Cindy Li via kasha)
new 1271117 HDFS-6063. TestAclCLI fails intermittently when running test 24: copyFromLocal. Contributed by Chris Nauroth.
new b55c1aa HDFS-6069. Quash stack traces when ACLs are disabled. Contributed by Chris Nauroth.
new 55af4b0 Mark HADOOP-8691 in CHANGES.txt as incompatible changes.
new b1f87bb HDFS-5986. Capture the number of blocks pending deletion on namenode webUI. Contributed by Chris Nauroth.
new b06cc16 YARN-1774. FS: Submitting to non-leaf queue throws NPE. (Anubhav Dhoot and Karthik Kambatla via kasha)
new 1c4047b YARN-1783. Fixed a bug in NodeManager's status-updater that was losing completed container statuses when NodeManager is forced to resync by the ResourceManager. Contributed by Jian He.
new 90b399c HDFS-5064. Standby checkpoints should not block concurrent readers. Contributed by Aaron Twining Myers.
new 1f6c2b0 HDFS-6076. DataNode with SimulatedDataSet should not create DatanodeRegistration with namenode layout version and namenode node type.
new 0f59591 HDFS-3405. Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages. Contributed by Vinayakumar B.
new 0b1304d YARN-1781. Modified NodeManagers to allow admins to specify max disk utilization for local disks so as to be able to offline full disks. Contributed by Varun Vasudev.
new b7428fe HADOOP-10393. Fix the javac warnings in hadoop-auth.
new 8497b87 YARN-1410. Added tests to validate that clients can fail-over to a new RM after getting an application-ID but before submission and can still submit to the newly active RM with no issues. Contributed by Xuan Gong.
new 874cc95 YARN-1787. Fixed help messages for applicationattempt and container sub-commands in bin/yarn. Contributed by Zhijie Shen.
new e2530de YARN-1790. Fair Scheduler UI not showing apps table (bc Wong via Sandy Ryza)
new 596004a HDFS-6078. TestIncrementalBlockReports is flaky. (Arpit Agarwal)
new 98594ab Remove extra file from HDFS-3405.
new dbd22b2 Revert HDFS-3405 for recommit with correct renamed files
new 94a1632 HDFS-3405. Checkpointing should use HTTP POST or PUT instead of GET-GET to send merged fsimages. Contributed by Vinayakumar B.
new d59dbc9 HDFS-6071. BlockReaderLocal does not return -1 on EOF when doing a zero-length read on a short file. (cmccabe)
new 7da0746 YARN-1793. Fixed ClientRMService#forceKillApplication not killing unmanaged application. Contributed by Karthik Kambatla
new a06b21c HDFS-5892. TestDeleteBlockPool fails in branch-2. Contributed by Ted Yu.
new daaa8f0 HDFS-6070. Cleanup use of ReadStatistics in DFSInputStream.
new e4190b2 YARN-1788. Fixed a bug in ResourceManager to set the apps-completed and apps-killed metrics correctly for killed applications. Contributed by Varun Vasudev.
new b674dfd HDFS-6077. running slive with webhdfs on secure HA cluster fails with unkown host exception. Contributed by Jing Zhao.
new 5bb7945 HDFS-6055. Change default configuration to limit file name length in HDFS. Contributed by Chris Nauroth.
new 8e68f64 HADOOP-10399. FileContext API for ACLs. Contributed by Vinayakumar B.
new d74ec9d HADOOP-10395. TestCallQueueManager is flaky. (Arpit Agarwal)
new 109e88b HADOOP-10394. TestAuthenticationFilter is flaky. (Arpit Agarwal)
new 024f8e9 Move HDFS-5535 to Release 2.4.0 in CHANGES.txt.
new 2e57b1f Move HDFS-3405 to 2.4.0 section in CHANGES.txt
new 0edda25 YARN-1764. Modified YarnClient to correctly handle failover of ResourceManager after the submitApplication call goes through. Contributed by Xuan Gong.
new 98ecd4f MAPREDUCE-5028. Fixed a bug in MapTask that was causing mappers to fail when a large value of io.sort.mb is set. Contributed by Karthik Kambatla.
new 66cde6a HADOOP-10337 ConcurrentModificationException from MetricsDynamicMBeanBase.createMBeanInfo() (Liang Xie via stack)
new bab90b2 HDFS-6085. Improve CacheReplicationMonitor log messages a bit (cmccabe)
new 8d29768 HDFS-5638. HDFS implementation of FileContext API for ACLs. Contributed by Vinayakumar B.
new b027ef8 HDFS-6072. Clean up dead code of FSImage. Contributed by Haohui Mai.
new 477ed62 YARN-1821. NPE on registerNodeManager if the request has containers for UnmanagedAMs (kasha)
new a3616c5 HDFS-6086. Fix a case where zero-copy or no-checksum reads were not allowed even when the block was cached. (cmccabe)
new 8aab853 YARN-1800. Fixed NodeManager to gracefully handle RejectedExecutionException in the public-localizer thread-pool. Contributed by Varun Vasudev.
new 4ce0e4b YARN-1444. Fix CapacityScheduler to deal with cases where applications specify host/rack requests without off-switch request. Contributed by Wangda Tan.
new 4de17c6 YARN-1812. Fixed ResourceManager to synchrously renew tokens after recovery and thus recover app itself synchronously and avoid races with resyncing NodeManagers. Contributed by Jian He.
new 197217c YARN-1816. Fixed ResourceManager to get RMApp correctly handle ATTEMPT_FINISHED event at ACCEPTED state that can happen after RM restarts. Contributed by Jian He.
new cbf1c72 MAPREDUCE-5778. JobSummary does not escape newlines in the job name. Contributed by Akira AJISAKA
new 3bbd671 MAPREDUCE-5553. Allow users to easily access completed/pending/successful/failed tasks on MR AM web-ui. Contributed by Paul Han.
new 135700a YARN-1789. ApplicationSummary does not escape newlines in the app name. Contributed by Tsuyoshi OZAWA
new b849dd5 HDFS-6079. Timeout for getFileBlockStorageLocations does not work. Contributed by Andrew Wang.
new 20ec0c0 HDFS-5705. Update CHANGES.txt for merging the original fix (r1555190) to branch-2 and branch-2.4.
new f0fa038 HDFS-6096. TestWebHdfsTokens may timeout. (Contributed by szetszwo)
new 6af044b YARN-1389. Made ApplicationClientProtocol and ApplicationHistoryProtocol expose analogous getApplication(s)/Attempt(s)/Container(s) APIs. Contributed by Mayank Bansal.
new a8f302a MAPREDUCE-5765. Update hadoop-pipes examples README (Mit Desai via jeagles)
new 87866d4 MAPREDUCE-5789. Average Reduce time is incorrect on Job Overview page. Contributed by Rushabh S Shah
new b44b648 HADOOP-10332. HttpServer's jetty audit log always logs 200 OK (jeagles)
new 2c6ce77 MAPREDUCE-5713. InputFormat and JobConf JavaDoc Fixes (Chen He via jeagles)
new 70aba7f HDFS-5244. TestNNStorageRetentionManager#testPurgeMultipleDirs fails. Contributed bye Jinghui Wang.
new 763b8eb MAPREDUCE-5794. SliveMapper always uses default FileSystem. (Contributed by szetszwo)
new aab4665 MAPREDUCE-5456. TestFetcher.testCopyFromHostExtraBytes is missing (Jason Lowe via jeagles)
new 842aa2b HDFS-6080. Improve NFS gateway performance by making rtmax and wtmax configurable. Contributed by Abin Shahab
new f730fa9 HDFS-6097. Zero-copy reads are incorrectly disabled on file offsets above 2GB (cmccabe)
new 53790d3 YARN-1771. Reduce the number of NameNode operations during localization of public resources using a cache. Contributed by Sangjin Lee
new 6988a4f HADOOP-3679. Fixup assert ordering in unit tests to yield meaningful error messages. Contributed by Jay Vyas
new 3800600 HDFS-6084. Namenode UI - Hadoop logo link shouldn't go to hadoop homepage. Contributed by Travis Thompson.
new d9cdcb9 YARN-1658. Modified web-app framework to let standby RMs redirect web-service calls to the active RM. Contributed by Cindy Li.
new d37c31a HDFS-6102. Lower the default maximum items per directory to fix PB fsimage loading. Contributed by Andrew Wang.
new 0ab1f90 MAPREDUCE-5751. MR app master fails to start in some cases if mapreduce.job.classloader is true. Contributed by Sangjin Lee
new 2a6e861 Update CHANGES.txt to show MR-5688 pulled into 2.4.0
new d9f723e MAPREDUCE-5769. Unregistration to RM should not be called if AM is crashed before registering with RM. Contributed by Rohith
new 8a2a741 MAPREDUCE-5570. Map task attempt with fetch failure has incorrect attempt finish time. Contributed by Rushabh S Shah
new b3ea4ae YARN-1717. Enabled periodically discarding old data in LeveldbTimelineStore. Contributed by Billie Rinaldi.
new 37cb314 HADOOP-10407. Fix the javac warnings in org.apache.hadoop.ipc package.
new 95b7f50 YARN-1833. TestRMAdminService Fails in trunk and branch-2 (Mit Desais via jeagles)
new fbdab6f YARN-1520. update capacity scheduler docs to include necessary parameters (Chen He via jeagles)
new 9a65a9a HDFS-6106. Reduce default for dfs.namenode.path.based.cache.refresh.interval.ms (cmccabe)
new 96e0ca2 YARN-1824. Improved NodeManager and clients to be able to handle cross platform application submissions. Contributed by Jian He. MAPREDUCE-4052. Improved MapReduce clients to use NodeManagers' ability to handle cross platform application submissions. Contributed by Jian He.
new f8e4391 YARN-1845. Elapsed time for failed tasks that never started is wrong (Rushabh S Shah via jeagles)
new 1190f19 YARN-1845. Elapsed time for failed tasks that never started is wrong (Rushabh S Shah via jeagles)
new 809e8bf HDFS-6094. The same block can be counted twice towards safe mode threshold. (Arpit Agarwal)
new bc00bc9 YARN-1830. Fixed TestRMRestart#testQueueMetricsOnRMRestart failure due to race condition when app is submitted. Contributed by Zhijie Shen
new d265dd9 HDFS-6107. When a block cannot be cached due to limited space on the DataNode, it becomes uncacheable (cmccabe)
new 7096c29 HDFS-6107: fix comment (cmccabe)
new 7944eab YARN-1136. Replace junit.framework.Assert with org.junit.Assert (Chen He via jeagles)
new 6318afe HDFS-5516. WebHDFS does not require user name when anonymous http requests are disallowed. Contributed by Miodrag Radulovic.
new 8314674 YARN-1685. Fixed few bugs related to handling of containers' log-URLs on ResourceManager and history-service. Contributed by Zhijie Shen.
new 6a89e57 YARN-1206. Fixed AM container log to show on NM web page after application finishes if log-aggregation is disabled. Contributed by Rohith Sharmaks
new 81a456e YARN-1591. Fixed AsyncDispatcher to handle interrupts on shutdown in a sane manner and thus fix failure of TestResourceTrackerService. Contributed by Tsuyoshi Ozawa.
new 92317e3 YARN-1839. Fixed handling of NMTokens in ResourceManager such that containers launched by AMs running on the same machine as the AM are correctly propagated. Contributed by Jian He.
new 0b3ee72 HDFS-6090. Use MiniDFSCluster.Builder instead of deprecated constructors. Contributed by Akira AJISAKA.
new b4d22bd HADOOP-10383 InterfaceStability annotations should have RetentionPolicy.RUNTIME
new 57cdf86 YARN-1512. Enhanced CapacityScheduler to be able to decouple scheduling from node-heartbeats. Contributed by Arun C Murthy.
new e52c153 YARN-1846. TestRM#testNMTokenSentForNormalContainer assumes CapacityScheduler. (Robert Kanter via kasha)
new bd98fa1 HDFS-6007. Update documentation about short-circuit local reads (iwasakims via cmccabe)
new 02b25ce HDFS-6068. Disallow snapshot names that are also invalid directory names. Contributed by sathish
new 534a5ee Add TestSnapshotNameWithInvalidCharacters.java for HDFS-6068.
new bfafc1d YARN-1705. Reset cluster-metrics on transition to standby. (Rohith via kasha)
new ed02d0c HDFS-6112. NFS Gateway docs are incorrect for allowed hosts configuration. Contributed by Aaron T. Myers.
new d0f7985 HDFS-6117. Print file path information in FileNotFoundException on INode ID mismatch. Contributed by Suresh Srinivas.
new 2b03ae9 HDFS-6099. HDFS file system limits not enforced on renames. Contributed by Chris Nauroth.
new fd1c424 YARN-1690. Made DistributedShell send timeline entities+events. Contributed by Mayank Bansal.
new 7817245 HDFS-6100. DataNodeWebHdfsMethods does not failover in HA mode. Contributed by Haohui Mai.
new f799618 HADOOP-10221. Add a plugin to specify SaslProperties for RPC protocol based on connection properties. (Contributed by Benoy Antony and Daryn Sharp)
new 234edca HADOOP-10221. Add file missed in previous checkin, fix typo.
new cfb4683 HDFS-6123. Do not log stack trace for ReplicaAlreadyExistsException and SocketTimeoutException.
new 44deaa8 HDFS-6105. NN web UI for DN list loads the same jmx page multiple times. Contributed by Haohui Mai.
new 764af69 YARN-1640. Fixed manual failover of ResourceManagers to work correctly in secure clusters. Contributed by Xuan Gong.
new 396c6c6 MAPREDUCE-2349. Modified FileInputFormat to be able to issue file and block location calls in parallel. Contributed by Siddharth Seth.
new aa4a045 HDFS-6127. WebHDFS tokens cannot be renewed in HA setup. Contributed by Haohui Mai.
new 7ec4308 HDFS-6129. When a replica is not found for deletion, do not throw an exception.
new 4f6397b HDFS-6089. Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspended. Contributed by Jing Zhao.
new fd6df76 YARN-1570. Fixed formatting of the lines in YarnCommands.apt.vm docs source. Contributed by Akira Ajisaka.
new 9dab514 HDFS-6038. Allow JournalNode to handle editlog produced by new release with future layoutversion. Contributed by Jing Zhao.
new bf428cc YARN-1855. Made Application-history server to be optional in MiniYARNCluster and thus avoid the failure of TestRMFailover#testRMWebAppRedirect. Contributed by Zhijie Shen.
new 1c49cfb YARN-1859. Fixed WebAppProxyServlet to correctly handle applications absent on the ResourceManager. Contributed by Zhijie Shen.
new 4224e61 YARN-1811. Fixed AMFilters in YARN to correctly accept requests from either web-app proxy or the RMs when HA is enabled. Contributed by Robert Kanter.
new 767a98a MAPREDUCE-5804. TestMRJobsWithProfiler#testProfiler timesout. Contributed by Mit Desai.
new 2826a35 YARN-1670. Fixed a bug in log-aggregation that can cause the writer to write more log-data than the log-length that it records. Contributed by Mit Desai.
new 2fbd94d HDFS-6138. Add a user guide for how to use viewfs with federation. Contributed by sanjay and szetszwo
new fc53af9 HDFS-6120. Fix and improve safe mode log messages. (Arpit Agarwal)
new a5c08ee MAPREDUCE-5787. Added the ability to keep alive shuffle connections in the MapReduce shuffle-handler. Contributed by Rajesh Balamohan.
new f672188 YARN-1849. Fixed NPE in ResourceTrackerService#registerNodeManager for UAM. Contributed by Karthik Kambatla
new 0657987 YARN-1775. Enhanced ProcfsBasedProcessTree to optionally add the ability to use smaps for obtaining used memory information. Contributed by Rajesh Balamohan.
new a764e9a YARN-1863. Fixed test failure in TestRMFailover after YARN-1859. Contributed by Xuan Gong.
new dc59410 YARN-1854. Fixed test failure in TestRMHA#testStartAndTransitions. Contributed by Rohith Sharma KS.
new 8a06949 MAPREDUCE-5806. Fixed a bug in MRAppMaster so as to enable users to properly override HADOOP_ROOT_LOGGER or HADOOP_CLIENT_OPTS. Contributed by Varun Vasudev.
new cbb3914 YARN-1536. Cleanup: Get rid of ResourceManager#get*SecretManager() methods and use the RMContext methods instead. (Anubhav Dhoot via kasha)
new ce56616 YARN-1776. Fixed DelegationToken renewal to survive RM failover. Contributed by Zhijie Shen
new ef9634b YARN-1577. Made UnmanagedAMLauncher do launchAM after the attempt reaches the LAUNCHED state. Contributed by Jian He.
new 62d2890 HADOOP-10191. Missing executable permission on viewfs internal dirs. Contributed by Gera Shegalov.
new 00ceaad HDFS-6140. WebHDFS cannot create a file with spaces in the name after HA failover changes. Contributed by Chris Nauroth.
new 6784b96 Relocate wrongly place entries in YARNs's CHANGES.txt (vinodkv)
new 0710b58 HADOOP-10418. SaslRpcClient should not assume that remote principals are in the default_realm. Contributed by Aaron T. Myers.
new 7a18c4a HDFS-3087. Decomissioning on NN restart can complete without blocks being replicated. Contributed by Rushabh S Shah.
new 2d89dcb YARN-1670. aggregated log writer can write more log data then it says is the log length (Mit Desai via jeagles)
new 0f1eda6 YARN-1838. Enhanced timeline service getEntities API to get entities from a given entity ID or insertion timestamp. Contributed by Billie Rinaldi.
new f89ede8 HADOOP-10015. UserGroupInformation prints out excessive warnings. Contributed by Nicolas Liochon
new a90a5c2 MAPREDUCE-5791. Shuffle phase is slow in Windows - FadviseFileRegion::transferTo does not read disks efficiently. Contributed by Nikola Vujic.
new 0febaa1 YARN-1852. Fixed RMAppAttempt to not resend AttemptFailed/AttemptKilled events to already recovered Failed/Killed RMApps. Contributed by Rohith Sharmaks
new 3bfd18c HDFS-6050. NFS does not handle exceptions correctly in a few places. Contributed by Brandon Li
new 8076ff3 HDFS-6135. In HDFS upgrade with HA setup, JournalNode cannot handle layout version bump when rolling back. Contributed by Jing Zhao.
new 6376cd3 Move HDFS-5138 to 2.4.0 section in CHANGES.txt
new 328fc86 HDFS-5846. Shuffle phase is slow in Windows - FadviseFileRegion::transferTo does not read disks efficiently. Contributed by Nikola Vujic.
new 9350751 HADOOP-10422. Remove redundant logging of RPC retry attempts. Contributed by Chris Nauroth.
new 830e367 HADOOP-10423. Clarify compatibility policy document for combination of new client and old server. (Chris Nauroth via kasha)
new c2ef7e2 HDFS-6124. Add final modifier to class members. (Contributed by Suresh Srinivas)
new 6015e95 MAPREDUCE-5795. Fixed MRAppMaster to record the correct job-state after it recovers from a commit during a previous attempt. Contributed by Xuan Gong.
new 9db6f98e HADOOP-10425. LocalFileSystem.getContentSummary should not count crc files.
new 09f3832 YARN-1850. Introduced the ability to optionally disable sending out timeline-events in the TimelineClient. Contributed by Zhijie Shen.
new 3a61d25 HDFS-6125. Cleanup unnecessary cast in HDFS code base. Contributed by Suresh Srinivas.
new 56205ca HDFS-5840. Follow-up to HDFS-5138 to improve error handling during partial upgrade failures. Contributed by Aaron T. Myers, Suresh Srinivas, and Jing Zhao.
new 867e0f8 HDFS-5196. Provide more snapshot information in WebUI. Contributed by Shinichi Yamashita.
new 274d9b2 HADOOP-10426. Declare CreateOpts.getOpt(..) with generic type argument, removes unused FileContext.getFileStatus(..) and fixes various javac warnings.
new d14eff7 YARN-1866. Fixed an issue with renewal of RM-delegation tokens on restart or fail-over. Contributed by Jian He.
new c64974a HADOOP-10280. Make Schedulables return a configurable identity of user or group. (Contributed by Chris Li)
new 54c7f06 HADOOP-10280. Add files missed in previous checkin.
new dce1d20 YARN-1452. Added documentation about the configuration and usage of generic application history and the timeline data service. Contributed by Zhijie Shen.
new 8a9ae9e YARN-1867. Fixed a bug in ResourceManager that was causing invalid ACL checks in the web-services after fail-over. Contributed by Vinod Kumar Vavilapalli.
new 71c2b15 YARN-1521. Mark Idempotent/AtMostOnce annotations to the APIs in ApplicationClientProtcol, ResourceManagerAdministrationProtocol and ResourceTrackerProtocol so that they work in HA scenario. Contributed by Xuan Gong
new 1fbb04e HDFS-5910. Enhance DataTransferProtocol to allow per-connection choice of encryption/plain-text. (Contributed by Benoy Antony)
new b5935fa HDFS-6130. NPE when upgrading namenode from fsimages older than -32. Contributed by Haohui Mai.
new c00703d HDFS-6150. Add inode id information in the logs to make debugging easier. Contributed by Suresh Srinivas.
new a206399 HDFS-6115. Call flush() for every append on block scan verification log. Contributed by Vinayakumar B
new 3d207f1 HADOOP-10440. HarFsInputStream.read(byte[]) updates position incorrectly. Contributed by guodongdong
new fe8c3dc HDFS-5672. TestHASafeMode#testSafeBlockTracking fails in trunk. Contributed by Jing Zhao.
new a126a01 HADOOP-10437. Fix the javac warnings in the conf and the util package.
new d337a5f HADOOP-10441. Namenode metric rpc.RetryCache/NameNodeRetryCache.CacheHit can't be correctly processed by Ganglia. Contributed by Jing Zhao.
new 3af3b0b YARN-1873. Fixed TestDistributedShell failure when the test cases are out of order. Contributed by Mit Desai.
new 14556cc HDFS-6155. Fix Boxing/unboxing to parse a primitive findbugs warnings. Contributed by Suresh Srinivas.
new 78b9321 HDFS-6119. FSNamesystem code cleanup. Contributed by Suresh Srinivas.
new 82be0f9 HDFS-6157. Fix the entry point of OfflineImageViewer for hdfs.cmd. Contributed by Haohui Mai.
new 533675b MAPREDUCE-5805. Fixed MapReduce JobHistory encoding of queue-name to escape hyphens and thus avoid parsing errors. Contributed by Akira Ajisaka.
new fd3d5ab HDFS-6158. Clean up dead code for OfflineImageViewer. Contributed by Haohui Mai.
new 21d225a HDFS-6162. Format strings should use platform independent line separator. Contributed by Suresh Srinivas.
new 51e353c HDFS-6163. Fix a minor bug in the HA upgrade document. Contributed by Fengdong Yu.
new 54c1daa HDFS-5978. Create a tool to take fsimage and expose read-only WebHDFS API. Contributed by Akira Ajisaka.
new b5b350c HADOOP-10442. Group look-up can cause segmentation fault when certain JNI-based mapping module is used. (Kihwal Lee via jeagles)
new 9d2d55e HDFS-6164. Remove lsr in OfflineImageViewer. Contributed by Haohui Mai.
new 92b9c6f HADOOP-10237. JavaKeyStoreProvider needs to set keystore permissions correctly. (Larry McCay via omalley)
new 2e799e5 HDFS-6156. Simplify the JMX API that provides snapshot information. Contributed by Shinichi Yamashita.
new 640a72e HADOOP-10449. Fix the javac warnings in the security package.
new 3f7aa79 HDFS-6168. Remove a deprecated constructor and the deprecated methods reportChecksumFailure, getDelegationToken(Text), renewDelegationToken and cancelDelegationToken from DistributedFileSystem.
new 6d2e1fd YARN-1883. TestRMAdminService fails due to inconsistent entries in UserGroups (Mit Desai via jeagles)
new f5a8815 HADOOP-10450. Build zlib native code bindings in hadoop.dll for Windows. Contributed by Chris Nauroth.
new 3c4d44d HADOOP-10301. AuthenticationFilter should return Forbidden for failed authentication. Contributed by Daryn Sharp.
new c3dbaea YARN-1891. Added documentation for NodeManager health-monitoring. Contributed by Varun Vasudev.
new 86ef362 MAPREDUCE-5810. Removed the faulty and failing streaming test TestStreamingTaskLog. Contributed by Akira Ajisaka.
new 72051fc YARN-1017. Added documentation for ResourceManager Restart. (jianhe)
new d46b2d0 HADOOP-9525. Add tests that validate winutils chmod behavior on folders. Contributed by Ivan Mitic.
new b4c41f3 HDFS-6166. Change Balancer socket read timeout to 20 minutes and add 10 seconds delay after error. Contributed by Nathan Roberts
new b7b3a7e MAPREDUCE-5813. Fix YarnChild to explicitly load job.xml from the local-filesystem, rather than rely on the classpath. Contributed by Gera Shegalov.
new 3532d96 YARN-1893. Mark AtMostOnce annotation to ApplicationMasterProtocol#allocate. Contributed by Xuan Gong.
new 004d085 HDFS-4564. Ensure webhdfs returns correct HTTP response codes for denied operations. Contributed by Daryn Sharp.
new fa9eed2 Preparing for hadoop-2.4.0 release.
new 8962a43 Added release notes for hadoop-2.4.0.
new 71bae5c HDFS-6173. Move the default processor from Ls to Web in OfflineImageViewer. Contributed by Akira Ajisaka.
new ed64289 HADOOP-10451. Remove unused field and imports from SaslRpcServer. Contributed by Benoy Antony.
new e908bbe HADOOP-10345. Sanitize the the inputs (groups and hosts) for the proxyuser configuration. Contributed by Benoy Antony.
new 7bd62b8 YARN-1889. In Fair Scheduler, avoid creating objects on each call to AppSchedulable comparator (Hong Zhiguo via Sandy Ryza)
new d28be56 MAPREDUCE-5759. Remove unnecessary conf load in Limits (Sandy Ryza)
new 8d62d92 HADOOP-10414. Incorrect property name for RefreshUserMappingProtocol in hadoop-policy.xml. Contributed by Joey Echeverria.
new b0180af YARN-1898. Made Standby RM links conf, stacks, logLevel, metrics, jmx, logs and static not be redirected to Active RM. Contributed by Xuan Gong.
new 5c7cb51 HADOOP-10455. When there is an exception, ipc.Server should first check whether it is an terse exception.
new f93d999 HDFS-6167. Relocate the non-public API classes in the hdfs.client package.
new 64c50d9 HDFS-5591. Checkpointing should use monotonic time when calculating period. Contributed by Charles Lamb.
new fb1d7fb HDFS-5570. Deprecate hftp / hsftp and replace them with webhdfs / swebhdfs. Contributed by Haohui Mai.
new 5b3481a HDFS-5570. Addendum commit for r1584100.
new 640a097 HADOOP-10459. distcp V2 doesn't preserve root dir's attributes when -p is specified. Contributed by Yongjun Zhang.
new 74e3a17 Move MAPREDUCE-5014 to the right section now that it's been merged to branch-2.
new 620809b HDFS-6190. Minor textual fixes in DFSClient. Contributed by Charles Lamb.
new f9df4d7 MAPREDUCE-5818. Added "hsadmin" command into mapred.cmd. Contributed by Jian He.
new 7a655d5 HADOOP-10454. Provide FileContext version of har file system. (Kihwal Lee via jeagles)
new b6e31fd Fixing an error in CHANGES.txt
new 362d284 HADOOP-10462. DF#getFilesystem is not parsing the command output. Contributed by Akira AJISAKA.
new 0941b99 HADOOP-10456. Bug in Configuration.java exposed by Spark (ConcurrentModificationException). Contributed by Nishkam Ravi.
new 4147a52 HDFS-6189. Multiple HDFS tests fail on Windows attempting to use a test root path containing a colon. Contributed by cnauroth
new 62ad7e2 Commit the hadoop-common part of HDFS-6189.
new 15ac36a YARN-1837. Fixed TestMoveApplication#testMoveRejectedByScheduler failure. Contributed by Hong Zhiguo
new 4e979f5 HDFS-6159. TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails if there is block missing after balancer success. Contributed by Chen He.
new 05da90e YARN-1898. Addendum patch to ensure /jmx and /metrics are re-directed to Active RM.
new 4eacde6 YARN-1905. TestProcfsBasedProcessTree must only run on Linux. Contributed by Chris Nauroth.
new aea35d9 HADOOP-10466. Lower the log level in UserGroupInformation. Contributed by Nicolas Liochon
new fe32862 HDFS-6191. Disable quota checks when replaying edit log.
new a5b37c6 HDFS-6181. Fix the wrong property names in NFS user guide. Contributed by Brandon Li
new 79bd50f HDFS-6197. Rolling upgrade rollback on Windows can fail attempting to rename edit log segment files to a destination that already exists. Contributed by Chris Nauroth.
new 2002dc6 HDFS-6180. Dead node count / listing is very broken in JMX and old GUI. Contributed by Haohui Mai.
new 5bbf271 HDFS-6198. DataNode rolling upgrade does not correctly identify current block pool directory and replace with trash on Windows. Contributed by Chris Nauroth.
new bcf1f33 HDFS-6143. WebHdfsFileSystem open should throw FileNotFoundException for non-existing paths. Contributed by Gera Shegalov.
new 38e011f HADOOP-10468. TestMetricsSystemImpl.testMultiThreadedPublish fails intermediately. Contributed by Haohui Mai.
new 245012a YARN-1757. NM Recovery. Auxiliary service support. (Jason Lowe via kasha)
new 7915b36 HDFS-6169. Move the address in WebImageViewer. Contributed by Akira Ajisaka.
new 6c2a0ce YARN-1908. Fixed DistributedShell to not fail in secure clusters. Contributed by Vinod Kumar Vavilapalli and Jian He.
new 8ca32df HADOOP-10474. Move o.a.h.record to hadoop-streaming. Contributed by Haohui Mai.
new 32bbc44 HADOOP-10475. ConcurrentModificationException in AbstractDelegationTokenSelector.selectToken(). Contributed by Jing Zhao.
new 1e1200d YARN-1784. TestContainerAllocation assumes CapacityScheduler. (Robert Kanter via kasha)
new b8f250a HADOOP-10104. Update jackson to 1.9.13 (Akira Ajisaka via stevel)
new c3f6d71 YARN-1907. TestRMApplicationHistoryWriter#testRMWritingMassiveHistory intermittently fails. Contributed by Mit Desai.
new 6cc92bf HDFS-6160. TestSafeMode occasionally fails. (Contributed by Arpit Agarwal)
new 58d49ce HDFS-6215. Wrong error message for upgrade. (Kihwal Lee via jeagles)
new f13a0fd HADOOP-10473. TestCallQueueManager should interrupt before counting calls.
new 06e4c84 HDFS-6206. Fix NullPointerException in DFSUtil.substituteForWildcardAddress.
new 0b97704 HDFS-6204. Fix TestRBWBlockInvalidation: change the last sleep to a loop.
new 0862ee6 HADOOP-10485. Remove dead classes in hadoop-streaming. Contributed by Haohui Mai.
new 5c18d45 HDFS-6209. TestValidateConfigurationSettings should use random ports. Contributed by Arpit Agarwal
new 9a2ec69 HADOOP-10432. Refactor SSLFactory to expose static method to determine HostnameVerifier. (tucu)
new 98a98ea HADOOP-10427. KeyProvider implementations should be thread safe. (tucu)
new 9a1f155 HADOOP-10429. KeyStores should have methods to generate the materials themselves, KeyShell should use them. (tucu)
new 8af0708 HDFS-6170. Support GETFILESTATUS operation in WebImageViewer. Contributed by Akira Ajisaka.
new 5c48f37 HDFS-6208. DataNode caching can leak file descriptors. Contributed by Chris Nauroth.
new 7af48dd HDFS-6225. Remove the o.a.h.hdfs.server.common.UpgradeStatusReport. Contributed by Haohui Mai.
new 791f2f6 YARN-1910. Fixed a race condition in TestAMRMTokens that causes the test to fail more often on Windows. Contributed by Xuan Gong.
new b4f0259 HADOOP-10428. JavaKeyStoreProvider should accept keystore password via configuration falling back to ENV VAR. (tucu)
new 897fe59 HDFS-6228. comments typo fix for FsDatasetImpl.java Contributed by zhaoyunjiong.
new 05fd3bb MAPREDUCE-5824. Fixed test-failure of TestPipesNonJavaInputFormat in Windows. Contributed by Xuan Gong.
new 8c19d0b HADOOP-10488. TestKeyProviderFactory fails randomly. (tucu)
new af0fe05 HDFS-5669. Storage#tryLock() should check for null before logging successfull message. Contributed by Vinayakumar B
new 3993d64 YARN-1920. Fixed TestFileSystemApplicationHistoryStore failure on windows. Contributed by Vinod Kumar Vavilapalli.
new 3c1250b HADOOP-10350. BUILDING.txt should mention openssl dependency required for hadoop-pipes (Vinayakumar B)
new b0c828f Reverse merged revision(s) 1586425 from hadoop/common/trunk: HADOOP-10350. BUILDING.txt should mention openssl dependency required for hadoop-pipes (Vinayakumar B) ........
new d149760 HADOOP-10350. BUILDING.txt should mention openssl dependency required for hadoop-pipes (Vinayakumar B)
new cde7b17 YARN-1914. Fixed resource-download on NodeManagers to skip permission verification of public cache files in Windows+local file-system environment. Contribued by Varun Vasudev.
new 26421dd MAPREDUCE-5825. Provide diagnostics for reducers killed during ramp down. Contributed by Gera Shegalov
new fad8620 HDFS-6224. Add a unit test to TestAuditLogger for file permissions passed to logAuditEvent. Contributed by Charles Lamb.
new 3b008ba Undo accidental FSNamesystem change introduced in HDFS-6224 commit.
new ed78328 YARN-1903. Set exit code and diagnostics when container is killed at NEW/LOCALIZING state. Contributed by Zhijie Shen
new dc84800 YARN-1924. Made ZKRMStateStore updateApplication(Attempt)StateInternal work when Application(Attempt) state hasn't been stored before. Contributed by Jian He.
new f8904ad HDFS-6231. DFSClient hangs infinitely if using hedged reads and all eligible datanodes die. Contributed by Chris Nauroth.
new 8d41b36 MAPREDUCE-5815. Fixed test-failure of TestMRAppMaster by making MRAppMaster gracefully handle empty-queue names. Contributed by Akira Ajisaka.
new d6a6e98 YARN-1926. Changed DistributedShell to use appIDs as unique identifiers for HDFS paths and thus avoid test failures on Windows. Contributed by Varun Vasudev.
new c1127d1 MAPREDUCE-5826. Fixed HistoryServerFileSystemStore to use right permissions on Windows for temporary files and thus also fix the test-issue with TestHistoryServerFileSystemStateStoreService. Contributed by Varun Vasudev.
new 91ebf58 HADOOP-10490. TestMapFile and TestBloomMapFile leak file descriptors. Contributed by Chris Nauroth.
new 76ea55c HDFS-6234. TestDatanodeConfig#testMemlockLimit fails on Windows due to invalid file path. Contributed by Chris Nauroth.
new 0a0ca4f HADOOP-8826. Docs still refer to 0.20.205 as stable line (Mit Desai via jeagles)
new 6d45bb5 HDFS-6235. TestFileJournalManager can fail on Windows due to file locking if tests run out of order. Contributed by Chris Nauroth.
new 01ea648 HDFS-6229. Race condition in failover can cause RetryCache fail to work. Contributed by Jing Zhao.
new 350ab4d HADOOP-10430. KeyProvider Metadata should have an optional description, there should be a method to retrieve the metadata from all keys. (tucu)
new 51a2cec HADOOP-10431. Change visibility of KeyStore.Options getter methods to public. (tucu)
new 922f97c YARN-1883. Merged into branch-2.4 also. svn merge --ignore-ancestry -c 1582862 ../../trunk/ onto branch-2.4. Fixed CHANGES.txt entries too.
new ba4474b YARN-1907. Merged into branch-2.4 also. svn merge --ignore-ancestry -c 1585992 ../../trunk/ onto branch-2.4. Fixed CHANGES.txt entries too.
new 4636f81 YARN-1833. Relocating CHANGES.txt entry in trunk and branch-2 to the right location.
new 2f72888 HDFS-6232. OfflineEditsViewer throws a NPE on edits containing ACL modifications (ajisakaa via cmccabe)
new 9274626 YARN-1923. Make Fair Scheduler resource ratio calculations terminate faster (Anubhav Dhoot via Sandy Ryza)
new 193f11a HDFS-6236. ImageServlet should use Time#monotonicNow to measure latency. Contributed by Chris Nauroth.
new 6351ee2 MAPREDUCE-5828. Fixed a test issue with TestMapReduceJobControl that was causing it to fail on Windows. Contributed by Vinod Kumar Vavilapalli.
new c6b70f4 YARN-1933. Fixed test issues with TestAMRestart and TestNodeHealthService. Contributed by Jian He.
new eb7b33c YARN-1928. Fixed a race condition in TestAMRMRPCNodeUpdates which caused it to fail occassionally. Contributed by Zhijie Shen.
new 091f42f HADOOP-10495. TestFileUtil fails on Windows due to bad permission assertions. Contributed by Chris Nauroth.
new 9ac54b5 HADOOP-10496. Metrics system FileSink can leak file descriptor. Contributed by Chris Nauroth.
new 7aed74b HDFS-6237. TestDFSShell#testGet fails on Windows due to invalid file system path. Contributed by Chris Nauroth.
new 8a9eff3 HDFS-6238. TestDirectoryScanner leaks file descriptors. Contributed by Chris Nauroth.
new caa6260 HADOOP-10500. TestDoAsEffectiveUser fails on JDK7 due to failure to reset proxy user configuration. Contributed by Chris Nauroth.
new 01af3a3 HDFS-6243. HA NameNode transition to active or shutdown may leave lingering image transfer thread. Contributed by Chris Nauroth.
new bf7b212 HADOOP-10498. Add support for proxy server. (daryn)
new 5833efc HDFS-6194. Create new tests for ByteRangeInputStream. Contributed by Akira Ajisaka.
new 161d978 MAPREDUCE-5836. Fix typo in RandomTextWriter (Akira AJISAKA via jeagles)
new 44b6261 YARN-1892. Improved some logs in the scheduler. Contributed by Jian He.
new 9887d7f HDFS-5409. TestOfflineEditsViewer#testStored fails on Windows due to CRLF line endings in editsStored.xml from git checkout. Contributed by Chris Nauroth.
new 38d5ca2 YARN-1934. Fixed a potential NPE in ZKRMStateStore caused by handling Disconnected event from ZK. Contributed by Karthik Kambatla.
new 14fee88 MAPREDUCE-5775. Remove unnecessary job.setNumReduceTasks in SleepJob.createJob. Contributed by jhanver chand sharma.
new 5e47eec HDFS-6214. Webhdfs has poor throughput for files >2GB (daryn)
new ef68759 HDFS-6219. Proxy superuser configuration should use true client IP for address checks. Contributed by Daryn Sharp.
new 5c8c84d fix CHANGES.txt.
new 28d62bf MAPREDUCE-3191. docs for map output compression incorrectly reference SequenceFile (Chen He via jeagles)
new 9a0dec6 HDFS-4909. Avoid protocol buffer RPC namespace clashes (cmccabe)
new dd7d032 HADOOP-10499. Remove unused parameter from ProxyUsers.authorize(). Contributed by Chris Nauroth.
new eb1d4c3 HDFS-6153. Document "fileId" and "childrenNum" fields in the FileStatus Json schema
new ad9edb0 YARN-1931. Private API change in YARN-1824 in 2.4 broke compatibility with previous releases (Sandy Ryza via tgraves)
new 36ed8c7 YARN-1870. FileInputStream is not closed in ProcfsBasedProcessTree#constructProcessSMAPInfo. (Fengdong Yu via junping_du)
new 0d087f7 YARN-1750. TestNodeStatusUpdater#testNMRegistration is incorrect in test case. (Wangda Tan via junping_du)
new bd43d24 YARN-1947. TestRMDelegationTokens#testRMDTMasterKeyStateOnRollingMasterKey is failing intermittently. (Jian He via junping_du)
new bad0215 YARN-1281. Fixed TestZKRMStateStoreZKClientConnections to not fail intermittently due to ZK-client timeouts. Contributed by Tsuyoshi Ozawa.
new bc0b7c6 HDFS-6256. Clean up ImageVisitor and SpotCheckImageVisitor. Contributed by Akira Ajisaka.
new cda8646 YARN-1940. deleteAsUser() terminates early without deleting more files on error. Contributed by Rushabh S Shah
new 8d569c2 MAPREDUCE-4937. MR AM handles an oversized split metainfo file poorly. Contributed by Eric Payne
new d667df4 YARN-1932. Javascript injection on the job status page. Contributed by Mit Desai
new c482cb2 MAPREDUCE-5642. TestMiniMRChildTask fails on Windows. Contributed by Chuan Liu.
new 4810e2b YARN-1865. ShellScriptBuilder does not check for some error conditions. Contributed by Remus Rusanu.
new 2d9f038 HDFS-6245. Datanode fails to start with a bad disk even when failed volumes is set. (Arpit Agarwal)
new cf61a55 HADOOP-9919. Update hadoop-metrics2.properties examples to Yarn. Contributed by Akira AJISAKA.
new 360c8d1 HADOOP-10522. JniBasedUnixGroupMapping mishandles errors. Contributed by Kihwal Lee.
new 291af51 HADOOP-10526. Chance for Stream leakage in CompressorStream. Contributed by Rushabh Shah.
new a447540 HDFS-6265. Prepare HDFS codebase for JUnit 4.11. Contributed by Chris Nauroth.
new 8438852 YARN-1970. Prepare YARN codebase for JUnit 4.11. Contributed by Chris Nauroth.
new 1be4dde HDFS-6178. Decommission on standby NN couldn't finish. Contributed by Ming Ma.
new 06c15b6 MAPREDUCE-5852. Prepare MapReduce codebase for JUnit 4.11. Contributed by Chris Nauroth.
new 1dfc9c3 MAPREDUCE-5827. TestSpeculativeExecutionWithMRApp fails. Contributed by Zhijie Shen.
new bb4216a MAPREDUCE-5827. Move attribution from 2.5.0 to 2.4.1 in CHANGES.txt.
new 4a91b87 MAPREDUCE-5833. TestRMContainerAllocator fails ocassionally. Contributed by Zhijie Shen.
new 7bd5718 HADOOP-10503. Move junit up to v 4.11. Contributed by Chris Nauroth.
new 586c46a MAPREDUCE-5832. Fixed TestJobClient to not fail on JDK7 or on Windows. Contributed by Jian He and Vinod Kumar Vavilapalli.
new ca4cf1c HADOOP-10527. Fix incorrect return code and allow more retries on EINTR. Contributed by Kihwal Lee.
new ee8a152 HDFS-5213. TestDataNodeConfig failing on Jenkins runs due to DN web port in use. (wang)
new 6eba48c HADOOP-10251. Both NameNodes could be in STANDBY State if SNN network is unstable. Contributed by Vinayakumar B.
new 876fd8a HDFS-6274. Cleanup javadoc warnings in HDFS code. Contributed by Suresh Srinivas.
new 7f635b8 HDFS-6275. Fix warnings - type arguments can be inferred and redudant local variable. Contributed by Suresh Srinivas.
new 6957745 MAPREDUCE-5841. uber job doesn't terminate on getting mapred job kill. Contributed by Sangjin Lee
new 53cb787 HDFS-6217. Webhdfs PUT operations may not work via a http proxy. Contributed by Daryn Sharp.
new 74b4719 HADOOP-10531. hadoop-config.sh - bug in --hosts argument. Contributed by Sebastien Barrier.
new e33ba5d MAPREDUCE-5843. Fixed TestMRKeyValueTextInputFormat to not leak files and thus avoid failing on Windows. Contributed by Varun Vasudev.
new f36f0dd HDFS-6276. Remove unnecessary conditions and null check. Contributed by Suresh Srinivas
new a93be7b MAPREDUCE-5846. Rumen doesn't understand JobQueueChangedEvent (Nathan Roberts via raviprak)
new 140f454 HDFS-6278. Create HTML5-based UI for SNN. Contributed by Haohui Mai.
new a5bec2b HDFS-6279. Create new index page for JN / DN. Contributed by Haohui Mai.
new 24d1cf9 HDFS-5693. Few NN metrics data points were collected via JMX when NN is under heavy load. Contributed by Ming Ma.
new f9a9c1e HADOOP-10534. KeyProvider getKeysMetadata should take a list of names rather than returning all keys. (omalley)
new cf4bc7f HDFS-6273. Config options to allow wildcard endpoints for namenode HTTP and HTTPS servers. (Contributed by Arpit Agarwal)
new 730e067 HDFS-6273. Add file missed in previous checkin.
new c02ea74 YARN-1975. Used resources shows escaped html in CapacityScheduler and FairScheduler page. Contributed by Mit Desai
new 4f60187 HADOOP-10539. Provide backward compatibility for ProxyUsers.authorize() call. Contributed by Benoy Antony.
new c7e8757 MAPREDUCE-5837. MRAppMaster fails when checking on uber mode. Contributed by Haohui Mai.
new 6d4c7df HADOOP-10535. Make the retry numbers in ActiveStandbyElector configurable. Contributed by Jing Zhao.
new fbc0a8b HDFS-6282. Re-add testIncludeByRegistrationName (cmccabe)
new 7bad941 HDFS-6281. Provide option to use the NFS Gateway without having to use the Hadoop portmapper. Contributed by Aaron T. Myers.
new 10a037c HDFS-6266. Identify full path for a given INode. Contributed by Jing Zhao.
new b34b7db HADOOP-10540. Datanode upgrade in Windows fails with hardlink error. (Contributed by Chris Nauroth and Arpit Agarwal)
new 0931bd9 HDFS-6246. Remove 'dfs.support.append' flag from trunk code. Contributed by Uma Maheswara Rao G.
new bce5a92 HDFS-6210. Support GETACLSTATUS operation in WebImageViewer. Contributed by Akira Ajisaka.
new 5492149 MAPREDUCE-5749. TestRMContainerAllocator#testReportedAppProgress Failed. Contributed by Jason Lowe
new a059ead MAPREDUCE-5639. Port DistCp2 document to trunk (Akira AJISAKA via jeagles)
new 445b742 HDFS-5865. Update OfflineImageViewer document. Contributed by Akira Ajisaka.
new faffede YARN-483. Improve documentation on log aggregation in yarn-default.xml (Akira Ajisaka via Sandy Ryza)
new 283a3a2 MAPREDUCE-5835. Killing Task might cause the job to go to ERROR state. Contributed by Ming Ma
new b8a3e2b HDFS-6270. Secondary namenode status page shows transaction count in bytes. Contributed by Benoy Antony.
new 39abe66 MAPREDUCE-5714. Removed forceful JVM exit in shutDownJob. (Jinghui Wang via Eric Yang)
new 295b58b HADOOP-10322. Add ability to read principal names from a keytab. Contributed by Benoy Antony and Daryn Sharp.
new 02d0f0b HDFS-6218. Audit log should use true client IP for proxied webhdfs operations. Contributed by Daryn Sharp.
new bb7ce82 MAPREDUCE-5812. Make job context available to OutputCommitter.isRecoverySupported(). Contributed by Mohammad Kamrul Islam
new 71aa608 HDFS-6288. DFSInputStream Pread doesn't update ReadStatistics. Contributed by Juan Yu.
new 02d2890 HADOOP-10508. RefreshCallQueue fails when authorization is enabled. Contributed by Chris Li.
new 9d21180 HDFS-2882. DN continues to start up, even if block pool fails to initialize (Contributed by Vinayakumar B)
new a9775b4 YARN-738. TestClientRMTokens is failing irregularly while running all yarn tests. Contributed by Ming Ma
new 7a241ae YARN-1929. Fixed a deadlock in ResourceManager that occurs when failover happens right at the time of shutdown. Contributed by Karthik Kambatla.
new 871d810 HADOOP-10547. Give SaslPropertiesResolver.getDefaultProperties() public scope. (Contributed by Benoy Antony)
new 19176f4 HADOOP-10547. Fix CHANGES.txt
new 693025a MAPREDUCE-5638. Port Hadoop Archives document to trunk (Akira AJISAKA via jeagles)
new 0532b8b HDFS-6269. NameNode Audit Log should differentiate between webHDFS open and HDFS open. (Eric Payne via jeagles)
new 74921bd HADOOP-10543. RemoteException's unwrapRemoteException method failed for PathIOException. Contributed by Yongjun Zhang.
new 0689363 HDFS-6304. Consolidate the logic of path resolution in FSDirectory. Contributed by Haohui Mai.
new e5d6fba HDFS-6289. HA failover can fail if there are pending DN messages for DNs which no longer exist. Contributed by Aaron T. Myers.
new ef49823 YARN-1696. Added documentation for ResourceManager fail-over. Contributed by Karthik Kambatla, Masatake Iwasaki, Tsuyoshi OZAWA.
new 6420249 HDFS-6252. Phase out the old web UI in HDFS. Contributed by Haohui Mai.
new 94381e8 HADOOP-10562. Namenode exits on exception without printing stack trace in AbstractDelegationTokenSecretManager. (Contributed by Suresh Srinivas)
new 13bba8c HADOOP-10562. Undo previous commit.
new bee448c HADOOP-10562. Namenode exits on exception without printing stack trace in AbstractDelegationTokenSecretManager. (Contributed by Suresh Srinivas)
new 73db6bd HADOOP-10549. MAX_SUBST and varPat should be final in Configuration.java. Contributed by Gera Shegalov.
new d777cb8 HADOOP-10563. Remove the dependency of jsp in trunk. Contributed by Haohui Mai.
new 1ac2ce0 HADOOP-10568. Add s3 server-side encryption. Contributed by David S. Wang.
new b2f65c2 HDFS-5168. Add cross node dependency support to BlockPlacementPolicy. Contributed by Nikola Vujic
new 2ad1cee YARN-1201. TestAMAuthorization fails with local hostname cannot be resolved. (Wangda Tan via junping_du)
new 9445859 HDFS-6295. Add decommissioning state and node state filtering to dfsadmin. Contributed by Andrew Wang.
new 8b0acf4 HDFS-6337. Setfacl testcase is failing due to dash character in username in TestAclCLI. Contributed by Uma Maheswara Rao G.
new 17d4fbb HADOOP-10433. Key Management Server based on KeyProvider API. (tucu)
new 03db132 MAPREDUCE-5402. In DynamicInputFormat, change MAX_CHUNKS_TOLERABLE, MAX_CHUNKS_IDEAL, MIN_RECORDS_PER_CHUNK and SPLIT_RATIO to be configurable. Contributed by Tsuyoshi OZAWA
new f4b687b YARN-2018. TestClientRMService.testTokenRenewalWrongUser fails after HADOOP-10562. (Contributed by Ming Ma)
new bd54137 MAPREDUCE-5637. Convert Hadoop Streaming document to APT (Akira AJISAKA via jeagles)
new 7fe28fc MAPREDUCE-5636. Convert MapReduce Tutorial document to APT (Akira AJISAKA via jeagles)
new 0ba580e HADOOP-10541. InputStream in MiniKdc#initKDCServer for minikdc.ldiff is not closed. Contributed by Swarnim Kulkarni.
new a6d19c5 HADOOP-10517. InputStream is not closed in two methods of JarFinder. Contributed by Ted Yu.
new 2d53620 HADOOP-10471. Reduce the visibility of constants in ProxyUsers. Contributed by Benoy Antony.
new dca7350 HADOOP-10566. Add toLowerCase support to auth_to_local rules for service name. (tucu)
new 838aeee HADOOP-10556. [FIXING JIRA NUMBER TYPO] Add toLowerCase support to auth_to_local rules for service name. (tucu)
new 1ff6940 HADOOP-10467. Enable proxyuser specification to support list of users in addition to list of groups. (Contributed bt Benoy Antony)
new cfc97a4 YARN-1864. Fair Scheduler Dynamic Hierarchical User Queues (Ashwin Shankar via Sandy Ryza)
new 1c5902f YARN-1864. Add missing file FSQueueType.java
new 280c764 HDFS-5381. ExtendedBlock#hashCode should use both blockId and block pool ID (Benoy Antony via Colin Patrick McCabe)
new 624f8b0 HADOOP-10581. TestUserGroupInformation#testGetServerSideGroups fails. Contributed by Mit Desai.
new 584e384 Correcting the check-in mistake for HADOOP-10581.
new 47f03bc HADOOP-10158. SPNEGO should work with multiple interfaces/SPNs. Contributed by Daryn Sharp.
new e2c1880 MAPREDUCE-5884. History server uses short user name when canceling tokens. Contributed by Mohammad Kamrul Islam
new 63fadf0 HDFS-6340.DN can't finalize upgrade. (Contributed by Rahul Singhal)
new eac832f HDFS-6329. WebHdfs does not work if HA is enabled on NN but logical URI is not configured. Contributed by Kihwal Lee.
new 87215cb Fix CHANGES.txt
new 5323d5e HDFS-6313. WebHdfs may use the wrong NN when configured for multiple HA NNs. Contributed by Kihwal Lee.
new 0c437e9 YARN-1701. Improved default paths of the timeline store and the generic history store. Contributed by Tsuyoshi Ozawa.
new ed6f32c HDFS-6240. WebImageViewer returns 404 if LISTSTATUS to an empty directory. Contributed by Akira Ajisaka.
new 1a2f75c YARN-2036. Document yarn.resourcemanager.hostname in ClusterSetup (Ray Chiang via Sandy Ryza)
new f131dba HDFS-6294. Use INode IDs to avoid conflicts when a file open for write is renamed (cmccabe)
new 72ba2b3 YARN-766. TestNodeManagerShutdown in branch-2 should use Shell to form the output path and a format issue in trunk. (Contributed by Siddharth Seth)
new fa6fd97 YARN-1982. Renamed the daemon name to be TimelineServer instead of History Server and deprecated the old usage. Contributed by Zhijie Shen.
new 58c81d5 YARN-1962. Changed Timeline Service client configuration to be off by default given the non-readiness of the feature yet. Contributed by Mohammad Kamrul Islam.
new ae9109b HDFS-6328. Clean up dead code in FSDirectory. Contributed by Haohui Mai.
new 4a19196 YARN-1987. Wrapper for leveldb DBIterator to aid in handling database exceptions. (Jason Lowe via kasha)
new ca95af7 YARN-2011. Fix typo and warning in TestLeafQueue (Contributed by Chen He)
new 41344a4 YARN-1975. Fix yarn application CLI to print the scheme of the tracking url of failed/killed applications. Contributed by Junping Du
new 5e33714 MAPREDUCE-5774. Job overview in History UI should list reducer phases in chronological order. (Gera Shegalov via kasha)
new e9c6840 Command hdfs dfs -rm -r can't remove empty directory. Contributed by Yongjun Zhang.
new 09002d9 HDFS-6230. Expose upgrade status through NameNode web UI. Contributed by Mit Desai.
new e9459ba HDFS-5522. Datanode disk error check may be incorrectly skipped. Contributed by Rushabh Shah.
new 4f6493b YARN-2016. Fix a bug in GetApplicationsRequestPBImpl to add the missed fields to proto. Contributed by Junping Du
new 089adaa YARN-1976. Fix CHANGES.txt for YARN-1976.
new 4f399bb HDFS-6367. EnumSetParam$Domain#parse fails for parameter containing more than one enum. Contributed by Yi Liu.
new 33ade35 HDFS-6334. Client failover proxy provider for IP failover based NN HA. Contributed by Kihwal Lee.
new 335f61a HADOOP-10585. Retry polices ignore interrupted exceptions (Daryn Sharp via jeagles)
new e4ee1d1 HDFS-6305. WebHdfs response decoding may throw RuntimeExceptions (Daryn Sharp via jeagles)
new 95ba9f4 YARN-1751. Improve MiniYarnCluster for log aggregation testing. Contributed by Ming Ma
new 0077999 HADOOP-10566. Refactor proxyservers out of ProxyUsers. Contributed by Benoy Antony.
new eff9217 HADOOP-10566. Adding files missed in previous commit 1594280
new 29c5ed3 HADOOP-10572. Example NFS mount command must pass noacl as it isn't supported by the server yet. Contributed by Harsh J.
new 8e5b516 HDFS-6186. Pause deletion of blocks when the namenode starts up. Contributed by Jing Zhao.
new 4bc3371 MAPREDUCE-5888. Failed job leaves hung AM after it unregisters (Jason Lowe via jeagles)
new c54a4bb HADOOP-10583. bin/hadoop key throws NPE with no args and assorted other fixups. (clamb via tucu)
new b0e80d1 MAPREDUCE-5814. fat jar with *-default.xml may fail when mapreduce.job.classloader=true. Contributed by Gera Shegalov
new f3c3d9e MAPREDUCE-5652. NM Recovery. ShuffleHandler should handle NM restarts. (Jason Lowe via kasha)
new dac9028 HDFS-6355. Fix divide-by-zero, improper use of wall-clock time in BlockPoolSliceScanner (cmccabe)
new 2f87e77 YARN-1861. Fixed a bug in RM to reset leader-election on fencing that was causing both RMs to be stuck in standby mode when automatic failover is enabled. Contributed by Karthik Kambatla and Xuan Gong.
new 1c48142 YARN-1981. Nodemanager version is not updated when a node reconnects (Jason Lowe via jeagles)
new 4b54bd8 HDFS-6370. Web UI fails to display in intranet under IE. Contributed by Haohui Mai.
new 15b9077 Branching from trunk for HADOOP-10150 and HDFS-6134 at 1594374
new 45b4267 YARN-1957. Consider the max capacity of the queue when computing the ideal capacity for preemption. Contributed by Carlo Curino
new b29434a YARN-1362. Distinguish between nodemanager shutdown for decommission vs shutdown for restart. (Contributed by Jason Lowe)
new 97f5895 HDFS-6293. Issues with OIV processing PB-based fsimages. Contributed by Kihwal Lee.
new cf7dddb HDFS-6381. Fix a typo in INodeReference.java. Contributed by Binglin Chang.
new 84dfae2 YARN-1986. In Fifo Scheduler, node heartbeat in between creating app and attempt causes NPE (Hong Zhiguo via Sandy Ryza)
new 561c014 YARN-2042. String shouldn't be compared using == in QueuePlacementRule#NestedUserQueue#getQueueForApp (Chen He via Sandy Ryza)
new 5bf7ef8 MAPREDUCE-5821. Avoid unintentional reallocation of byte arrays in segments during merge. Contributed by Todd Lipcon
new 88e76f9 HDFS-2949. Add check to active state transition to prevent operator-induced split brain. Contributed by Rushabh S Shah.
new f099fa4 HADOOP-10401. ShellBasedUnixGroupsMapping#getGroups does not always return primary group first (ajisakaa via cmccabe)
new 65158e4 HDFS-6326. WebHdfs ACL compatibility is broken. Contributed by Chris Nauroth.
new f2933f2 HDFS-6287. Add vecsum test of libhdfs read access times (cmccabe)
new 1e5d2c6 MAPREDUCE-5861. finishedSubMaps field in LocalContainerLauncher does not need to be volatile. (Contributed by Tsuyoshi OZAWA)
new 046ad2e HDFS-6400. Cannot execute hdfs oiv_legacy. Contributed by Akira AJISAKA.
new 1c0e7a3 HDFS-6361. TestIdUserGroup.testUserUpdateSetting failed due to out of range nfsnobody Id. Contributed by Yongjun Zhang
new 1959afe HDFS-5683. Better audit log messages for caching operations. Contributed by Abhiraj Butala.
new 9a0fcae HDFS-6362. InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID. (Arpit Agarwal)
new 68867fd HDFS-6402. Suppress findbugs warning for failure to override equals and hashCode in FsAclPermission. Contributed by Chris Nauroth.
new 8f48760 HDFS-6345. DFS.listCacheDirectives() should allow filtering based on cache directive ID. (wang)
new 51b3796 HADOOP-10586. KeyShell doesn't allow setting Options via CLI. (clamb via tucu)
new 0f9147c YARN-2053. Fixed a bug in AMS to not add null NMToken into NMTokens list from previous attempts for work-preserving AM restart. Contributed by Wangda Tan
new 0c5e2f6 Relocate entry in CHANGES.txt
new 0fb47db HDFS-6250. Fix test failed in TestBalancerWithNodeGroup.testBalancerWithRackLocality (Contributed by Binglin Chang and Chen He)
new c937718 MAPREDUCE 5874. Creating MapReduce REST API section. Contributed by Tsuyoshi Ozawa
new 11be733 MAPREDUCE-5809. Enhance distcp to support preserving HDFS ACLs. Contributed by Chris Nauroth.
new 1251d6a Merge trunk r1595301 to branch
new 8384d57 Add CHANGES-fs-encryption.txt to Common and HDFS
new da3992b HDFS-6406. Add capability for NFS gateway to reject connections from unprivileged ports. Contributed by Aaron T. Myers.
new f25c33b HDFS-4913. Deleting file through fuse-dfs when using trash fails, requiring root permissions (cmccabe)
new 7bff84a HADOOP-10609. .gitignore should ignore .orig and .rej files. (kasha)
new 461ded8 YARN-2066. Wrong field is referenced in GetApplicationsRequestPBImpl#mergeLocalToBuilder (Contributed by Hong Zhiguo)
new 1e4e98a HADOOP-10614. CBZip2InputStream is not threadsafe (Xiangrui Meng via Sandy Ryza)
new 9a0ed1c HDFS-6325. Append should fail if the last block has insufficient number of replicas (Keith Pak via cos)
new f74e446 MAPREDUCE-5867. Fix NPE in KillAMPreemptionPolicy related to ProportionalCapacityPreemptionPolicy. Contributed by Sunil G.
new 35058fc HDFS-6397. NN shows inconsistent value in deadnode count. Contributed by Mohammad Kamrul Islam.
new bd64a2a HADOOP-10489. UserGroupInformation#getTokens and UserGroupInformation#addToken can lead to ConcurrentModificationException. Contributed by Robert Kanter.
new 161dcf1 Updated CHANGES.txt to reflect revert of HADOOP 10474 and 10485 from branch-2
new 4a839f0 Fix CRLFs in TestKillAMPreemptionPolicy.java
new 674c523 HADOOP-10612. NFS failed to refresh the user group id mapping table. Contributed by Brandon Li
new 0796bdd Add .classpath, .project and .settings to svn:ignore.
new 1f8bb10 MAPREDUCE-5309. 2.0.4 JobHistoryParser can't parse certain failed job history files generated by 2.0.3 history server. Contributed by Rushabh S Shah
new 64ec743 YARN-2050. Fix LogCLIHelpers to create the correct FileContext. Contributed by Ming Ma
new 668f70d HDFS-6421. Fix vecsum.c compile on BSD and some other systems (Mit Desai via Colin Patrick McCabe)
new 44e9d34 HDFS-6432. Add snapshot related APIs to webhdfs. Contributed by Jing Zhao.
new cb5682b HDFS-6419. TestBookKeeperHACheckpoints.TestSBNCheckpoints fails on trunk. Contributed by Akira AJISAKA.
new 14ff0a1 HADOOP-10562. Fix CHANGES.txt
new 011b53b HADOOP-10562. Fix CHANGES.txt entry again
new ac23a55 Merge HDFS-2006 HDFS XAttrs branch to Trunk
new fdb5870 YARN-1938. Added kerberos login for the Timeline Server. Contributed by Zhijie Shen.
new 4dfedd8 HDFS-6396. Remove support for ACL feature from INodeSymlink. Contributed by Charles Lamb.
new 2805889 YARN-2081. Fixed TestDistributedShell failure after YARN-1962. Contributed by Zhiguo Hong.
new b2f4e53 HDFS-6409. Fix typo in log message about NameNode layout version upgrade. Contributed by Chen He.
new 6b2e615 HDFS-6433. Replace BytesMoved class with AtomicLong. Contributed by Benoy Antony.
new 82f3454 YARN-2017. Merged some of the common scheduler code. Contributed by Jian He.
new 619ec83 YARN-2089. FairScheduler: QueuePlacementPolicy and QueuePlacementRule are missing audience annotations. (Zhihai Xu via kasha)
new 752a9d8 HDFS-6438. DeleteSnapshot should be a DELETE request in WebHdfs. Contributed by Jing Zhao.
new 5b1e88b HDFS-6423. Diskspace quota usage should be updated when appending data to partial block. Contributed by Jing Zhao.
new 57d3daa Merge from trunk to fs-encryption branch
new 3671a5e MAPREDUCE-5899. Support incremental data copy in DistCp. Contributed by Jing Zhao.
new 3c4c16a HADOOP-10618. Remove SingleNodeSetup.apt.vm (Contributed by Akira Ajisaka)
new 1ba203e HDFS-6435. Add support for specifying a static uid/gid mapping for the NFS gateway. (atm via wang)
new b867b69 YARN-2049. Added delegation-token support for the Timeline Server. Contributed by Zhijie Shen.
new af8b09a YARN-1936. Added security support for the Timeline Client. Contributed by Zhijie Shen.
new 892ada8 YARN-1937. Added owner-only ACLs support for Timeline Client and server. Contributed by Zhijie Shen.
new 6c56612 YARN-2012. Fair Scheduler: allow default queue placement rule to take an arbitrary queue (Ashwin Shankar via Sandy Ryza)
new 7f0724d YARN-2059. Added admin ACLs support to Timeline Server. Contributed by Zhijie Shen.
new a00b2d4 YARN-2073. Fair Scheduler: Add a utilization threshold to prevent preempting resources when cluster is free (Karthik Kambatla via Sandy Ryza)
new 7dd378c YARN-2096. Race in TestRMRestart#testQueueMetricsOnRMRestart. (Anubhav Dhoot via kasha)
new b20180f HADOOP-10603. Crypto input and output streams implementing Hadoop stream interfaces. Contributed by Yi Liu and Charles Lamb.
new 4dd2003 YARN-2071. Modified levelDB store permissions to be readable only by the server user. Contributed by Zhijie Shen.
new 978e3a6 HDFS-6443. Fix MiniQJMHACluster related test failures. (Contributed by Zesheng Wu)
new 1228f8f HBASE-6110 adding more slow action log in critical write path (Liang Xie via stack)
new 8d9e8ce HDFS-6227. ShortCircuitCache#unref should purge ShortCircuitReplicas whose streams have been closed by java interrupts. Contributed by Colin Patrick McCabe.
new 1c867b1 HDFS-6416. Use Time#monotonicNow in OpenFileCtx and OpenFileCtxCatch to avoid system clock bugs. Contributed by Abhiraj Butala
new 0ec6fc9 HDFS-6411. nfs-hdfs-gateway mount raises I/O error and hangs when a unauthorized user attempts to access it. Contributed by Brandon Li
new edfbc8a YARN-2105. Fix TestFairScheduler after YARN-2012. (Ashwin Shankar via Sandy Ryza)
new fc1e525 HADOOP-10625. Trim configuration names when putting/getting them to properties
new e976652 HDFS-6442. Fix TestEditLogAutoroll and TestStandbyCheckpoints failure caused by port conficts. (Contributed by Zesheng Wu)
new cfd8647 HDFS-6448. BlockReaderLocalLegacy should set socket timeout based on conf.socketTimeout (liangxie via cmccabe)
new 001078e YARN-2107. Refactored timeline classes into o.a.h.y.s.timeline package. Contributed by Vinod Kumar Vavilapalli.
new 4bb4de9 MAPREDUCE-5862. Line records longer than 2x split size aren't handled correctly. Contributed by bc Wong
new 66c5bcf HDFS-6453. Use Time#monotonicNow to avoid system clock reset. Contributed by Liang Xie.
new 342da5b YARN-596. Use scheduling policies throughout the queue hierarchy to decide which containers to preempt (Wei Yan via Sandy Ryza)
new 61c59c0 MAPREDUCE-5895. Close streams properly to avoid leakage in TaskLog. Contributed by Kousuke Saruta.
new 806f4d1 HADOOP-10602. Documentation has broken "Go Back" hyperlinks. Contributed by Akira AJISAKA.
new 3c5ce2d HADOOP-10602. Correct CHANGES.txt.
new cd24e95 YARN-2112. Fixed yarn-common's pom.xml to include jackson dependencies so that both Timeline Server and client can access them. Contributed by Zhijie Shen.
new 4a4868e HADOOP-10448. Support pluggable mechanism to specify proxy user settings (Contributed by Benoy Antony)
new 1d5e564 HDFS-6461. Use Time#monotonicNow to compute duration in DataNode#shutDown. Contributed by James Thomas.
new c559473 HDFS-6462. NFS: fsstat request fails with the secure hdfs. Contributed by Brandon Li
new 5dff070 HDFS-6356. Fix typo in DatanodeLayoutVersion. Contributed by Tulasi G.
new f40a367 HDFS-6447. balancer should timestamp the completion message. Contributed by Juan Yu.
new 04b0f68 HADOOP-10639. FileBasedKeyStoresFactory initialization is not using default for SSL_REQUIRE_CLIENT_CERT_KEY. (tucu)
new 2e5ae1a HADOOP-10628. Javadoc and few code style improvement for Crypto input and output streams. (yliu via clamb)
new 333562b merge from trunk r1598430
new 39f3d13 HDFS-6463. Clarify behavior of AclStorage#createFsPermissionForExtendedAcl in comments. Contributed by Chris Nauroth.
new b3d7759 HADOOP-9968. Update CHANGES.txt in trunk.
new 6809d58 HADOOP-10638. Updating hadoop-daemon.sh to work as expected when nfs is started as a privileged user. Contributed by Manikandan Narayanaswamy.
new 9c2848e HADOOP-10632. Minor improvements to Crypto input and output streams. Contributed by Yi Liu
new f792103 HADOOP-10635. Add a method to CryptoCodec to generate SRNs for IV. Contributed by Yi Liu
new 49a3a0c YARN-2054. Better defaults for YARN ZK configs for retries and retry-inteval when HA is enabled. (kasha)
new 75112e9 YARN-2010. Document yarn.resourcemanager.zk-auth and its scope. (Robert Kanter via kasha)
new 6659869 YARN-1338. Recover localized resource cache state upon nodemanager restart (Contributed by Jason Lowe)
new e4c0685 HDFS-6404. HttpFS should use a 000 umask for mkdir and create operations. (yoderme via tucu)
new d599adc YARN-1868. YARN status web ui does not show correctly in IE 11. Contributed by Chuan Liu.
new f7f651f HDFS-6472. fix typo in webapps/hdfs/explorer.js. Contributed by Juan Yu.
new 05d8586 HADOOP-10645. TestKMS fails because race condition writing acl files. (tucu)
new 12cf175 HADOOP-10611. KMS, keyVersion name should not be assumed to be keyName@versionNumber. (tucu)
new 42391d2 HDFS-6056. Clean up NFS config settings. Contributed by Brandon Li
new 4054a40 HDFS-6388. HDFS integration with KeyProvider. (clamb)
new 871616b merge from trunk r1598783
new da5df3a Move HDFS-6110 down to 2.5.0 section of CHANGES.txt
new 880a0c6 HDFS-6375. Listing extended attributes with the search permission. Contributed by Charles Lamb.
new 23c325a YARN-2115. Replaced RegisterNodeManagerRequest's ContainerStatus with a new NMContainerStatus which has more information that is needed for work-preserving RM-restart. Contributed by Jian He.
new 77805fb Fix merge error.
new a4ba451 YARN-1474. Make schedulers services. (Tsuyoshi Ozawa via kasha)
new 790cbbf YARN-2103. Inconsistency between viaProto flag and initial value of SerializedExceptionProto.Builder (Contributed by Binglin Chang)
new 75ec579 HADOOP-10653. Add a new constructor for CryptoInputStream that receives current position of wrapped stream. Contributed by Yi Liu
new 0aad2d5 YARN-1550. NPE in FairSchedulerAppsBlock#render. (Anubhav Dhoot via kasha)
new f15ff5e HDFS-6109 let sync_file_range() system call run in background (Liang Xie via stack)
new 5bbc484 YARN-1877. Updated CHANGES.txt to fix the JIRA number. It was previously committed as YARN-2010.
new cf03bdc HADOOP-10630. Possible race condition in RetryInvocationHandler. Contributed by Jing Zhao.
new a29d2d3 HDFS-6424. blockReport doesn't need to invalidate blocks on SBN. Contributed by Ming Ma.
new 16caa3f YARN-1913. With Fair Scheduler, cluster can logjam when all resources are consumed by AMs (Wei Yan via Sandy Ryza)
new ad5d0d7 HADOOP 9704. Write metrics sink plugin for Hadoop/Graphite (Chu Tong, Alex Newman and Babak Behzad via raviprak)
new 0634b42 HADOOP-10658. SSLFactory expects truststores being configured. Contributed by Alejandro Abdelnur.
new 02fcb6b HDFS-6268. Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found. (wang)
new 731f417 YARN-2119. DEFAULT_PROXY_ADDRESS should use DEFAULT_PROXY_PORT. (Anubhav Dhoot via kasha)
new d1d6bb7 YARN-2061. Revisit logging levels in ZKRMStateStore. (Ray Chiang via kasha)
new d86db3f HADOOP-10662. NullPointerException in CryptoInputStream while wrapped stream is not ByteBufferReadable. Add tests using normal stream. Contributed by Yi Liu
new bdee397 HADOOP-6392. Wire crypto streams for encrypted files in DFSClient. (clamb and yliu)
new 0ceb742 YARN-1977. Add tests on getApplicationRequest with filtering start time range. (Contributed by Junping Du)
new 1cbff8f HDFS-6476. Print out the KeyProvider after finding KP successfully on startup. Contributed by Juan Yu.
new e40524d HDFS-6369. Document that BlockReader#available() can return more bytes than are remaining in the block (Ted Yu via Colin Patrick McCabe)
new 3f892e9 HDFS-6473. Protocol and API for Encryption Zones (clamb)
new a93a37a Various fixes to CHANGES-fs-encryption.txt. Various Jiras ended up in the hadoop-common CHANGES-fs-encryption.txt by accident. Moved them to HDFS CHANGES-fs-encryption.txt
new 6a4f6d6 HDFS-6464. Support multiple xattr.name parameters for WebHDFS getXAttrs. Contributed by Yi Liu.
new f81c7b0 MAPREDUCE-5898. distcp to support preserving HDFS extended attributes(XAttrs). Contributed by Yi Liu.
new d7f5d76 YARN-2118. Fixed the type mismatch in Map#containsKey check of TimelineWebServices#injectOwnerInfo. Contributed by Ted Yu.
new 3d07772 HADOOP-10647. String Format Exception in SwiftNativeFileSystemStore.java.
new 40ba8c1 MAPREDUCE-5777. Support utf-8 text with Byte Order Marker. (Zhihai Xu via kasha)
new 08b4aa6 YARN-2117. Fixed the issue that secret file reader is potentially not closed in TimelineAuthenticationFilterInitializer. Contributed by Chen He.
new 825365d YARN-2121. Fixed NPE handling in Timeline Server's TimelineAuthenticator. Contributed by Zhijie Shen.
new 14394ee HDFS-6487. TestStandbyCheckpoint#testSBNCheckpoints is racy. Contributed by Mit Desai.
new 9528ed9 HDFS-6497. Make TestAvailableSpaceVolumeChoosingPolicy deterministic (cmccabe)
new 969bef3 YARN-2122. In AllocationFileLoaderService, the reloadThread should be created in init() and started in start(). (Robert Kanter via kasha)
new 85d4c78 YARN-2128. FairScheduler: Incorrect calculation of amResource usage. (Wei Yan via kasha)
new fb7ea6d HDFS-6297. Add CLI testcases to reflect new features of dfs and dfsadmin (Contributed by Dasha Boudnik)
new 9958072 YARN-2132. ZKRMStateStore.ZKAction#runWithRetries doesn't log the exception it encounters. (Vamsee Yarlagadda via kasha)
new cc9bc8e HDFS-6500. Snapshot shouldn't be removed silently after renaming to an existing snapshot. (Contributed by Nicholas SZE)
new 424fd94 YARN-1368. Added core functionality of recovering container state into schedulers after ResourceManager Restart so as to preserve running work in the cluster. Contributed by Jian He.
new 8b2b7ff HDFS-6257. TestCacheDirectives#testExceedsCapacity fails occasionally (cmccabe)
new a72f850 HDFS-6399. Add note about setfacl in HDFS permissions guide. Contributed by Chris Nauroth.
new d4b9a04 HADOOP-10664. TestNetUtils.testNormalizeHostName fails. Contributed by Aaron T. Myers.
new 36383505 Moving CHANGES.txt entry for HADOOP-9099 to the correct section.
new c94f2ce Augmented RMStateStore with state machine. Contributed by Binglin Chang.
new 123c563 HDFS-6460. Ignore stale and decommissioned nodes in NetworkTopology#sortByDistance. Contributed by Yongjun Zhang.
new d3b8971 YARN-2030. Augmented RMStateStore with state machine. Contributed by Binglin Chang
new 4888b16 MAPREDUCE-5886. Allow wordcount example job to accept multiple input paths. Contributed by Chris Nauroth.
new 50b0653 HADOOP-9555. HA functionality that uses ZooKeeper may experience inadvertent TCP RST and miss session expiration event due to bug in client connection management. Contributed by Chris Nauroth.
new 5de6f72 YARN-1424. RMAppAttemptImpl should return the DummyApplicationResourceUsageReport for all invalid accesses. (Ray Chiang via kasha)
new ecfd43a YARN-2091. Add more values to ContainerExitStatus and pass it from NM to RM and then to app masters (Tsuyoshi OZAWA via bikas)
new 6480fdf MAPREDUCE-5834. Increased test-timeouts in TestGridMixClasses to avoid occassional failures. Contributed by Mit Desai.
new c802ca2 HDFS-6364. Incorrect check for unknown datanode in Balancer. (Contributed by Benoy Antony)
new 81bc395 HADOOP-9629. Support Windows Azure Storage - Blob as a file system in Hadoop. Contributed by Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, Alexander Stojanovic, Brian Swan, and Min Wei.
new 49fecbd HDFS-6503. Fix typo of DFSAdmin restoreFailedStorage. Contributed by Zesheng Wu.
new e985298 HDFS-6315. Decouple recording edit logs from FSDirectory. Contributed by Haohui Mai.
new 710a869 YARN-2124. Fixed NPE in ProportionalCapacityPreemptionPolicy. Contributed by Wangda Tan
new c6e29a9 YARN-2125. Changed ProportionalCapacityPreemptionPolicy to log CSV in debug level. Contributed by Wangda Tan
new 473e83a MAPREDUCE-5920. Add Xattr option in DistCp docs. Contributed by Yi Liu.
new ca8f112 HADOOP-10656. The password keystore file is not picked by LDAP group mapping. Contributed by Brandon Li
new 22ec67e Moved the HDFS-2006 break down tasks list to 2.5 section in merging HDFS-2006 to branch-2
new 1758f31 HADOOP-10622. Shell.runCommand can deadlock. Contributed by Gera Shegalov
new 8bfbec8 HDFS-6379. HTTPFS - Implement ACLs support. (yoderme via tucu)
new 2584d53 YARN-2148. TestNMClient failed due more exit code values added and passed to AM (Wangda Tan via bikas)
new 34e9173 HADOOP-10376. Refactor refresh*Protocols into a single generic refreshConfigProtocol. (Contributed by Chris Li)
new 2f4f261 HDFS-6471. Make moveFromLocal CLI testcases to be non-disruptive (Contributed by Dasha Boudnik)
new deb858a YARN-2075. Fixed the test failure of TestRMAdminCLI. Contributed by Kenji Kikushima.
new fc7c8f9 HADOOP-10686. Writables are not always configured. (Abraham Elmahrek via kasha)
new 2368332 HADOOP-10561. Copy command with preserve option should handle Xattrs. Contributed by Yi Liu.
new 180ac8d MAPREDUCE-5912. Task.calculateOutputSize does not handle Windows files after MAPREDUCE-5196. Contributed by Remus Rusanu.
new befa4bb HDFS-6395. Skip checking xattr limits for non-user-visible namespaces. Contributed by Yi Liu.
new be01103 HDFS-3493. Invalidate corrupted blocks as long as minimum replication is satisfied. Contributed by Juan Yu and Vinayakumar B.
new 6aef8fe Fixup CHANGES.txt message for HDFS-3493
new 4bc91b4 YARN-2155. FairScheduler: Incorrect threshold check for preemption. (Wei Yan via kasha)
new dc7dd1f YARN-1702. Added kill app functionality to RM web services. Contributed by Varun Vasudev.
new ab54276 HADOOP-6350. Document Hadoop Metrics. (Contributed by Akira Ajisaka)
new be3fdd1 HADOOP-10691. Improve the readability of 'hadoop fs -help'. Contributed by Lei Xu.
new d282b7d HADOOP-10678. SecurityUtil has unnecessary synchronization on collection used for only tests. Contributed by Benoy Antony.
new 13052a3 HADOOP-9629. Set svn:ignore on new hadoop-tools/hadoop-azure directory.
new cd894ca HADOOP-9629. Correct svn:ignore on new hadoop-tools/hadoop-azure directory.
new 02f3ff3 HDFS-6330. Move mkdirs() to FSNamesystem. Contributed by Haohui Mai.
new 70db2ec HDFS-6470. TestBPOfferService.testBPInitErrorHandling is flaky. Contributed by Ming Ma.
new 41eca36 HADOOP-10688. Expose thread-level FileSystem StatisticsData (Sandy Ryza)
new 3f5e049 HDFS-6529. Trace logging for RemoteBlockReader2 to identify remote datanode and file being read. Contributed by Anubhav Dhoot.
new d18af7e HDFS-6499. Use NativeIO#renameTo instead of File#renameTo in FileJournalManager. Contributed by Yongjun Zhang.
new 2ad014a Moved CHANGES.txt entries of MAPREDUCE-5898, MAPREDUCE-5920, HDFS-6464, HDFS-6375 from trunk to 2.5 section on merging HDFS-2006 to branch-2
new 2693697 Preparing to release hadoop-2.4.1.
new b2ffbd8 HADOOP-10657. Have RetryInvocationHandler log failover attempt at INFO level. Contributed by Ming Ma.
new c5b7236 merge from trunk r1602933
new 05b8e8f HADOOP-10683. Users authenticated with KERBEROS are recorded as being authenticated with SIMPLE. Contributed by Benoy Antony.
new b98da7f HDFS-6539. test_native_mini_dfs is skipped in hadoop-hdfs pom.xml (decstery via cmccabe)
new 082c2ab YARN-2159. Better logging in SchedulerNode#allocateContainer. (Ray Chiang via kasha)
new 45c52ef HDFS-6518. TestCacheDirectives#testExceedsCapacity should take FSN read lock when accessing pendingCached list. (wang)
new f4b1c44 HDFS-6528. Add XAttrs to TestOfflineImageViewer. Contributed by Stephen Chu.
new c04a4b4 HADOOP-10702. KerberosAuthenticationHandler does not log the principal names correctly. Contributed by Benoy Antony.
new 50cd2a6 HADOOP-10666. Remove Copyright /d/d/d/d Apache Software Foundation from the source files license header. Contributed by Henry Saputra.
new 95897ca YARN-1885. Fixed a bug that RM may not send application-clean-up signal to NMs where the completed applications previously ran in case of RM restart. Contributed by Wangda Tan
new 072360d YARN-1339. Recover DeletionService state upon nodemanager restart. (Contributed by Jason Lowe)
new 98238a8 YARN-2167. LeveldbIterator should get closed in NMLeveldbStateStoreService#loadLocalizationState() within finally block. Contributed by Junping Du
new c1eda00 HADOOP-10699. Fix build native library on mac osx. Contributed by Binglin Chang
new 6e37dd3 HADOOP-10557. FsShell -cp -pa option for preserving extended ACLs. Contributed by Akira Ajisaka.
new 2298f3d HDFS-6545. Finalizing rolling upgrade can make NN unavailable for a long duration. Contributed by Kihwal Lee.
new 0abddac MAPREDUCE-5924. Changed TaskAttemptImpl to ignore TA_COMMIT_PENDING event at COMMIT_PENDING state. Contributed by Zhijie Shen
new 8e8a769 HDFS-6527. Edit log corruption due to defered INode removal. Contributed by Kihwal Lee and Jing Zhao.
new 44ac743 HADOOP-10590. ServiceAuthorizationManager is not threadsafe. (Contributed by Benoy Antony)
new 1adec79 HADOOP-10660. GraphiteSink should implement Closeable (Chen He and Ted Yu via raviprak)
new c797284 HADOOP-10607. Create API to separate credential/password storage from applications. (Larry McCay via omalley)
new bae5837 HADOOP-10717. Missing JSP support in Jetty
new 1af6955 HDFS-6530. Fix Balancer documentation.
new 52d18aa HDFS-6552. add DN storage to a BlockInfo will not replace the different storage from same DN. (Contributed by Amir Langer)
new 4cf94aa HDFS-6551. Rename with OVERWRITE option may throw NPE when the target file/directory is a reference INode. Contributed by Jing Zhao.
new 22cbcd1 HADOOP-10717. Revert r1603571.
new 2ecab65 HDFS-6439. NFS should not reject NFS requests to the NULL procedure whether port monitoring is enabled or not. Contributed by Brandon Li
new 21ffcc3 HDFS-6559. Fix wrong option "dfsadmin -rollingUpgrade start" in the document. (Contributed by Akira Ajisaka)
new cebf3c6 HADOOP-10711. Cleanup some extra dependencies from hadoop-auth. (rkanter via tucu)
new 6ef3a9e HDFS-6386. HDFS Encryption Zones (clamb)
new 5e5e1a6 Merge trunk r1603663 to branch.
new db437b7 HADOOP-10716. Cannot use more than 1 har filesystem. Contributed by Rushabh Shah.
new bd23a2f MAPREDUCE-5896. InputSplits should indicate which locations have the block cached in memory. (Sandy Ryza via kasha)
new eb93f73 HDFS-6553. Add missing DeprecationDeltas for NFS Kerberos configurations. Contributed by Stephen Chu
new a4e0ff5 HDFS-6480. Move waitForReady() from FSDirectory to FSNamesystem. Contributed by Haohui Mai.
new 3f82484 HDFS-6563. NameNode cannot save fsimage in certain circumstances when snapshots are in use. Contributed by Aaron T. Myers.
new 7b9c074 MAPREDUCE-5844. Add a configurable delay to reducer-preemption. (Maysam Yabandeh via kasha)
new d417e49 HDFS-6492. Support create-time xattrs and atomically setting multiple xattrs. (wang)
new a3908b8 Move HDFS-6375 down to 2.5 section in CHANGES.txt
new 97583db Merge from trunk to branch
new 0da148d HDFS-3848. A Bug in recoverLeaseInternal method of FSNameSystem class. Contributed by Hooman Peiro Sajjad and Chen He.
new 9ff3836 HDFS-6549. Add support for accessing the NFS gateway from the AIX NFS client. Contributed by Aaron T. Myers.
new 38e2322 HADOOP-10696. Add optional attributes to KeyProvider Options and Metadata. (tucu)
new 46dc32e HDFS-6312. WebHdfs HA failover is broken on secure clusters. (daryn via tucu)
new af6c91a HDFS-6403. Add metrics for log warnings reported by JVM pauses. Contributed by Yongjun Zhang.
new e74d99b HADOOP-10279. Create multiplexer, a requirement for the fair queue. (Contributed by Chris Li)
new f8041b0 HADOOP-9559. When metrics system is restarted MBean names get incorrectly flagged as dupes. Contributed by Mostafa Elhemali and Mike Liddell.
new d9eb18b HDFS-6535. HDFS quota update is wrong when file is appended. Contributed by George Wong.
new 1355ff6 MAPREDUCE-5830. Added back the private API HostUtil.getTaskLogUrl(..) for binary compatibility with older clients like Hive 0.13. Contributed by Akira Ajisaka.
new 8300b9f HADOOP-10689. InputStream is not closed in AzureNativeFileSystemStore#retrieve(). Contributed by Chen He.
new 61bf9f7 HADOOP-10690. Lack of synchronization on access to InputStream in NativeAzureFileSystem#NativeAzureFsInputStream#close(). Contributed by Chen He.
new 9ca79e8 HDFS-6557. Move the reference of fsimage to FSNamesystem. Contributed by Haohui Mai.
new bfc9c4b HADOOP-10479. Fix new findbugs warnings in hadoop-minikdc. Contributed by Swarnim Kulkarni.
new 0c51289 HDFS-6222. Remove background token renewer from webhdfs. Contributed by Rushabh Shah and Daryn Sharp.
new 905c58e Updated release notes for hadoop-2.4.1 rc1.
new 6fcbf9b8 YARN-2187. FairScheduler: Disable max-AM-share check by default. (Robert Kanter via kasha)
new 8a83bb7 HDFS-4667. Capture renamed files/directories in snapshot diff report. Contributed by Jing Zhao and Binglin Chang.
new f43f099 HADOOP-10713. Refactor CryptoCodec#generateSecureRandom to take a byte[]. (wang via yliu)
new 1e89eba HDFS-6583. Remove clientNode in FileUnderConstructionFeature. Contributed by Haohui Mai.
new e8ca648 HDFS-6507. Improve DFSAdmin to support HA cluster better. (Contributd by Zesheng Wu)
new a90a8b2 HDFS-6580. FSNamesystem.mkdirsInt should call the getAuditFileInfo() wrapper. Contributed bu Zhilei Xu.
new 9ddedbf HDFS-6587. Bug in TestBPOfferService can cause test failure. (Contributed by Zhilei Xu)
new 5ac06c8 HDFS-6578. add toString method to DatanodeStorage for easier debugging. (Contributed by Yongjun Zhang)
new 59b5e9f YARN-2191. Added a new test to ensure NM will clean up completed applications in the case of RM restart. Contributed by Wangda Tan
new 214aceb HADOOP-10659. Refactor AccessControlList to reuse utility functions and to improve performance. (Contributed by Benoy Antony)
new 08986fd HDFS-6562. Refactor rename() in FSDirectory. Contributed by Haohui Mai.
new 22b9a60 HADOOP-10665. Make Hadoop Authentication Handler loads case in-sensitive (Contributed by Benoy Antony)
new ff41321 HDFS-6486. Add user doc for XAttrs via WebHDFS. Contributed by Yi Liu.
new cb2b34b YARN-2195. Clean a piece of code in ResourceRequest. Contributed by Wei Yan.
new d164700 YARN-2074. Changed ResourceManager to not count AM preemptions towards app failures. Contributed by Jian He.
new 29c102c YARN-2111. In FairScheduler.attemptScheduling, we don't count containers as assigned if they have 0 memory but non-zero cores (Sandy Ryza)
new 46162a2 HDFS-6430. HTTPFS - Implement XAttr support. (Yi Liu via tucu)
new db4d277 YARN-2192. TestRMHA fails when run with a mix of Schedulers. (Anubhav Dhoot via kasha)
new b7e3c2e HADOOP-10746. TestSocketIOWithTimeout#testSocketIOWithTimeout fails on Power PC. (Contributed by Jinghui Wang)
new c0991d1 YARN-2109. Fix TestRM to work with both schedulers. (Anubhav Dhoot via kasha)
new b880b48 HADOOP-10652. Refactor Proxyusers to use AccessControlList. (Contributed by Benoy Antony)
new fdbff67 HADOOP-10717. HttpServer2 should load jsp DTD from local jars instead of going remote. Contributed by Dapeng Sun.
new 1f9a0fd YARN-2072. RM/NM UIs and webservices are missing vcore information. (Nathan Roberts via tgraves)
new bdf3de9 HDFS-6593. Move SnapshotDiffInfo out of INodeDirectorySnapshottable. Contributed by Jing Zhao.
new eaf2f61 HADOOP-9629. In CHANGES.txt, move attribution of Azure-related patches to trunk section.
new a92318c HDFS-6587. Fix a typo in message issued from explorer.js. Contributed by Yongjun Zhang.
new 0d91576 HADOOP-10728. Metrics system for Windows Azure Storage Filesystem. Contributed by Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, Alexander Stojanovic, Brian Swan, and Min Wei.
new e285b98 YARN-2152. Added missing information into ContainerTokenIdentifier so that NodeManagers can report the same to RM when RM restarts. Contributed Jian He.
new 55a1def HDFS-6475. WebHdfs clients fail without retry because incorrect handling of StandbyException. Contributed by Yongjun Zhang.
new 2eb913b HADOOP-10747. Support configurable retries on SASL connection failures in RPC client. Contributed by Chris Nauroth.
new 988bc17 HADOOP-10674. Improve PureJavaCrc32 performance and use java.util.zip.CRC32 for Java 7 and above.
new c3f1c30 YARN-1365. Changed ApplicationMasterService to allow an app to re-register after RM restart. Contributed by Anubhav Dhoot
new 2676365 HDFS-6387. HDFS CLI admin tool for creating & deleting an encryption zone. (clamb)
new 1a3a7e0 YARN-2204. TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler. (Robert Kanter via kasha)
new e3612e4 HDFS-6595. Allow the maximum threads for balancing on datanodes to be configurable. Contributed by Benoy Antony
new 9571db1 YARN-2171. Improved CapacityScheduling to not lock on nodemanager-count when AMs heartbeat in. Contributed by Jason Lowe.
new 7fcaab2 HADOOP-10715. Remove public GraphiteSink#setWriter()
new c3e2673 HADOOP-9705. FsShell cp -p does not preserve directory attibutes. Contributed by Akira AJISAKA.
new f194aaa HADOOP-8943. Support multiple group mapping providers. Contributed by Kai Zheng
new 6023da8 Removing two zero java files
new cfd9344 MAPREDUCE-5939. StartTime showing up as the epoch time in JHS UI after upgrade. Contributed by Chen He
new d431124 HADOOP-10754. Reenable several HA ZooKeeper-related tests on Windows. Contributed by Chris Nauroth.
new 280bdb9 HDFS-6572. Add an option to the NameNode that prints the software and on-disk image versions. Contributed by Charles Lamb.
new f084170 YARN 2163. WebUI: Order of AppId in apps table should be consistent with ApplicationId.compareTo()
new fdf9014 HADOOP-10565. Support IP ranges (CIDR) in proxyuser.hosts. (Contributed by Benoy Antony)
new 5f880f7 HADOOP-10701. NFS should not validate the access premission only based on the user's primary group. Contributed by Harsh J.
new f911f54 YARN-2204. Addendum patch. TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler. (Robert Kanter via kasha)
new bbbbd27 HADOOP-10649. Allow overriding the default ACL for service authorization (Contributed by Benoy Antony)
new 2efea95 HDFS-6391. Get the Key/IV from the NameNode for encrypted files in DFSClient. Contributed by Charles Lamb and Andrew Wang.
new 3161773 HDFS-6389. Rename restrictions for encryption zones. (clamb)
new 73927ba YARN-2104. Scheduler queue filter failed to work because index of queue column changed. Contributed by Wangda Tan
new 739b135 HADOOP-10739. Renaming a file into a directory containing the same filename results in a confusing I/O error. Contributed by chang li
new 55a0aa0 YARN-2201. Made TestRMWebServicesAppsModification be independent of the changes on yarn-default.xml. Contributed by Varun Vasudev.
new 78cafe3 HDFS-6556. Refine XAttr permissions. Contributed by Uma Maheswara Rao G.
new 94a1462 HDFS-6601. Issues in finalizing rolling upgrade when there is a layout version change. Contributed by Kihwal Lee.
new b717d44 YARN-614. Changed ResourceManager to not count disk failure, node loss and RM restart towards app failures. Contributed by Xuan Gong
new 2f75cd1 HDFS-6418. Regression: DFS_NAMENODE_USER_NAME_KEY missing
new b0c5150 YARN-2052. Embedded an epoch number in container id to ensure the uniqueness of container id after RM restarts. Contributed by Tsuyoshi OZAWA
new e5ae7c5 TestRMApplicationHistoryWriter sometimes fails in trunk. Contributed by Zhijie Shen
new e8186a9 HDFS-6558. Missing newline in the description of dfsadmin -rollingUpgrade. Contributed by Chen He.
new 4ac6e1d HADOOP-10710. hadoop.auth cookie is not properly constructed according to RFC2109. (Juan Yu via tucu)
new 0ca41a8 HDFS-6591. while loop is executed tens of thousands of times in Hedged Read. Contributed by Liang Xie.
new 950ae82 HADOOP-10695. KMSClientProvider should respect a configurable timeout. (yoderme via tucu)
new e6b0f6d HADOOP-10767. Clean up unused code in Ls shell command. Contributed by Chris Nauroth.
new 075ff27 YARN-1713. Added get-new-app and submit-app functionality to RM web services. Contributed by Varun Vasudev.
new 03a25d2 YARN-2022 Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy (Sunil G via mayank)
new 58e398f YARN-2204. Explicitly enable vmem check in TestContainersMonitor#testContainerKillOnMemoryOverflow. (Anubhav Dhoot via kasha)
new c89bf01 HDFS-6603. Add XAttr with ACL test. Contributed by Stephen Chu.
new d1f54f4 YARN-2065 AM cannot create new containers after restart
new 9dfe9cf HDFS-6612. MiniDFSNNTopology#simpleFederatedTopology(int) always hardcode nameservice ID. Contributed by Juan Yu.
new 130182d HDFS-6614. shorten TestPread run time with a smaller retry timeout setting. Contributed by Liang Xie.
new 297e3c7 HDFS-6604. The short-circuit cache doesn't correctly time out replicas that haven't been used in a while (cmccabe)
new 447c1c2 YARN-2241. ZKRMStateStore: On startup, show nicer messages if znodes already exist. (Robert Kanter via kasha)
new 45b191e YARN-2232. Fixed ResourceManager to allow DelegationToken owners to be able to cancel their own tokens in secure mode. Contributed by Varun Vasudev.
new 3047336 YARN-2022. Fixing CHANGES.txt to be correctly placed.
new 9b5d551 HDFS-6610. TestShortCircuitLocalRead tests sometimes timeout on slow machines. Contributed by Charles Lamb.
new 51b97a1 HDFS-6605.Client server negotiation of cipher suite. (wang)
new 2a3bccd HDFS-6625. Remove the Delete Encryption Zone function (clamb)
new c6a09d2 MAPREDUCE-5900. Changed to the interpret container preemption exit code as a task attempt killing event. Contributed by Mayank Bansal.
new 54dc17c Preparing for release 2.6.0
new 362ae51 HADOOP-10312 Shell.ExitCodeException to have more useful toString
new e09ea0c HADOOP-9361: Strictly define FileSystem APIs
new b6fbaba HADOOP-9361: Strictly define FileSystem APIs - HDFS portion
new becc23f HADOOP-9361: Strictly define FileSystem APIs - OpenStack portion
new a10a4f7 HADOOP-9361: Strictly define FileSystem APIs - OpenStack portion
new 6cb273c HADOOP-9361: site and gitignore
new 8997eb2 HADOOP-9361: changes.txt
new 1def6cd HADOOP-10312 changes.text updated in wrong place
new 5cb489f YARN-2242. Improve exception information on AM launch crashes. (Contributed by Li Lu)
new 160c912 HDFS-6620. Snapshot docs should specify about preserve options with cp command. Contributed by Stephen Chu.
new 93e23a9 HDFS-6613. Improve logging in caching classes. (wang)
new f881f0e HDFS-6493. Change dfs.namenode.startup.delay.block.deletion to second instead of millisecond. Contributed by Juan Yu.
new 151c5de HDFS-6511. BlockManager#computeInvalidateWork() could do nothing. Contributed by Juan Yu.
new bfef980 HADOOP-10693. Implementation of AES-CTR CryptoCodec using JNI to OpenSSL (hitliuyi via cmccabe)
new 03c858d HADOOP-10693: add files left out of previous checkin (cmccabe)
new c386652 HDFS-6516. List of Encryption Zones should be based on inodes (clamb)
new 4074843 YARN-2251. Avoid negative elapsed time in JHS/MRAM web UI and services (Contributed by Zhijie Shen)
new 5644f52 YARN-2250. FairScheduler.findLowestCommonAncestorQueue returns null when queues not identical (Krisztian Horvath via Sandy Ryza)
new 7b52955 HADOOP-10757. KeyProvider KeyVersion should provide the key name. (asuresh via tucu)
new 405dbd5 HADOOP-10719. Add generateEncryptedKey and decryptEncryptedKey methods to KeyProvider. (asuresh via tucu)
new ed642b5 HADOOP-10769. Create KeyProvider extension to handle delegation tokens. Contributed by Arun Suresh.
new 6d7dbd4 YARN-1367. Changed NM to not kill containers on NM resync if RM work-preserving restart is enabled. Contributed by Anubhav Dhoot
new 83702b0 HDFS-6629. Not able to create symlinks after HDFS-6516 (umamaheswararao)
new 93c1bc8 HDFS-6617. Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op. Contributed by Liang Xie.
new 55e7ddf HADOOP-10782. Fix typo in DataChecksum class. Contributed by Jingguo Yao.
new d85f90e MAPREDUCE-5868. Fixed an issue with TestPipeApplication that was causing the nightly builds to fail. Contributed by Akira Ajisaka.
new 286ae1e MAPREDUCE-5866. TestFixedLengthInputFormat fails in windows. Contributed by Varun Vasudev.
new 4b2ded8 MAPREDUCE-5517. Fixed MapReduce ApplicationMaster to not validate reduce side resource configuration for deciding uber-mode on map-only jobs. Contributed by Siqi Li.
new dda8563 Merge trunk to branch.
new 76a621f HDFS-6609. Use DirectorySnapshottableFeature to represent a snapshottable directory. Contributed by Jing Zhao.
new ceed0f6 HDFS-6635. Refactor encryption zone functionality into new EncryptionZoneManager class. (wang)
new 7aa0791 Move something down in CHANGES-fs-encryption.txt
new 12c4197 YARN-2158. Improved assertion messages of TestRMWebServicesAppsModification. Contributed by Varun Vasudev.
new e6446b7 HDFS-4286. Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM. Contributed by Rakesh R.
new 986c09f HDFS-4221. Remove the format limitation point from BKJM documentation as HDFS-3810 closed. Contributed by Rakesh R.
new cddd618 HDFS-5411. Update Bookkeeper dependency to 4.2.3. Contributed by Rakesh R.
new 3470dd9 HDFS-6614. Addendum patch to shorten TestPread run time with smaller retry timeout setting. Contributed by Liang Xie.
new c030bac HADOOP-10781. Unportable getgrouplist usage breaks FreeBSD (Dmitry Sivachenko via Colin Patrick McCabe)
new f62e93d HDFS-6638. Shorten test run time with a smaller retry timeout setting. Contributed by Liang Xie.
new fc4c42c move HADOOP-10781 to 2.6
new 709d5cb HDFS-6627. Rename DataNode#checkWriteAccess to checkReadAccess. Contributed by Liang Xie.
new 3b0db60 HDFS-6646. [ HDFS Rolling Upgrade - Shell ] shutdownDatanode and getDatanodeInfo usage is missed ( Contributed by Brahma Reddy Battula)
new ce0d636 HADOOP-10801 dead link in site.xml
new d751a61 YARN-1366. Changed AMRMClient to re-register with RM and send outstanding requests back to RM on work-preserving RM restart. Contributed by Rohith
new 8fbca62 YARN-2131. Add a way to format the RMStateStore. (Robert Kanter via kasha)
new 8044a12 HDFS-6618. FSNamesystem#delete drops the FSN lock between removing INodes from the tree and deleting them from the inode map (kihwal via cmccabe)
new d9c5f20 HDFS-6622. Rename and AddBlock may race and produce invalid edits (kihwal via cmccabe)
new 36492f0 HDFS-6645. Add test for successive Snapshots between XAttr modifications. Contributed by Stephen Chu.
new e67b80e HDFS-6643. Refactor INodeWithAdditionalFields.PermissionStatusFormat and INodeFile.HeaderFormat.
new d906711 HADOOP-10803. Update OpensslCipher#getInstance to accept CipherSuite#name format. (yliu)
new a532626 HADOOP-10812. Delegate KeyProviderExtension#toString to underlying KeyProvider. (wang)
new 1121457 HADOOP-10507. FsShell setfacl can throw ArrayIndexOutOfBoundsException when no perm is specified. Contributed by Stephen Chu and Sathish Gurram.
new 5279f64 HADOOP-10808. Remove unused native code for munlock. Contributed by Chris Nauroth.
new cce02e3 HDFS-6631. TestPread#testHedgedReadLoopTooManyTimes fails intermittently. Contributed by Liang Xie.
new 8f52038 HDFS-6647. Edit log corruption when pipeline recovery occurs for deleted file present in snapshot. Contributed by Kihwal Lee.
new c9fb040 YARN-2181. Added preemption info to logs and RM web UI. Contributed by Wangda Tan
new c30872a Temporary removing files incorrect case in SVN that break OSX
new 9f1768f YARN-2224. Fix CHANGES.txt. This was committed as YARN-2204 before.
new 50be856 YARN-2088. Fixed a bug in GetApplicationsRequestPBImpl#mergeLocalToBuilder. Contributed by Binglin Chang
new 520e458 HADOOP-10815. Implement Windows equivalent of mlock. Contributed by Chris Nauroth.
new c0439b7 YARN-2269. Remove external links from YARN UI. Contributed by Craig Welch
new 3bdea22 Moved few YARN entries in CHANGES.txt from 2.5 to 2.6
new 95986dd MAPREDUCE-5890. Support for encrypting Intermediate data and spills in local filesystem. (asuresh via tucu)
new b90dfe0 HDFS-6640. Syntax for MKDIRS, CREATESYMLINK, and SETXATTR are given wrongly in WebHdfs document (missed webhdfs/v1). Contributed by Stephen Chu.
new 81930b7 HDFS-5202. Support Centralized Cache Management on Windows. Contributed by Chris Nauroth.
new 952b0fb HDFS-6630. Unable to fetch the block information by Browsing the file system on Namenode UI through IE9 ( Contributed by Haohui Mai)
new 64306aa MAPREDUCE-5956. Made MR AM not use maxAttempts to determine if the current attempt is the last retry. Contributed by Wangda Tan.
new d79f27b HDFS-6474. Namenode needs to get the actual keys and iv from the KeyProvider. (wang)
new f00c0df Create a branch for HDFS-6584: Support archival storage.
new c9676bb HDFS-2976. Move attribution to release 2.6.0 section in CHANGES.txt.
new 1c6be51 HADOOP-8158. Move attribution to release 2.6.0 section in CHANGES.txt.
new 23e61a7 HDFS-3851. Move attribution to release 2.6.0 section in CHANGES.txt.
new 4334267 HADOOP-10736. Add key attributes to the key shell. Contributed by Mike Yoder.
new 905c90b HADOOP-10734. Implement high-performance secure random number sources. (Yi Liu via Colin Patrick McCabe)
new 4d211d5 YARN-2274. FairScheduler: Add debug information about cluster capacity, availability and reservations. (kasha)
new 4256168 HADOOP-10780. hadoop_user_info_alloc fails on FreeBSD due to incorrect sysconf use (trtrmitya via cmccabe)
new 3b54223 HDFS-2856. Fix block protocol so that Datanodes don't require root or jsvc. Contributed by Chris Nauroth.
new 9fc9724 HADOOP-10810. Clean up native code compilation warnings. Contributed by Chris Nauroth.
new 6f41baa HDFS-6677. Change INodeFile and FSImage to support storage policy ID.
new 4f1fae8 HDFS-6670. Add block storage policy support with default HOT, WARM and COLD policies.
new 395c763 Merge r1609845 through r1610532 from trunk.
new 3d9bea2 HDFS-6378. NFS registration should timeout instead of hanging when portmap/rpcbind is not available. Contributed by Abhiraj Butala
new 97b5fbc HDFS-6678. MiniDFSCluster may still be partially running after initialization fails. Contributed by Chris Nauroth.
new c6cc6a6 YARN-2260. Fixed ResourceManager's RMNode to correctly remember containers when nodes resync during work-preserving RM restart. Contributed by Jian He.
new a6cd712 YARN-2228. Augmented TimelineServer to load pseudo authentication filter when authentication = simple. Contributed by Zhijie Shen.
new b60ef8b MAPREDUCE-5790. Made it easier to enable hprof profile options by default. Contributed by Gera Shegalov.
new 65b0cfc HADOOP-10831. UserProvider is not thread safe. (Benoy Antony via umamahesh)
new 7fe6ab7 HDFS-5809. BlockPoolSliceScanner and high speed hdfs appending make datanode to drop into infinite loop (cmccabe)
new 317542f HADOOP-10834. Typo in CredentialShell usage. (Benoy Antony via umamahesh)
new cc57df3 Creating development branch for MAPREDUCE-2841
new 4dcc08b Addendum patch for HADOOP-10468 TestMetricsSystemImpl.testMultiThreadedPublish fails intermediately. Contributed by Akira AJISAKA
new fb1f5bc HDFS-6456. NFS should throw error for invalid entry in dfs.nfs.exports.allowed.hosts. Contributed by Abhiraj Butala
new b066be8 HDFS-6619. Clean up encryption-related tests. (wang)
new 56c0bd4 Merge from trunk to branch
new 43589a8 YARN-1408 Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins. (Sunil G via mayank)
new 2d91a0c HADOOP-7664. Move attribution to release 2.6.0 section in CHANGES.txt.
new 0305803 YARN-2233. Implemented ResourceManager web-services to create, renew and cancel delegation tokens. Contributed by Varun Vasudev.
new 790ee456 HADOOP-10673. Update rpc metrics when the call throws an exception. Contributed by Ming Ma.
new beb0c19 HADOOP-10735. Fall back AesCtrCryptoCodec implementation from OpenSSL to JCE if non native support. (yliu)
new 6198370 HADOOP-10845. Add common tests for ACLs in combination with viewfs. Contributed by Stephen Chu.
new dc31d66 HADOOP-9921. daemon scripts should remove pid file on stop call after stop or process is found not running ( Contributed by Vinayakumar B)
new 80d7f09 HADOOP-10824. Refactor KMSACLs to avoid locking. (Benoy Antony via umamahesh)
new 43fe48d HDFS-5624. Add HDFS tests for ACLs in combination with viewfs. Contributed by Stephen Chu.
new 40e1bb9 YARN-2264. Fixed a race condition in DrainDispatcher which may cause random test failures. Contributed by Li Lu
new 7f357d6 HADOOP-10839. Add unregisterSource() to MetricsSystem API. Contributed by Shanyu Zhao.
new e896de9 HDFS-6689. NFS doesn't return correct lookup access for direcories. Contributed by Brandon Li
new 77f0e2c HDFS-6405. Test Crypto streams in HDFS. (yliu via wang)
new 43a12f3 MAPREDUCE-5952. LocalContainerLauncher#renameMapOutputForReduce incorrectly assumes a single dir for mapOutIndex. (Gera Shegalov via kasha)
new e8a1ff7 MAPREDUCE-5971. Move the default options for distcp -p to DistCpOptionSwitch. Contributed by Charles Lamb.
new c477a16 HDFS-2538. option to disable fsck dots. Contributed by Mohammad Kamrul Islam.
new bda2318 YARN-2219. Changed ResourceManager to avoid AMs and NMs getting exceptions after RM recovery but before scheduler learns about apps and app-attempts. Contributed by Jian He.
new ca52cb0 HDFS-6690. Deduplicate xattr names in memory. (wang)
new 9dff25e HADOOP-10816. KeyShell returns -1 on error to the shell, should be 1. (Mike Yoder via wang)
new 3c19381 YARN-2219. Addendum patch for YARN-2219
new 0a02b5a HADOOP-10840. Fix OutOfMemoryError caused by metrics system in Azure File System. Contributed by Shanyu Zhao.
new 38af610 HDFS-6671. Change BlockPlacementPolicy to consider block storage policy in replicaiton.
new f4151bb HDFS-6478. RemoteException can't be retried properly for non-HA scenario. Contributed by Ming Ma.
new b2551c0 Import initial code for MAPREDUCE-2841 (native output collector)
new 9aaa714 HADOOP-10732. Fix locking in credential update. (Ted Yu via omalley)
new 1e7ce76 HADOOP-10733. Fix potential null dereference in CredShell. (Ted Yu via omalley)
new ef9e24f HADOOP-10591. Compression codecs must used pooled direct buffers or deallocate direct buffers when stream is closed (cmccabe)
new 8755922 MAPREDUCE-5910. Make MR AM resync with RM in case of work-preserving RM-restart. Contributed by Rohith
new ce1659f HDFS-6693. TestDFSAdminWithHA fails on windows ( Contributed by Vinayakumar B )
new dae1b6c HADOOP-10610. Upgrade S3n s3.fs.buffer.dir to support multi directories. Contributed by Ted Malaska.
new 7ba5913 HDFS-6667. In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error. Contributed by Jing Zhao.
new 403ec8e YARN-1341. Recover NMTokens upon nodemanager restart. (Contributed by Jason Lowe)
new 04fd201 Merge r1609845 through r1611528 from trunk.
new 2c5ceee HDFS-6655. Add 'header banner' to 'explorer.html' also in Namenode UI ( Contributed by Vinayakumar B )
new 7f06998 HADOOP-10841. EncryptedKeyVersion should have a key name property. (asuresh via tucu)
new f714413 HADOOP-10842. CryptoExtension generateEncryptedKey method should receive the key name. (asuresh via tucu)
new d2024f2 HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Rakesh R )
new 8f0c341 reverted HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Rakesh R ) ........
new 9f75b97 HDFS-4120. Add a new "-skipSharedEditsCheck" option for BootstrapStandby ( Contributed by Liang Xie and Rakesh R )
new 962ef69 HDFS-6490. Fix the keyid format for generated keys in FSNamesystem.createEncryptionZone (clamb)
new 5f9e52f HDFS-6597. Add a new option to NN upgrade to terminate the process after upgrade on NN is completed. Contributed by Danilo Vunjak.
new 9368957 fix eol style on TestBootstrapStandbyWithBKJM
new 08466ea HDFS-6700. BlockPlacementPolicy shoud choose storage but not datanode for deletion.
new 2b07af0 Merge r1609845 through r1611734 from tunk.
new 5510249 HDFS-6599. 2.4 addBlock is 10 to 20 times slower compared to 0.23 (daryn)
new 7c18f8d HDFS-6616. Add exclude-datanodes feature to WebHDFS redirection so that it will not redirect retries to the same datanode. Contributed by zhaoyunjiong
new 64ed72a HADOOP-10817. ProxyUsers configuration should support configurable prefixes. (tucu)
new f1b831c YARN-2208. AMRMTokenManager need to have a way to roll over AMRMToken. Contributed by Xuan Gong
new 0a3ea6c HADOOP-10750. KMSKeyProviderCache should be in hadoop-common. (asuresh via tucu)
new 8871d8e YARN-2244. FairScheduler missing handling of containers for unknown application attempts. (Anubhav Dhoot via kasha)
new 7c71a3b YARN-2323. FairShareComparator creates too many Resource objects (Hong Zhiguo via Sandy Ryza)
new 014be25 HDFS-6710. Change BlockPlacementPolicy to consider block storage policy in replica deletion.
new 0a736fb HDFS-6679. Bump NameNodeLayoutVersion and update editsStored test files. Contributed by vinayakumarb
new ee3a327 Merge r1609845 through r1612268 from trunk.
new 8a87085 YARN-2045. Data persisted in NM should be versioned. Contributed by Junping Du
new 9e62bcc MAPREDUCE-5957. AM throws ClassNotFoundException with job classloader enabled if custom output format/committer is used. Contributed by Sangjin Lee
new 87c632c HADOOP-10857. Native Libraries Guide does not mention a dependency on openssl-development package (ozawa via cmccabe)
new 0c1469e HADOOP-10720. KMS: Implement generateEncryptedKey and decryptEncryptedKey in the REST API. (asuresh via tucu)
new c2174a5 MAPREDUCE-5756. CombineFileInputFormat.getSplits() including directories in its results. Contributed by Jason Dere
new cb20bb61 Merge from trunk to branch
new d3bf818 HADOOP-10755. Support negative caching of user-group mapping. Contributed by Lei Xu.
new 1ad2d7b YARN-2321. NodeManager web UI can incorrectly report Pmem enforcement. Contributed by Leitao Guo
new 44d9bb2 HDFS-6680. BlockPlacementPolicyDefault does not choose favored nodes correctly.
new 761d44f HADOOP-10866. RawLocalFileSystem fails to read symlink targets via the stat command when the format of the stat command uses non-curly quotes (yzhang via cmccabe)
new 3de6c61 Merge r1609845 through r1612431 from trunk.
new a4984f5 HADOOP-10871. incorrect prototype in OpensslSecureRandom.c (cmccabe)
new 7b466b3 HDFS-6716. Update usage of KeyProviderCryptoExtension APIs on NameNode. (wang)
new b57ec16 HDFS-6718. Remove EncryptionZoneManager lock. (wang)
new 6fac3e9 HADOOP-10870. Failed to load OpenSSL cipher error logs on systems with old openssl versions (cmccabe)
new 266a4ff YARN-2131. Addendum. Add a way to format the RMStateStore. (Robert Kanter via kasha)
new 537c361 YARN-2013. The diagnostics is always the ExitCodeException stack when the container crashes. (Contributed by Tsuyoshi OZAWA)
new 70deded YARN-2270. Made TestFSDownload#testDownloadPublicWithStatCache be skipped when there’s no ancestor permissions. Contributed by Akira Ajisaka.
new 25b0e84 HDFS-6702. Change DFSClient to pass the StorageType from the namenode to datanodes and change datanode to write block replicas using the specified storage type.
new ee13f8b Merge r1609845 through r1612502 from trunk.
new b52b80d HADOOP-10853. Refactor get instance of CryptoCodec and support create via algorithm/mode/padding. (yliu)
new afb9394 YARN-2242. Addendum patch. Improve exception information on AM launch crashes. (Contributed by Li Lu)
new eac0701 YARN-2319. Made the MiniKdc instance start/close before/after the class of TestRMWebServicesDelegationTokens. Contributed by Wenwu Peng.
new ab6af79 HADOOP-10826. Iteration on KeyProviderFactory.serviceLoader is thread-unsafe. (benoyantony viat tucu)
new 9c062e0 HADOOP-10864. Tool documentenation is broken. (Contributed by Akira Ajisaka)
new 0c72ca9 HDFS-6704. Fix the command to launch JournalNode in HDFS-HA document. Contributed by Akira AJISAKA.
new c83c5b8 HDFS-6701. Make seed optional in NetworkTopology#sortByDistance. Contributed by Ashwin Shankar.
new f6c723f YARN-2295. Refactored DistributedShell to use public APIs of protocol records. Contributed by Li Lu
new 69b75fc HDFS-6720. Remove KeyProvider in EncryptionZoneManager. (wang)
new df2abcb YARN-2131. Addendum2: Document -format-state-store. Add a way to format the RMStateStore. (Robert Kanter via kasha)
new 60b1e835e0 MAPREDUCE-5963. ShuffleHandler DB schema should be versioned with compatible/incompatible changes. Contributed by Junping Du
new e788e8b MAPREDUCE-5985. native-task: Fix build on macosx. Contributed by Binglin Chang
new fee737e HDFS-6712. Document HDFS Multihoming Settings. (Contributed by Arpit Agarwal)
new c5686ad HDFS-6703. NFS: Files can be deleted from a read-only mount. Contributed by Srikanth Upputuri
new 853ed29 HDFS-6731. Run 'hdfs zkfc -formatZK' on a server in a non-namenode will cause a null pointer exception. Contributed by Masatake Iwasaki
new ff77582 YARN-2273. NPE in ContinuousScheduling thread when we lose a node. (Wei Yan via kasha)
new 181c466 HADOOP-10855. Allow Text to be read with a known Length. Contributed by Todd Lipcon.
new e0f00e1 HADOOP-10881. Clarify usage of encryption and encrypted encryption key in KeyProviderCryptoExtension. (wang)
new 341695e Merge trunk into branch
new c88402f YARN-2313. Livelock can occur in FairScheduler when there are lots of running apps (Tsuyoshi Ozawa via Sandy Ryza)
new 687ce1a HDFS-6733. Creating encryption zone results in NPE when KeyProvider is null. (clamb)
new 512b756 HDFS-6738. Remove unnecessary getEncryptionZoneForPath call in EZManager#createEncryptionZone. (clamb)
new ac5e8ae HDFS-6686. Change BlockPlacementPolicy to use fallback when some storage types are unavailable.
new 48dc486 Merge r1609845 through r1612880 from trunk.
new fa08b92 HADOOP-10872. TestPathData fails intermittently with 'Mkdirs failed to create d1'. (Contributed by Yongjun Zhang
new 61156a8 HADOOP-10830. Missing lock in JavaKeyStoreProvider.createCredentialEntry. Contributed by Benoy Antony.
new d15ea6c Moved CHANGES.txt entry for HADOOP-10830 to 2.6 section
new b9370fd HADOOP-10890. TestDFVariations.testMount fails intermittently. (Contributed by Yongjun Zhang)
new 5343b43 HDFS-6422. getfattr in CLI doesn't throw exception or return non-0 return code when xattr doesn't exist. (Charles Lamb via umamahesh)
new 552b4fb Merge from trunk to branch
new 22ba00d Merge from trunk to branch pt 2
new a6b1d2a HDFS-6114. Block Scan log rolling will never happen if blocks written continuously leading to huge size of dncp_block_verification.log.curr (vinayakumarb via cmccabe)
new 2a5f102 HDFS-6455. NFS: Exception should be added in NFS log for invalid separator in nfs.exports.allowed.hosts. Contributed by Abhiraj Butala
new 28fca92 YARN-2147. client lacks delegation token exception details when application submit fails. Contributed by Chen He
new 9bfae42 HADOOP-10887. Add XAttrs to ViewFs and make XAttrs + ViewFileSystem internal dir behavior consistent. Contributed by Stephen Chu.
new 06e5c5c YARN-2300. Improved the documentation of the sample requests for RM REST API - submitting an app. Contributed by Varun Vasudev.
new 2050e0d YARN-1342. Recover container tokens upon nodemanager restart. Contributed by Jason Lowe.
new d468a92 MAPREDUCE-5994. Simplify ByteUtils and fix failing test. Contributed by Todd Lipcon.
new b2cba48 MAPREDUCE-5996. native-task: Rename system tests into standard directory layout. Contributed by Todd Lipcon.
new 2054453 HADOOP-10882. Move DirectBufferPool into common util. Contributed by Todd Lipcon.
new 5149a8a Merge trunk into branch
new 77acc70 MAPREDUCE-5997. native-task: Use DirectBufferPool from Hadoop Common. Contributed by Todd Lipcon.
new 6635180 MAPREDUCE-6000. native-task: Simplify ByteBufferDataReader/Writer. Contributed by Todd Lipcon.
new ea9e5b7 MAPREDUCE-5991. native-task should not run unit tests if native profile is not enabled. Contributed by Binglin Chang.
new ef9b6a4 HDFS-6657. Remove link to 'Legacy UI' in trunk's Namenode UI. Contributed by Vinayakumar B.
new f2137d7 HADOOP-10894. Fix dead link in ToolRunner documentation. (Contributed by Akira Ajisaka)
new a7855e1 HDFS-6723. New NN webUI no longer displays decommissioned state for dead node. Contributed by Ming Ma.
new 8c6e172 HDFS-6715. Webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode. Contributed by Jing Zhao.
new e171254 Name node cannot start if the path of a file under construction contains .snapshot. (wang)
new 934ba44 HADOOP-10891. Add EncryptedKeyVersion factory method to KeyProviderCryptoExtension. (wang)
new e670641 Merge from trunk to branch
new 2bb6501 HDFS-5919. FileJournalManager doesn't purge empty and corrupt inprogress edits files (vinayakumarb)
new 1e55385 YARN-2214. FairScheduler: preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness. (Ashwin Shankar via kasha)
new 77363b9 YARN-2335. Annotate all hadoop-sls APIs as @Private. (Wei Yan via kasha)
new cc0464f HDFS-6752. Avoid Address bind errors in TestDatanodeConfig#testMemlockLimit (vinayakumarb)
new b9e4be4 HDFS-6724. Decrypt EDEK before creating CryptoInputStream/CryptoOutputStream. (wang)
new 79d2141 Fix up HDFS CHANGES.txt for 2.5.0
new 10286e9 Fix up Common CHANGES.txt for 2.5.0
new d4fec34 YARN-2211. Persist AMRMToken master key in RMStateStore for RM recovery. Contributed by Xuan Gong
new 57d8f82 HDFS-6755. There is an unnecessary sleep in the code path where DFSOutputStream#close gives up its attempt to contact the namenode (mitdesai21 via cmccabe)
new e85a3fe HDFS-6750. The DataNode should use its shared memory segment to mark short-circuit replicas that have been unlinked as stale (cmccabe)
new 9cfde45 HADOOP-10896. Update compatibility doc to capture visibility of un-annotated classes/ methods. (kasha)
new b0c2c85 YARN-1726. ResourceSchedulerWrapper broken due to AbstractYarnScheduler. (Wei Yan via kasha)
new 5d4677b YARN-1796. container-executor shouldn't require o-r permissions. Contributed by Aaron T. Myers.
new 4625792 YARN-1726. Add missing files. ResourceSchedulerWrapper broken due to AbstractYarnScheduler. (Wei Yan via kasha)
new 9bce3ec HDFS-6749. FSNamesystem methods should call resolvePath. Contributed by Charles Lamb.
new 549bcc2 MAPREDUCE-6002. Made MR task avoid reporting error to AM when the task process is shutting down. Contributed by Wangda Tan.
new 1d3e9ec merge from trunk r1613787
new d6532d3 YARN-2247. Made RM web services authenticate users via kerberos and delegation token. Contributed by Varun Vasudev.
new 43917e5 Add entry to branch's CHANGES.txt for previous commit
new 78d86a9 MAPREDUCE-5995. native-task: Revert changes to Text internals. Contributed by Todd Lipcon.
new f49c2a1 HDFS-6717. JIRA HDFS-5804 breaks default nfs-gateway behavior for unsecured config. Contributed by Brandon Li
new 4f9ffc7 HDFS-6739. Add getDatanodeStorageReport to ClientProtocol.
new c6cddce HADOOP-10876. The constructor of Path should not take an empty URL as a parameter. Contributed by Zhihai Xu.
new 10d6210 Merge r1609845 through r1614231 from trunk.
new 260fd25 HADOOP-8069. Enable TCP_NODELAY by default for IPC. (Contributed by Todd Lipcon)
new c0b49ff YARN-2328. FairScheduler: Verify update and continuous scheduling threads are stopped when the scheduler is stopped. (kasha)
new 407bb3d HDFS-6509. Create a special /.reserved/raw directory for raw access to encrypted data. Contributed by Charles Lamb.
new 3a90228 HDFS-6509 addendum, extra file
new 4152235 HDFS-6771. Require specification of an encryption key when creating an encryption zone. (wang)
new 9ca2f34 HDFS-6730. Create a .RAW extended attribute namespace. (clamb)
new 7e54b1c YARN-2354. DistributedShell may allocate more containers than client specified after AM restarts. Contributed by Li Lu
new 1224190 HDFS-6665. Add tests for XAttrs in combination with viewfs. Contributed by Stephen Chu.
new 09e7ff0 HDFS-6778. The extended attributes javadoc should simply refer to the user docs. Contributed by Charles Lamb.
new c3fa0b5 Merge from trunk to branch
new f6436c0 HDFS-4629. Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA.
new 9b2bfc7 HDFS-4629. Using com.sun.org.apache.xml.internal.serialize.* in XmlEditsVisitor.java is JVM vendor specific. Breaks IBM JAVA -pom indentation
new 535fe14 HDFS-6570. add api that enables checking if a user has certain permissions on a file. Contributed by Jitendra Pandey.
new bda9c58 HADOOP-10756. KMS audit log should consolidate successful similar requests. (asuresh via tucu)
new 18360e7 HDFS-6768. Fix a few unit tests that use hard-coded port numbers. (Arpit Agarwal)
new 7405953 HDFS-6692. Add more HDFS encryption tests. (wang)
new ab47b66 HDFS-6785. Should not be able to create encryption zone using path to a non-directory file. (clamb)
new 4996bf8 HADOOP-10910. Increase findbugs maxHeap size. (wang)
new b8b8f3f HDFS-6441. Add ability to exclude/include specific datanodes while balancing. (Contributed by Benoy Antony and Yu Li)
new 1d6e178 YARN-2347. Consolidated RMStateVersion and NMDBSchemaVersion into Version in yarn-server-common. Contributed by Junping Du.
new e52f67e YARN-1994. Expose YARN/MR endpoints on multiple interfaces. Contributed by Craig Welch, Milan Potocnik,and Arpit Agarwal
new beebb36 Fix some merge errors that slipped through.
new b8597e6 HDFS-6685. Balancer should preserve storage type of replicas.
new b5b862e HDFS-6797. DataNode logs wrong layoutversion during upgrade. (Contributed by Benoy Antony)
new 8bca3c6 HDFS-3482. Update CHANGES.txt.
new dc7744d Merge r1609845 through r1615019 from trunk.
new 1141edc YARN-2051. Fix bug in PBimpls and add more unit tests with reflection. (Contributed by Binglin Chang)
new 397c882 HDFS-6798. Add test case for incorrect data node condition during balancing. (Contributed by Benoy Antony)
new 7e12b19 HDFS-6796. Improve the argument check during balancer command line parsing. Contributed by Benoy Antony
new 45db4d2 HDFS-6794. Update BlockManager methods to use DatanodeStorageInfo where possible. (Arpit Agarwal)
new 0d66f1f HADOOP-10902. Deletion of directories with snapshots will not output reason for trash move failure. Contributed by Stephen Chu.
new 5918e99 HADOOP-10900. CredentialShell args should use single-dash style. (wang)
new c4a3a29 HADOOP-10793. KeyShell args should use single-dash style. (wang)
new ce9aae4 HADOOP-10920. site plugin couldn't parse hadoop-kms index.apt.vm. Contributed by Akira Ajisaka.
new da2ce46 HDFS-6802. Some tests in TestDFSClientFailover are missing @Test annotation. Contributed by Akira Ajisaka.
new 3d9e39e HDFS-6807. Fix TestReservedRawPaths. (clamb)
new 70c9927 HDFS-6780. Batch the encryption zones listing API. (wang)
new 07860b1 HDFS-6788. Improve synchronization in BPOfferService with read write lock. Contributed by Yongjun Zhang.
new 1ba3f89 HDFS-6482. Use block ID-based block layout on datanodes (James Thomas via Colin Patrick McCabe)
new a41c314 YARN-2343. Improve NMToken expire exception message. Contributed by Li Lu
new c614cee HADOOP-10925. Compilation fails in native link0 function on Windows. Contributed by Chris Nauroth.
new bcf7ab1 HDFS-6810. StorageReport array is initialized with wrong size in DatanodeDescriptor#getStorageReports. (Contributed by szetszwo)
new 2ad6da0 HADOOP-10903. Enhance hadoop classpath command to expand wildcards or write classpath into jar manifest. Contributed by Chris Nauroth.
new 04ae560 YARN-2370. Fix comment in o.a.h.y.server.resourcemanager.schedulerAppSchedulingInfo (Contributed by Wenwu Peng)
new 83a3967 MAPREDUCE-6005. native-task: Fix some valgrind errors (Binglin Chang)
new 30a9ec2 HDFS-5723. Append failed FINALIZED replica should not be accepted as valid when that block is underconstruction. Contributed by Vinayakumar B.
new 33518e5 HDFS-5185. DN fails to startup if one of the data dir is full. Contributed by Vinayakumar B.
new 10db613 HADOOP-10886. CryptoCodec#getCodecclasses throws NPE when configurations not loaded. Contributed by Uma Maheswara Rao G.
new 6e421f7 HDFS-6814. Mistakenly dfs.namenode.list.encryption.zones.num.responses configured as boolean. Contributed by Uma Maheswara Rao G.
new b8f1512 YARN-1354. Recover applications upon nodemanager restart. (Contributed by Jason Lowe)
new 431857d HDFS-6787. Remove duplicate code in FSDirectory#unprotectedConcat. Contributed by Yi Liu.
new 9ffc4b1 HADOOP-10759. Remove hardcoded JAVA_HEAP_MAX. (Eric Yang)
new c9aa747 HDFS-6451. NFS should not return NFS3ERR_IO for AccessControlException. Contributed by Abhiraj Butala
new ff189d9 HADOOP-10759. Remove hardcoded JAVA_HEAP_MAX. (Sam Liu via Eric Yang)
new e2cb6e3 commit the additional doc change for HDFS-6717
new d7b5709 HADOOP-10928. Incorrect usage on . Contributed by Josh Elser.
new c8abf5f HADOOP-10927. Fix CredentialShell help behavior and error codes. Contributed by Josh Elser.
new 513dc29 HADOOP-10937. Need to set version name correctly before decrypting EEK. Contributed by Arun Suresh.
new ac73d41 Merge from trunk to branch
new b7e67db HADOOP-10936. Change default KeyProvider bitlength to 128. (wang)
new 7a246c4 Merge from trunk to branch
new b9984e5 HADOOP-10918. JMXJsonServlet fails when used within Tomcat. (tucu)
new 2d7dcff HADOOP-10791. AuthenticationFilter should support externalizing the secret for signing and provide rotation support. (rkanter via tucu)
new a6cfaab HADOOP-10933. FileBasedKeyStoresFactory Should use Configuration.getPassword for SSL Passwords. (lmccay via tucu)
new ac47ad1 HDFS-6394. HDFS encryption documentation. (wang)
new 857d134 MAPREDUCE-6014. New task status field in task attempts table can lead to an empty web page. Contributed by Mit Desai
new 34e3bba HADOOP-10939. Fix TestKeyProviderFactory testcases to use default 128 bit length keys. Contributed by Arun Suresh.
new 4869fa2 Edit CHANGES.txt files to move HADOOP-10759 and HDFS-6717 from 2.5.0 to 2.6.0
new a4f1292 HADOOP-10905. LdapGroupsMapping Should use configuration.getPassword for SSL and LDAP Passwords. Contributed by Larry McCay
new 812ac91 HDFS-6790. DFSUtil Should Use configuration.getPassword for SSL passwords. Contributed by Larry McCay
new 2b5e044 HDFS-6817. Fix findbugs and other warnings. (yliu)
new b47f652 YARN-2298. Move TimelineClient to yarn-common project (Contributed by Zhijie Shen)
new 7ecaa81 MAPREDUCE-5984. native-task: Reuse lz4 sources in hadoop-common. Contributed by Binglin Chang
new 432f641 MAPREDUCE-5976. native-task: should not fail to build if snappy is missing (Manu Zhang)
new 4d4fb17 MAPREDUCE-5978. native-task: remove test case for not supported codec Bzip2Codec and DefaultCodec (Manu Zhang)
new d7a57c2 HDFS-6517. Remove hadoop-metrics2.properties from hdfs project (Akira AJISAKA via aw)
new 6fa66f2 HDFS-6517. Remove hadoop-metrics2.properties from hdfs project (Akira AJISAKA via aw)
new 9ebeac1 YARN-2374. Fixed TestDistributedShell#testDSShell failure due to hostname dismatch. Contributed by Varun Vasudev
new efc73a0 HDFS-6791. A block could remain under replicated if all of its replicas are on decommissioned nodes. Contributed by Ming Ma.
new 8feddc4 YARN-2359. Application hangs when it fails to launch AM container. (Zhihai Xu via kasha)
new be63605 YARN-2388. Fixed TestTimelineWebServices failure due to HADOOP-10791. Contributed by Zhijie Shen.
new 83b9933 HDFS-6809. Move Balancer's inner classes MovedBlocks and Matcher as to standalone classes and separates KeyManager from NameNodeConnector.
new 0ed8732 HDFS-6812. Remove addBlock and replaceBlock from DatanodeDescriptor.
new b50cb5e Merge r1609845 through r1616427 from trunk.
new 96fc3b3 HADOOP-10931 compile error on tools/hadoop-openstack
new 3bfdb00 YARN-2288. Made persisted data in LevelDB timeline store be versioned. Contributed by Junping Du.
new b98400d HDFS-6781. Separate HDFS commands from CommandsManual.apt.vm. (Contributed by Akira Ajisaka)
new 8437df8 YARN-2008. Fixed CapacityScheduler to calculate headroom based on max available capacity instead of configured max capacity. Contributed by Craig Welch
new de25958 MAPREDUCE-6021. MR AM should have working directory in LD_LIBRARY_PATH. Contributed by Jason Lowe
new 311d2f0 Merge from trunk to branch.
new eca80dc HDFS-6728. Dynamically add new volumes to DataStorage, formatted if necessary. Contributed by Lei Xu.
new 8b32f84 HADOOP-10929. Typo in Configuration.getPasswordFromCredentialProviders. Contributed by Larry McCay
new d758be1 HDFS-6740. Make FSDataset support adding data volumes dynamically. Contributed by Lei Xu.
new 041b832 MAPREDUCE-6007. Add support to distcp to preserve raw.* namespace extended attributes. (clamb)
new 17e4365 Revert HADOOP-10876.
new 2ac640e HDFS-6722. Display readable last contact time for dead nodes on NN webUI. Contributed by Ming Ma.
new 4e7c4a6 HADOOP-10771. Refactor HTTP delegation support out of httpfs to common, PART 1. (tucu)
new be9c679 HADOOP-10771. Refactor HTTP delegation support out of httpfs to common, PART 2. (tucu)
new d3a2fe2 HDFS-6772. Get DN storages out of blockContentsStale state faster after NN restarts. (Contributed by Ming Ma)
new 1fa2d6c HDFS-6834. Improve the configuration guidance in DFSClient when there are no Codec classes found in configs. Contributed by Uma Maheswara Rao G.
new 14864e9 YARN-2352. FairScheduler: Collect metrics on duration of critical methods that affect performance. (kasha)
new 6d39525 YARN-2352. Add missing file. FairScheduler: Collect metrics on duration of critical methods that affect performance. (kasha)
new 70d4536 HDFS-573. Porting libhdfs to Windows. Contributed by Chris Nauroth.
new e6bdb33 HADOOP-10919. Copy command should preserve raw.* namespace extended attributes. (clamb)
new 6da830c HDFS-6823. dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS
new a42231d HDFS-6823. dfs.web.authentication.kerberos.principal shows up in logs for insecure HDFS
new a70c9de HDFS-6830. BlockInfo.addStorage fails when DN changes the storage for a block replica. (Arpit Agarwal)
new 05d1bf4 HDFS-6830. Revert accidental checkin
new c3cf331 HDFS-6828. Separate block replica dispatching from Balancer. Contributed by Tsz Wo Nicholas Sze.
new eeb4acd YARN-2212: ApplicationMaster needs to find a way to update the AMRMToken periodically. Contributed by Xuan Gong
new 9d5f8fa Merging r1616428 through r1616893 from trunk.
new 021ae47 HADOOP-10862. Miscellaneous trivial corrections to KMS classes. (asuresh via tucu)
new 74fe843 HADOOP-10224. JavaKeyStoreProvider has to protect against corrupting underlying store. (asuresh via tucu)
new a7643f4 YARN-2026. Fair scheduler: Consider only active queues for computing fairshare. (Ashwin Shankar via kasha)
new ee3825e YARN-1954. Added waitFor to AMRMClient(Async). Contributed by Tsuyoshi Ozawa.
new 743f7f3 YARN-2400. Fixed TestAMRestart fails intermittently. Contributed by Jian He:
new e91d099 YARN-2302. Refactor TimelineWebServices. (Contributed by Zhijie Shen)
new af6d709 HADOOP-10402. Configuration.getValByRegex does not substitute for variables. (Robert Kanter via kasha)
new bdd3e2c YARN-2337. ResourceManager sets ClientRMService in RMContext multiple times. (Zhihai Xu via kasha)
new da7b508 YARN-2361. RMAppAttempt state machine entries for KILLED state has duplicate event entries. (Zhihai Xu via kasha)
new 946be75 YARN-2400: Addendum fix for TestAMRestart failure. Contributed by Jian He
new e606736 HDFS-6837. Code cleanup for Balancer and Dispatcher. Contributed by Tsz Wo Nicholas Sze.
new c4dc685 YARN-2138. Cleaned up notifyDone* APIs in RMStateStore. Contributed by Varun Saxena
new 80691b0 HDFS-6838. Code cleanup for unnecessary INode replacement. Contributed by Jing Zhao.
new b760f20 HDFS-6582. Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler). Contributed by Abhiraj Butala
new 04884cd Merging r1616894 through r1617376 from trunk.
new 6d7a676 HADOOP-10835. Implement HTTP proxyuser support in HTTP authentication client/server libraries. (tucu)
new c2febdc YARN-1337. Recover containers upon nodemanager restart. (Contributed by Jason Lowe)
new acc3d73 HDFS-6839. Fix TestCLI to expect new output. (clamb)
new 74f7be0 merge from trunk r1617527
new 0a2ee2f HADOOP-10820. Throw an exception in GenericOptionsParser when passed an empty Path. Contributed by Alex Holmes and Zhihai Xu.
new 0c9b8f2 YARN-2373. Changed WebAppUtils to use Configuration#getPassword for accessing SSL passwords. Contributed by Larry McCay
new de3804f Merging r1617377 through r1617565 from trunk.
new 37207b7 HDFS-6835. Archival Storage: Add a new API to set storage policy. Contributed by Jing Zhao.
new 7ad7ab1 YARN-2317. Updated the document about how to write YARN applications. Contributed by Li Lu.
new 662c5bb HDFS-6830. BlockInfo.addStorage fails when DN changes the storage for a block replica. (Arpit Agarwal)
new 486e718 YARN-2399. FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt. (kasha)
new a72fba5 HDFS-6836. HDFS INFO logging is verbose & uses file appenders. (Contributed by Xiaoyu Yao)
new d687f6f HADOOP-10851. NetgroupCache does not remove group memberships. (Contributed by Benoy Antony)
new 4239695 YARN-2399. Delete old versions of files. FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt. (kasha)
new f7ac928 HADOOP-10962. Flags for posix_fadvise are not valid in some architectures (David Villegas via Colin Patrick McCabe)
new e0a9e1b HADOOP-10281. Create a scheduler, which assigns schedulables a priority level. (Contributed by Chris Li)
new 5197f8c YARN-1370. Fair scheduler to re-populate container allocation state. (Anubhav Dhoot via kasha)
new a34dafe HADOOP-8944. Shell command fs -count should include human readable option (Jonathan Allen via aw)
new 03d8ff4 HDFS-6567. Normalize the order of public final in HdfsFileStatus. Contributed by Tassapol Athiapinya.
new 471b136 HDFS-6847. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (Contributed by Vinayakumar B.)
new 6554994 Reverted Merged revision(s) 1617784 from hadoop/common/trunk: HDFS-6847. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (Contributed by Vinayakumar B.) ........
new 195961a HDFS-6247. Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer (vinayakumarb)
new 6ab25df HADOOP-8944. Shell command fs -count should include human readable option (Jonathan Allen via aw) (continued)
new cc93c1f MAPREDUCE-5944. Remove MRv1 commands from CommandsManual.apt.vm (Akira AJISAKA via aw)
new e51a5d6 MAPREDUCE-5943. Separate mapred commands from CommandManual.apt.vm (Akira AJISAKA via aw)
new 2f3ed50 HADOOP-10966. Hadoop Common native compilation broken in windows. (Contributed by David Villegas)
new 065d9ec HDFS-6849. Replace HttpFS custom proxyuser handling with common implementation. (tucu)
new 41aa4ba YARN-2277. Added cross-origin support for the timeline server web services. Contributed by Jonathan Eagles.
new 1a535f8 YARN-2070. Made DistributedShell publish the short user name to the timeline server. Contributed by Robert Kanter.
new e90d940 HADOOP-10843. TestGridmixRecord unit tests failure on PowerPC (Jinghui Wang via Colin Patrick McCabe)
new 44864c6 HDFS-6783. Fix HDFS CacheReplicationMonitor rescan logic. Contributed by Yi Liu and Colin Patrick McCabe.
new bd79a4b HADOOP-10838. Byte array native checksumming. Contributed by James Thomas.
new 886338f MAPREDUCE-6006. native-task: add native tests to maven and fix bug in pom.xml. Contributed by Binglin Chang.
new 808bf8b MAPREDUCE-6026. native-task: fix logging. Contributed by Manu Zhang.
new eace4dd MAPREDUCE-6035. native-task: sources/test-sources jar distribution. Contributed by Manu Zhang.
new 13ad623 Updated contributors name in CHANGES.txt for HDFS-6783
new b3df973 MAPREDUCE-883. harchive: Document how to unarchive (Akira AJISAKA and Koji Noguchi via aw)
new 1e016e6 MAPREDUCE-4791. Javadoc for KeyValueTextInputFormat should include default separator and how to change it (Akira AJISAKA via aw)
new e7b540e MAPREDUCE-5363. Fix doc and spelling for TaskCompletionEvent#getTaskStatus and getStatus (Akira AJISAKA via aw)
new 9579554 MAPREDUCE-6010. HistoryServerFileSystemStateStore fails to update tokens. Contributed by Jason Lowe
new 92054f2 MAPREDUCE-5597. Missing alternatives in javadocs for deprecated constructors in mapreduce.Job (Akira AJISAKA via aw)
new 6be9809 MAPREDUCE-5950. incorrect description in distcp2 document (Akira AJISAKA via aw)
new 7557f7b MAPREDUCE-5998. CompositeInputFormat javadoc is broken (Akira AJISAKA via aw)
new e1f15d2 MAPREDUCE-5999. Fix dead link in InputFormat javadoc (Akira AJISAKA via aw)
new 2d904b3 MAPREDUCE-5906. Inconsistent configuration in property "mapreduce.reduce.shuffle.input.buffer.percent" (Akira AJISAKA via aw)
new 20dcb84 HDFS-6546. Add non-superuser capability to get the encryption zone for a specific path. (clamb)
new 399e428 HADOOP-10121. Fix javadoc spelling for HadoopArchives#writeTopLevelDirs (Akira AJISAKA via aw)
new a9023c2 YARN-2397. Avoided loading two authentication filters for RM and TS web interfaces. Contributed by Varun Vasudev.
new 597b3fd HADOOP-10231. Add some components in Native Libraries document (Akira AJISAKA via aw)
new b8ea45c YARN-2197. Add a link to YARN CHANGES.txt in the left side of doc (Akira AJISAKA via aw)
new 0350ea3 YARN-1918. Typo in description and error message for yarn.resourcemanager.cluster-id (Anandha L Ranganathan via aw)
new 7378af7 MAPREDUCE-5878. some standard JDK APIs are not part of system classes defaults. Contributed by Sangjin Lee
new 894b4e4 HDFS-6850. Move NFS out of order write unit tests into TestWrites class. Contributed by Zhe Zhang.
new e86c9ef HADOOP-10770. KMS add delegation token support. (tucu)
new be117cb HADOOP-10967. Improve DefaultCryptoExtension#generateEncryptedKey performance. (hitliuyi via tucu)
new cfeaf4c HADOOP-10964. Small fix for NetworkTopologyWithNodeGroup#sortByDistance. Contributed by Yi Liu.
new 16b7bd4 Move HADOOP-10121 to correct section of CHANGES.txt
new 7360cec YARN-2378. Added support for moving applications across queues in CapacityScheduler. Contributed by Subramaniam Venkatraman Krishnan
new 6d39367 MAPREDUCE-6025: distribute nativetask.so to right folder (Manu Zhang)
new e932365 HADOOP-10698. KMS, add proxyuser support. (tucu)
new 31e4789 Wrong categorization for a variety of commits in the CHANGES.txt files
new 84bc2fe MAPREDUCE-6032. Made MR jobs write job history files on the default FS when the current context’s FS is different. Contributed by Benjamin Zhitomirsky.
new ddf1084 MAPREDUCE-6032. Fix the non-unicode character in the change log in CHANGES.txt.
new c3084d6 YARN-2389. Added functionality for schedulers to kill all applications in a queue. Contributed by Subramaniam Venkatraman Krishnan
new 9b250d7 HDFS-6847. Support storage policy on directories and include storage policy in HdfsFileStatus. Contributed by Jing Zhao
new cb75b6b Merge r1609845 through r1618416 from trunk.
new c1cd41c HADOOP-10650. Add ability to specify a reverse ACL (black list) of users and groups. (Contributed by Benoy Antony)
new b47ad1c HADOOP-10335. An ip whilelist based implementation to resolve Sasl properties per connection. (Contributed by Benoy Antony)
new 4850567 HADOOP-10335. Undo checkin to resolve test build issue.
new 8684083 HADOOP-10335. An ip whilelist based implementation to resolve Sasl properties per connection. (Contributed by Benoy Antony)
new 519c4be YARN-2411. Support simple user and group mappings to queues. Contributed by Ram Venkatesh
new 1c77c80 HDFS-6783. Addendum patch to fix test failures. (Contributed by Yi Liu)
new 08d6201 MAPREDUCE-6033. Updated access check for displaying job information (Yu Gao via Eric Yang)
new 4a978bf HADOOP-10059. RPC authentication and authorization metrics overflow to negative values on busy clusters. Contributed by Tsuyoshi OZAWA and Akira AJISAKA
new 5d5aae0 HDFS-6801. Archival Storage: Add a new data migration tool. Contributed by Tsz Wo Nicholas Sze.
new f8e871d MAPREDUCE-6024. Shortened the time when Fetcher is stuck in retrying before concluding the failure by configuration. Contributed by Yunjiong Zhao.
new e446497 HDFS-6561. org.apache.hadoop.util.DataChecksum should support native checksumming (James Thomas via Colin Patrick McCabe)
new 110cf46 HADOOP-10973. Native Libraries Guide contains format error. (Contributed by Peter Klavins)
new bd61655 HDFS-6825. Edit log corruption due to delayed block removal. Contributed by Yongjun Zhang.
new 55d7fec Update CHANGES.txt for HDFS-6561 which was renamed to HADOOP-10975.
new d51f81c MAPREDUCE-6036. TestJobEndNotifier fails intermittently in branch-2. Contributed by chang li
new 73325f2 MAPREDUCE-6012. DBInputSplit creates invalid ranges on Oracle. (Wei Yan via kasha)
new 0cc08f6 Merge from trunk to branch.
new 4129a6e HADOOP-10972. Native Libraries Guide contains mis-spelt build line (Peter Klavins via aw)
new 379292a HADOOP-10873. Fix dead link in Configuration javadoc (Akira AJISAKA via aw)
new 1b5139b HDFS-6188. An ip whitelist based implementation of TrustedChannelResolver. (Contributed by Benoy Antony)
new 2fb04d2 HDFS-6569. OOB message can't be sent to the client when DataNode shuts down for upgrade. Contributed by Brandon Li
new 4e324bc Merge r1609845 through r1618763 from trunk.
new 3146745 HADOOP-9902. Shell script rewrite (aw)
new 375c221 YARN-2409. RM ActiveToStandBy transition missing stoping previous rmDispatcher. Contributed by Rohith
new bf9aa34 HADOOP-10968. hadoop native build fails to detect java_libarch on ppc64le (Dinar Valeev via Colin Patrick McCabe)
new f6a778c YARN-2249. Avoided AM release requests being lost on work preserving RM restart. Contributed by Jian He.
new 14b01dd HDFS-6872. Fix TestOptionsParser. (clamb)
new a4ee77b HDFS-6873. Constants in CommandWithDestination should be static. (clamb)
new fbc1ee4 HDFS-6868. portmap and nfs3 are documented as hadoop commands instead of hdfs. Contributed by Brandon Li
new d2a39b6 Merge from trunk to branch.
new e4539e8 YARN-2174. Enable HTTPs for the writer REST API of TimelineServer. Contributed by Zhijie Shen
new 55a2b55 YARN-2034. Description for yarn.nodemanager.localizer.cache.target-size-mb is incorrect. Contributed by Chen He
new f20d363 HDFS-6870. Blocks and INodes could leak for Rename with overwrite flag. Contributed by Yi Liu.
new 834fccf Merge from trunk to branch
new d7200a4 HDFS-6134 and HADOOP-10150 subtasks. Merge fs-encryption branch to trunk.
new ef32d09 [post-HADOOP-9902] mapred version is missing (Akira AJISAKA via aw)
new b0f0ef1 Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs.
new 9b8250c Set the release date for 2.5.0 in CHANGES.txt
new e1dd210 YARN-1919. Potential NPE in EmbeddedElectorService#stop. (Tsuyoshi Ozawa via kasha)
new 8304001 HDFS-6858. Allow dfs.data.transfer.saslproperties.resolver.class default to hadoop.security.saslproperties.resolver.class. Contributed by Benoy Antony.
new 8f00897 HDFS-6878. Change MiniDFSCluster to support StorageType configuration for individual directories. (Arpit Agarwal)
new 6824abc HDFS-6758. Block writer should pass the expected block size to DataXceiverServer (Arpit Agarwal)
new c92d869 Merge r1609845 through r1619277 from trunk.
new 7e75226 YARN-2424. LCE should support non-cgroups, non-secure mode (Chris Douglas via aw)
new e5e9d79 MAPREDUCE-5974. Allow specifying multiple MapOutputCollectors with fallback. (Todd Lipcon via kasha)
new 7b28f36 HDFS-6890. NFS readdirplus doesn't return dotdot attributes. Contributed by Brandon Li
new ddb7f12 HADOOP-10992. Merge KMS to branch-2, updating hadoop-common CHANGES.txt. (tucu)
new cbbb899 YARN-2436. [post-HADOOP-9902] yarn application help doesn't work
new da4ba50 HADOOP-10893. isolated classloader on the client side. Contributed by Sangjin Lee
new 4236c66 YARN-2434. RM should not recover containers from previously failed attempt when AM restart is not enabled. Contributed by Jian He
new 5109157 MAPREDUCE-5130. Add missing job config options to mapred-default.xml (Ray Chiang via Sandy Ryza)
new 603cbe5 HDFS-6863. Archival Storage: Support migration for snapshot paths. Contributed by Jing Zhao.
new e69954d HDFS-6906. Archival Storage: Add more tests for BlockStoragePolicy. Contributed by Tsz Wo Nicholas Sze.
new 7be2808 HADOOP-8896. Javadoc points to Wrong Reader and Writer classes in SequenceFile (Ray Chiang via aw)
new b6c2447 HADOOP-10989. Work around buggy getgrouplist() implementations on Linux that return 0 on failure. Contributed by Chris Nauroth.
new 3aa3b0a HDF-6905. fs-encryption merge triggered release audit failures. (clamb via tucu)
new 0097b15 YARN-2393. FairScheduler: Add the notion of steady fair share. (Wei Yan via kasha)
new 524a63e MAPREDUCE-6044. Fully qualified intermediate done dir path breaks per-user dir creation on Windows. Contributed by Zhijie Shen.
new e6c3650 HDFS-6829. DFSAdmin refreshSuperUserGroupsConfiguration failed in security cluster. (Contributed by zhaoyunjiong)
new 10d2679 HADOOP-10998. Fix bash tab completion code to work (Jim Hester via aw)
new 4b3a6b8 HADOOP-10282. Create a FairCallQueue: a multi-level call queue which schedules incoming calls and multiplexes outgoing calls. (Contributed by Chris Li)
new a83d055 HDFS-4852. libhdfs documentation is out of date. Contributed by Chris Nauroth.
new e871955 HDFS-6899. Allow changing MiniDFSCluster volumes per DN and capacity per volume. (Arpit Agarwal)
new dc154ab Add a section for 2.5.1 in CHANGES.txt
new 2d9b77d Fix CHANGES.txt entry for MAPREDUCE-6033.
new d16bfd1 YARN-1326. RM should log using RMStore at startup time. (Tsuyoshi Ozawa via kasha)
new d778abf YARN-2035. FileSystemApplicationHistoryStore should not make working dir when it already exists. Contributed by Jonathan Eagles.
new a1618a2 HADOOP-11002. shell escapes are incompatible with previous releases (aw)
new 9ec4a93 HADOOP-10996. Stop violence in the *_HOME (aw)
new 812bd0c MAPREDUCE-5885. build/test/test.mapred.spill causes release audit warnings. Contributed by Chen He
new c5d9a4a HDFS-6694. TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms - debugging patch (Contributed by Yongjun Zhang)
new e2d0ff3 YARN-2182. Updated ContainerId#toString() to append RM Epoch number. Contributed by Tsuyoshi OZAWA
new 6b441d2 HDFS-6908. Incorrect snapshot directory diff generated by snapshot deletion. Contributed by Juan Yu and Jing Zhao.
new 555900a Merge branch 'trunk' into HDFS-6584
new 8ea20b5 HDFS-6911. Archival Storage: check if a block is already scheduled in Mover. Contributed by Tsz Wo Nicholas Sze.
new cd9182d HDFS-6892. Add XDR packaging method for each NFS request. Contributed by Brandon Li
new 26ebdd8 HDFS-6938. Cleanup javac warnings in FSNamesystem. Contributed by Charles Lamb.
new fad4524 MAPREDUCE-5977. Fix or suppress native-task gcc warnings. Contributed by Manu Zhang.
new bfd1d75 MAPREDUCE-6054. native-task: Speed up tests. Contributed by Todd Lipcon.
new fdd3bc5 HADOOP-10746. HttpServer2 should not load JspServlet. Contributed by Haohui Mai.
new d805cc2 HDFS-6773. MiniDFSCluster should skip edit log fsync by default. Contributed by Stephen Chu.
new 225569e HDFS-4486. Add log category for long-running DFSClient notices. Contributed by Zhe Zhang.
new b6b95ff HDFS-6902. FileWriter should be closed in finally block in BlockReceiver#receiveBlock() (Tsuyoshi OZAWA via Colin Patrick McCabe)
new b7ded46 HDFS-6920. Archival Storage: check the storage type of delNodeHintStorage when deleting a replica. Contributed by Tsz Wo Nicholas Sze.
new 6962510 HDFS-6879. Adding tracing to Hadoop RPC. Contributed by Masatake Iwasaki.
new 3754957 Add HDFS-6879 to CHANGES.txt
new a26aa6b HDFS-6944. Archival Storage: add retry and termination logic for Mover. Contributed by Jing Zhao.
new 7a16731 HADOOP-10957. The globber will sometimes erroneously return a permission denied exception when there is a non-terminal wildcard.
new a7bcc95 HDFS-6921. Add LazyPersist flag to FileStatus. (Arpit Agarwal)
new 7f49537 HDFS-6924. Add new RAM_DISK storage type. (Arpit Agarwal)
new 042b33f HDFS-6922. Add LazyPersist flag to INodeFile, save it in FsImage and edit logs. (Arpit Agarwal)
new c2354a7 HDFS-6923. Propagate LazyPersist flag to DNs via DataTransferProtocol. (Arpit Agarwal)
new a317bd7 HDFS-6925. DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received. (Arpit Agarwal)
new eb448e1 HDFS-6926. DN support for saving replicas to persistent storage and evicting in-memory replicas. (Arpit Agarwal)
new 3f64c4a HDFS-6927. Initial unit tests for Lazy Persist files. (Arpit Agarwal)
new 2e98714 HDFS-6929. NN periodically unlinks lazy persist files with missing replicas from namespace. (Arpit Agarwal)
new c4c9a78 HADOOP-11001. Fix test-patch to work with the git repo. (kasha)
new 722cc92 Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
new d1ae479 HADOOP-10880. Move HTTP delegation tokens out of URL querystring to a header. (tucu)
new 88c5e21 Fixing CHANGES.txt, moving HADOOP-8815 to 2.6.0 release
new d9a7404 Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs following merge to branch-2
new bbaa7dc HDFS-6928. 'hdfs put' command should accept lazyPersist flag for testing. (Arpit Agarwal)
new 48aa3b7 Fix typos in log messages. Contributed by Ray Chiang
new ab638e7 HDFS-6865. Byte array native checksumming on client side. Contributed by James Thomas.
new 7119bd4 HADOOP-11005. Fix HTTP content type for ReconfigurationServlet. Contributed by Lei Xu.
new d8774cc HADOOP-11013. CLASSPATH handling should be consolidated, debuggable (aw)
new 6bf16d1 HADOOP-10880. Move HTTP delegation tokens out of URL querystring to a header. (tucu)
new bc6ce2c Fixing CHANGES.txt, moving HADOOP-8815 to 2.6.0 release
new 2ca93d1 Fix up CHANGES.txt for HDFS-6134, HADOOP-10150 and related JIRAs following merge to branch-2
new fef8554 Fix typos in log messages. Contributed by Ray Chiang
new 7e32be8 Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
new 7b3e27a YARN-2406. Move RM recovery related proto to yarn_server_resourcemanager_recovery.proto. Contributed by Tsuyoshi OZAWA
new 9d68445 Add CHANGES.txt for YARN-2406.
new 4cf9afa HDFS-6960. Bugfix in LazyWriter, fix test case and some refactoring. (Arpit Agarwal)
new c92837a HDFS-6931. Move lazily persisted replicas to finalized directory on DN startup. (Arpit Agarwal)
new fa80ca4 YARN-2405. NPE in FairSchedulerAppsBlock. (Tsuyoshi Ozawa via kasha)
new 4ae8178 HDFS-6800. Support Datanode layout changes with rolling upgrade. (Contributed by James Thomas)
new 4bd0194 YARN-2449. Fixed the bug that TimelineAuthenticationFilterInitializer is not automatically added when hadoop.http.filter.initializers is not configured. Contributed by Varun Vasudev.
new 3de6601 YARN-2450. Fix typos in log messages. Contributed by Ray Chiang.
new 156e6a4 HADOOP-10911. hadoop.auth cookie after HADOOP-10710 still not proper according to RFC2109. (gchanan via tucu)
new c686aa3 YARN-2447. RM web service app submission doesn't pass secrets correctly. Contributed by Varun Vasudev
new b1dce2a HADOOP-10814. Update Tomcat version used by HttpFS and KMS to latest 6.x version. (rkanter via tucu)
new 15366d9 MAPREDUCE-5931. Validate SleepJob command line parameters. Contributed by Gera Shegalov
new 7eab2a2 HDFS-6774. Make FsDataset and DataStore support removing volumes. Contributed by Lei Xu.
new b03653f YARN-2462. TestNodeManagerResync#testBlockNewContainerRequestsOnStartAndResync should have a test timeout. Contributed by Eric Payne
new f65183e Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
new c60da4d HADOOP-10994. KeyProviderCryptoExtension should use CryptoCodec for generation/decryption of keys. (tucu)
new ea1c6f3 HADOOP-11021. Configurable replication factor in the hadoop archive command. Contributed by Zhe Zhang.
new 93010fa Add CHANGES.txt for HADOOP-11021.
new 6066b1a HDFS-6972. TestRefreshUserMappings.testRefreshSuperUserGroupsConfiguration doesn't decode url correctly. Contributed by Yongjun Zhang.
new 9ad413b HADOOP-11030. Define a variable jackson.version instead of using constant at multiple places. (Juan Yu via kasha)
new 270a271 YARN-2360. Fair Scheduler: Display dynamic fair share for queues on the scheduler page. (Ashwin Shankar and Wei Yan via kasha)
new 5c14bc4 YARN-1506. Changed RMNode/SchedulerNode to update resource with event notification. Contributed by Junping Du
new 0f34e6f YARN-2395. FairScheduler: Preemption timeout should be configurable per queue. (Wei Yan via kasha)
new 258c7d0 HADOOP-10833. Remove unused cache in UserProvider. (Benoy Antony)
new 217dea7 Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
new 3e2a0b5 HDFS-6969. Archival Storage: INode#getStoragePolicyID should always return the latest storage policy. Contributed by Jing Zhao.
new 17cd0fa MAPREDUCE-6058. native-task: KVTest and LargeKVTest should check mr job is sucessful (Contributed by Binglin Chang)
new 7ade9b0 MAPREDUCE-6056. native-task: move system test working dir to target dir and cleanup test config xml files (Manu Zhang via bchang)
new e1109fb HADOOP-11036. Add build directory to .gitignore (Tsuyoshi OZAWA via aw)
new 01e8f05 HADOOP-11012. hadoop fs -text of zero-length file causes EOFException. Contributed by Eric Payne
new bad5f38 HADOOP-10990. Add missed NFSv3 request and response classes. Contributed by Brandon Li
new 329b659 Merge branch 'trunk' of https://git-wip-us.apache.org/repos/asf/hadoop into trunk
new e06d2e3 HADOOP-11041. VersionInfo specifies subversion (Tsuyoshi OZAWA via aw)
new 59384df HADOOP-10373 create tools/hadoop-amazon for aws/EMR support
new 6595e92 Fix hadoop-common-project/hadoop-common/src/main/native/README to current mail list and URL
new faa4455 HDFS-6634. inotify in HDFS. Contributed by James Thomas.
new a0ccf83 HDFS-6954. With crypto, no native lib systems are too verbose. Contributed by Charles Lamb.
new 0340206 HADOOP-11033. shell scripts ignore JAVA_HOME on OS X. (aw)
new 727331b HDFS-4257. The ReplaceDatanodeOnFailure policies could have a forgiving option. Contributed by szetszwo.
new cce7d1e Merge remote-tracking branch 'origin/trunk' into MR-2841
new 08a9ac7 HDFS-6942. Fix typos in log messages. Contributed by Ray Chiang.
new a6b32a3 Merge trunk into HDFS-6581
new 3425ae5 HDFS-2975. Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart). (Yi Liu via umamahesh)
new ce04621 HADOOP-10956. Fix create-release script to include docs and necessary txt files. (kasha)
new 1dcaba9 YARN-2394. FairScheduler: Configure fairSharePreemptionThreshold per queue. (Wei Yan via kasha)
new 762b04e HDFS-6950. Add Additional unit tests for HDFS-6581. (Contributed by Xiaoyu Yao)
new 08a8f2b Merge trunk into HDFS-6581
new 1081d9c MAPREDUCE-6055. native-task: findbugs, interface annotations, and other misc cleanup
new cb9b485 HDFS-6930. Improve replica eviction from RAM disk. (Arpit Agarwal)
new d9a03e2 HADOOP-10863. KMS should have a blacklist for decrypting EEKs. (asuresh via tucu)
new 45d5b13 Merge changes from trunk
new a18424e MAPREDUCE-6063. Correct spill size calculation for spills wrapping the circular buffer. Contributed by zhihai xu.
new 3a0142b HDFS-6848. Lack of synchronization on access to datanodeUuid in DataStorage#format. (Contributed by Xiaoyu Yao)
new f4caedf HDFS-6959 Make the HDFS home directory location customizable. Contributed by Yongjun Zhang
new 8f1a668 HADOOP-11056. OsSecureRandom.setConf() might leak file descriptors. Contributed by Yongjun Zhang.
new 41f1662 HADOOP-11054. Add a KeyProvider instantiation based on a URI. (tucu)
new 70b2187 HADOOP-11015. Http server/client utils to propagate and recreate Exceptions from server to client. (tucu)
new b69a48c HADOOP-11060. Create a CryptoCodec test that verifies interoperability between the JCE and OpenSSL implementations. (hitliuyi via tucu)
new 91d45f0 YARN-2509. Enable Cross Origin Filter for timeline server only and not all Yarn servers (Mit Desai via jeagles)
new 1a09536 Fixing HDFS CHANGES.txt, missing HDFS-6905 entry
new b44b2ee HADOOP-11063. KMS cannot deploy on Windows, because class names are too long. Contributed by Chris Nauroth.
new 3fa5f72 YARN-2431. NM restart: cgroup is not removed for reacquired containers. Contributed by Jason Lowe
new e08701e HDFS-6961. Archival Storage: BlockPlacementPolicy#chooseTarget should check each valid storage type in each choosing round.
new 51a4faf YARN-2511. Allowed all origins by default when CrossOriginFilter is enabled. Contributed by Jonathan Eagles.
new f7df24b HDFS-6996. SnapshotDiff report can hit IndexOutOfBoundsException when there are nested renamed directory/file. Contributed by Jing Zhao.
new 6104520 HDFS-6886. Use single editlog record for creating file + overwrite. Contributed by Yi Liu.
new 185200e HDFS-6876. Archival Storage: support set/get storage policy in DFSAdmin. Contributed by Jing Zhao.
new 772d1fb HDFS-6714. TestBlocksScheduledCounter#testBlocksScheduledCounter should shutdown cluster (vinayakumarb)
new 0032216 MAPREDUCE-6067. native-task: fix some counter issues (Binglin Chang)
new 45efc96 MAPREDUCE-6071. JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs. Contributed by Tsuyoshi OZAWA
new c6107f5 HDFS-6376. Distcp data between two HA clusters requires another configuration. Contributed by Dave Marion and Haohui Mai.
new 683987b MAPREDUCE-6069. Lint/style fixes and removal of unused code. Contributed by Todd Lipcon.
new 9e941d9 HDFS-6831. Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'. (Contributed by Xiaoyu Yao)
new 4b3f1e2 Merge remote-tracking branch 'apache/trunk' into MR-2841
new fab9bc5 HDFS-6979. hdfs.dll not produce .pdb files. Contributed by Chris Nauroth.
new b051327 HDFS-6979. Fix minor error in CHANGES.txt. Contributed by Chris Nauroth.
new 9609b73 HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao)
new 71269f7 HDFS-6998. warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command. (Contributed by Xiaoyu Yao)
new 7a62515 HADOOP-11052. hadoop_verify_secure_prereq's results aren't checked in bin/hdfs (aw)
new 300cb12 Merge trunk into HDFS-6584
new 54767d3 Fix TestOfflineEditsViewer after merging.
new 0571b45 HADOOP-11065. Rat check should exclude **/build/**. (kasha)
new 2cd5b4f HDFS-6979. hdfs.dll not produce .pdb files. Contributed by Chris Nauroth.
new c828b8a HDFS-6979. Fix minor error in CHANGES.txt. Contributed by Chris Nauroth.
new c5ef9c9 HDFS-6862. Add missing timeout annotations to tests. (Contributed by Xiaoyu Yao)
new fc68337 HDFS-6998. warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command. (Contributed by Xiaoyu Yao)
new a149afd HADOOP-11052. hadoop_verify_secure_prereq's results aren't checked in bin/hdfs (aw)
new ba4fc93 HADOOP-11065. Rat check should exclude **/build/**. (kasha)
new 21c0cde HADOOP-11067 [HDFS-6998]. Fix CHANGES.txt
new e6420fe YARN-2508. Cross Origin configuration parameters prefix are not honored (Mit Desai via jeagles)
new 7c91f9b MAPREDUCE-6074. native-task: Fix release audit warnings
new 52a8b4d MAPREDUCE-6077. native-task: Remove CustomModule examples in nativetask (seanzhong)
new 339d21f Merge trunk into HDFS-6581
new 71c8d73 HADOOP-11070. Create MiniKMS for testing. (tucu)
new 0f3c19c HADOOP-11069. KMSClientProvider should use getAuthenticationMethod() to determine if in proxyuser mode or not. (tucu)
new 3b35f81 HDFS-6986. DistributedFileSystem must get delegation tokens from configured KeyProvider. (zhz via tucu)
new 88209ce HDFS-6940. Refactoring to allow ConsensusNode implementation. Contributed by Konstantin Shvachko.
new 31bbeaf Merge remote-tracking branch 'apache-commit/trunk' into HDFS-6581
new 22a41dc HDFS-6997: add more tests for data migration and replicaion.
new cbea1b1 YARN-2519. Credential Provider related unit tests failed on Windows. Contributed by Xiaoyu Yao.
new d1fa582 HDFS-6898. DN must reserve space for a full block when an RBW block is created. (Contributed by Arpit Agarwal)
new b160707 Merge branch 'trunk' into MR-2841
new a23144f HDFS Credential Provider related Unit Test Failure. Contributed by Xiaoyu Yao.
new eb8284d Merge trunk into HDFS-6581
new a092cdf YARN-2512. Allowed pattern matching for origins in CrossOriginFilter. Contributed by Jonathan Eagles.
new 56dc496 YARN-2507. Documented CrossOriginFilter configurations for the timeline server. Contributed by Jonathan Eagles.
new 0974f43 YARN-2515. Updated ConverterUtils#toContainerId to parse epoch. Contributed by Tsuyoshi OZAWA
new f1432e2 Merge branch 'trunk' into HDFS-6584
new 302d9a0 Credential Provider related Unit Test Failure on Windows. Contributed by Xiaoyu Yao.
new ccdf005 HDFS-6977. Delete all copies when a block is deleted from the block space. (Arpit Agarwal)
new 6e5f780 Merge branch 'trunk' into HDFS-6581
new c1f8323 HDFS-6943. Improve NN allocateBlock log to include replicas' datanode IPs. Contributed by Ming Ma.
new df8c84c HADOOP-11071. KMSClientProvider should drain the local generated EEK cache on key rollover. (tucu)
new 6a84f88 HDFS-7005. DFS input streams do not timeout. Contributed by Daryn Sharp.
new cad14aa HDFS-6036. Forcibly timeout misbehaving DFSClients that try to do no-checksum reads that extend too long. (cmccabe)
new 6c790a7 HDFS-6893. crypto subcommand is not sorted properly in hdfs\'s hadoop_usage (David Luo via aw)
new d989ac0 MAPREDUCE-5972. Fix typo 'programatically' in job.xml (and a few other places) (Akira AJISAKA via aw)
new 2b5c528 HDFS-6875. Archival Storage: support migration for a list of specified paths. Contributed by Jing Zhao.
new 74a7e22 HDFS-7027. Archival Storage: Mover does not terminate when some storage type is out of space. Contributed by Tsz Wo Nicholas Sze.
new a18caf7 HDFS-6991. Notify NN of evicted block before deleting it from RAM disk. (Arpit Agarwal)
new 867f0f1 HDFS-7029. Archival Storage: fix TestDFSInotifyEventInputStream and TestDistributedFileSystem. Contributed by Tsz Wo Nicholas Sze.
new 4ff128a Merge branch 'trunk' into HDFS-6581
new 6997c1c Merge remote-tracking branch 'origin/trunk' into HDFS-6584
new 04915a0 HDFS-6951. Correctly persist raw namespace xattrs to edit log and fsimage. Contributed by Charles Lamb.
new 7498dd7 Update CHANGES.txt for HDFS-6951
new f949f6b HDFS-6981. Fix DN upgrade with layout version change. (Arpit Agarwal)
new 90c8ece HDFS-6981. Fix CHANGES.txt
new 61ccd50 Merge branch 'trunk' into HDFS-6581
new 2749fc6 Newly moved block replica been invalidated and deleted in TestBalancer. Contributed by Binglin Chang.
new be30c86 HDFS-6482. Fix CHANGES.txt in trunk
new 9b81045 Add missing YARN-1471 to the CHANGES.txt
new 3e8f353 HADOOP-10925. Change attribution in CHANGES.txt from trunk to 2.6.0.
new 28d99db YARN-2526. SLS can deadlock when all the threads are taken by AMSimulators. (Wei Yan via kasha)
new 05af0ff Revert HDFS-6940.
new 0d2f6b4 Merge branch 'trunk' into HDFS-6581
new 0de563a HDFS-6482. Fix CHANGES.txt in trunk.
new de20cf2 Merge branch 'trunk' into HDFS-6581
new 4124905 HDFS-7028: FSDirectory should not get storage policy id from symlinks
new 6dae4b4 HADOOP-11057. checknative command to probe for winutils.exe on windows. Contributed by Xiaoyu Yao.
new bbff44c HDFS-6776. Using distcp to copy data between insecure and secure cluster via webdhfs doesn't work. (yzhangal via tucu)
new 9ee891a HADOOP-11077. NPE if hosts not specified in ProxyUsers. (gchanan via tucu)
new b100949 HADOOP-9989. Bug introduced in HADOOP-9374, which parses the -tokenCacheFile as binary file but set it to the configuration as JSON file. (zxu via tucu)
new db41a1b Merge changes from trunk
new 3072c83 YARN-1458. FairScheduler: Zero weight can lead to livelock. (Zhihai Xu via kasha)
new b67d5ba YARN-2448. Changed ApplicationMasterProtocol to expose RM-recognized resource types to the AMs. Contributed by Varun Vasudev.
new 47bdfa0 YARN-2459. RM crashes if App gets rejected for any reason and HA is enabled. Contributed by Jian He
new cbfe263 YARN-2158. Fixed TestRMWebServicesAppsModification#testSingleAppKill test failure. Contributed by Varun Vasudev
new b02a4b4 HADOOP-10758. KMS: add ACLs on per key basis. (tucu)
new 7d38ffc Fix CHANGES.txt. Credit Mayank Bansal for his contributions on YARN-2459
new 7f80e14 MAPREDUCE-6075. HistoryServerFileSystemStateStore can create zero-length files. Contributed by Jason Lowe
new 5ec7fcd HADOOP-11074. Move s3-related FS connector code to hadoop-aws. (David S. Wang via Colin Patrick McCabe)
new 83be3ad YARN-415. Capture aggregate memory allocation at the app-level for chargeback. Contributed by Eric Payne & Andrey Klochkov
new 4be9517 YARN-2440. Enabled Nodemanagers to limit the aggregate cpu usage across all containers to a preconfigured limit. Contributed by Varun Vasudev.
new 70dfe9c Merge branch 'trunk' into HDFS-6584
new 9e28e08 MAPREDUCE-6070. yarn.app.am.resource.mb/cpu-vcores affects uber mode but is not documented. Contributed by Tsuyoshi OZAWA
new bf64fce HDFS-6966. Add additional unit tests for encryption zones. Contributed by Stephen Chu.
new d1dab6c HDFS-6621. Hadoop Balancer prematurely exits iterations. Contributed by Rafal Wodjdyla and Benjamin Bowman.
new 1e68499 HDFS-7045. Fix NameNode deadlock when opening file under /.reserved path. Contributed by Yi Liu.
new a123d02 HADOOP-9540: move CHANGES.txt entry to 2.6
new ac35e34 HADOOP-10373: move CHANGES.txt entry to branch-2.6
new c11ada5 YARN-2534. FairScheduler: Potential integer overflow calculating totalMaxShare. (Zhihai Xu via kasha)
new 80ac6aa HDFS-7042. Upgrade fails for Windows HA cluster due to file locks held during rename in JournalNode. Contributed by Chris Nauroth.
new 581176c HADOOP-11085. Excessive logging by org.apache.hadoop.util.Progress when value is NaN. Contributed by Mit Desai
new 0d85f7e HDFS-7034. Archival Storage: Fix TestBlockPlacement and TestStorageMover. Contributed by Jing Zhao.
new 8de20a1 Merge trunk into HDFS-6584
new c656d7d HADOOP-11083. After refactoring of HTTP proxyuser to common, doAs param is case sensitive. (tucu)
new dc27ee9 HDFS-7039. Archival Storage: fix Balancer tests. Contributed by Tsz Wo Nicholas Sze.
new 6c08339 HADOOP-11074. Add JIRA to CHANGES.txt
new 17ffbe0 Update CHANGES.txt to set the release date for 2.5.1
new 6b8b160 YARN-2033. Merging generic-history into the Timeline Store (Contributed by Zhijie Shen)
new d6ce269 HDFS-7051. TestDataNodeRollingUpgrade#isBlockFileInPrevious assumes Unix file path separator. Contributed by Chris Nauroth.
new 5633da2 YARN-2541. Fixed ResourceManagerRest.apt.vm table syntax error. Contributed by Jian He
new 469ea3d YARN-2538. Added logs when RM sends roll-overed AMRMToken to AM. Contributed by Xuan Gong.
new 78b0483 YARN-2484. FileSystemRMStateStore#readFile/writeFile should close FSData(In|Out)putStream in final block. Contributed by Tsuyoshi OZAWA
new 3122daa YARN-2229. Changed the integer field of ContainerId to be long type. Contributed by Tsuyoshi OZAWA
new 7aeda47 Merge branch 'trunk' into HDFS-6581
new 54e5794 YARN-2547. Cross Origin Filter throws UnsupportedOperationException upon destroy (Mit Desai via jeagles)
new 957414d HADOOP-11088. Unittest TestKeyShell, TestCredShell and TestKMS assume UNIX path separator for JECKS key store path. Contributed by Xiaoyu Yao.
new 40364dc YARN-2525. yarn logs command gives error on trunk (Akira AJISAKA via aw)
new e65ae57 YARN-2456. Possible livelock in CapacityScheduler when RM is recovering apps. Contributed by Jian He
new a0ad975 YARN-2542. Fixed NPE when retrieving ApplicationReport from TimeLineServer. Contributed by Zhijie Shen
new 8a3a327 MAPREDUCE-2841. Merge remote-tracking branch 'apache/MR-2841' into trunk
new 3c91817 Merge MR-2841 changes into main MapReduce CHANGES.txt file
new ebdd5e5 Merge branch 'trunk' into HDFS-6581
new 98588cf YARN-2528. Relaxed http response split vulnerability protection for the origins header and made it accept multiple origins in CrossOriginFilter. Contributed by Jonathan Eagles.
new 9f22fb8 HDFS-6978. Directory scanner should correctly reconcile blocks on RAM disk. (Arpit Agarwal)
new dba52ce Merge branch 'trunk' into HDFS-6584
new 14e2639 YARN-611. Added an API to let apps specify an interval beyond which AM failures should be ignored towards counting max-attempts. Contributed by Xuan Gong.
new fdf0542 Merge branch 'trunk' into HDFS-6581
new fc741b5 HDFS-7061. Add test to verify encryption zone creation after NameNode restart without saving namespace. Contributed by Stephen Chu.
new 24d920b HADOOP-10400. Incorporate new S3A FileSystem implementation. Contributed by Jordan Mendelson and Dave Wang.
new 2689b6c HDFS-7062. Archival Storage: skip under construction block for migration. Contributed by Jing Zhao.
new 43b0303 HDFS-7032. Add WebHDFS support for reading and writing to encryption zones. Contributed by Charles Lamb.
new ece3eca Merge remote-tracking branch 'origin/trunk' into HDFS-6584
new 9d4ec97 YARN-2549. TestContainerLaunch fails due to classpath problem with hamcrest classes. Contributed by Chris Nauroth.
new 88e329f YARN-2529. Generic history service RPC interface doesn't work when service authorization is enabled. Contributed by Zhijie Shen
new 0c8aec4 YARN-2438. yarn-env.sh cleanup (aw)
new 2f847b3 HDFS-7059. HAadmin transtionToActive with forceActive option can show confusing message. Contributed by Rushabh Shah.
new 8008f0e HDFS-6912. SharedFileDescriptorFactory should not allocate sparse files (cmccabe)
new a4dcbaa HDFS-7066. LazyWriter#evictBlocks misses a null check for replicaState. (Contributed by Xiaoyu Yao)
new a7814e1 Merge branch 'trunk' into HDFS-6581
new 0ac760a HADOOP-11091. Eliminate old configuration parameter names from s3a (dsw via cmccabe)
new 932ae03 HADOOP-10868. AuthenticationFilter should support externalizing the secret for signing and provide rotation support. (rkanter via tucu)
new 7e08c0f HADOOP-10868. Addendum
new 0c26412 HDFS-6965. NN continues to issue block locations for DNs with full disks. Contributed by Rushabh Shah.
new 9f6891d YARN-2531. Added a configuration for admins to be able to override app-configs and enforce/not-enforce strict control of per-container cpu usage. Contributed by Varun Vasudev.
new 8e5d671 YARN-2557. Add a parameter "attempt_Failures_Validity_Interval" into DistributedShell. Contributed by Xuan Gong
new 56119fe HDFS-6880. Adding tracing to DataNode data transfer protocol (iwasakims via cmccabe)
new ffdb7eb HADOOP-11055. non-daemon pid files are missing (aw)
new e0d7fb4 Merge branch 'trunk' into HDFS-6581
new 3e85f5b HDFS-7006. Test encryption zones with KMS. (Anthony Young-Garner and tucu)
new 4603e44 HDFS-7064. Fix unit test failures in HDFS-6581 branch. (Contributed by Xiaoyu Yao)
new 7971c97 HADOOP-11022. User replaced functions get lost 2-3 levels deep (e.g., sbin) (aw)
new 02adf71 HDFS-6799. The invalidate method in SimulatedFSDataset failed to remove (invalidate) blocks from the file system. Contributed by Megasthenis Asteris.
new 33ce887 HDFS-6851. Refactor EncryptionZoneWithId and EncryptionZone. (clamb via wang)
new a044407 HDFS-6789. TestDFSClientFailover.testFileContextDoesntDnsResolveLogicalURI and TestDFSClientFailover.testDoesntDnsResolveLogicalURI failing on jdk7. Contributed by Akira Ajisaka.
new b6d3230 HADOOP-10922. User documentation for CredentialShell. Contributed by Larry McCay.
new 2e4033e HDFS-7052. Archival Storage: Add Mover into hdfs script. Contributed by Jing Zhao.
new 432b863 Merge changes from trunk
new a24a933 Merge branch 'trunk' into HDFS-6581
new dcbc467 HDFS-7079. Few more unit test fixes for HDFS-6581. (Arpit Agarwal)
new 90a0c03 YARN-1250. Generic history service should support application-acls. (Contributed by Zhijie Shen)
new 0e7d1db YARN-1250. Addendum
new bd2e409 HDFS-7072. Fix TestBlockManager and TestStorageMover. Contributed by Jing Zhao
new aaa7e21 Merge branch 'trunk' into HDFS-6584
new 91f6dde Fix hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt .
new e14e71d HADOOP-11096. KMS: KeyAuthorizationKeyProvider should verify the keyversion belongs to the keyname on decrypt. (tucu)
new 8cf1052 HADOOP-11097. kms docs say proxyusers, not proxyuser for config params. (clamb via tucu)
new c0c7e6f HADOOP-11062. CryptoCodec testcases requiring OpenSSL should be run only if -Pnative is used. (asuresh via tucu)
new b014e83 HDFS-6864. Archival Storage: add user documentation. Contributed by Tsz Wo Nicholas Sze.
new e4ddb6d HADOOP-11099. KMS return HTTP UNAUTHORIZED 401 on ACL failure. (tucu)
new 0a495be HADOOP-11016. KMS should support signing cookies with zookeeper secret manager. (tucu)
new d9a8603 HADOOP-10982
new 3f8f860 Revert "HADOOP-10982"
new 8a7671d Revert "HADOOP-11016. KMS should support signing cookies with zookeeper secret manager. (tucu)"
new ea4e2e8 HDFS-6705. Create an XAttr that disallows the HDFS admin from accessing a file. (clamb via wang)
new 24f8156 Merge branch 'trunk' into HDFS-6581
new e3803d0 HDFS-6843. Create FileStatus isEncrypted() method (clamb via cmccabe)
new 911979c Merge changes from trunk
new f24ac42 HDFS-6843. Add to CHANGES.txt
new f230248 HDFS-7075. hadoop-fuse-dfs fails because it cannot find JavaKeyStoreProvider$Factory. (cmccabe)
new a186d51 Merge branch 'trunk' into HDFS-6581
new f488611 YARN-2558. Updated ContainerTokenIdentifier#read/write to use ContainerId#getContainerId. Contributed by Tsuyoshi OZAWA.
new 900f6e5 Merge branch 'trunk' into HDFS-6581
new 4eab083 HDFS-7080. Fix finalize and upgrade unit test failures. (Arpit Agarwal)
new 123f20d HADOOP-11016. KMS should support signing cookies with zookeeper secret manager. (tucu)
new 47e5e19 HADOOP-11040. Return value of read(ByteBuffer buf) in CryptoInputStream is incorrect in some cases. (Yi Liu via wang)
new bf38793 Move some HDFS JIRAs to the correct CHANGES.txt
new 10e8602 HDFS-7004. Update KeyProvider instantiation to create by URI. (wang)
new 0ecefe6 HDFS-7078. Fix listEZs to work correctly with snapshots. (wang)
new ee21b13 YARN-2559. Fixed NPE in SystemMetricsPublisher when retrieving FinalApplicationStatus. Contributed by Zhijie Shen
new 2d2b000 Merge branch 'trunk' into HDFS-6584
new a3d9934 YARN-1779. Fixed AMRMClient to handle AMRMTokens correctly across ResourceManager work-preserving-restart or failover. Contributed by Jian He.
new 76ccb80 HDFS-7088. Archival Storage: fix TestBalancer and TestBalancerWithMultipleNameNodes. Contributed by Tsz Wo Nicholas Sze.
new 485c96e YARN-2001. Added a time threshold for RM to wait before starting container allocations after restart/failover. Contributed by Jian He.
new 849ccfa Merge branch 'trunk' into HDFS-6581
new 5e4627d HDFS-7084. FsDatasetImpl#copyBlockFiles debug log can be improved. (Contributed by Xiaoyu Yao)
new 570b8b4 HDFS-7047. Expose FileStatus#isEncrypted in libhdfs (cmccabe)
new 0b10e5a Merge branch 'trunk' into HDFS-6581
new 9ea7b6c YARN-2363. Submitted applications occasionally lack a tracking URL. Contributed by Jason Lowe
new 474f116 HADOOP-11084 jenkins patchprocess links are broken
new 1cf3198 MAPREDUCE-6090. mapred hsadmin getGroups fails to connect in some cases. Contributed by Robert Kanter
new a337f0e YARN-2561. MR job client cannot reconnect to AM after NM restart. Contributed by Junping Du
new eb92cc6 YARN-2563. Fixed YarnClient to call getTimeLineDelegationToken only if the Token is not present. Contributed by Zhijie Shen
new fe2f54d HADOOP-11106. Document considerations of HAR and Encryption. (clamb via wang)
new 70be56d HDFS-7003. Add NFS Gateway support for reading and writing to encryption zones. (clamb via wang)
new 2c3da25 MAPREDUCE-5891. Improved shuffle error handling across NM restarts. Contributed by Junping Du
new 1942364 HADOOP-11105. MetricsSystemImpl could leak memory in registered callbacks. Contributed by Chuan Liu.
new 1b4b460 HADOOP-11105. Update CHANGES.txt.
new 52945a3 MAPREDUCE-6086. mapreduce.job.credentials.binary should allow all URIs. (Zhihai Xu via kasha)
new 22295b4 Merge branch 'trunk' into HDFS-6581
new fad4cd8 KMS: Support for multiple Kerberos principals. (tucu)
new 98f7bfe Merge branch 'HDFS-6584' into trunk
new fd3cddf Fix hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt for HDFS-6584 after merge.
new 5d01a68 Revise the HDFS-6584 entry CHANGES.txt.
new fe38d2e HDFS-6727. Refresh data volumes on DataNode based on configuration changes (Lei Xu via Colin Patrick McCabe)
new 20a076b HDFS-6970. Move startFile EDEK retries to the DFSClient. (wang)
new 8e73084 HDFS-6840. Clients are always sent to the same datanode when read is off rack. (wang)
new 6434572 HADOOP-11109. Site build is broken. Contributed by Jian He.
new e79c98c HDFS-7091. Add forwarding constructor for INodeFile for existing callers. (Arpit Agarwal)
new 6fe5c6b YARN-2568. Fixed the potential test failures due to race conditions when RM work-preserving recovery is enabled. Contributed by Jian He.
new f8bbf80 Merge branch 'trunk' into HDFS-6581
new e4d29fd Merge branch 'trunk' into HDFS-6581
new f02d934 HDFS-6948. DN rejects blocks if it has older UC block. Contributed by Eric Payne.
new bf27b9c HDFS-7065. Pipeline close recovery race can cause block corruption. Contributed by Kihwal Lee.
new 25fd69a HDFS-7096. Fix TestRpcProgramNfs3 to use DFS_ENCRYPTION_KEY_PROVIDER_URI (clamb via cmccabe)
new 222bf0f Merge branch 'trunk' into HDFS-6581
new 444acf8 YARN-2565. Fixed RM to not use FileSystemApplicationHistoryStore unless explicitly set. Contributed by Zhijie Shen
new 9f03a7c HADOOP-10946. Fix a bunch of typos in log messages (Ray Chiang via aw)
new 951847b MAPREDUCE-6091. YARNRunner.getJobStatus() fails with ApplicationNotFoundException if the job rolled off the RM view. Contributed by Sangjin Lee
new aa1052c YARN-2460. Remove obsolete entries from yarn-default.xml (Ray Chiang via aw)
new adf0b67 HADOOP-10970. Cleanup KMS configuration keys. (wang)
new 9e35571 HDFS-7046. HA NN can NPE upon transition to active. Contributed by Kihwal Lee.
new b6ceef9 HADOOP-11112. TestKMSWithZK does not use KEY_PROVIDER_URI. (tucu via wang)
new 332e2e2 HDFS-7105. Fix TestJournalNode#testFailToStartWithBadConfig to match log output change. Contributed by Ray Chiang.
new f85cc14 HDFS-7073. Allow falling back to a non-SASL connection on DataTransferProtocol in several edge cases. Contributed by Chris Nauroth.
new db890ee HADOOP-11017. KMS delegation token secret manager should be able to use zookeeper as store. (asuresh via tucu)
new 09dab88 Merge branch 'trunk' into HDFS-6581
new b2d5ed3 HDFS-7100. Make eviction scheme pluggable. (Arpit Agarwal)
new 84a0a62 HDFS-7095. Archival Storage: TestStorageMover often fails in Jenkins. Contributed by Jing Zhao.
new 50b3210 HDFS-7108. Fix unit test failures in SimulatedFsDataset. (Arpit Agarwal)
new e257b6d Merge branch 'trunk' into HDFS-6581
new 486a76a HDFS-7071. Updated editsStored and editsStored.xml to bump layout version and add LazyPersist flag. (Contributed by Xiaoyu Yao and Arpit Agarwal)
new 8c9860f HDFS-7071. Undo accidental commit of binary file editsStored.
new 47491f9 HDFS-7107. Avoid Findbugs warning for synchronization on AbstractNNFailoverProxyProvider#fallbackToSimpleAuth. Contributed by Chris Nauroth.
new 0795fe3 HDFS-7109. TestDataStorage does not release file locks between tests. Contributed by Chris Nauroth.
new b6fd5cc HDFS-7110. Skip tests related to short-circuit read on platforms that do not currently implement short-circuit read. Contributed by Chris Nauroth.
new c50fc92 YARN-2452. TestRMApplicationHistoryWriter fails with FairScheduler. (Zhihai Xu via kasha)
new 1737950 HDFS-6987. Move CipherSuite xattr information up to the encryption zone root. Contributed by Zhe Zhang.
new eab15af HADOOP-10131. NetWorkTopology#countNumOfAvailableNodes() is returning wrong value if excluded nodes passed are not part of the cluster tree (Contributed by Vinayakumar B)
new 9721e2c YARN-2453. TestProportionalCapacityPreemptionPolicy fails with FairScheduler. (Zhihai Xu via kasha)
new 7039b98 MAPREDUCE-6095. Enable DistributedCache for uber-mode Jobs. Contributed by Gera Shegalov
new 26cba7f HDFS-7115. TestEncryptionZones assumes Unix path separator for KMS key store path. Contributed by Xiaoyu Yao.
new 376233c MAPREDUCE-5279. Made MR headroom calculation honor cpu dimension when YARN scheduler resource type is memory plus cpu. Contributed by Peng Zhang and Varun Vasudev.
new 0a64149 YARN-1372. Ensure all completed containers are reported to the AMs across RM restart. Contributed by Anubhav Dhoot
new 912ad32 HDFS-7106. Reconfiguring DataNode volumes does not release the lock files in removed volumes. (cnauroth via cmccabe)
new 23e17ce YARN-2540. FairScheduler: Queue filters not working on scheduler page in RM UI. (Ashwin Shankar via kasha)
new 43efdd3 YARN-2539. FairScheduler: Set the default value for maxAMShare to 0.5. (Wei Yan via kasha)
new 7b8df93 HDFS-7001. Tests in TestTracing should not depend on the order of execution. (iwasakims via cmccabe)
new 889122b Merge branch 'trunk' into HDFS-6581
new 8b139b0 HDFS-6990. Add unit test for evict/delete RAM_DISK block with open handle. (Contributed by Xiaoyu Yao)
new a9a55db YARN-2584. TestContainerManagerSecurity fails on trunk. (Contributed by Jian He)
new 568d3dc YARN-1959. Fix headroom calculation in FairScheduler. (Anubhav Dhoot via kasha)
new f557820 YARN-2252. Intermittent failure of TestFairScheduler.testContinuousScheduling. (Ratandeep Ratti and kasha via kasha)
new df52fec HADOOP-11111 MiniKDC to use locale EN_US for case conversions
new 7aa667e HADOOP-11111 MiniKDC to use locale EN_US for case conversions: hadoop-common/CHANGES.TXT
new a1fd804 HDFS-7126. TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path. Contributed by Xiaoyu Yao.
new 5338ac4 YARN-2569. Added the log handling APIs for the long running services. Contributed by Xuan Gong.
new 3dc28e2 HADOOP-11092. hadoop shell commands should print usage if not given a class (aw)
new f48686a HDFS-7132. hdfs namenode -metadataVersion command does not honor configured name dirs. Contributed by Charles Lamb.
new b93d960 HDFS-7130. TestDataTransferKeepalive fails intermittently on Windows. Contributed by Chris Nauroth.
new bfc7b7e Merge branch 'trunk' into HDFS-6581
new ef784a2 HADOOP-11017. Addendum to fix RM HA. KMS delegation token secret manager should be able to use zookeeper as store. (Arun Suresh via kasha)
new cb74f39 HDFS-6534. Fix build on macosx: HDFS parts (Binglin Chang via aw)
new 034df0e YARN-2161. Fix build on macosx: YARN parts (Binglin Chang via aw)
new 7af4c38 MAPREDUCE-6104. TestJobHistoryParsing.testPartialJob fails in branch-2. Contributed by Mit Desai
new 073bbd8 HDFS-7081. Add new DistributedFileSystem API for getting all the existing storage policies. Contributed by Jing Zhao.
new d78b452 YARN-2102. Added the concept of a Timeline Domain to handle read/write ACLs on Timeline service event data. Contributed by Zhijie Shen.
new 9fa5a89 Move HDFS-6987 from trunk to branch-2 in CHANGES.txt
new 39c8734 YARN-2596. TestWorkPreservingRMRestart fails with FairScheduler. (kasha)
new cbf0ae7 HADOOP-11064. UnsatisifedLinkError with hadoop 2.4 JARs on hadoop-2.6 due to NativeCRC32 method changes. Contributed by Chris Nauroth.
new 3cde37c HADOOP-11009. Add Timestamp Preservation to DistCp (Gary Steelman via aw)
new 63198bf HDFS-7139. Unit test for creating encryption zone on root path. (Zhe Zhang via wang)
new 116f831 Add branch-2 only commit HDFS-7138 to CHANGES.txt
new c86674a YARN-2581. Passed LogAggregationContext to NM via ContainerTokenIdentifier. Contributed by Xuan Gong.
new 72b0881 YARN-2546. Made REST API for application creation/submission use numeric and boolean types instead of the string of them. Contributed by Varun Vasudev.
new 428a766 HDFS-7140. Add a tool to list all the existing block storage policies. Contributed by Jing Zhao.
new b1000fb Merge branch 'trunk' into HDFS-6581
new feda473 HDFS-7143. Fix findbugs warnings in HDFS-6581 branch. (Contributed by Tsz Wo Nicholas Sze)
new e8e7fbe HDFS-6932. Balancer and Mover tools should ignore replicas on RAM_DISK. (Contributed by Xiaoyu Yao)
new dff95f7 HADOOP-11101. How about inputstream close statement from catch block to finally block in FileContext#copy() ( Contributed by skrho )
new 6c3cebd MAPREDUCE-6078. native-task: fix gtest build on macosx (Binglin Chang)
new e0b1dc5 HDFS-7118. Improve diagnostics on storage directory rename operations by using NativeIO#renameTo in Storage#rename. Contributed by Chris Nauroth.
new e9edafc Merge branch 'trunk' into HDFS-6581
new 364e60b HDFS-7144. Fix findbugs warnings in RamDiskReplicaTracker. (Contributed by Tsz Wo Nicholas Sze)
new dc2ebf8 HDFS-7111. TestSafeMode assumes Unix line endings in safe mode tip. Contributed by Chris Nauroth.
new b607c3c HDFS-7127. TestLeaseRecovery leaks MiniDFSCluster instances. Contributed by Chris Nauroth.
new f614cb7 MAPREDUCE-6109. Fix minor typo in distcp -p usage text (Charles Lamb via aw)
new 6c54308 MAPREDUCE-6093. minor distcp doc edits (Charles Lamb via aw)
new 5a5a7da Merge branch 'trunk' into HDFS-6581
new 1861b32 HDFS-6808. Add command line option to ask DataNode reload configuration. (Lei Xu via Colin McCabe)
new 9f9a222 HDFS-7119. Split error checks in AtomicFileOutputStream#close into separate conditions to improve diagnostics. Contributed by Chris Nauroth.
new 8269bfa YARN-2523. ResourceManager UI showing negative value for "Decommissioned Nodes" field. Contributed by Rohith
new e9c37de HDFS-7131. During HA upgrade, JournalNode should create a new committedTxnId file in the current directory. Contributed by Jing Zhao.
new f435724 YARN-2608. FairScheduler: Potential deadlocks in loading alloc files and clock access. (Wei Yan via kasha)
new e96ce6f HDFS-7077. Separate CipherSuite from crypto protocol version. (wang)
new 032e0eb Merge branch 'trunk' into HDFS-6581
new 2639779 Fix test build break after merging from trunk
new 840825d Add HDFS-7148 to CHANGES.txt, branch-2 only commit.
new 4ea77ef HADOOP-11140. hadoop-aws only need test-scoped dependency on hadoop-common's tests jar. Contributed by Juan Yu.
new 662fc11 MAPREDUCE-5831. Make MR client ignore unknown counters received from AM. Contributed by Junping Du.
new a6049aa CHANGES.txt: move HDFS-6584 and its subtasks to Release 2.6.0.
new 55302cc HDFS-6956. Allow dynamically changing the tracing level in Hadoop servers (cmccabe)
new ac70c27 YARN-2577. Clarify ACL delimiter and how to configure ACL groups only (Mikos Christine via aw)
new 7060502 Merge branch 'trunk' into HDFS-6581
new df5fed5 HADOOP-8808. Update FsShell documentation to mention deprecation of some of the commands, and mention alternatives (Akira AJISAKA via aw)
new 1147b9a MAPREDUCE-6073. Description of mapreduce.job.speculative.slowtaskthreshold in mapred-default should be moved into description tags (Tsuyoshi OZAWA via aw)
new 83264cf HADOOP-10954. Adding site documents of hadoop-tools (Masatake Iwasaki via aw)
new 3a1f981 HDFS-6664. HDFS permissions guide documentation states incorrect default group mapping class. (Ray Chiang via aw)
new 32870db YARN-2372. There are Chinese Characters in the FairScheduler's document (Fengdong Yu via aw)
new f154ebe HADOOP-11048. user/custom LogManager fails to load if the client classloader is enabled. Contributed by Sangjin Lee
new b40f433 MAPREDUCE-5796. Use current version of the archive name in DistributedCacheDeploy document (Akira AJISAKA via aw)
new c7c8e38 MAPREDUCE-5945. Update the description of GenericOptionsParser -jt option (Akira AJISAKA via aw)
new aa5d925 HADOOP-10731. Remove @date JavaDoc comment in ProgramDriver class (Henry Saputra via aw)
new 6b7673e HADOOP-10552. Fix usage and example at FileSystemShell.apt.vm (Kenji Kikushima via aw)
new a2d4eda HDFS-7155. Bugfix in createLocatedFileStatus caused by bad merge. (Arpit Agarwal)
new d963966 Merge branch 'trunk' into HDFS-6581
new 5391919 YARN-668. Changed NMTokenIdentifier/AMRMTokenIdentifier/ContainerTokenIdentifier to use protobuf object as the payload. Contributed by Junping Du.
new 5f16c98 MAPREDUCE-6087. Fixed wrong config name of MRJobConfig#MR_CLIENT_TO_AM_IPC_MAX_RETRIES_ON_TIMEOUTS. Contributed by Akira AJISAKA
new 7f300bc HADOOP-11143 NetUtils.wrapException loses inner stack trace on BindException
new 9cbb2c5 Merge branch 'trunk' into HDFS-6581
new 400e1bb HDFS-7156. Update fsck documentation. Contributed by Masahiro Yamaguch.
new b38e52b HDFS-7093. Add config key to restrict setStoragePolicy. (Arpit Agarwal)
new 9a53c36 Merge branch 'trunk' into HDFS-6581
new 9c22065 YARN-1769. CapacityScheduler: Improve reservations. Contributed by Thomas Graves
new cf4631d HADOOP-11049. javax package system class default is too broad. Contributed by Sangjin Lee
new 4666440 MAPREDUCE-6072. Remove INSTALL document (Akira AJISAKA via aw)
new 9829f9f HDFS-6519. Document oiv_legacy command (Akira AJISAKA via aw)
new 84b9c63 HDFS-4227. Document dfs.namenode.resource.* (Daisuke Kobayashi via aw)
new 371ef4c Move HDFS-4165 from trunk to 2.6.0 in CHANGES.txt.
new 23fbfe3 MAPREDUCE-6094. TestMRCJCFileInputFormat.testAddInputPath() fails on trunk. Contributed by Akira AJISAKA
new 9e985e6 HADOOP-11084. Jenkins patchprocess links are broken. (Arpit Agarwal)
new b3d5d26 HDFS-7157. Using Time.now() for recording start/end time of reconfiguration tasks (Lei Xu via Colin Patrick McCabe)
new d45e7c7 HDFS-7153. Add storagePolicy to NN edit log during file creation. (Arpit Agarwal)
new f0293f1 HDFS-7104. Fix and clarify INodeInPath getter functions. Contributed by Zhe Zhang.
new a78953c HADOOP-11110. JavaKeystoreProvider should not report a key as created if it was not flushed to the backing file. (Arun Suresh via wang)
new a45b331 Move HDFS-7157 to HDFS CHANGES.txt
new 1e6b4b9 Merge branch 'trunk' into HDFS-6581
new 7f0efe9 HDFS-7124. Remove EncryptionZoneManager.NULL_EZ. (clamb via wang)
new e10eeaa YARN-2606. Application History Server tries to access hdfs before doing secure login (Mit Desai via jeagles)
new c6c3247 HDFS-7122. Use of ThreadLocal<Random> results in poor block placement. (wang)
new 64aef18 HADOOP-11153. Make number of KMS threads configurable. (wang)
new c88c6c5 HADOOP-11130. NFS updateMaps OS check is reversed. Contributed by Brandon Li
new 7f0422b Merge branch 'trunk' into HDFS-6581
new 0577eb3 HDFS-6779. Add missing version subcommand for hdfs. Contributed by Sasaki Toru.
new 368e242 Merge branch 'trunk' into HDFS-6581
new bb84f1f HDFS-7159. Use block storage policy to set lazy persist preference. (Arpit Agarwal)
new 5e8b697 HDFS-7129. Metrics to track usage of memory for writes. (Contributed by Xiaoyu Yao)
new 8dc4e94 HADOOP-11154. Update BUILDING.txt to state that CMake 3.0 or newer is required on Mac. Contributed by Chris Nauroth.
new b915869 HADOOP-11145. TestFairCallQueue fails. Contributed by Akira AJISAKA.
new ea32a66 Preparing to branch hadoop-2.6
new cdf1af0 HDFS-7167. NPE while running Mover if the given path is for a file. Contributed by Jing Zhao.
new f7743dd YARN-2610. Hamlet should close table tags. (Ray Chiang via kasha)
new 9582a50 YARN-2627. Added the info logs of attemptFailuresValidityInterval and number of previous failed attempts. Contributed by Xuan Gong.
new feaf139 YARN-2387. Resource Manager crashes with NPE due to lack of synchronization. Contributed by Mit Desai
new 14d60da YARN-2594. Potential deadlock in RM when querying ApplicationResourceUsageReport. (Wangda Tan via kasha)
new d7075ad HADOOP-11156. DelegateToFileSystem should implement getFsStatus(final Path f). Contributed by Zhihai Xu.
new bbff96b YARN-2602. Fixed possible NPE in ApplicationHistoryManagerOnTimelineStore. Contributed by Zhijie Shen
new a4c9b80 HADOOP-11113. Namenode not able to reconnect to KMS after KMS restart. (Arun Suresh via wang)
new a469833 HADOOP-11117 UGI HadoopLoginModule doesn't catch & wrap all kerberos-related exceptions (stevel)
new dde2ed1 Merge branch 'trunk' into HDFS-6581
new 9e9e9cf HDFS-7153. Add storagePolicy to NN edit log during file creation. (Arpit Agarwal)
new 65ef35b Merge branch 'trunk' into HDFS-6581
new a45ad33 HDFS-7171. Fix Jenkins failures in HDFS-6581 branch. (Arpit Agarwal)
new 17d1202 YARN-2179. [YARN-1492] Initial cache manager structure and context. (Chris Trezzo via kasha)
new 3f25d91 HDFS-6754. TestNamenodeCapacityReport.testXceiverCount may sometimes fail due to lack of retry. Contributed by Mit Desai.
new e431d05 Merge branch 'trunk' into HDFS-6581
new 04b0843 HDFS-6581. Update CHANGES.txt in preparation for trunk merge
new 5ca97f1 YARN-1063. Augmented Hadoop common winutils to have the ability to create containers as domain users. Contributed by Remus Rusanu. Committed as a YARN patch even though all the code changes are in common.
new ba7f31c YARN-1972. Added a secure container-executor for Windows. Contributed by Remus Rusanu.
new 737f280 HDFS-7172. Test data files may be checked out of git with incorrect line endings, causing test failures in TestHDFSCLI. Contributed by Chris Nauroth.
new 1f5b42a HDFS-7158. Reduce the memory usage of WebImageViewer. Contributed by Haohui Mai.
new 875aa79 HDFS-6894. Add XDR parser method for each NFS response. Contributed by Brandon Li.
new dd1b8f2 HDFS-7176. The namenode usage message doesn't include "-rollingupgrade started" (cmccabe)
new 52bbe0f YARN-2630. Prevented previous AM container status from being acquired by the current restarted AM. Contributed by Jian He.
new 8dfe54f Addendum patch for HDFS-7172. Contributed by Chris Nauroth.
new 0708827 YARN-2613. Support retry in NMClient for rolling-upgrades. (Contributed by Jian He)
new 9e40de6 YARN-2446. Augmented Timeline service APIs to start taking in domains as a parameter while posting entities and events. Contributed by Zhijie Shen.
new c7cee9b YARN-1979. TestDirectoryCollection fails when the umask is unusual. (Contributed by Vinod Kumar Vavilapalli and Tsuyoshi OZAWA)
new c2fa5d1 HDFS-7178. Additional unit test for replica write with full disk. (Arpit Agarwal)
new 3ef1cf1 YARN-2617. Fixed NM to not send duplicate container status whose app is not running. Contributed by Jun Gong
new 5e0b49d YARN-2254. TestRMWebServicesAppsModification should run against both CS and FS. (Zhihai Xu via kasha)
new 29f5200 YARN-2624. Resource Localization fails on a cluster due to existing cache directories. Contributed by Anubhav Dhoot
new 03db9cc8 HDFS-7162. Wrong path when deleting through fuse-dfs a file which already exists in trash (cmccabe)
new a56f3ec HDFS-7162. Fix CHANGES.txt (should have Chenging Liu's name)
new d2d5a0e HDFS-7179. DFSClient should instantiate a KeyProvider, not a KeyProviderCryptoExtension. (wang)
new 6ac1051 HDFS-7181. Remove incorrect precondition check on key length in FileEncryptionInfo. (wang)
new f679ca3 HADOOP-11160. Fix typo in nfs3 server duplicate entry reporting. Contributed by Charles Lamb.
new 1c93025 YARN-2527. Fixed the potential NPE in ApplicationACLsManager and added test cases for it. Contributed by Benoy Antony.
new 054f285 YARN-2628. Capacity scheduler with DominantResourceCalculator carries out reservation even though slots are free. Contributed by Varun Vasudev
new 2d8e6e2 HADOOP-11151. Automatically refresh auth token and retry on auth failure. Contributed by Arun Suresh.
new eb6ce5e YARN-2562. Changed ContainerId#toString() to be more readable. Contributed by Tsuyoshi OZAWA
new 80d11eb YARN-2635. TestRM, TestRMRestart, TestClientToAMTokens should run with both CS and FS. (Wei Yan and kasha via kasha)
new 34cdcaa YARN-2468. Enhanced NodeManager to support log handling APIs (YARN-2569) for use by long running services. Contributed by Xuan Gong.
new 7f6ed7f HDFS-7055. Add tracing to DFSInputStream (cmccabe)
new eb3e40b YARN-1707. Introduce APIs to add/remove/resize queues in the CapacityScheduler. Contributed by Carlo Curino and Subru Krishnan (cherry picked from commit aac47fda7fecda9fc18ade34d633eca895865a70)
new 1c69503 YARN-2475. Logic for responding to capacity drops for the ReservationSystem. Contributed by Carlo Curino and Subru Krishnan. (cherry picked from commit f83a07f266f2c5e6eead554d8a331ed7e75e10d5)
new c9266df YARN-1708. Public YARN APIs for creating/updating/deleting reservations. (cherry picked from commit 3f2e3b275bcf29264a112c5d2f4eae289fe7f52c)
new cf4b342 YARN-1709. In-memory data structures used to track resources over time to enable reservations. (cherry picked from commit 0d8b2cd88b958b1e602fd4ea4078ef8d4742a7c3)
new f66ffcf YARN-1710. Logic to find allocations within a Plan that satisfy user ReservationRequest(s). Contributed by Carlo Curino and Subru Krishnan. (cherry picked from commit aef7928899b37262773f3dc117157bb746bf8918)
new b6df0dd YARN-1711. Policy to enforce instantaneous and over-time quotas on user reservation. Contributed by Carlo Curino and Subru Krishnan. (cherry picked from commit c4918cb4cb5a267a8cfd6eace28fcfe7ad6174e8)
new 3418c56 YARN-1712. Plan follower that synchronizes the current state of reservation subsystem with the scheduler. Contributed by Subru Krishnan and Carlo Curino. (cherry picked from commit 169085319b8b76641f8b9f6840a3fef06d221e2b)
new 6261f7c YARN-2080. Integrating reservation system with ResourceManager and client-RM protocol. Contributed by Subru Krishnan and Carlo Curino. (cherry picked from commit 8baeaead8532898163f1006276b731a237b1a559)
new 3f28276 MAPREDUCE-6103.Adding reservation APIs to MR resource manager delegate. Contributed by Subru Krishnan and Carlo Curino. (cherry picked from commit aa92dd45f2d8c89a8a17ad2e4449aa3ff08bc53a)
new 5e10a13 YARN-2576. Making test patch pass in branch. Contributed by Subru Krishnan and Carlo Curino. (cherry picked from commit 90ac0be86b898aefec5471db4027554c8e1b310c)
new a298623 YARN-2611. Fixing jenkins findbugs warning and TestRMWebServicesCapacitySched for branch YARN-1051. Contributed by Subru Krishnan and Carlo Curino. (cherry picked from commit c47464aba407d1dafe10be23fe454f0489cc4367)
new c8212ba YARN-1051. Add a system for creating reservations of cluster capacity. Contributed by Subru Krishnan and Carlo Curino.
new 69c9af9 HADOOP-11163. MetricsSystemImpl may miss a registered source. Contributed by Chuan Liu.
new bbb3b1a HADOOP-11163. Correct CHANGES.txt.
new 8f9ab99 HADOOP-10681. Remove unnecessary synchronization from Snappy & Zlib codecs. Contributed by Gopal Vijayaraghavan.
new 16333b4 HADOOP-10731. Sync-ing CHANGES.txt across branches.
new ed841dd HDFS-6995. Block should be placed in the client's 'rack-local' node if 'client-local' node is not available (vinayakumarb)
new 8380ca3 Move YARN-1051 to 2.6
new ea26cc0 YARN-2615. Changed ClientToAMTokenIdentifier/RM(Timeline)DelegationTokenIdentifier to use protobuf as payload. Contributed by Junping Du
new 3affad9 HDFS-7169. Add SE_BAD_FIELD to findbugsExcludeFile.xml.
new 8099de2 HADOOP-10404. Some accesses to DomainSocketWatcher#closed are not protected by the lock (cmccabe)
new 687d83c HADOOP-10404. Commit correct version of patch (cmccabe)
new 8dc6abf HDFS-7194 Fix findbugs "inefficient new String constructor" warning in DFSClient#PATH (yzhang via cmccabe)
new 519e5a7 YARN-2644. Fixed CapacityScheduler to return up-to-date headroom when AM allocates. Contributed by Craig Welch
new 0fb2735 HADOOP-11168. Remove duplicated entry dfs.webhdfs.enabled in the user doc. Contributed by Yi Liu.
new 2e789eb MAPREDUCE-6029. TestCommitterEventHandler fails in trunk. Contributed by Mit Desai
new 9196db9 HDFS-7186. Document the "hadoop trace" command. (Masatake Iwasaki via Colin P. McCabe)
new 30d56fd YARN-1857. CapacityScheduler headroom doesn't account for other AM's running. Contributed by Chen He and Craig Welch
new 99d7a45 HADOOP-11007. Reinstate building of ant tasks support. Contributed by Jason Lowe.
new c8617ff Missing files from the previous commit of HADOOP-11007
new b2f6197 HADOOP-11169. Fix DelegationTokenAuthenticatedURL to pass the connection Configurator to the authenticator. (Arun Suresh via wang)
new 4b28348 HADOOP-11172. Improve error message in Shell#runCommand on OutOfMemoryError. (Yongjun Zhang via wang)
new 0263656 Fixup for CHANGES.txt
new 9b8a35a HDFS-7128. Decommission slows way down when it gets towards the end. Contributed by Ming Ma.
new 60f0f6f HADOOP-11166. Remove ulimit from test-patch.sh.
new 1efd9c9 HDFS-7112. LazyWriter should use either async IO or one thread per physical disk. Contributed by Xiaoyu Yao.
new e16e25a YARN-2649. Fixed TestAMRMRPCNodeUpdates test failure. Contributed by Ming Ma
new 6a32671 YARN-913 service registry: YARN-2652 add hadoop-yarn-registry package under hadoop-yarn
new 853cb70 HDFS-7203. Concurrent appending to the same file can cause data corruption. Contributed by Kihwal Lee.
new 7b29f99 CHANGES.txt: move HADOOP-10404 underneath branch 2.6
new 2217e2f HADOOP-10809. hadoop-azure: page blob support. Contributed by Dexter Bradshaw, Mostafa Elhemali, Eric Hanson, and Mike Liddell.
new a169051 HADOOP-11179. Java untar should handle the case that the file entry comes without its parent directory entry. Contributed by Craig Welch.
new df3becf YARN-2598 GHS should show N/A instead of null for the inaccessible information (Zhijie Shen via mayank)
new d996235 HDFS-7202. Should be able to omit package name of SpanReceiver on "hadoop trace -add" (iwasakims via cmccabe)
new 2a51494 HADOOP-11161. Expose close method in KeyProvider to give clients of Provider implementations a hook to release resources. Contribued by Arun Suresh.
new 8d7c549 HADOOP-11133. Should trim the content of keystore password file for JavaKeyStoreProvider (Yi Liu via umamahesh)
new db71bb5 HDFS-7217. Better batching of IBRs. Contributed by Kihwal Lee.
new 1123a06 HADOOP-11175. Fix several issues of hadoop security configuration in user doc. Contributed by Yi Liu.
new 180afa2 YARN-2493. Added user-APIs for using node-labels. Contributed by Wangda Tan.
new 9097183 HDFS-7195. Update user doc of secure mode about Datanodes don't require root or jsvc. Contributed by Chris Nauroth.
new d7b647f HADOOP-11178. Fix findbugs exclude file. (Arun Suresh via wang)
new 1d4612f YARN-2629. Made the distributed shell use the domain-based timeline ACLs. Contributed by Zhijie Shen.
new 8d94114 HADOOP-11174. Delegation token for KMS should only be got once if it already exists. (Yi Liu via wang)
new 596702a YARN-2544. Added admin-API objects for using node-labels. Contributed by Wangda Tan.
new d8d628d HADOOP-11184. Update Hadoop's lz4 to r123 (cmccabe)
new 4f426fe YARN-2180. [YARN-1492] In-memory backing store for cache manager. (Chris Trezzo via kasha)
new e532ed8 YARN-2617. Fixed ApplicationSubmissionContext to still set resource for backward compatibility. Contributed by Wangda Tan.
new cbd21fd HDFS-7026. Introduce a string constant for "Failed to obtain user group info...". Contributed by Yongjun Zhang.
new 5b12df6 YARN-2671. Fix the Jira number in the change log.
new 684170d MAPREDUCE-6122. TestLineRecordReader may fail due to test data files checked out of git with incorrect line endings. Contributed by Chris Nauroth.
new 2f0166d MAPREDUCE-6122. Fix CHANGES.txt.
new 777877d MAPREDUCE-6123. TestCombineFileInputFormat incorrectly starts 2 MiniDFSCluster instances. Contributed by Chris Nauroth.
new d3afd73 YARN-2662. TestCgroupsLCEResourcesHandler leaks file descriptors. Contributed by Chris Nauroth.
new cb81bac YARN-2583. Modified AggregatedLogDeletionService to be able to delete rolling aggregated logs. Contributed by Xuan Gong.
new db7f165 YARN-2494. Added NodeLabels Manager internal API and implementation. Contributed by Wangda Tan.
new 1ceb326 HDFS-7198. Fix "unchecked conversion" warning in DFSClient#getPathTraceScope (cmccabe)
new d3d3d47 HDFS-7209. Populate EDEK cache when creating encryption zone. (Yi Liu via wang)
new f4b7e99 HADOOP-11188. hadoop-azure: automatically expand page blobs when they become full. Contributed by Eric Hanson.
new 428dfaa Update CHANGES.txt after merging HDFS-6252 and HDFS-6657 to branch-2.
new a5ec3d0 YARN-2501. Enhanced AMRMClient library to support requests against node labels. Contributed by Wangda Tan.
new 554250c HADOOP-11193. Fix uninitialized variables in NativeIO.c. Contributed by Xiaoyu Yao.
new ac64ff7 YARN-2668 yarn-registry JAR won't link against ZK 3.4.5. (stevel)
new e8a31f2 MAPREDUCE-5875. Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild. (Gera Shegalov via kasha)
new bbe80cd MAPREDUCE-6125. TestContainerLauncherImpl sometimes fails. Contributed by Mit Desai
new 344a10a YARN-2667. Fix the release audit warning caused by hadoop-yarn-registry. Contributed by Yi Liu
new 793dbf2 MAPREDUCE-6115. TestPipeApplication#testSubmitter fails in trunk. Contributed by Binglin Chang
new 98ac9f2 HDFS-7236. Fix TestOpenFilesWithSnapshot#testOpenFilesWithMultipleSnapshots. Contributed by Yongjun Zhang.
new 5310031 HDFS-6544. Broken Link for GFS in package.html. Contributed by Suraj Nayak M.
new 4aed2d8 YARN-2651. Spun off LogRollingInterval from LogAggregationContext. Contributed by Xuan Gong.
new 1770bb9 HDFS-7090. Use unbuffered writes when persisting in-memory replicas. Contributed by Xiaoyu Yao.
new a56ea01 YARN-2377. Localization exception stack traces are not passed as diagnostic info. Contributed by Gera Shegalov
new f9680d9 YARN-2308. Changed CapacityScheduler to explicitly throw exception if the queue to which the apps were submitted is changed across RM restart. Contributed by Craig Welch & Chang Li
new 178bc50 Missing Changes.txt for YARN-2308
new da709a2 YARN-2641. Decommission nodes on -refreshNodes instead of next NM-RM heartbeat. (Zhihai Xu via kasha)
new cc93e7e YARN-2566. DefaultContainerExecutor should pick a working directory randomly. (Zhihai Xu via kasha)
new 0e57aa3 HADOOP-11176. KMSClientProvider authentication fails when both currentUgi and loginUgi are a proxied user. Contributed by Arun Suresh.
new f6d0b88 HDFS-7237. The command "hdfs namenode -rollingUpgrade" throws ArrayIndexOutOfBoundsException.
new 5faaba0 HADOOP-11198. Fix typo in javadoc for FileSystem#listStatus(). Contributed by Li Lu.
new 7dcad84 HDFS-7228. Add an SSD policy into the default BlockStoragePolicySuite. Contributed by Jing Zhao.
new cdce883 HADOOP-11181. Generalized o.a.h.s.t.d.DelegationTokenManager to handle all sub-classes of AbstractDelegationTokenIdentifier. Contributed by Zhijie Shen.
new 0260231 HDFS-7201. Fix typos in hdfs-default.xml. Contributed by Dawson Choong.
new 1220bb7 YARN-2656. Made RM web services authentication filter support proxy user. Contributed by Varun Vasudev and Zhijie Shen.
new 128ace1 HDFS-7190. Bad use of Preconditions in startFileInternal(). Contributed by Dawson Choong.
new b9edad6 MAPREDUCE-5873. Shuffle bandwidth computation includes time spent waiting for maps. Contributed by Siqi Li
new 1862064 HDFS-7185. The active NameNode will not accept an fsimage sent from the standby during rolling upgrade. Contributed by Jing Zhao.
new f19771a MAPREDUCE-5970. Provide a boolean switch to enable MR-AM profiling. Contributed by Gera Shegalov
new 0af1a2b YARN-2312. Deprecated old ContainerId#getId API and updated MapReduce to use ContainerId#getContainerId instead. Contributed by Tsuyoshi OZAWA
new 466f087 HADOOP-11181. GraphiteSink emits wrong timestamps (Sascha Coenen via raviprak)
new f2ea555 YARN-2496. Enhanced Capacity Scheduler to have basic support for allocating resources based on node-labels. Contributed by Wangda Tan. YARN-2500. Ehnaced ResourceManager to support schedulers allocating resources based on node-labels. Contributed by Wangda Tan.
new b3056c2 YARN-2685. Fixed a bug in CommonNodeLabelsManager that caused wrong resource tracking per label when a host runs multiple node-managers. Contributed by Wangda Tan.
new 41980c5 HDFS-7208. NN doesn't schedule replication when a DN storage fails. Contributed by Ming Ma
new 2894433 HDFS-5089. When a LayoutVersion support SNAPSHOT, it must support FSIMAGE_NAME_OPTIMIZATION.
new 6f43491 YARN-2689 TestSecureRMRegistryOperations failing on windows: secure ZK won't start
new 233d446 YARN-2621. Simplify the output when the user doesn't have the access for getDomain(s). Contributed by Zhijie Shen
new b0d6ac9 HADOOP-11182. GraphiteSink emits wrong timestamps (Sascha Coenen via raviprak) Fix CHANGES.txt
new 0fd0eba YARN-2682. Updated WindowsSecureContainerExecutor to not use DefaultContainerExecutor#getFirstApplicationDir and use getWorkingDir() instead. Contributed by Zhihai Xu
new 72093fd Moved YARN-2682 from 2.6 to 2.7 in CHANGES.txt
new cba1f9e HDFS-6995. Block should be placed in the client's 'rack-local' node if 'client-local' node is not available (vinayakumarb) Adding missed test file
new 1c3ff0b HDFS-7242. Code improvement for FSN#checkUnreadableBySuperuser. (Contributed by Yi Liu)
new 3687431 HDFS-7252. small refinement to the use of isInAnEZ in FSNamesystem. (Yi Liu via vinayakumarb)
new abae63c YARN-2699. Fixed a bug in CommonNodeLabelsManager that caused tests to fail when using ephemeral ports on NodeIDs. Contributed by Wangda Tan.
new a6aa6e4 YARN-2588. Standby RM fails to transitionToActive if previous transitionToActive failed with ZK exception. Contributed by Rohith Sharmaks
new 209b169 MAPREDUCE-5542. Killing a job just as it finishes can generate an NPE in client. Contributed by Rohith
new 1137557 HADOOP-11207. Enhanced common DelegationTokenAuthenticationHandler to support proxy-users on Delegation-token management operations. Contributed by Zhijie Shen.
new c3de241 YARN-1879. Marked Idempotent/AtMostOnce annotations to ApplicationMasterProtocol for RM fail over. Contributed by Tsuyoshi OZAWA
new e9c66e8 YARN-2705. Fixed bugs in ResourceManager node-label manager that were causing test-failures: added a dummy in-memory labels-manager. Contributed by Wangda Tan.
new 2e14052 HDFS-7260. Change DFSOutputStream.MAX_PACKETS to be configurable.
new 39063cd YARN-2676. Enhanced Timeline auth-filter to support proxy users. Contributed by Zhijie Shen.
new 8256766 YARN-2504. Enhanced RM Admin CLI to support management of node-labels. Contribyted by Wangda Tan.
new 7bbda6e MAPREDUCE-5911. Terasort TeraOutputFormat does not check for output directory existance. Contributed by Bruno P. Kinoshita.
new da80c4d Revert "MAPREDUCE-5911. Terasort TeraOutputFormat does not check for output directory existance. Contributed by Bruno P. Kinoshita."
new d5084b9 HADOOP-11194. Ignore .keep files (kasha)
new e4d6a87 HDFS-7184. Allow data migration tool to run as a daemon. (Benoy Antony)
new 8942741 YARN-2673. Made timeline client put APIs retry if ConnectException happens. Contributed by Li Lu.
new e90718f YARN-2582. Fixed Log CLI and Web UI for showing aggregated logs of LRS. Contributed Xuan Gong.
new 4799570 HDFS-7266. HDFS Peercache enabled check should not lock on object (awang via cmccabe)
new 7aab5fa HDFS-7154. Fix returning value of starting reconfiguration task (Lei Xu via Colin P. McCabe)
new 2839365 YARN-2701. Potential race condition in startLocalizer when using LinuxContainerExecutor. Contributed by Xuan Gong
new 4fa1fb3 Missing file for YARN-2701
new 4a78a75 Missing file for YARN-1879
new 171f237 YARN-2717. Avoided duplicate logging when container logs are not found. Contributed by Xuan Gong.
new b6f9d55 HDFS-7259. Unresponseive NFS mount point due to deferred COMMIT response. Contributed by Brandon Li
new 6f2028b YARN-90. NodeManager should identify failed disks becoming good again. Contributed by Varun Vasudev
new 4e134a0 HDFS-7215.Add JvmPauseMonitor to NFS gateway. Contributed by Brandon Li
new 6637e3c YARN-2720. Windows: Wildcard classpath variables not expanded against resources contained in archives. Contributed by Craig Welch.
new ac56b06 HDFS-7221. TestDNFencingWithReplication fails consistently. Contributed by Charles Lamb.
new b85919f Updated CHANGES.txt for HDFS-6581 merge into branch-2.6.
new 4baca31 HDFS-7204. balancer doesn't run as a daemon (aw)
new b294276 YARN-2709. Made timeline client getDelegationToken API retry if ConnectException happens. Contributed by Li Lu.
new c0e0343 YARN-2715. Fixed ResourceManager to respect common configurations for proxy users/groups beyond just the YARN level config. Contributed by Zhijie Shen.
new 7e3b5e6 YARN-2721. Suppress NodeExist exception thrown by ZKRMStateStore when it retries creating znode. Contributed by Jian He.
new 85a8864 YARN-2692 ktutil test hanging on some machines/ktutil versions (stevel)
new b8f7966 MAPREDUCE-6126. Fixed Rumen JobBuilder to ignore NormalizedResourceEvent. Contributed by Junping Du
new 1c8d191 HDFS-7228. Fix TestDNFencing.testQueueingWithAppend. Contributed by Yongjun Zhang.
new d67214f Updated CHANGES.txt to move MAPREDUCE-6126 to 2.6
new 90e5ca2 YARN-2700 TestSecureRMRegistryOperations failing on windows: auth problems
new 66e8187 HDFS-7254. Add documentation for hot swaping DataNode drives (Lei Xu via Colin P. McCabe)
new 7b0f9bb HDFS-6877. Avoid calling checkDisk when an HDFS volume is removed during a write. (Lei Xu via Colin P. McCabe)
new 70719e5 HADOOP-11122. Fix findbugs in ZK DelegationTokenSecretManagers. (Arun Suresh via kasha)
new 08457e9 Move HDFS-2486 down to 2.7.0 in CHANGES.txt
new a36399e HDFS-6824. Additional user documentation for HDFS encryption.
new 3b12fd6 YARN-2198. Remove the need to run NodeManager as privileged account for Windows Secure Container Executor. Contributed by Remus Rusanu
new f729ecf HDFS-7277. Remove explicit dependency on netty 3.2 in BKJournal. Contributed by Haohui Mai.
new b94b8b3 YARN-2732. Fixed syntax error in SecureContainer.apt.vm. Contributed by Jian He.
new d71d40a HDFS-7180. NFSv3 gateway frequently gets stuck due to GC. Contributed by Brandon Li
new 8c5b23b HDFS-7165. Separate block metrics for files with replication count 1. (Zhe Zhang via wang)
new 86cad00 HDFS-7222. Expose DataNode network errors as a metric. (Charles Lamb via wang)
new 7ab7545 HDFS-7227. Fix findbugs warning about NP_DEREFERENCE_OF_READLINE_VALUE in SpanReceiverHost (cmccabe)
new 828429d HDFS-7232. Populate hostname in httpfs audit log (Zoran Dimitrijevic via aw)
new 670879e HDFS-7257. Add the time of last HA state transition to NN's /jmx page. Contributed by Charles Lamb.
new db45f04 HADOOP-11170. ZKDelegationTokenSecretManager fails to renewToken created by a peer. (Arun Suresh and Gregory Chanan via kasha)
new 5b56ac4 HDFS-7223. Tracing span description of IPC client is too long (iwasakims via cmccabe)
new 57dec28 HDFS-7243. HDFS concat operation should not be allowed in Encryption Zone. (clamb via yliu)
new 0f3b690 YARN-2209. Replaced AM resync/shutdown command with corresponding exceptions and made related MR changes. Contributed by Jian He.
new 071c925 Updated CHANGES.txt to move YARN-2682 to branch-2.6
new 0942c99 HDFS-7258. CacheReplicationMonitor rescan schedule log should use DEBUG level instead of INFO level. Contributed by Xiaoyu Yao.
new b3d8a64 HDFS-7283. Bump DataNode OOM log from WARN to ERROR. Contributed by Stephen Chu.
new e31f0a6 YARN-2724. Skipped uploading a local log file to HDFS if exception is raised when opening it. Contributed by Xuan Gong.
new e2be333 HDFS-6904. YARN unable to renew delegation token fetched via webhdfs due to incorrect service port.
new 86ac0d4 HDFS-6904. Added files missing in previous commit.
new f7e89bb HADOOP-11228. Winutils task: unsecure path should not call AddNodeManagerAndUserACEsToObject. Contributed by Remus Rusanu
new 501e49f Fix CHANGES.txt for HADOOP-11228
new a52eb4b HDFS-6988. Improve HDFS-6581 eviction configuration (Xiaoyu Yao via Colin P. McCabe)
new f81dc3f YARN-2703. Added logUploadedTime into LogValue for better display. Contributed by Xuan Gong.
new dc6e819 HADOOP-11231. Remove dead code in ServletUtil. Contributed by Li Lu.
new 0ac6988 Fix CHANGES.txt for HADOOP-112321 and HADOOP-10748.
new 683897f YARN-2713. "RM Home" link in NM should point to one of the RMs in an HA setup. (kasha)
new 5864dd9 YARN-1915. Fixed a race condition that client could use the ClientToAMToken to contact with AM before AM actually receives the ClientToAMTokenMasterKey. Contributed by Jason Lowe
new f44cf99 YARN-2314. Disable ContainerManagementProtocolProxy cache by default to prevent creating thousands of threads in a large cluster. Contributed by Jason Lowe
new c51e53d YARN-2183. [YARN-1492] Cleaner service for cache manager. (Chris Trezzo and Sangjin Lee via kasha)
new 28051e41 HADOOP-6857. FsShell should report raw disk usage including replication factor. Contributed by Byron Wong.
new 65d95b1 YARN-2723. Fix rmadmin -replaceLabelsOnNode does not correctly parse port. Contributed by Naganarasimha G R
new 0186645 YARN-2743. Fixed a bug in ResourceManager that was causing RMDelegationToken identifiers to be tampered and thus causing app submission failures in secure mode. Contributed by Jian He.
new 9ada928 HADOOP-11170. Pulling into branch-2.6 also, fixing CHANGES.txt.
new caecd9f YARN-2734. Skipped sub-folders in the local log dir when aggregating logs. Contributed by Xuan Gong.
new 2429b31 HADOOP-11236. NFS: Fix javadoc warning in RpcProgram.java. Contributed by Abhiraj Butala. (harsh)
new 0058ead HDFS-6538. Comment format error in ShortCircuitRegistry javadoc. Contributed by David Luo. (harsh)
new 463aec1 HDFS-6934. Move checksum computation off the hot path when writing to RAM disk. Contributed by Chris Nauroth.
new baf794d HDFS-7278. Add a command that allows sysadmins to manually trigger full block reports from a DN (cmccabe)
new ce1a441 YARN-2726. CapacityScheduler should explicitly log when an accessible label has no capacity. Contributed by Wangda Tan
new c05b581 YARN-2591. Fixed AHSWebServices to return FORBIDDEN(403) if the request user doesn't have access to the history data. Contributed by Zhijie Shen
new 5b1dfe7 HDFS-6934. Revert files accidentally committed.
new a16d022 YARN-2704. Changed ResourceManager to optionally obtain tokens itself for the sake of localization and log-aggregation for long-running services. Contributed by Jian He.
new 00b4e44 HDFS-5928. Show namespace and namenode ID on NN dfshealth page. Contributed by Siqi Li.
new 518a7f4 HDFS-7282. Fix intermittent TestShortCircuitCache and TestBlockReaderFactory failures resulting from TemporarySocketDirectory GC (Jinghui Wang via Colin P. McCabe)
new b0e19c9 HADOOP-10926. Improve test-patch.sh to apply binary diffs (cmccabe)
new f6b963f YARN-2502. Changed DistributedShell to support node labels. Contributed by Wangda Tan
new 6b2f11b MAPREDUCE-5933. Enabled MR AM to post history events to the timeline server. Contributed by Robert Kanter.
new 971e91c MAPREDUCE-6018. Added an MR specific config to enable emitting job history data to the timeline server. Contributed by Robert Kanter.
new e785901 HADOOP-11233. hadoop.security.kms.client.encrypted.key.cache.expiry property spelled wrong in core-default. (Stephen Chu via yliu)
new 0398db1 HDFS-6741. Improve permission denied message when FSPermissionChecker#checkOwner fails. Contributed by Stephen Chu and Harsh J. (harsh)
new c9bec46 Revert "HADOOP-10926. Improve test-patch.sh to apply binary diffs (cmccabe)"
new 58c0bb9 HDFS-6606. Optimize HDFS Encrypted Transport performance. (yliu)
new ade3727 YARN-2760. Remove 'experimental' from FairScheduler docs. (Harsh J via kasha)
new 0d3e7e2 RN-2279. Add UTs to cover timeline server authentication. Contributed by Zhijie Shen
new 371a3b8 HDFS-6663. Admin command to track file and locations from block id. Contributed by Chen He.
new e226b5b HDFS-7213. processIncrementalBlockReport performance degradation. Contributed by Eric Payne.
new 69f79be YARN-2758. Update TestApplicationHistoryClientService to use the new generic history store. Contributed by Zhijie Shen
new c6f04f3 HDFS-7291. Persist in-memory replicas with appropriate unbuffered copy API on POSIX and Windows. Contributed by Xiaoyu Yao.
new 8984e9b YARN-2741. Made NM web UI serve logs on the drive other than C: on Windows. Contributed by Craig Welch.
new ac9ab03 HDFS-7235. DataNode#transferBlock should report blocks that don't exist using reportBadBlock (yzhang via cmccabe)
new 675bca2 HDFS-7280. Use netty 4 in WebImageViewer. Contributed by Haohui Mai.
new 1a78082 HADOOP-11217. Disable SSLv3 in KMS. (Robert Kanter via kasha)
new 3f48493 HDFS-7274. Disable SSLv3 in HttpFS. (Robert Kanter via kasha)
new d5e0a09 YARN-2503. Added node lablels in web UI. Contributed by Wangda Tan
new 0782f60 Missing CHANGES.txt for YARN-2503.
new 3c5f5af HADOOP-11243. SSLFactory shouldn't allow SSLv3. (Wei Yan via kasha)
new ec63a3f YARN-2747. Fixed the test failure of TestAggregatedLogFormat when native I/O is enabled. Contributed by Xuan Gong.
new 3f14412 MAPREDUCE-6142. Fixed test failures in TestJobHistoryEventHandler and TestMRTimelineEventHandling. Contributed by Zhijie Shen.
new 782971a YARN-2742. FairSchedulerConfiguration should allow extra spaces between value and unit. (Wei Yan via kasha)
new b056048 MAPREDUCE-6022. map_input_file is missing from streaming job environment. Contributed by Jason Lowe.
new 72a556d HADOOP-11195. Move Id-Name mapping in NFS to the hadoop-common area for better maintenance. Contributed by Yongjun Zhang
new 5c900b5 HADOOP-11068. Match hadoop.auth cookie format to jetty output. Contributed by Gregory Chanan.
new a8c1202 YARN-2769. Fixed the problem that timeline domain is not set in distributed shell AM when using shell_command on Windows. Contributed by Varun Vasudev.
new c2575fb HADOOP-11186: documentation should talk about hadoop.htrace.spanreceiver.classes, not hadoop.trace.spanreceiver.classes (cmccabe)
new d33e07d HDFS-7287. The OfflineImageViewer (OIV) can output invalid XML depending on the filename (Ravi Prakash via Colin P. McCabe)
new 3ae84e1 HDFS-7300. HDFS-7300. The getMaxNodesPerRack() method in BlockPlacementPolicyDefault is flawed. contributed by Kihwal Lee
new 6f5f604 HDFS-7305. NPE seen in wbhdfs FS while running SLive. Contributed by Jing Zhao.
new 05b66ca HADOOP-11247. Fix a couple javac warnings in NFS. Contributed by Brandon Li.
new 2a6be65 HA |