Return-Path: X-Original-To: apmail-hadoop-common-commits-archive@www.apache.org Delivered-To: apmail-hadoop-common-commits-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C364218D8A for ; Fri, 4 Mar 2016 05:03:30 +0000 (UTC) Received: (qmail 74630 invoked by uid 500); 4 Mar 2016 05:03:30 -0000 Delivered-To: apmail-hadoop-common-commits-archive@hadoop.apache.org Received: (qmail 74463 invoked by uid 500); 4 Mar 2016 05:03:30 -0000 Mailing-List: contact common-commits-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: common-dev@hadoop.apache.org Delivered-To: mailing list common-commits@hadoop.apache.org Received: (qmail 73788 invoked by uid 99); 4 Mar 2016 05:03:29 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 04 Mar 2016 05:03:29 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id 894A5E78F6; Fri, 4 Mar 2016 05:03:29 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit From: wang@apache.org To: common-commits@hadoop.apache.org Date: Fri, 04 Mar 2016 05:03:32 -0000 Message-Id: In-Reply-To: <8ecd7f94537a4662bcaeedeec1bd20f6@git.apache.org> References: <8ecd7f94537a4662bcaeedeec1bd20f6@git.apache.org> X-Mailer: ASF-Git Admin Mailer Subject: [4/5] hadoop git commit: HADOOP-11792. Remove all of the CHANGES.txt files. http://git-wip-us.apache.org/repos/asf/hadoop/blob/67094481/hadoop-common-project/hadoop-common/CHANGES.txt ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/CHANGES.txt b/hadoop-common-project/hadoop-common/CHANGES.txt deleted file mode 100644 index 7ea0cfb..0000000 --- a/hadoop-common-project/hadoop-common/CHANGES.txt +++ /dev/null @@ -1,17809 +0,0 @@ -Hadoop Change Log - -Release 2.9.0 - UNRELEASED - - INCOMPATIBLE CHANGES - - NEW FEATURES - - HADOOP-12702. Add an HDFS metrics sink. (Daniel Templeton via kasha) - - IMPROVEMENTS - - HADOOP-12321. Make JvmPauseMonitor an AbstractService. - (Sunil G via Stevel) - - HADOOP-12625. Add a config to disable the /logs endpoints (rkanter) - - HADOOP-12566. Add NullGroupMapping. (Daniel Templeton via kasha) - - HADOOP-12663. Remove Hard-Coded Values From FileSystem.java. - (BELUGA BEHR via stevel) - - HADOOP-12653. Use SO_REUSEADDR to avoid getting "Address already in use" - when using kerberos and attempting to bind to any port on the local IP - address (cmccabe) - - HADOOP-12683. Add number of samples in last interval in snapshot of - MutableStat. (Vikram Srivastava via kasha) - - HADOOP-8887. Use a Maven plugin to build the native code using CMake - (cmccabe) - - HADOOP-12713. Disable spurious checkstyle checks. (wang) - - HADOOP-12662. The build should fail if a -Dbundle option fails (Kai Zheng - via cmccabe) - - HADOOP-12749. Create a threadpoolexecutor that overrides afterExecute to - log uncaught exceptions/errors. (Sidharta Seethana via vvasudev) - - HADOOP-12710. Remove dependency on commons-httpclient for TestHttpServerLogs - (Wei-Chiu Chuang via iwasakims) - - HADOOP-12817. Enable TLS v1.1 and 1.2 (rkanter) - - HADOOP-12841. Update s3-related properties in core-default.xml. (Wei-Chiu Chuang via lei) - - HADOOP-10321. TestCompositeService should cover all enumerations of - adding a service to a parent service. (Ray Chiang via kasha) - - HADOOP-12859. Disable hiding field style checks in class setters. (Kai Zheng via wang) - - BUG FIXES - - HADOOP-12605. Fix intermittent failure of TestIPC.testIpcWithReaderQueuing - (iwasakims) - - HADOOP-12655. TestHttpServer.testBindAddress bind port range is wider - than expected. (Wei-Chiu Chuang via stevel) - - HADOOP-12613. TestFind.processArguments occasionally fails. - (Wei-Chiu Chuang via stevel) - - HADOOP-12597. In kms-site.xml configuration - "hadoop.security.keystore.JavaKeyStoreProvider.password" - should be updated with new name. (Surendra Singh Lilhore via stevel) - - HADOOP-12573. TestRPC.testClientBackOff failing. - (Xiao Chen via stevel) - - HDFS-9517. Fix missing @Test annotation on - TestDistCpUtils.testUnpackAttributes (Wei-Chiu Chuang via cmccabe) - - HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe) - - HADOOP-12829. StatisticsDataReferenceCleaner swallows interrupt exceptions - (Gregory Chanan via cmccabe) - -Release 2.8.0 - UNRELEASED - - INCOMPATIBLE CHANGES - - HADOOP-11746. rewrite test-patch.sh (aw) - - HADOOP-12416. Trash messages should be handled by Logger instead of being - delivered on System.out. (Mingliang Liu via aajisaka) - - HADOOP-12552. Fix undeclared/unused dependency to httpclient (iwasakims) - - NEW FEATURES - - HADOOP-11226. Add a configuration to set ipc.Client's traffic class with - IPTOS_LOWDELAY|IPTOS_RELIABILITY. (Gopal V via ozawa) - - HADOOP-9477. Add posixGroups support for LDAP groups mapping service. - (Dapeng Sun via Yongjun Zhang) - - HADOOP-11843. Make setting up the build environment easier. - (Niels Basjes via cnauroth) - - HADOOP-11949. Add user-provided plugins to test-patch (Sean Busbey via aw) - - HADOOP-8934. Shell command ls should include sort options (Jonathan Allen - via aw) - - HADOOP-10971. Add -C flag to make `hadoop fs -ls` print filenames only. - (Kengo Seki via aajisaka) - - HADOOP-5732. Add SFTP FileSystem. (Ramtin Boustani and Inigo Goiri via - cdouglas) - - HADOOP-12360. Create StatsD metrics2 sink. (Dave Marion via stevel) - - HADOOP-10300. Allowed deferred sending of call responses. (Daryn Sharp via - yliu) - - HADOOP-12366. expose calculated paths (aw) - - HADOOP-12657. Add a option to skip newline on empty files with getMerge -nl. - (Kanaka Kumar Avvaru via aajisaka) - - HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei) - - HADOOP-12691. Add CSRF Filter for REST APIs to Hadoop Common. - (Larry McCay via cnauroth) - - HADOOP-12635. Adding Append API support for WASB. (Dushyanth via cnauroth) - - HADOOP-12426. Add Entry point for Kerberos health check - (Steve Loughran via cnauroth) - - HADOOP-12548. Read s3a creds from a Credential Provider. - (Larry McCay via cnauroth) - - IMPROVEMENTS - - HADOOP-12831. LocalFS/FSOutputSummer NPEs in constructor if bytes per checksum - set to 0 (Mingliang Liu via gtcarrera9) - - HADOOP-12458. Retries is typoed to spell Retires in parts of - hadoop-yarn and hadoop-common - (Neelesh Srinivas Salian via harsh) - - HADOOP-12271. Hadoop Jar Error Should Be More Explanatory - (Josh Elser via harsh) - - HADOOP-6842. "hadoop fs -text" does not give a useful text representation - of MapWritable objects (Akira Ajisaka via bobby) - - HADOOP-11719. [Fsshell] Remove bin/hadoop reference from - GenericOptionsParser default help text. - (Brahma Reddy Battula via harsh) - - HADOOP-11692. Improve authentication failure WARN message to avoid user - confusion. (Yongjun Zhang) - - HADOOP-11659. o.a.h.fs.FileSystem.Cache#remove should use a single hash map - lookup. (Brahma Reddy Battula via aajisaka) - - HADOOP-11709. Time.NANOSECONDS_PER_MILLISECOND - use class-level final - constant instead of method variable (Ajith S via ozawa) - - HADOOP-11447. Add a more meaningful toString method to SampleStat and - MutableStat. (kasha) - - HADOOP-11737. mockito's version in hadoop-nfs’ pom.xml shouldn't be - specified. (Kengo Seki via ozawa) - - HADOOP-11741. Add LOG.isDebugEnabled() guard for some LOG.debug(). - (Walter Su via ozawa) - - HADOOP-11660. Add support for hardware crc of HDFS checksums on ARM aarch64 - architecture (Edward Nevill via Colin P. McCabe) - - HADOOP-9805. Refactor RawLocalFileSystem#rename for improved testability. - (Jean-Pierre Matsumoto via cnauroth) - - HADOOP-11717. Support JWT tokens for web single sign on to the Hadoop - servers. (Larry McCay via omalley) - - HADOOP-11814. Reformat hadoop-annotations, o.a.h.classification.tools. - (Li Lu via wheat9) - - HADOOP-7713. dfs -count -q should label output column (Jonathan Allen - via aw) - - HADOOP-11819. HttpServerFunctionalTest#prepareTestWebapp should create web - app directory if it does not exist. (Rohith via vinayakumarb) - - HADOOP-11827. Speed-up distcp buildListing() using threadpool - (Zoran Dimitrijevic via raviprak) - - HADOOP-10597. RPC Server signals backoff to clients when all request - queues are full. (Ming Ma via Arpit Agarwal) - - HADOOP-11357. Print information of the build enviornment in test-patch.sh - (aw) - - HADOOP-11328. ZKFailoverController does not log Exception when doRun raises - errors. (Tianyin Xu via ozawa) - - HADOOP-11120. hadoop fs -rmr gives wrong advice. (Juliet Hougland via wang) - - HADOOP-11911. test-patch should allow configuration of default branch - (Sean Busbey via aw) - - HADOOP-11917. test-patch.sh should work with ${BASEDIR}/patchprocess - setups (aw) - - HADOOP-11925. backport trunk's smart-apply-patch.sh to branch-2 (aw) - - HADOOP-11906. test-patch.sh should use 'file' command for patch - determinism (Sean Busbey via aw) - - HADOOP-11950. Add cli option to test-patch to set the project-under-test - (Sean Busbey via aw) - - HADOOP-11948. test-patch's issue matching regex should be configurable. - (Sean Busbey via aw) - - HADOOP-9723. Improve error message when hadoop archive output path already - exists. (Jean-Baptiste Onofré and Yongjun Zhang via aajisak) - - HADOOP-11713. ViewFileSystem should support snapshot methods. - (Rakesh R via cnauroth) - - HADOOP-11960. Enable Azure-Storage Client Side logging. - (Dushyanth via cnauroth) - - HADOOP-11939. Deprecate DistCpV1 and Logalyzer. - (Brahma Reddy Battula via aajisaka) - - HADOOP-11884. test-patch.sh should pull the real findbugs version - (Kengo Seki via aw) - - HADOOP-11944. add option to test-patch to avoid relocating patch process - directory (Sean Busbey via aw) - - HADOOP-1540. Support file exclusion list in distcp. (Rich Haase via jing9) - - HADOOP-11103. Clean up RemoteException (Sean Busbey via vinayakumarb) - - HADOOP-11995. Make jetty version configurable from the maven command line. - (Sriharsha Devineni via wheat9) - - HADOOP-10366. Add whitespaces between classes for values in - core-default.xml to fit better in browser. - (kanaka kumar avvaru via aajisaka) - - HADOOP-11594. Improve the readability of site index of documentation. - (Masatake Iwasaki via aajisaka) - - HADOOP-12030. test-patch should only report on newly introduced - findbugs warnings. (Sean Busbey via aw) - - HADOOP-11894. Bump the version of Apache HTrace to 3.2.0-incubating - (Masatake Iwasaki via Colin P. McCabe) - - HADOOP-12043. Display warning if defaultFs is not set when running fs - commands. (Lei Xu via wang) - - HADOOP-12037. Fix wrong classname in example configuration of hadoop-auth - documentation. (Masatake Iwasaki via wang) - - HADOOP-12059. S3Credentials should support use of CredentialProvider. - (Sean Busbey via wang) - - HADOOP-12056. Use DirectoryStream in DiskChecker#checkDirs to detect - errors when listing a directory. (Zhihai Xu via wang) - - HADOOP-12055. Deprecate usage of NativeIO#link. (Andrew Wang via cnauroth) - - HADOOP-11971. Move test utilities for tracing from hadoop-hdfs to - hadoop-common. (Masatake Iwasaki via aajisaka) - - HADOOP-11965. determine-flaky-tests needs a summary mode. - (Yufei Gu via Yongjun Zhang) - - HADOOP-11958. MetricsSystemImpl fails to show backtrace when an error - occurs (Jason Lowe via jeagles) - - HADOOP-11813. releasedocmaker.py should use today's date instead of - unreleased (Darrell Taylor via aw) - - HADOOP-12158. Improve error message in - TestCryptoStreamsWithOpensslAesCtrCryptoCodec when OpenSSL is not - installed. (wang) - - HADOOP-12124. Add HTrace support for FsShell (cmccabe) - - HADOOP-12171. Shorten overly-long htrace span names for server (cmccabe) - - HADOOP-12045. Enable LocalFileSystem#setTimes to change atime. - (Kazuho Fujii via cnauroth) - - HADOOP-11974. Fix FIONREAD #include on Solaris (Alan Burlison via Colin P. - McCabe) - - HADOOP-12193. Rename Touchz.java to Touch.java. (wang) - - HADOOP-12195. Add annotation to package-info.java file to workaround - MCOMPILER-205. (wang) - - HADOOP-12201. Add tracing to FileSystem#createFileSystem and Globber#glob - (cmccabe) - - HADOOP-12180. Move ResourceCalculatorPlugin from YARN to Common. - (Chris Douglas via kasha) - - HADOOP-12210. Collect network usage on the node (Robert Grandl via cdouglas) - - HADOOP-12211. Collect disk usage on the node (Robert Grandl via cdouglas) - - HADOOP-12153. ByteBufferReadable doesn't declare @InterfaceAudience and - @InterfaceStability. (Brahma Reddy Battula via ozawa) - - HADOOP-11893. Mark org.apache.hadoop.security.token.Token as - @InterfaceAudience.Public. (Brahma Reddy Battula via stevel) - - HADOOP-12081. Fix UserGroupInformation.java to support 64-bit zLinux. - (aajisaka) - - HADOOP-12214. Parse 'HadoopArchive' commandline using cli Options. - (vinayakumarb) - - HADOOP-12184. Remove unused Linux-specific constants in NativeIO (Martin - Walsh via Colin P. McCabe) - - HADOOP-12161. Add getStoragePolicy API to the FileSystem interface. - (Brahma Reddy Battula via Arpit Agarwal) - - HADOOP-12189. Improve CallQueueManager#swapQueue to make queue elements - drop nearly impossible. (Zhihai Xu via wang) - - HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter) - - HADOOP-12170. hadoop-common's JNIFlags.cmake is redundant and can be - removed (Alan Burlison via Colin P. McCabe) - - HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw) - - HADOOP-12183. Annotate the HTrace span created by FsShell with the - command-line arguments passed by the user (Masatake Iwasaki via Colin P. - McCabe) - - HADOOP-12318. Expose underlying LDAP exceptions in SaslPlainServer. (Mike - Yoder via atm) - - HADOOP-9891. CLIMiniCluster instructions fail with MiniYarnCluster - ClassNotFoundException (Darrell Taylor via aw) - - HADOOP-12295. Improve NetworkTopology#InnerNode#remove logic. (yliu) - - HADOOP-12050. Enable MaxInactiveInterval for hadoop http auth token - (hzlu via benoyantony) - - HADOOP-12325. RPC Metrics : Add the ability track and log slow RPCs. - (Anu Engineer via xyao) - - HADOOP-12368. Mark ViewFileSystemBaseTest and ViewFsBaseTest as abstract. - (wang) - - HADOOP-12367. Move TestFileUtil's test resources to resources folder. - (wang via yliu) - - HADOOP-12369. Point hadoop-project/pom.xml java.security.krb5.conf - within target folder. (wang) - - HADOOP-12358. Add -safely flag to rm to prompt when deleting many files. - (xyao via wang) - - HADOOP-12384. Add "-direct" flag option for fs copy so that user can choose - not to create "._COPYING_" file (J.Andreina via vinayakumarb) - - HADOOP-12324. Better exception reporting in SaslPlainServer. - (Mike Yoder via stevel) - - HADOOP-12404. Disable caching for JarURLConnection to avoid sharing - JarFile with other users when loading resource from URL in Configuration - class. (zxu) - - HADOOP-12428. Fix inconsistency between log-level guards and statements. - (Jagadesh Kiran N and Jackie Chang via ozawa) - - HADOOP-12446. Undeprecate createNonRecursive() (Ted Yu via kihwal) - - HADOOP-12452. Fix tracing documention reflecting the update to htrace-4 - (Masatake Iwasaki via Colin P. McCabe) - - HADOOP-12350. WASB Logging: Improve WASB Logging around deletes, reads and - writes (Dushyanth via cnauroth) - - HADOOP-11104. org.apache.hadoop.metrics2.lib.MetricsRegistry needs numerical - parameter checking. (Ray Chiang via aajisaka) - - HADOOP-12344. Improve validateSocketPathSecurity0 error message (Casey - Brotherton via Colin P. McCabe) - - HADOOP-10775. Shell operations to fail with meaningful errors on windows if - winutils.exe not found. (stevel) - - HADOOP-12481. JWTRedirectAuthenticationHandler doesn't Retain Original Query - String (Larry McCay via cnauroth) - - HADOOP-12460. Add overwrite option for 'get' shell command - (Jagadesh Kiran N via vinayakumarb) - - HADOOP-10406. TestIPC.testIpcWithReaderQueuing may fail. (Xiao Chen via wang) - - HADOOP-9692. Improving log message when SequenceFile reader throws - EOFException on zero-length file. (Zhe Zhang and Chu Tong via ozawa) - - HADOOP-7266. Deprecate metrics v1. (Akira AJISAKA via ozawa) - - HADOOP-12472. Make GenericTestUtils.assertExceptionContains robust. - (Steve Loughran via jing9) - - HADOOP-12514. Make static fields in GenericTestUtils for - assertExceptionContains() package-private and final. - (Mingliang Liu via stevel) - - HADOOP-12520. Use XInclude in hadoop-azure test configuration to isolate - Azure Storage account keys for service integration tests. (cnauroth) - - HADOOP-11685. StorageException complaining " no lease ID" during HBase - distributed log splitting (Duo Xu via cnauroth) - - HADOOP-12562. Make hadoop dockerfile usable by Yetus. - (Allen Wittenauer via wheat9) - - HADOOP-12568. Update core-default.xml to describe posixGroups support. - (Wei-Chiu Chuang via aajisaka) - - HADOOP-12564. Upgrade JUnit3 TestCase to JUnit 4 in - org.apache.hadoop.io package. (Dustin Cote via ozawa) - - HADOOP-12582. Using BytesWritable's getLength() and getBytes() instead - of get() and getSize(). (Akira AJISAKA via ozawa) - - HADOOP-12575. Add build instruction for docker toolbox instead of - boot2docker(Kai Sasaki via ozawa) - - HADOOP-10035. Cleanup TestFilterFileSystem. (Suresh Srinivas via wheat9) - - HADOOP-10555. Add offset support to MurmurHash. - (Sergey Shelukhin via wheat9) - - HADOOP-10465. Fix use of generics within SortedMapWritable. - (Bertrand Dechoux via wheat9) - - HADOOP-12600. FileContext and AbstractFileSystem should be annotated as a - Stable interface. (cnauroth) - - HADOOP-12618. Fix NPE in TestSequenceFile. (Brahma Reddy Battula via umamahesh) - - HADOOP-12639. Improve JavaDoc for getTrimmedStrings. (BELUGA BEHR via umamahesh) - - HADOOP-12570. HDFS Secure Mode Documentation updates. - (Arpit Agarwal via cnauroth) - - HADOOP-12686. Update FileSystemShell documentation to mention the meaning - of each columns of fs -du. (Daisuke Kobayashi via aajisaka) - - HADOOP-12658. Clear javadoc and check style issues around DomainSocket - (Kai Zheng via umamahesh) - - HADOOP-12604. Exception may be swallowed in KMSClientProvider. - (Yongjun Zhang) - - HADOOP-12696. Add tests for S3Filesystem Contract (Matt Paduano via raviprak) - - HADOOP-12755. Fix typo in defaultFS warning message. (wang) - - HADOOP-12292. Make use of DeleteObjects optional. - (Thomas Demoor via stevel) - - HADOOP-12759. RollingFileSystemSink should eagerly rotate directories. - (Daniel Templeton via wang) - - HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential - propagation (Steve Loughran via cnauroth) - - HADOOP-12788. OpensslAesCtrCryptoCodec should log which random number generator is used. - (Wei-Chiu Chuang via umamahesh) - - HADOOP-12764. Increase default value of KMS maxHttpHeaderSize and make it - configurable. (zhz) - - HADOOP-12699. TestKMS#testKMSProvider intermittently fails during - 'test rollover draining'. (Xiao Chen via wang) - - HADOOP-12776. Remove getaclstatus call for non-acl commands in getfacl. - (Brahma Reddy Battula via vinayakumarb) - - HADOOP-11031. Design Document for Credential Provider API. - (Larry McCay via cnauroth) - - HADOOP-12828. Print user when services are started. - (Wei-Chiu Chuang via Yongjun Zhang) - - HADOOP-11613. Remove commons-httpclient dependency from hadoop-azure. - (Masatake Iwasaki via cnauroth) - - HADOOP-12668. Support excluding weak Ciphers in HttpServer2 through - ssl-server.conf. (Vijay Singh via zhz) - - HADOOP-12555. WASB to read credentials from a credential provider. - (Larry McCay via cnauroth) - - HADOOP-12535. Run FileSystem contract tests with hadoop-azure. - (Madhumita Chakraborty via cnauroth) - - HADOOP-12824. Collect network and disk usage on the node running Windows. - (Inigo Goiri via xyao) - - HADOOP-12711. Remove dependency on commons-httpclient for ServletUtil - (Wei-Chiu Chuang via iwasakims) - - HADOOP-12825. Log slow name resolutions. - (Sidharta Seethana via stevel) - - HADOOP-12622. Improve the loggings in RetryPolicies and RetryInvocationHandler. - (Junping Du via jianhe) - - HADOOP-12793. Write a new group mapping service guide - (Wei-Chiu Chuang via iwasakims) - - OPTIMIZATIONS - - HADOOP-11785. Reduce the number of listStatus operation in distcp - buildListing (Zoran Dimitrijevic via Colin P. McCabe) - - HADOOP-11970. Replace uses of ThreadLocal with JDK7 - ThreadLocalRandom. (Sean Busbey via Colin P. McCabe) - - HADOOP-11772. RPC Invoker relies on static ClientCache which has - synchronized(this) blocks. (wheat9) - - HADOOP-11242. Record the time of calling in tracing span of - IPC server. (Masatake Iwasaki via aajisaka) - - HADOOP-11885. hadoop-dist dist-layout-stitching.sh does not work with dash. - (wang) - - HADOOP-12104. Migrate Hadoop Pipes native build to new CMake framework - (alanburlison via cmccabe) - - HADOOP-12036. Consolidate all of the cmake extensions in one directory - (alanburlison via cmccabe) - - HADOOP-12112. Make hadoop-common-project Native code -Wall-clean - (alanburlison via cmccabe) - - HADOOP-12172. FsShell mkdir -p makes an unnecessary check for the existence - of the parent. (cnauroth) - - HADOOP-12194. Support for incremental generation in the protoc plugin. - (wang) - - HADOOP-11878. FileContext#fixRelativePart should check for not null for a - more informative exception. (Brahma Reddy Battula via kasha) - - HADOOP-11984. Enable parallel JUnit tests in pre-commit. - (Chris Nauroth via vinayakumarb) - - HADOOP-12450. UserGroupInformation should not log at WARN level if no groups - are found. (Elliott Clark via stevel) - - HADOOP-12758. Extend CSRF Filter with UserAgent Checks - (Larry McCay via cnauroth) - - HADOOP-10865. Add a Crc32 chunked verification benchmark for both directly - and non-directly buffer cases. (szetszwo) - - HADOOP-12853. Change WASB documentation regarding page blob support. - (Madhumita Chakraborty via cnauroth) - - BUG FIXES - - HADOOP-12617. SPNEGO authentication request to non-default realm gets - default realm name inserted in target server principal. (mattf) - - HADOOP-12352. Delay in checkpointing Trash can leave trash for 2 intervals - before deleting (Casey Brotherton via harsh) - - HADOOP-11568. Description on usage of classpath in hadoop command is - incomplete. ( Archana T via vinayakumarb ) - - HADOOP-10027. *Compressor_deflateBytesDirect passes instance instead of - jclass to GetStaticObjectField. (Hui Zheng via cnauroth) - - HADOOP-11724. DistCp throws NPE when the target directory is root. - (Lei Eddy Xu via Yongjun Zhang) - - HADOOP-11760. Fix typo of javadoc in DistCp. (Brahma Reddy Battula via - ozawa). - - HADOOP-11800. Clean up some test methods in TestCodec.java. - (Brahma Reddy Battula via aajisaka) - - HADOOP-11811. Fix typos in hadoop-project/pom.xml and TestAccessControlList. - (Brahma Reddy Battula via ozawa) - - HADOOP-11704. DelegationTokenAuthenticationFilter must pass ipaddress - instead of hostname to ProxyUsers#authorize (Anubhav Dhoot via asuresh) - - HADOOP-11846 TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8. - (Larry McCay via stevel) - - HADOOP-11859. PseudoAuthenticationHandler fails with httpcomponents v4.4. - (Eugene Koifman via jitendra) - - HADOOP-11848. Incorrect arguments to sizeof in DomainSocket.c - (Malcolm Kavalsky via Colin P. McCabe) - - HADOOP-11861. test-patch.sh rewrite addendum patch. - (Allen Wittenauer via cnauroth) - - HADOOP-11864. JWTRedirectAuthenticationHandler breaks java8 javadocs. - (Larry McCay via stevel) - - HADOOP-11876. Refactor code to make it more readable, minor - maybePrintStats bug (Zoran Dimitrijevic via raviprak) - - HADOOP-11870. [JDK8] AuthenticationFilter, CertificateUtil, - SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issues (rkanter) - - HADOOP-11881. test-patch.sh javac result is wildly wrong (Kengo Seki via - aw) - - HADOOP-11821. Fix findbugs warnings in hadoop-sls. - (Brahma Reddy Battula via aajisaka) - - HADOOP-11866. increase readability and reliability of checkstyle, - shellcheck, and whitespace reports (aw) - - HADOOP-11889. Make checkstyle runnable from root project - (Gera Shegalov via jeagles) - - HADOOP-11900. Add failIfNoTests=false to hadoop-build-tools pom. (gera) - - HADOOP-11916. TestStringUtils#testLowerAndUpperStrings failed on MAC - due to a JVM bug. (Ming Ma via ozawa) - - HADOOP-11904. test-patch.sh goes into an infinite loop on non-maven - builds (aw) - - HADOOP-11898. add nfs3 and portmap starting command in hadoop-daemon.sh - in branch-2 (brandonli) - - HADOOP-11926. test-patch.sh mv does wrong math (aw) - - HADOOP-11912. Extra configuration key used in TraceUtils should respect - prefix (Masatake Iwasaki via Colin P. McCabe) - - HADOOP-10387. Misspelling of threshold in log4j.properties for tests in - hadoop-common-project. (Brahma Reddy Battula via aajisaka) - - HADOOP-11936. Dockerfile references a removed image (aw) - - HADOOP-11922. Misspelling of threshold in log4j.properties for tests - in hadoop-tools (Gabor Liptak via vinayakumarb) - - HADOOP-11877. SnappyDecompressor's Logger class name is wrong - (surendra singh lilhore via vinayakumarb) - - HADOOP-10356. Corrections in winutils/chmod.c. (Rene Nyffenegger via - Arpit Agarwal) - - HADOOP-7165. listLocatedStatus(path, filter) is not redefined in FilterFs - (Hairong Kuang via jlowe) - - HADOOP-9729. The example code of org.apache.hadoop.util.Tool is incorrect - (hellojinjie via jlowe) - - HADOOP-11928. Test-patch check for @author tags incorrectly flags - removal of @author tags (Kengo Seki via aw) - - HADOOP-11951. test-patch should give better info about failures to handle - dev-support updates without resetrepo option (Sean Busbey via aw) - - HADOOP-11947. test-patch should return early from determine-issue when - run in jenkins mode. (Sean Busbey via aw) - - HADOOP-11962. Sasl message with MD5 challenge text shouldn't be LOG out - even in debug level. (Junping Du via wheat9) - - HADOOP-8174. Remove confusing comment in Path#isAbsolute() - (Suresh Srinivas via vinayakumarb) - - HADOOP-11988. Fix typo in the document for hadoop fs -find. - (Kengo Seki via aajisaka) - - HADOOP-10582. Fix the test case for copying to non-existent dir in - TestFsShellCopy. (Kousuke Saruta via aajisaka) - - HADOOP-11581. Multithreaded correctness Warnings - #org.apache.hadoop.fs.shell.Ls (Brahma Reddy Battula via aw) - - HADOOP-11963. Metrics documentation for FSNamesystem misspells - PendingDataNodeMessageCount. (Anu Engineer via cnauroth) - - HADOOP-12000. cannot use --java-home in test-patch (aw) - - HADOOP-12014. hadoop-config.cmd displays a wrong error message. - (Kengo Seki via aajisaka) - - HADOOP-11955. Fix a typo in the cluster setup doc. - (Yanjun Wang via aajisaka) - - HADOOP-11743. maven doesn't clean all the site files - (ramtin via vinayakumarb) - - HADOOP-11927. Fix "undefined reference to dlopen" error when compiling - libhadooppipes (Xianyin Xin via Colin P. McCabe) - - HADOOP-8751. NPE in Token.toString() when Token is constructed using null - identifier. (kanaka kumar avvaru via aajisaka) - - HADOOP-12004. test-patch breaks with reexec in certain situations (Sean - Busbey via aw) - - HADOOP-12035. shellcheck plugin displays a wrong version potentially - (Kengo Seki via aw) - - HDFS-8429. Avoid stuck threads if there is an error in DomainSocketWatcher - that stops the thread. (zhouyingchao via cmccabe) - - HADOOP-11930. test-patch in offline mode should tell maven to be in - offline mode (Sean Busbey via aw) - - HADOOP-11959. WASB should configure client side socket timeout in storage - client blob request options. (Ivan Mitic via cnauroth) - - HADOOP-12042. Users may see TrashPolicy if hdfs dfs -rm is run - (Andreina J via vinayakumarb) - - HADOOP-11991. test-patch.sh isn't re-executed even if smart-apply-patch.sh - is modified. (Kengo Seki via aajisaka) - - HADOOP-12018. smart-apply-patch.sh fails if the patch edits CR+LF files - and is created by 'git diff --no-prefix'. (Kengo Seki via aajisaka) - - HADOOP-12019. update BUILDING.txt to include python for 'mvn site' - in windows (vinayakumarb) - - HADOOP-11994. smart-apply-patch wrongly assumes that git is infallible. - (Kengo Seki via Arpit Agarwal) - - HADOOP-11924. Tolerate JDK-8047340-related exceptions in - Shell#isSetSidAvailable preventing class init. (Tsuyoshi Ozawa via gera) - - HADOOP-12052 IPC client downgrades all exception types to IOE, breaks - callers trying to use them. (Brahma Reddy Battula via stevel) - - HADOOP-12054. RPC client should not retry for InvalidToken exceptions. - (Varun Saxena via Arpit Agarwal) - - HADOOP-12073. Azure FileSystem PageBlobInputStream does not return -1 on - EOF. (Ivan Mitic via cnauroth) - - HADOOP-7817. RawLocalFileSystem.append() should give FSDataOutputStream - with accurate .getPos() (kanaka kumar avvaru via vinayakumarb) - - HADOOP-12074. in Shell.java#runCommand() rethrow InterruptedException as - InterruptedIOException (Lavkesh Lahngir via vinayakumarb) - - HADOOP-12001. Fixed LdapGroupsMapping to include configurable Posix UID and - GID attributes during the search. (Patrick White via vinodkv) - - HADOOP-12095. org.apache.hadoop.fs.shell.TestCount fails. - (Brahma Reddy Battula via aajisaka) - - HADOOP-12076. Incomplete Cache Mechanism in CredentialProvider API. - (Larry McCay via cnauroth) - - HADOOP-12119. hadoop fs -expunge does not work for federated namespace - (J.Andreina via vinayakumarb) - - HADOOP-12089. StorageException complaining " no lease ID" when updating - FolderLastModifiedTime in WASB. (Duo Xu via cnauroth) - - HADOOP-12154. FileSystem#getUsed() returns the file length only from root '/' - (J.Andreina via vinayakumarb) - - HADOOP-10798. globStatus() should always return a sorted list of files - (cmccabe) - - HADOOP-12159. Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil - and fix for HA namespaces (rchiang via rkanter) - - HADOOP-12116. Fix unrecommended syntax usages in hadoop/hdfs/yarn script for - cygwin in branch-2. (Li Lu via cnauroth) - - HADOOP-12164. Fix TestMove and TestFsShellReturnCode failed to get command - name using reflection. (Lei (Eddy) Xu) - - HADOOP-12173. NetworkTopology::add calls toString always. - (Inigo Goiri via cdouglas) - - HADOOP-12185. NetworkTopology is not efficient adding/getting/removing - nodes. (Inigo Goiri via cdouglas) - - HADOOP-12117. Potential NPE from Configuration#loadProperty with - allowNullValueProperties set. (zhihai xu via vinayakumarb) - - HADOOP-12200. TestCryptoStreamsWithOpensslAesCtrCryptoCodec should be - skipped in non-native profile. (Masatake Iwasaki via aajisaka) - - HADOOP-10615. FileInputStream in JenkinsHash#main() is never closed. - (Chen He via ozawa) - - HADOOP-12240. Fix tests requiring native library to be skipped in non-native - profile. (Masatake Iwasaki via ozawa) - - HADOOP-12235 hadoop-openstack junit & mockito dependencies should be - "provided". (Ted Yu via stevel) - - HADOOP-12209 Comparable type should be in FileStatus. - (Yong Zhang via stevel) - - HADOOP-12088. KMSClientProvider uses equalsIgnoreCase("application/json"). - (Brahma Reddy Battula via stevel) - - HADOOP-11797. releasedocmaker.py needs to put ASF headers on output (aw) - - HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal - tags. (Akira AJISAKA via stevel). - - HADOOP-12386. RetryPolicies.RETRY_FOREVER should be able to specify a - retry interval. (Sunil G via wangda) - - HADOOP-8436. NPE In getLocalPathForWrite ( path, conf ) when the - required context item is not configured - (Brahma Reddy Battula via harsh) - - HADOOP-12252. LocalDirAllocator should not throw NPE with empty string - configuration. (Zhihai Xu) - - HADOOP-11918. Listing an empty s3a root directory throws FileNotFound. - (Lei (Eddy) Xu via cnauroth) - - HADOOP-12440. TestRPC#testRPCServerShutdown did not produce the desired - thread states before shutting down. (Xiao Chen via mingma) - - HADOOP-12447. Clean up some htrace integration issues (cmccabe) - - HADOOP-12448. TestTextCommand: use mkdirs rather than mkdir to create test - directory. (Contributed by Colin Patrick McCabe and Chris Nauroth) - - HADOOP-10296. Incorrect null check in SwiftRestClient#buildException(). - (Rahul Palamuttam and Kanaka Kumar Avvaru via aajisaka) - - HADOOP-8437. getLocalPathForWrite should throw IOException for invalid - paths. (Brahma Reddy Battula via zxu) - - HADOOP-11098. [JDK8] Max Non Heap Memory default changed between JDK7 - and 8. (ozawa) - - HADOOP-12284. UserGroupInformation doAs can throw misleading exception - (Aaron Dosset via stevel) - - HADOOP-12449. TestDNS and TestNetUtils failing if no network. (stevel) - - HADOOP-11515. Upgrade jsch lib to jsch-0.1.51 to avoid problems running - on java7. (stevel and ozawa) - - HADOOP-12478. Shell.getWinUtilsPath() has been renamed - Shell.getWinutilsPath(). (stevel) - - HADOOP-12475. Replace guava Cache with ConcurrentHashMap for caching - Connection in ipc Client (Walter Su via sjlee) - - HADOOP-12479. ProtocMojo does not log the reason for a protoc compilation - failure. (cnauroth) - - HADOOP-11628. SPNEGO auth does not work with CNAMEs in JDK8. - (Daryn Sharp via stevel). - - HADOOP-10941. Proxy user verification NPEs if remote host is unresolvable. - (Benoy Antony via stevel). - - HADOOP-12483. Maintain wrapped SASL ordering for postponed IPC responses. - (Daryn Sharp via yliu) - - HADOOP-12513. Dockerfile lacks initial 'apt-get update'. - (Akihiro Suda via ozawa) - - HADOOP-12457. [JDK8] Fix a failure of compiling common by javadoc. - (Akira AJISAKA via ozawa) - - HADOOP-12178. NPE during handling of SASL setup if problem with SASL - resolver class. (Steve Loughran via zxu) - - HADOOP-12519. hadoop-azure tests should avoid creating a metrics - configuration file in the module root directory. (cnauroth) - - HADOOP-9242. Duplicate surefire plugin config in hadoop-common. - (Andrey Klochkov via suresh) - - HADOOP-12533. Introduce FileNotFoundException in WASB for read and seek API. - (Dushyanth via cnauroth) - - HADOOP-12508. delete fails with exception when lease is held on blob. - (Gaurav Kanade via cnauroth) - - HADOOP-12542. TestDNS fails on Windows after HADOOP-12437. (cnauroth) - - HADOOP-12540. TestAzureFileSystemInstrumentation#testClientErrorMetrics - fails intermittently due to assumption that a lease error will be thrown. - (Gaurav Kanade via cnauroth) - - HADOOP-12560: Fix sprintf warnings in {{DomainSocket.c}} introduced by - HADOOP-12344 (Mingliang Liu via Colin P. McCabe) - - HADOOP-12567: NPE in SaslRpcServer (Sergey Shelukhin via cnauroth) - - HADOOP-8419. Fixed GzipCode NPE reset for IBM JDK. (Yu Li via eyang) - - HADOOP-11149. TestZKFailoverController times out. (Steve Loughran - via ozawa) - - HADOOP-9822. Create constant MAX_CAPACITY in RetryCache rather than - hard-coding 16 in RetryCache constructor. (Tsuyoshi Ozawa via wheat9) - - HADOOP-11954. Solaris does not support RLIMIT_MEMLOCK as in Linux - (Alan Burlison via aw) - - HADOOP-12598. Add XML namespace declarations for some hadoop/tools modules. - (Xin Wang via aajisaka) - - HADOOP-12468. Partial group resolution failure should not result in user - lockout. (Wei-Chiu Chuang via Yongjun Zhang) - - HADOOP-12656. MiniKdc throws "address in use" BindException. - (Wei-Chiu Chuang via Arpit Agarwal) - - HADOOP-12051. ProtobufRpcEngine.invoke() should use Exception.toString() - over getMessage() in logging/span events. (Varun Saxena via stevel) - - HADOOP-12017. Hadoop archives command should use configurable replication - factor when closing (Bibin A Chundatt via vinayakumarb) - - HADOOP-12239. StorageException complaining " no lease ID" when updating - FolderLastModifiedTime in WASB. (Duo Xu via cnauroth) - - HADOOP-12245. References to misspelled REMAINING_QUATA in - FileSystemShell.md. (Gabor Liptak via aajisaka) - - HADOOP-12175. FsShell must load SpanReceierHost to support tracing - (Masatake Iwasaki via Colin P. McCabe) - - HADOOP-10945. 4-digit octal umask permissions throws a parse error (Chang - Li via jlowe) - - HADOOP-7824. NativeIO.java flags and identifiers must be set correctly for - each platform, not hardcoded to their Linux values (Martin Walsh via Colin - P. McCabe) - - HADOOP-12268. AbstractContractAppendTest#testRenameFileBeingAppended - misses rename operation. (Zhihai Xu) - - HADOOP-12274. Remove direct download link from BULIDING.txt. - (Caleb Severn via aajisaka) - - HADOOP-12302. Fix native compilation on Windows after HADOOP-7824 - (Vinayakumar B via Colin P. McCabe) - - HADOOP-12258. Need translate java.nio.file.NoSuchFileException to - FileNotFoundException to avoid regression. (Zhihai Xu via cnauroth) - - HADOOP-12322. typos in rpcmetrics.java. (Anu Engineer via - Arpit Agarwal) - - HADOOP-12317. Applications fail on NM restart on some linux distro - because NM container recovery declares AM container as LOST - (adhoot via rkanter) - - HADOOP-12347. Fix mismatch parameter name in javadocs of - AuthToken#setMaxInactives (xyao) - - HADOOP-12362. Set hadoop.tmp.dir and hadoop.log.dir in pom. - (Charlie Helin via wang) - - HADOOP-10318. Incorrect reference to nodeFile in RumenToSLSConverter - error message. (Wei Yan via ozawa) - - HADOOP-12388. Fix components' version information in the web page - 'About the Cluster'. (Jun Gong via zxu) - - HADOOP-12407. Test failing: hadoop.ipc.TestSaslRPC. (stevel) - - HADOOP-12417. TestWebDelegationToken failing with port in use. - (Mingliang Liu via wheat9) - - HADOOP-12438. Reset RawLocalFileSystem.useDeprecatedFileStatus in - TestLocalFileSystem. (Chris Nauroth via wheat9) - - HADOOP-12437. Allow SecurityUtil to lookup alternate hostnames. - (Arpit Agarwal) - - HADOOP-12442. Display help if the command option to 'hdfs dfs' is not valid - (nijel via vinayakumarb) - - HADOOP-12441. Fixed shell-kill command behaviour to work correctly on some - Linux distributions after HADOOP-12317. (Wangda Tan via vinodkv) - - HADOOP-12474. MiniKMS should use random ports for Jetty server by default. - (Mingliang Liu via wheat9) - - HADOOP-12418. TestRPC.testRPCInterruptedSimple fails intermittently. - (kihwal) - - HADOOP-12334. Change Mode Of Copy Operation of HBase WAL Archiving to bypass - Azure Storage Throttling after retries. (Gaurav Kanade via cnauroth) - - HADOOP-12484. Single File Rename Throws Incorrectly In Potential Race - Condition Scenarios. (Gaurav Kanade via cnauroth) - - HADOOP-11901. BytesWritable fails to support 2G chunks due to integer - overflow. (Reynold Xin via wheat9) - - HADOOP-11218. Add TLSv1.1,TLSv1.2 to KMS, HttpFS, SSLFactory. - (Vijay Singh via wheat9) - - HADOOP-12467. Respect user-defined JAVA_LIBRARY_PATH in Windows Hadoop - scripts. (Radhey Shah via wheat9) - - HADOOP-12181. Fix intermittent test failure of TestZKSignerSecretProvider. - (Masatake Iwasaki via wheat9) - - HADOOP-12098. Remove redundant test dependencies in Hadoop Archives. - (Varun Saxena via wheat9) - - HADOOP-10068. Improve log4j regex in testFindContainingJar. - (Robert Rati via wheat9) - - HADOOP-11149. Increase the timeout of TestZKFailoverController. - (Steve Loughran via wheat9) - - HADOOP-11677. Add cookie flags for logs and static contexts. - (nijel via wheat9) - - HADOOP-12313. NPE in JvmPauseMonitor when calling stop() before start(). - (Gabor Liptak via wheat9) - - HADOOP-12609. Fix intermittent failure of TestDecayRpcScheduler. - (Masatake Iwasaki via Arpit Agarwal) - - HADOOP-10729. Add tests for PB RPC in case version mismatch of client and - server. (Junping Du via wheat9) - - HADOOP-12636. Prevent ServiceLoader failure init for unused FileSystems. - (Inigo Goiri via cdouglas) - - HADOOP-12681. start-build-env.sh fails in branch-2. - (Kengo Seki via aajisaka) - - HADOOP-12559. KMS connection failures should trigger TGT renewal. - (Zhe Zhang via xyao) - - HADOOP-12682. Fix TestKMS#testKMSRestart* failure. - (Wei-Chiu Chuang via xyao) - - HADOOP-12608. Fix exception message in WASB when connecting with anonymous - credential. (Dushyanth via xyao) - - HADOOP-12689. S3 filesystem operations stopped working correctly - (Matt Paduano via raviprak) - - HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to - address case of potential data loss due to partial copy - (Gaurav Kanade via cnauroth) - - HADOOP-12675. Fix description about retention period in usage of expunge - command. (Masatake Iwasaki via stevel) - - HADOOP-12678. Handle empty rename pending metadata file during atomic rename - in redo path. (Madhumita Chakraborty via cnauroth) - - HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API - (Dushyanth via cnauroth) - - HADOOP-12584. Disable browsing the static directory in HttpServer2. - (Robert Kanter via aajisaka) - - HADOOP-12603. TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir - occasionally fail. (Wei-Chiu Chuang via cnauroth) - - HADOOP-12590. TestCompressorDecompressor failing without stack traces - (John Zhuge via stevel) - - HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. - (John Zhuge via aajisaka) - - HADOOP-12356. Fix computing CPU usage statistics on Windows. - (Inigo Goiri via wangda) - - HADOOP-12423. Handle failure of registering shutdownhook by - ShutdownHookManager in static block (Abhishek Agarwal via vinayakumarb) - - HADOOP-7161. Remove unnecessary oro package from dependency management - section. (Sean Busbey via aajisaka) - - HADOOP-12659. Incorrect usage of config parameters in token manager of - KMS. (Mingliang Liu via xyao) - - HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly - documented as required. (Kengo Seki via aajisaka) - - HADOOP-12731. Remove useless boxing/unboxing code. - (Kousuke Saruta via aajisaka) - - HADOOP-12718. Incorrect error message by fs -put local dir without - permission. (John Zhuge via Yongjun Zhang) - - HADOOP-12735. core-default.xml misspells - hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe) - - HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. - (Xiaobing Zhou via xyao) - - HADOOP-12766. The default value of - "hadoop.workaround.non.threadsafe.getpwuid" is different between - core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe) - - HADOOP-12795. KMS does not log detailed stack trace for unexpected errors. - (cnauroth) - - HADOOP-12780. During atomic rename handle crash when one directory has been - renamed but not file under it. (Madhumita Chakraborty via cnauroth) - - HADOOP-12878. KMS SPNEGO sequence does not work with WEBHDFS. (xyao) - - HADOOP-12716. KerberosAuthenticator#doSpnegoSequence use incorrect class to - determine isKeyTab in JDK8. (Xiaoyu Yao via cnauroth) - - HADOOP-12849. TestSymlinkLocalFSFileSystem fails intermittently. - (Mingliang Liu via cnauroth) - - HADOOP-12846. Credential Provider Recursive Dependencies. - (Larry McCay via cnauroth) - - HADOOP-12813. Migrate TestRPC and related codes to rebase on - ProtobufRpcEngine. (Kai Zheng via wheat9) - - HADOOP-12851. S3AFileSystem Uptake of - ProviderUtils.excludeIncompatibleCredentialProviders. - (Larry McCay via cnauroth) - - HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka) - -Release 2.7.3 - UNRELEASED - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - HADOOP-12413. AccessControlList should avoid calling getGroupNames in - isUserInList with empty groups. (Zhihai Xu via cnauroth) - - HADOOP-12794. Support additional compression levels for GzipCodec. - (Ravi Mutyala via junping_du) - - OPTIMIZATIONS - - HADOOP-12810. FileSystem#listLocatedStatus causes unnecessary RPC calls - (Ryan Blue via vinayakumarb) - - BUG FIXES - - HADOOP-12296. when setnetgrent returns 0 in linux, exception should be - thrown (Chang Li via jlowe) - - HADOOP-12545. Hadoop javadoc has broken links for AccessControlList, - ImpersonationProvider, DefaultImpersonationProvider, and DistCp. - (Arshad Mohammad via aajisaka) - - HADOOP-12374. Updated expunge command description. - (WeiWei Yang via eyang) - - HADOOP-12348. MetricsSystemImpl creates MetricsSourceAdapter with wrong - time unit parameter. (zxu via rkanter) - - HADOOP-12482. Race condition in JMX cache update. (Tony Wu via lei) - - HADOOP-12565. Replace DSA with RSA for SSH key type in SingleCluster.md. - (Mingliang Liu via aajisaka) - - HADOOP-12602. TestMetricsSystemImpl#testQSize occasionally fails. - (Masatake Iwasaki via aajisaka) - - HADOOP-12588. Fix intermittent test failure of TestGangliaMetrics. - (Masatake Iwasaki via aajisaka) - - HADOOP-12107. long running apps may have a huge number of StatisticsData - instances under FileSystem (Sangjin Lee via Ming Ma) - - HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp - times out occasionally (Sangjin Lee and Colin Patrick McCabe via jlowe) - - HADOOP-12761. incremental maven build is not really incremental (sjlee) - - HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop - infinitely for invalid 'loc' values (Kuhu Shukla via kihwal) - - HADOOP-12792. TestUserGroupInformation#testGetServerSideGroups fails in - chroot (Eric Badger via jlowe) - - HADOOP-8818. Use equals instead == in MD5MD5CRC32FileChecksum - and TFileDumper. (Brandon Li via suresh) - - HADOOP-9121. InodeTree.java has redundant check for vName while - throwing exception. (Arup Malakar via suresh) - - HADOOP-12870. Fix typo admininistration in CommandsManual.md. - (John Zhuge via aajisaka) - - HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. - (Brahma Reddy Battula via aajisaka) - - HADOOP-12872. Fix formatting in ServiceLevelAuth.md. - (Brahma Reddy Battula via aajisaka) - -Release 2.7.2 - 2016-01-25 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - HADOOP-12232. Upgrade Tomcat dependency to 6.0.44. (cnauroth) - - HADOOP-5323. Trash documentation should describe its directory structure and - configurations. (Weiwei Yang via ozawa) - - OPTIMIZATIONS - - BUG FIXES - - HADOOP-12186. ActiveStandbyElector shouldn't call monitorLockNodeAsync - multiple times (zhihai xu via vinayakumarb) - - HADOOP-12191. Bzip2Factory is not thread safe. (Brahma Reddy Battula - via ozawa) - - HDFS-8767. RawLocalFileSystem.listStatus() returns null for UNIX pipefile. - (kanaka kumar avvaru via wheat9) - - HADOOP-12304. Applications using FileContext fail with the default file - system configured to be wasb/s3/etc. (cnauroth) - - HADOOP-12061. Incorrect command in single cluster setup document. - (Kengo Seki via aajisaka) - - HADOOP-12359. hadoop fs -getmerge doc is wrong. - (Jagadesh Kiran N via aajisaka) - - HADOOP-10365. BufferedOutputStream in FileUtil#unpackEntries() should be - closed in finally block. (Kiran Kumar M R and Sanghyun Yun via ozawa) - - HADOOP-12213. Interrupted exception can occur when Client#stop is called. - (Kuhu Shukla via ozawa) - - HADOOP-12451. Setting HADOOP_HOME explicitly should be allowed. (kasha) - - HADOOP-12230. hadoop-project declares duplicate, conflicting curator - dependencies. (Rakesh R via aajisaka) - - HADOOP-12465. Incorrect javadoc in WritableUtils.java. - (Jagadesh Kiran N via aajisaka) - - HADOOP-12464. Interrupted client may try to fail-over and retry (kihwal) - - HADOOP-12415. Fixed pom files to correctly include compile-time dependency on - netty. (Tom Zeng via cos) - - HADOOP-12786. "hadoop key" command usage is not documented. - (Xiao Chen via aajisaka) - -Release 2.7.1 - 2015-07-06 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - HADOOP-12103. Small refactoring of DelegationTokenAuthenticationFilter to - allow code sharing. (Yongjun Zhang) - - OPTIMIZATIONS - - BUG FIXES - - HADOOP-11868. Invalid user logins trigger large backtraces in server log - (Chang Li via jlowe) - - HADOOP-11872. "hadoop dfs" command prints message about using "yarn jar" on - Windows(branch-2 only) (Varun Vasudev via cnauroth) - - HADOOP-11891. OsSecureRandom should lazily fill its reservoir (asuresh) - - HADOOP-9658. SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when - native code is not loaded. (Zhijie Shen via ozawa) - - HADOOP-11663. Remove description about Java 6 from docs. - (Masatake Iwasaki via aajisaka) - - HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed - through hadoop-daemon.sh. (cnauroth) - - HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get - created with ACLs. (Gregory Chanan via asuresh) - - HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. - (Kazuho Fujii via aajisaka) - - HADOOP-12078. The default retry policy does not handle RetriableException - correctly. (Arpit Agarwal) - - HADOOP-12100. ImmutableFsPermission should not override applyUmask since - that method doesn't modify the FsPermission (Bibin A Chundatt via Colin P. - McCabe) - - HADOOP-12107. long running apps may have a huge number of StatisticsData - instances under FileSystem (Sangjin Lee via Ming Ma) - -Release 2.7.0 - 2015-04-20 - - INCOMPATIBLE CHANGES - - HADOOP-10530 Make hadoop build on Java7+ only (stevel) - - NEW FEATURES - - HADOOP-10987. Provide an iterator-based listing API for FileSystem (kihwal) - - HADOOP-7984. Add hadoop --loglevel option to change log level. - (Akira AJISAKA via cnauroth) - - HADOOP-9629. Support Windows Azure Storage - Blob as a file system in Hadoop. - (Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, - Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, - Alexander Stojanovic, Brian Swan, and Min Wei via cnauroth) - - HADOOP-10728. Metrics system for Windows Azure Storage Filesystem. - (Dexter Bradshaw, Mostafa Elhemali, Xi Fang, Johannes Klein, David Lao, - Mike Liddell, Chuan Liu, Lengning Liu, Ivan Mitic, Michael Rys, - Alexander Stojanovich, Brian Swan, and Min Wei via cnauroth) - - HADOOP-8989. hadoop fs -find feature (Jonathan Allen via aw) - - HADOOP-11490. Expose truncate API via FileSystem and shell command. - (Milan Desai via shv) - - HADOOP-11045. Introducing a tool to detect flaky tests of hadoop jenkins testing - job. (Yongjun Zhang and Todd Lipcon via ozawa) - - HADOOP-11510. Expose truncate API via FileContext. (yliu) - - HADOOP-11569. Provide Merge API for MapFile to merge multiple similar MapFiles - to one MapFile. (Vinayakumar B via ozawa) - - IMPROVEMENTS - - HADOOP-11483. HardLink.java should use the jdk7 createLink method (aajisaka) - - HADOOP-11156. DelegateToFileSystem should implement - getFsStatus(final Path f). (Zhihai Xu via wang) - - HADOOP-11172. Improve error message in Shell#runCommand on OutOfMemoryError. - (Yongjun Zhang via wang) - - HADOOP-10748. HttpServer2 should not load JspServlet. (wheat9) - - HADOOP-6857. FsShell should report raw disk usage including replication - factor. (Byron Wong via shv) - - HADOOP-10847. Remove the usage of sun.security.x509.* in testing code. - (Pascal Oliva via wheat9) - - HADOOP-10563. Remove the dependency of jsp in trunk. (wheat9) - - HADOOP-11291. Log the cause of SASL connection failures. - (Stephen Chu via cnauroth) - - HADOOP-11173. Improve error messages for some KeyShell commands. (wang) - - HADOOP-11257: Update "hadoop jar" documentation to warn against using it - for launching yarn jars (iwasakims via cmccabe) - - HADOOP-11341. KMS support for whitelist key ACLs. (Arun Suresh via wang) - - HADOOP-11301. [optionally] update jmx cache to drop old metrics - (Maysam Yabandeh via stack) - - HADOOP-11313. Adding a document about NativeLibraryChecker. - (Tsuyoshi OZAWA via cnauroth) - - HADOOP-11287. Simplify UGI#reloginFromKeytab for Java 7+. - (Li Lu via wheat9) - - HADOOP-10476) Bumping the findbugs version to 3.0.0. (wheat9) - - HADOOP-11410. Make the rpath of libhadoop.so configurable (cmccabe) - - HADOOP-11416. Move ChunkedArrayList into hadoop-common (cmccabe) - - HADOOP-10840. Fix OutOfMemoryError caused by metrics system in Azure File - System. (Shanyu Zhao via cnauroth) - - HADOOP-11248. Add hadoop configuration to disable Azure Filesystem metrics - collection. (Shanyu Zhao via cnauroth) - - HADOOP-11421. Add IOUtils#listDirectory (cmccabe) - - HADOOP-11427. ChunkedArrayList: fix removal via iterator and implement get - (cmccabe) - - HADOOP-11430. Add GenericTestUtils#disableLog, GenericTestUtils#setLogLevel - (cmccabe) - - HADOOP-11422. Check CryptoCodec is AES-CTR for Crypto input/output stream - (Yi Liu via Colin P. McCabe) - - HADOOP-11213. Typos in html pages: SecureMode and EncryptedShuffle. - (Wei Yan via kasha) - - HADOOP-11395. Add site documentation for Azure Storage FileSystem - integration. (Chris Nauroth via Arpit Agarwal) - - HDFS-7555. Remove the support of unmanaged connectors in HttpServer2. - (wheat9) - - HADOOP-11399. Java Configuration file and .xml files should be - automatically cross-compared (rchiang via rkanter) - - HADOOP-11455. KMS and Credential CLI should request confirmation for - deletion by default. (Charles Lamb via yliu) - - HADOOP-11390 Metrics 2 ganglia provider to include hostname in - unresolved address problems. (Varun Saxena via stevel) - - HADOOP-11032. Replace use of Guava's Stopwatch with Hadoop's StopWatch - (ozawa) - - HADOOP-11464. Reinstate support for launching Hadoop processes on Windows - using Cygwin. (cnauroth) - - HADOOP-9992. Modify the NN loadGenerator to optionally run as a MapReduce job - (Akshay Radia via brandonli) - - HADOOP-11465. Fix findbugs warnings in hadoop-gridmix. (Varun Saxena via - Arpit Agarwal) - - HADOOP-11481. ClassCastException while using a key created by keytool to - create encryption zone. (Charles Lamb via Colin P. McCabe) - - HADOOP-8757. Metrics should disallow names with invalid characters - (rchiang via rkanter) - - HADOOP-11261 Set custom endpoint for S3A. (Thomas Demoor via stevel) - - HADOOP-11171 Enable using a proxy server to connect to S3a. - (Thomas Demoor via stevel) - - HADOOP-11489 Dropping dependency on io.netty from hadoop-nfs' pom.xml - (Ted Yu via ozawa) - - HADOOP-11419 Improve hadoop-maven-plugins. (Herve Boutemy via stevel) - - HADOOP-11450. Cleanup DistCpV1 not to use deprecated methods and fix - javadocs. (Varun Saxena via ozawa) - - HADOOP-4297. Enable Java assertions when running tests. - (Tsz Wo Nicholas Sze via wheat9) - - HADOOP-10626. Limit Returning Attributes for LDAP search. (Jason Hubbard - via atm) - - HADOOP-11317. Increment SLF4J version to 1.7.10. (Tim Robertson via ozawa) - - HADOOP-10525. Remove DRFA.MaxBackupIndex config from log4j.properties - (aajisaka) - - HADOOP-10574. Bump the maven plugin versions too -moving the numbers into - properties. (aajisaka) - - HADOOP-11441. Hadoop-azure: Change few methods scope to public. - (Shashank Khandelwal via cnauroth) - - HADOOP-9137. Support connection limiting in IPC server (kihwal) - - HADOOP-11498. Bump the version of HTrace to 3.1.0-incubating (Masatake - Iwasaki via Colin P. McCabe) - - HADOOP-11442. hadoop-azure: Create test jar. - (Shashank Khandelwal via cnauroth) - - HADOOP-11544. Remove unused configuration keys for tracing. (Masatake - Iwasaki via aajisaka) - - HADOOP-11492. Bump up curator version to 2.7.1. (Arun Suresh and - Karthik Kambatla via kasha) - - HADOOP-11463 Replace method-local TransferManager object with - S3AFileSystem#transfers. (Ted Yu via stevel) - - HADOOP-11520. Clean incomplete multi-part uploads in S3A tests. - (Thomas Demoor via stevel) - - HADOOP-11579. Documentation for truncate. (shv) - - HADOOP-10140. Specification of HADOOP_CONF_DIR via the environment in - hadoop_config.cmd. (Kiran Kumar M R via cnauroth) - - HADOOP-11543. Improve help message for hadoop/yarn command. (Brahma - Reddy Battula via ozawa). - - HADOOP-11586. Update use of Iterator to Iterable in - AbstractMetricsContext.java. (Ray Chiang via aajisaka) - - HADOOP-9869. Configuration.getSocketAddr()/getEnum() should use - getTrimmed(). (Tsuyoshi Ozawa via aajisaka) - - HADOOP-11589. NetUtils.createSocketAddr should trim the input URI. - (Rakesh R via ozawa) - - HADOOP-11600. Fix up source codes to be compiled with Guava 17.0. (ozawa) - - HADOOP-11522. Update S3A Documentation. (Thomas Demoor via stevel) - - HADOOP-11521. Make connection timeout configurable in s3a. - (Thomas Demoor via stevel) - - HADOOP-11440. Use "test.build.data" instead of "build.test.dir" for testing - in ClientBaseWithFixes. (Kengo Seki via aajisaka) - - HADOOP-11607. Reduce log spew in S3AFileSystem. (Lei (Eddy) Xu via stevel) - - HADOOP-11495. Convert site documentation from apt to markdown - (Masatake Iwasaki via aw) - - HADOOP-11632. Cleanup Find.java to remove SupressWarnings annotations. - (Akira Ajisaka via ozawa) - - HADOOP-10976. moving the source code of hadoop-tools docs to the - directory under hadoop-tools (Masatake Iwasaki via aw) - - HADOOP-11658. Externalize io.compression.codecs property. - (Kai Zheng via aajisaka) - - HADOOP-11648. Set DomainSocketWatcher thread name explicitly. - (Liang Xie via ozawa) - - HADOOP-11642. Upgrade azure sdk version from 0.6.0 to 2.0.0. - (Shashank Khandelwal and Ivan Mitic via cnauroth) - - HADOOP-11714. Add more trace log4j messages to SpanReceiverHost (cmccabe) - - HADOOP-8059. Add javadoc to InterfaceAudience and InterfaceStability. - (Brandon Li via suresh) - - HADOOP-9329. document native build dependencies in BUILDING.txt (Vijay Bhat - via Colin P. McCabe) - - HADOOP-10670. Allow AuthenticationFilters to load secret from signature - secret files. (Kai Zheng via wheat9) - - HADOOP-11801. Update BUILDING.txt for Ubuntu. (Gabor Liptak via - Arpit Agarwal) - - HADOOP-9737. JarFinder#getJar should delete the jar file upon destruction - of the JVM (jbonofre via rkanter) - - OPTIMIZATIONS - - HADOOP-11323. WritableComparator#compare keeps reference to byte array. - (Wilfred Spiegelenburg via wang) - - HADOOP-10809. hadoop-azure: page blob support. (Dexter Bradshaw, - Mostafa Elhemali, Eric Hanson, and Mike Liddell via cnauroth) - - HADOOP-11188. hadoop-azure: automatically expand page blobs when they become - full. (Eric Hanson via cnauroth) - - HADOOP-11231. Remove dead code in ServletUtil. (Li Lu via wheat9) - - HADOOP-11620. Add support for load balancing across a group of KMS for HA. - (Arun Suresh via wang) - - HADOOP-11183. Memory-based S3AOutputstream. (Thomas Demoor via stevel) - - HADOOP-11633. Convert remaining branch-2 .apt.vm files to markdown. - (Masatake Iwasaki via wheat9) - - BUG FIXES - - HADOOP-11512. Use getTrimmedStrings when reading serialization keys - (Ryan P via harsh) - - HADOOP-11488. Difference in default connection timeout for S3A FS - (Daisuke Kobayashi via harsh) - - HADOOP-11256. Some site docs have inconsistent appearance (Masatake - Iwasaki via aw) - - HADOOP-11318. Update the document for hadoop fs -stat (aajisaka) - - HADOOP 11400. GraphiteSink does not reconnect to Graphite after 'broken pipe' - (Kamil Gorlo via raviprak) - - HADOOP-11236. NFS: Fix javadoc warning in RpcProgram.java (Abhiraj Butala via harsh) - - HADOOP-11166. Remove ulimit from test-patch.sh. (wang) - - HDFS-7227. Fix findbugs warning about NP_DEREFERENCE_OF_READLINE_VALUE in - SpanReceiverHost (cmccabe) - - HADOOP-11186. documentation should talk about - hadoop.htrace.spanreceiver.classes, not hadoop.trace.spanreceiver.classes (cmccabe) - - HADOOP-11165. TestUTF8 fails when run against java 8. - (Stephen Chu via cnauroth) - - HADOOP-10717. HttpServer2 should load jsp DTD from local jars instead of - going remote. (Dapeng Sun via wheat9) - - HADOOP-11268. Update BUILDING.txt to remove the workaround for tools.jar. - (Li Lu via wheat9) - - HADOOP-11230. Add missing dependency of bouncycastle for kms, httpfs, hdfs, MR - and YARN. (Robert Kanter via wheat9) - - HADOOP-11269. Add java 8 profile for hadoop-annotations. (Li Lu via wheat9) - - HADOOP-11271. Use Time.monotonicNow() in Shell.java instead of Time.now() - (vinayakumarb) - - HADOOP-11266. Remove no longer supported activation properties for packaging - from pom. (Masatake Iwasaki via wheat9) - - HADOOP-11267. TestSecurityUtil fails when run with JDK8 because of empty - principal names. (Stephen Chu via wheat9) - - HADOOP-10714. AmazonS3Client.deleteObjects() need to be limited to 1000 - entries per call. (Juan Yu via atm) - - HADOOP-11272. Allow ZKSignerSecretProvider and - ZKDelegationTokenSecretManager to use the same curator client. (Arun Suresh via atm) - - HADOOP-11187 NameNode - KMS communication fails after a long period of - inactivity. (Arun Suresh via atm) - - HADOOP-11289. Fix typo in RpcUtil log message. (Charles Lamb via wheat9) - - HADOOP-11294. Nfs3FileAttributes should not change the values of rdev, - nlink and size in the constructor. (Brandon Li via wheat9) - - HADOOP-11157. ZKDelegationTokenSecretManager never shuts down - listenerThreadPool. (Arun Suresh via atm) - - HADOOP-11311. Restrict uppercase key names from being created with JCEKS. - (wang) - - HADOOP-11309. System class pattern package.Foo should match - package.Foo$Bar, too (Gera Shegalov via jlowe) - - HADOOP-11312. Fix unit tests to not use uppercase key names. (wang) - - HADOOP-11201. Hadoop Archives should support globs resolving to files. - (Gera Shegalov via cnauroth) - - HADOOP-11322. key based ACL check in KMS always check KeyOpType.MANAGEMENT - even actual KeyOpType is not MANAGEMENT. (Dian Fu via yliu) - - HADOOP-11300. KMS startup scripts must not display the keystore / - truststore passwords. (Arun Suresh via wang) - - HADOOP-11257. Update "hadoop jar" documentation to warn against using it - for launching yarn jars (iwasakims via cmccabe) - - HADOOP-11337. KeyAuthorizationKeyProvider access checks need to be done - atomically. (Dian Fu via wang) - - HADOOP-11344. KMS kms-config.sh sets a default value for the keystore - password even in non-ssl setup. (Arun Suresh via wang) - - HADOOP-11342. KMS key ACL should ignore ALL operation for default key ACL - and whitelist key ACL. (Dian Fu via wang) - - HADOOP-11332. KerberosAuthenticator#doSpnegoSequence should check if - kerberos TGT is available in the subject. (Dian Fu via atm) - - HADOOP-11348. Remove unused variable from CMake error message for finding - openssl (Dian Fu via Colin P. McCabe) - - HADOOP-11355. When accessing data in HDFS and the key has been deleted, - a Null Pointer Exception is shown. (Arun Suresh via wang) - - HADOOP-11354. ThrottledInputStream doesn't perform effective throttling. - (Ted Yu via jing9) - - HADOOP-11329. Add JAVA_LIBRARY_PATH to KMS startup options. (Arun Suresh via wang) - - HADOOP-11363 Hadoop maven surefire-plugin uses must set heap size. (stevel) - - HADOOP-10134 [JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc - comments. (apurtell via stevel) - - HADOOP-11367. Fix warnings from findbugs 3.0 in hadoop-streaming. (Li Lu via wheat9) - - HADOOP-11369. Fix new findbugs warnings in hadoop-mapreduce-client, - non-core directories. (Li Lu via wheat9) - - HADOOP-11372. Fix new findbugs warnings in mapreduce-examples. - (Li Lu via wheat9) - - HADOOP-11273. TestMiniKdc failure: login options not compatible with IBM - JDK. (Gao Zhong Liang via wheat9) - - HADOOP-11379. Fix new findbugs warnings in hadoop-auth*. (Li Lu via wheat9) - - HADOOP-11378. Fix new findbugs warnings in hadoop-kms. (Li Lu via wheat9) - - HADOOP-11349. RawLocalFileSystem leaks file descriptor while creating a - file if creat succeeds but chmod fails. (Varun Saxena via Colin P. McCabe) - - HADOOP-11381. Fix findbugs warnings in hadoop-distcp, hadoop-aws, - hadoop-azure, and hadoop-openstack. (Li Lu via wheat9) - - HADOOP-10482. Fix various findbugs warnings in hadoop-common. (wheat9) - - HADOOP-11388. Remove deprecated o.a.h.metrics.file.FileContext. - (Li Lu via wheat9) - - HADOOP-11386. Replace \n by %n in format hadoop-common format strings. - (Li Lu via wheat9) - - HADOOP-11211. mapreduce.job.classloader.system.classes semantics should be - be order-independent. (Yitong Zhou via gera) - - HADOOP-11389. Clean up byte to string encoding issues in hadoop-common. - (wheat9) - - HADOOP-11394. hadoop-aws documentation missing. (cnauroth) - - HADOOP-11396. Provide navigation in the site documentation linking to the - Hadoop Compatible File Systems. (cnauroth) - - HADOOP-11412 POMs mention "The Apache Software License" rather than - "Apache License". (Herve Boutemy via stevel) - - HADOOP-11321. copyToLocal cannot save a file to an SMB share unless the user - has Full Control permissions. (cnauroth) - - HADOOP-11420. Use latest maven-site-plugin and replace link to svn with - link to git. (Herve Boutemy via wheat9) - - HADOOP-10689. InputStream is not closed in - AzureNativeFileSystemStore#retrieve(). (Chen He via cnauroth) - - HADOOP-10690. Lack of synchronization on access to InputStream in - NativeAzureFileSystem#NativeAzureFsInputStream#close(). - (Chen He via cnauroth) - - HADOOP-10946. Fix a bunch of typos in log messages (Ray Chiang via aw) - - HADOOP-11358. Tests for encryption/decryption with IV calculation - overflow. (yliu) - - HADOOP-11125. Remove redundant tests in TestOsSecureRandom. - (Masanori Oyama via wheat9) - - HADOOP-11385. Prevent cross site scripting attack on JMXJSONServlet. - (wheat9) - - HADOOP-11409. FileContext.getFileContext can stack overflow if default fs - misconfigured (Gera Shegalov via jlowe) - - HADOOP-11428. Remove obsolete reference to Cygwin in BUILDING.txt. - (Arpit Agarwal via wheat9) - - HADOOP-11431. clean up redundant maven-site-plugin configuration. - (Herve Boutemy via wheat9) - - HADOOP-11429. Findbugs warnings in hadoop extras. - (Varun Saxena via wheat9) - - HADOOP-11414. FileBasedIPList#readLines() can leak file descriptors. - (ozawa) - - HADOOP-11283. SequenceFile.Writer can leak file descriptors in - DistCpV1#setup(). (Varun Saxena via ozawa) - - HADOOP-11448. Fix findbugs warnings in FileBasedIPList. (ozawa) - - HADOOP-11039. ByteBufferReadable API doc is inconsistent with the - implementations. (Yi Liu via Colin P. McCabe) - - HADOOP-11446. S3AOutputStream should use shared thread pool to - avoid OutOfMemoryError. (Ted Yu via stevel) - - HADOOP-11459. Fix recent findbugs in ActiveStandbyElector, NetUtils - and ShellBasedIdMapping (vinayakumarb) - - HADOOP-11445. Bzip2Codec: Data block is skipped when position of newly - created stream is equal to start of split (Ankit Kamboj via jlowe) - - HADOOP-11462. TestSocketIOWithTimeout needs change for PowerPC platform. - (Ayappan via cnauroth) - - HADOOP-10542 Potential null pointer dereference in Jets3tFileSystemStore - retrieveBlock(). (Ted Yu via stevel) - - HADOOP-10668. TestZKFailoverControllerStress#testExpireBackAndForth - occasionally fails. (Ming Ma via cnauroth) - - HADOOP-11327. BloomFilter#not() omits the last bit, resulting in an - incorrect filter (Eric Payne via jlowe) - - HADOOP-11209. Configuration#updatingResource/finalParameters are not - thread-safe. (Varun Saxena via ozawa) - - HADOOP-11500. InputStream is left unclosed in ApplicationClassLoader. - (Ted Yu via ozawa) - - HADOOP-11008. Remove duplicated description about proxy-user in site - documents (Masatake Iwasaki via aw) - - HADOOP-11493. Fix some typos in kms-acls.xml description. - (Charles Lamb via aajisaka) - - HADOOP-11507 Hadoop RPC Authentication problem with different user locale. - (Talat UYARER via stevel) - - HADOOP-11499. Check of executorThreadsStarted in - ValueQueue#submitRefillTask() evades lock acquisition (Ted Yu via jlowe) - - HADOOP-6221 RPC Client operations cannot be interrupted. (stevel) - - HADOOP-11509. Change parsing sequence in GenericOptionsParser to parse -D - parameters before -files. (xgong) - - HADOOP-11469. KMS should skip default.key.acl and whitelist.key.acl when - loading key acl. (Dian Fu via yliu) - - HADOOP-11316. "mvn package -Pdist,docs -DskipTests -Dtar" fails because - of non-ascii characters. (ozawa) - - HADOOP-9907. Webapp http://hostname:port/metrics link is not working. - (aajisaka) - - HADOOP-11403. Avoid using sys_errlist on Solaris, which lacks support for it - (Malcolm Kavalsky via Colin P. McCabe) - - HADOOP-11523. StorageException complaining " no lease ID" when updating - FolderLastModifiedTime in WASB. (Duo Xu via cnauroth) - - HADOOP-11432. Fix SymlinkBaseTest#testCreateLinkUsingPartQualPath2. - (Liang Xie via gera) - - HADOOP-10181. GangliaContext does not work with multicast ganglia setup. - (Andrew Johnson via cnauroth) - - HADOOP-11529. Fix findbugs warnings in hadoop-archives. - (Masatake Iwasaki via wheat9) - - HADOOP-11546. Checkstyle failing: Unable to instantiate - DoubleCheckedLockingCheck. (ozawa) - - HADOOP-11548. checknative should display a nicer error message when openssl - support is not compiled in. (Anu Engineer via cnauroth) - - HADOOP-11547. hadoop-common native compilation fails on Windows due to - missing support for __attribute__ declaration. (cnauroth) - - HADOOP-11549. flaky test detection tool failed to handle special control - characters in test result. (Yongjun Zhang via aajisaka) - - HADOOP-10062. race condition in MetricsSystemImpl#publishMetricsNow that - causes incorrect results. (Sangjin Lee via junping_du) - - HADOOP-11526. Memory leak in Bzip2Compressor and Bzip2Decompressor. - (Anu Engineer via cnauroth) - - HADOOP-11535 TableMapping related tests failed due to 'successful' - resolving of invalid test hostname. (Kai Zheng via stevel) - - HADOOP-10953. NetworkTopology#add calls NetworkTopology#toString without - holding the netlock (Liang Xie via Colin P. McCabe) - - HADOOP-11587. TestMapFile#testMainMethodMapFile creates test files in - hadoop-common project root. (Xiaoyu Yao via wheat9) - - HADOOP-11497. Fix typo in ClusterSetup.html#Hadoop_Startup(Christian - Winkler via ozawa). - - HADOOP-11467. KerberosAuthenticator can connect to a non-secure cluster. - (yzhangal via rkanter) - - HADOOP-11000. HAServiceProtocol's health state is incorrectly transitioned - to SERVICE_NOT_RESPONDING (Ming Ma via vinayakumarb) - - HADOOP-11570. S3AInputStream.close() downloads the remaining bytes of - the object from S3. (Dan Hecht via stevel). - - HADOOP-11599. Client#getTimeout should use IPC_CLIENT_PING_DEFAULT when - IPC_CLIENT_PING_KEY is not configured. (zhihai xu via ozawa) - - HADOOP-11545. ArrayIndexOutOfBoundsException is thrown with "hadoop - credential list -provider". (Brahma Reddy Battula via aajisaka) - - HADOOP-11595. Add default implementation for AbstractFileSystem#truncate. - (yliu) - - HADOOP-9087. Queue size metric for metric sinks isn't actually maintained - (Akira AJISAKA via jlowe) - - HADOOP-11612. Workaround for Curator's ChildReaper requiring Guava 15+. - (rkanter) - - HADOOP-11584 s3a file block size set to 0 in getFileStatus. - (Brahma Reddy Battula via stevel) - - HADOOP-10478. Fix new findbugs warnings in hadoop-maven-plugins. - (Li Lu via wheat9) - - HADOOP-8642. Document that io.native.lib.available only controls native bz2 - and zlib compression codecs. (aajisaka) - - HADOOP-11619. FTPFileSystem should override getDefaultPort. - (Brahma Reddy Battula via gera) - - HADOOP-11480. Typo in hadoop-aws/index.md uses wrong scheme for - test.fs.s3.name. (Ted Yu via aajisaka) - - HADOOP-11629. WASB filesystem should not start BandwidthGaugeUpdater if - fs.azure.skip.metrics set to true. (Shanyu Zhao via cnauroth) - - HADOOP-9922. hadoop windows native build will fail in 32 bit machine. - (Kiran Kumar M R via cnauroth) - - HADOOP-11634. Description of webhdfs' principal/keytab should switch places - each other. (Brahma Reddy Battula via ozawa) - - HADOOP-11615. Update ServiceLevelAuth.md for YARN. - (Brahma Reddy Battula via aajisaka) - - HADOOP-11605. FilterFileSystem#create with ChecksumOpt should propagate it - to wrapped FS. (gera) - - HADOOP-11666. Revert the format change of du output introduced by - HADOOP-6857. (Byron Wong via aajisaka) - - HADOOP-11670. Regression: s3a auth setup broken. (Adam Budde via stevel) - - HADOOP-11602. Fix toUpperCase/toLowerCase to use Locale.ENGLISH. (ozawa) - - HADOOP-11686. MiniKDC cannot change ORG_NAME or ORG_DOMAIN. - (Duo Zhang via wheat9) - - HADOOP-11618. DelegateToFileSystem erroneously uses default FS's port in - constructor. (Brahma Reddy Battula via gera) - - HADOOP-11693. Azure Storage FileSystem rename operations are throttled too - aggressively to complete HBase WAL archiving. (Duo Xu via cnauroth) - - HADOOP-11558. Fix dead links to doc of hadoop-tools. (Jean-Pierre - Matsumoto via ozawa) - - HADOOP-11638. OpensslSecureRandom.c pthreads_thread_id should support FreeBSD - and Solaris in addition to Linux. (Kiran Kumar M R via cnauroth) - - HADOOP-11720. [JDK8] Fix javadoc errors caused by incorrect or illegal - tags in hadoop-tools. (Akira AJISAKA via ozawa) - - HADOOP-11722. Some Instances of Services using - ZKDelegationTokenSecretManager go down when old token cannot be deleted. - (Arun Suresh via atm) - - HADOOP-10703. HttpServer2 creates multiple authentication filters. - (Benoy Antony via wheat9) - - HADOOP-11729. Fix link to cgroups doc in site.xml. (Masatake Iwasaki via - ozawa) - - HADOOP-11609. Correct credential commands info in - CommandsManual.html#credential. (Varun Saxena via ozawa) - - HADOOP-11014. Potential resource leak in JavaKeyStoreProvider due to - unclosed stream. (ozawa) - - HADOOP-11738. Fix a link of Protocol Buffers 2.5 for download in BUILDING.txt. - (ozawa) - - HADOOP-11748. The secrets of auth cookies should not be specified in - configuration in clear text. (Li Lu and Haohui Mai via wheat9) - - HADOOP-11691. X86 build of libwinutils is broken. - (Kiran Kumar M R via cnauroth) - - HADOOP-11639. Clean up Windows native code compilation warnings related to - Windows Secure Container Executor. (Remus Rusanu via cnauroth) - - HADOOP-11761. Fix findbugs warnings in org.apache.hadoop.security - .authentication. (Li Lu via wheat9) - - HADOOP-11754. RM fails to start in non-secure mode due to authentication - filter failure. (wheat9) - - HADOOP-11787. OpensslSecureRandom.c pthread_threadid_np usage signature is - wrong on 32-bit Mac. (Kiran Kumar M R via cnauroth) - - HADOOP-11757. NFS gateway should shutdown when it can't start UDP or TCP - server (brandonli) - - HADOOP-11377. Added Null.java without which jdiff completely flops. (Tsuyoshi - Ozawa via vinodkv) - - HADOOP-11776. Fixed the broken JDiff support in Hadoop 2. (Li Lu via vinodkv) - - HADOOP-11796. Skip TestShellBasedIdMapping.testStaticMapUpdate on Windows. - (Xiaoyu Yao via cnauroth) - - HADOOP-11815. HttpServer2 should destroy SignerSecretProvider when it - stops. (Rohith via wheat9) - - HADOOP-11837. AuthenticationFilter should destroy SignerSecretProvider in - Tomcat deployments. (Bowen Zhang via wheat9) - -Release 2.6.5 - UNRELEASED - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - HADOOP-12805. Annotate CanUnbuffer with @InterfaceAudience.Public - (Ted Yu via vinayakumarb) - - OPTIMIZATIONS - - BUG FIXES - - HADOOP-12773. HBase classes fail to load with client/job classloader - enabled (sjlee) - - HADOOP-12589. Fix intermittent test failure of TestCopyPreserveFlag - (iwasakims) - -Release 2.6.4 - 2016-02-11 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - OPTIMIZATIONS - - BUG FIXES - - HADOOP-11252. RPC client does not time out by default. - (Wilfred Spiegelenburg and Masatake Iwasaki via aajisaka) - - HADOOP-12107. long running apps may have a huge number of StatisticsData - instances under FileSystem (Sangjin Lee via Ming Ma) - - HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp - times out occasionally (Sangjin Lee and Colin Patrick McCabe via jlowe) - - HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks - sometimes times out. (Xiao Chen via aajisaka) - - HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. - (Xiao Chen via waltersu4549) - -Release 2.6.3 - 2015-12-17 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - HADOOP-12413. AccessControlList should avoid calling getGroupNames in - isUserInList with empty groups. (Zhihai Xu via cnauroth) - - OPTIMIZATIONS - - BUG FIXES - - HADOOP-12526. there are duplicate dependency definitions in pom's (sjlee) - - HADOOP-12577. Bumped up commons-collections version to 3.2.2 to address a - security flaw. (Wei-Chiu Chuang via vinodkv) - -Release 2.6.2 - 2015-10-28 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - OPTIMIZATIONS - - BUG FIXES - -Release 2.6.1 - 2015-09-23 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - IMPROVEMENTS - - HADOOP-7139. Allow appending to existing SequenceFiles - (kanaka kumar avvaru via vinayakumarb) - - HADOOP-12280. Skip unit tests based on maven profile rather than - NativeCodeLoader.isNativeCodeLoaded (Masatake Iwasaki via Colin P. McCabe) - - OPTIMIZATIONS - - HADOOP-11238. Update the NameNode's Group Cache in the background when - possible (Chris Li via Colin P. McCabe) - - HADOOP-11506. Configuration variable expansion regex expensive for long - values. (Gera Shegalov via gera) - - BUG FIXES - - HADOOP-11466: FastByteComparisons: do not use UNSAFE_COMPARER on the SPARC - architecture because it is slower there (Suman Somasundar via Colin P. - McCabe) - - HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. (Stephen Chu via wheat9) - - HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification - pipe is full (zhaoyunjiong via cmccabe) - - HADOOP-11343. Overflow is not properly handled in caclulating final iv for - AES CTR. (Jerry Chen via wang) - - HADOOP-11368. Fix SSLFactory truststore reloader thread leak in - KMSClientProvider. (Arun Suresh via wang) - - HADOOP-11350. The size of header buffer of HttpServer is too small when - HTTPS is enabled. (Benoy Antony via wheat9) - - HADOOP-11482. Use correct UGI when KMSClientProvider is called by a proxy - user. Contributed by Arun Suresh. - - HADOOP-11295. RPC Server Reader thread can't shutdown if RPCCallQueue is - full. (Ming Ma via kihwal) - - HADOOP-11604. Prevent ConcurrentModificationException while closing domain - sockets during shutdown of DomainSocketWatcher thread. (cnauroth) - - HADOOP-11674. oneByteBuf in CryptoInputStream and CryptoOutputStream - should be non static. (Sean Busbey via yliu) - - HADOOP-11710. Make CryptoOutputStream behave like DFSOutputStream wrt - synchronization. (Sean Busbey via yliu) - - HADOOP-11812. Implement listLocatedStatus for ViewFileSystem to speed up - split calculation (gera) - - HADOOP-11730. Regression: s3n read failure recovery broken. - (Takenori Sato via stevel) - - HADOOP-11802: DomainSocketWatcher thread terminates sometimes after there - is an I/O error during requestShortCircuitShm (cmccabe) - - HADOOP-11491. HarFs incorrectly declared as requiring an authority. - (Brahma Reddy Battula via gera) - - HADOOP-8151. Error handling in snappy decompressor throws invalid - exceptions. (Matt Foley via harsh) - - HADOOP-11932. MetricsSinkAdapter may hang when being stopped. - (Brahma Reddy Battula via jianhe) - - HADOOP-11934. Use of JavaKeyStoreProvider in LdapGroupsMapping causes - infinite loop. (Larry McCay via cnauroth) - -Release 2.6.0 - 2014-11-18 - - INCOMPATIBLE CHANGES - - NEW FEATURES - - HADOOP-10433. Key Management Server based on KeyProvider API. (tucu) - - HADOOP-10893. isolated classloader on the client side (Sangjin Lee via - jlowe) - - HADOOP-10400. Incorporate new S3A FileSystem implementation. (Jordan - Mendelson and Dave Wang via atm) - - IMPROVEMENTS - - HADOOP-10808. Remove unused native code for munlock. (cnauroth) - - HADOOP-10815. Implement Windows equivalent of mlock. (cnauroth) - - HADOOP-7664. Remove warmings when overriding final parameter configuration - if the override value is same as the final parameter value. - (Ravi Prakash via suresh) - - HADOOP-10673. Update rpc metrics when the call throws an exception. (Ming Ma - via jing9) - - HADOOP-10845. Add common tests for ACLs in combination with viewfs. - (Stephen Chu via cnauroth) - - HADOOP-10839. Add unregisterSource() to MetricsSystem API. - (Shanyu Zhao via cnauroth) - - HADOOP-10607. Create an API to separate credentials/password storage - from applications (Larry McCay via omalley) - - HADOOP-10732. Fix locking in credential update. (Ted Yu via omalley) - - HADOOP-10733. Fix potential null dereference in CredShell. (Ted Yu via - omalley) - - HADOOP-10610. Upgrade S3n s3.fs.buffer.dir to support multi directories. - (Ted Malaska via atm) - - HADOOP-10817. ProxyUsers configuration should support configurable - prefixes. (tucu) - - HADOOP-10755. Support negative caching of user-group mapping. - (Lei Xu via wang) - - HADOOP-10855. Allow Text to be read with a known Length. (todd) - - HADOOP-10887. Add XAttrs to ViewFs and make XAttrs + ViewFileSystem - internal dir behavior consistent. (Stephen Chu via wang) - - HADOOP-10882. Move DirectBufferPool into common util. (todd) - - HADOOP-8069. Enable TCP_NODELAY by default for IPC. (Todd Lipcon via - Arpit Agarwal) - - HADOOP-10902. Deletion of directories with snapshots will not output - reason for trash move failure. (Stephen Chu via wang) - - HADOOP-10900. CredentialShell args should use single-dash style. (wang) - - HADOOP-10903. Enhance hadoop classpath command to expand wildcards or write - classpath into jar manifest. (cnauroth) - - HADOOP-10791. AuthenticationFilter should support externalizing the - secret for signing and provide rotation support. (rkanter via tucu) - - HADOOP-10771. Refactor HTTP delegation support out of httpfs to common. - (tucu) - - HADOOP-10835. Implement HTTP proxyuser support in HTTP authentication - client/server libraries. (tucu) - - HADOOP-10820. Throw an exception in GenericOptionsParser when passed - an empty Path. (Alex Holmes and Zhihai Xu via wang) - - HADOOP-10281. Create a scheduler, which assigns schedulables a priority - level. (Chris Li via Arpit Agarwal) - - HADOOP-8944. Shell command fs -count should include human readable option - (Jonathan Allen via aw) - - HADOOP-10231. Add some components in Native Libraries document (Akira - AJISAKA via aw) - - HADOOP-10650. Add ability to specify a reverse ACL (black list) of users - and groups. (Benoy Antony via Arpit Agarwal) - - HADOOP-10335. An ip whilelist based implementation to resolve Sasl - properties per connection. (Benoy Antony via Arpit Agarwal) - - HADOOP-10975. org.apache.hadoop.util.DataChecksum should support calculating - checksums in native code (James Thomas via Colin Patrick McCabe) - - HADOOP-10201. Add listing to KeyProvider API. (Larry McCay via omalley) - - HADOOP-10177. Create CLI tools for managing keys. (Larry McCay via omalley) - - HADOOP-10432. Refactor SSLFactory to expose static method to determine - HostnameVerifier. (tucu) - - HADOOP-10429. KeyStores should have methods to generate the materials - themselves, KeyShell should use them. (tucu) - - HADOOP-10427. KeyProvider implementations should be thread safe. (tucu) - - HADOOP-10428. JavaKeyStoreProvider should accept keystore password via - configuration falling back to ENV VAR. (tucu) - - HADOOP-10430. KeyProvider Metadata should have an optional description, - there should be a method to retrieve the metadata from all keys. (tucu) - - HADOOP-10431. Change visibility of KeyStore.Options getter methods to - public. (tucu) - - HADOOP-10534. KeyProvider getKeysMetadata should take a list of names - rather than returning all keys. (omalley) - - HADOOP-10719. Add generateEncryptedKey and decryptEncryptedKey - methods to KeyProvider. (asuresh via tucu) - - HADOOP-10817. ProxyUsers configuration should support configurable - prefixes. (tucu) - - HADOOP-10881. Clarify usage of encryption and encrypted encryption - key in KeyProviderCryptoExtension. (wang) - - HADOOP-10770. KMS add delegation token support. (tucu) - - HADOOP-10698. KMS, add proxyuser support. (tucu) - - HADOOP-8896. Javadoc points to Wrong Reader and Writer classes - in SequenceFile (Ray Chiang via aw) - - HADOOP-10998. Fix bash tab completion code to work (Jim Hester via aw) - - HADOOP-10880. Move HTTP delegation tokens out of URL querystring to - a header. (tucu) - - HADOOP-11005. Fix HTTP content type for ReconfigurationServlet. - (Lei Xu via wang) - - HADOOP-10814. Update Tomcat version used by HttpFS and KMS to latest - 6.x version. (rkanter via tucu) - - HADOOP-10994. KeyProviderCryptoExtension should use CryptoCodec for - generation/decryption of keys. (tucu) - - HADOOP-11021. Configurable replication factor in the hadoop archive - command. (Zhe Zhang via wang) - - HADOOP-11030. Define a variable jackson.version instead of using constant - at multiple places. (Juan Yu via kasha) - - HADOOP-10990. Add missed NFSv3 request and response classes (brandonli) - - HADOOP-10863. KMS should have a blacklist for decrypting EEKs. - (asuresh via tucu) - - HADOOP-11054. Add a KeyProvider instantiation based on a URI. (tucu) - - HADOOP-11015. Http server/client utils to propagate and recreate - Exceptions from server to client. (tucu) - - HADOOP-11060. Create a CryptoCodec test that verifies interoperability - between the JCE and OpenSSL implementations. (hitliuyi via tucu) - - HADOOP-11070. Create MiniKMS for testing. (tucu) - - HADOOP-11057. checknative command to probe for winutils.exe on windows. - (Xiaoyu Yao via cnauroth) - - HADOOP-10758. KMS: add ACLs on per key basis. (tucu) - - HADOOP-9540. Expose the InMemoryS3 and S3N FilesystemStores implementations - for Unit testing. (Hari via stevel) - - HADOOP-10373 create tools/hadoop-amazon for aws/EMR support (stevel) - - HADOOP-11074. Move s3-related FS connector code to hadoop-aws (David S. - Wang via Colin Patrick McCabe) - - HADOOP-11091. Eliminate old configuration parameter names from s3a (David - S. Wang via Colin Patrick McCabe) - - HADOOP-10868. AuthenticationFilter should support externalizing the - secret for signing and provide rotation support. (rkanter via tucu) - - HADOOP-10922. User documentation for CredentialShell. (Larry McCay via wang) - - HADOOP-11016. KMS should support signing cookies with zookeeper secret - manager. (tucu) - - HADOOP-11106. Document considerations of HAR and Encryption. (clamb via wang) - - HADOOP-10970. Cleanup KMS configuration keys. (wang) - - HADOOP-11017. KMS delegation token secret manager should be able to use - zookeeper as store. (asuresh via tucu) - - HADOOP-11009. Add Timestamp Preservation to DistCp (Gary Steelman via aw) - - HADOOP-11101. How about in