Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 6A5EB200CE1 for ; Fri, 28 Jul 2017 06:28:14 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 698FF16ADC1; Fri, 28 Jul 2017 04:28:14 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 56E7916ADD2 for ; Fri, 28 Jul 2017 06:28:12 +0200 (CEST) Received: (qmail 49318 invoked by uid 500); 28 Jul 2017 04:28:11 -0000 Mailing-List: contact common-commits-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list common-commits@hadoop.apache.org Received: (qmail 48848 invoked by uid 99); 28 Jul 2017 04:28:09 -0000 Received: from git1-us-west.apache.org (HELO git1-us-west.apache.org) (140.211.11.23) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 28 Jul 2017 04:28:09 +0000 Received: by git1-us-west.apache.org (ASF Mail Server at git1-us-west.apache.org, from userid 33) id CB65BE95C7; Fri, 28 Jul 2017 04:28:09 +0000 (UTC) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit From: shv@apache.org To: common-commits@hadoop.apache.org Date: Fri, 28 Jul 2017 04:28:10 -0000 Message-Id: In-Reply-To: References: X-Mailer: ASF-Git Admin Mailer Subject: [2/3] hadoop git commit: Preparing for release 2.7.4 archived-at: Fri, 28 Jul 2017 04:28:14 -0000 http://git-wip-us.apache.org/repos/asf/hadoop/blob/4c66bfca/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html ---------------------------------------------------------------------- diff --git a/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html b/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html index acd0c56..afa36fd 100644 --- a/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html +++ b/hadoop-common-project/hadoop-common/src/main/docs/releasenotes.html @@ -1,5 +1,5 @@ -Hadoop 2.6.0 Release Notes +Hadoop 2.7.4 Release Notes -

Hadoop 2.6.0 Release Notes

Hadoop 2.7.4 Release Notes

These release notes include new developer and user-facing incompatibilities, features, and major improvements. -

Changes since Hadoop 2.5.1

Changes since Hadoop 2.7.3

YARN-2853. - Major bug reported by Jian He and fixed by Jian He
- Killing app may hang while AM is unregistering
+
YARN-6818. + Major bug reported by Jonathan Hung and fixed by Jonathan Hung
+ User limit per partition is not honored in branch-2.7 >=
YARN-2846. - Blocker bug reported by Junping Du and fixed by Junping Du (nodemanager)
- Incorrect persist exit code for running containers in reacquireContainer() that interrupted by NodeManager restart.
+
YARN-6719. + Major bug reported by Akira Ajisaka and fixed by Akira Ajisaka
+ Fix findbugs warnings in SLSCapacityScheduler.java
YARN-2843. - Major sub-task reported by Sushmitha Sreenivasan and fixed by Wangda Tan (resourcemanager)
- NodeLabels manager should trim all inputs for hosts and labels
+
YARN-6615. + Major bug reported by Wilfred Spiegelenburg and fixed by Wilfred Spiegelenburg
+ AmIpFilter drops query parameters on redirect
YARN-2841. - Critical sub-task reported by Jian He and fixed by Jian He (resourcemanager)
- RMProxy should retry EOFException
+
YARN-6493. + Major improvement reported by Jonathan Hung and fixed by Jonathan Hung
+ Print requested node partition in assignContainer logs
YARN-2834. - Blocker bug reported by Yesha Vora and fixed by Jian He
- Resource manager crashed with Null Pointer Exception
+
YARN-6457. + Major improvement reported by Sanjay M Pujare and fixed by Sanjay M Pujare (webapp , yarn)
+ Allow custom SSL configuration to be supplied in WebApps
YARN-2830. - Blocker bug reported by Jonathan Eagles and fixed by Jonathan Eagles
- Add backwords compatible ContainerId.newInstance constructor for use within Tez Local Mode
-
I just committed this. Thanks [~jeagles] for the patch and [~ozawa] for the reviews!
YARN-2827. - Critical bug reported by Wangda Tan and fixed by Wangda Tan (client)
- Fix bugs of yarn queue CLI
+
YARN-6310. + Major bug reported by Haibo Chen and fixed by Haibo Chen (yarn)
+ OutputStreams in AggregatedLogFormat.LogWriter can be left open upon exceptions
YARN-2826. - Critical bug reported by Sidharta Seethana and fixed by Wangda Tan
- User-Group mappings not updated by RM when a user is removed from a group.
+
YARN-6304. + Major bug reported by Rohith Sharma K S and fixed by Rohith Sharma K S (resourcemanager)
+ Skip rm.transitionToActive call to RM if RM is already active.
YARN-2825. - Critical bug reported by Jian He and fixed by Jian He
- Container leak on NM
+
YARN-6274. + Trivial task reported by Charles Zhang and fixed by Weiwei Yang (documentation)
+ Documentation refers to incorrect nodemanager health checker interval property
YARN-2824. - Critical sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)
- Capacity of labels should be zero by default
+
YARN-6152. + Major bug reported by Jonathan Hung and fixed by Jonathan Hung
+ Used queue percentage not accurate in UI for 2.7 and below when using DominantResourceCalculator
YARN-2823. - Critical bug reported by Gour Saha and fixed by Jian He (resourcemanager)
- NullPointerException in RM HA enabled 3-node cluster
+
YARN-6024. + Major bug reported by Wangda Tan and fixed by Wangda Tan
+ Capacity Scheduler 'continuous reservation looking' doesn't work when sum of queue's used and reserved resources is equal to max
YARN-2819. - Critical bug reported by Gopal V and fixed by Zhijie Shen (timelineserver)
- NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6
+
YARN-5988. + Blocker bug reported by Ajith S and fixed by Ajith S
+ RM unable to start in secure setup
YARN-2818. - Critical bug reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)
- Remove the logic to inject entity owner as the primary filter
-
YARN-2813. - Major bug reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)
- NPE from MemoryTimelineStore.getDomains
-
YARN-2812. - Major test reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)
- TestApplicationHistoryServer is likely to fail on less powerful machine
-
YARN-2810. - Major test reported by Varun Vasudev and fixed by Varun Vasudev (resourcemanager)
- TestRMProxyUsersConf fails on Windows VMs
-
YARN-2805. - Blocker bug reported by Arpit Gupta and fixed by Wangda Tan (resourcemanager)
- RM2 in HA setup tries to login using the RM1's kerberos principal
-
YARN-2804. - Critical bug reported by Zhijie Shen and fixed by Zhijie Shen
- Timeline server .out log have JAXB binding exceptions and warnings.
-
YARN-2803. - Critical bug reported by Chris Nauroth and fixed by Craig Welch (nodemanager)
- MR distributed cache not working correctly on Windows after NodeManager privileged account changes.
-
YARN-2798. - Blocker bug reported by Arpit Gupta and fixed by Zhijie Shen (timelineserver)
- YarnClient doesn't need to translate Kerberos name of timeline DT renewer
-
YARN-2795. - Major sub-task reported by Phil D'Amore and fixed by Wangda Tan (resourcemanager)
- Resource Manager fails startup with HDFS label storage and secure cluster
-
YARN-2794. - Major bug reported by Jian He and fixed by Jian He
- Fix log msgs about distributing system-credentials
-
YARN-2790. - Critical bug reported by Tassapol Athiapinya and fixed by Jian He (nodemanager)
- NM can't aggregate logs past HDFS delegation token expiry.
-
YARN-2789. - Critical task reported by Siddharth Seth and fixed by Wangda Tan
- Re-instate the NodeReport.newInstance API modified in YARN-2698
-
YARN-2788. - Blocker bug reported by Gopal V and fixed by Xuan Gong (log-aggregation)
- yarn logs -applicationId on 2.6.0 should support logs written by 2.4.0
-
YARN-2785. - Major test reported by Varun Vasudev and fixed by Varun Vasudev
- TestContainerResourceUsage fails intermittently
-
YARN-2779. - Critical bug reported by Zhijie Shen and fixed by Zhijie Shen (resourcemanager , timelineserver)
- SystemMetricsPublisher can use Kerberos directly instead of timeline DT
-
YARN-2778. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (client)
- YARN node CLI should display labels on returned node reports
-
YARN-2770. - Critical sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)
- Timeline delegation tokens need to be automatically renewed by the RM
-
YARN-2769. - Major bug reported by Varun Vasudev and fixed by Varun Vasudev (applications/distributed-shell)
- Timeline server domain not set correctly when using shell_command on Windows
-
YARN-2767. - Major test reported by Varun Vasudev and fixed by Varun Vasudev (resourcemanager)
- RM web services - add test case to ensure the http static user cannot kill or submit apps in secure mode
-
YARN-2760. - Trivial bug reported by Harsh J and fixed by Harsh J (documentation)
- Completely remove word 'experimental' from FairScheduler docs
-
YARN-2758. - Major test reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)
- Update TestApplicationHistoryClientService to use the new generic history store
-
YARN-2755. - Critical bug reported by Siqi Li and fixed by Siqi Li
- NM fails to clean up usercache_DEL_<timestamp> dirs after YARN-661
-
YARN-2753. - Major sub-task reported by zhihai xu and fixed by zhihai xu
- Fix potential issues and code clean up for *NodeLabelsManager
-
YARN-2752. - Critical bug reported by Xuan Gong and fixed by Xuan Gong
- ContainerExecutor always append "nice -n" in command on branch-2
-
YARN-2747. - Major test reported by Xuan Gong and fixed by Xuan Gong
- TestAggregatedLogFormat fails in trunk
-
YARN-2744. - Critical sub-task reported by Sumit Mohanty and fixed by Wangda Tan (capacityscheduler)
- Under some scenario, it is possible to end up with capacity scheduler configuration that uses labels that no longer exist
-
YARN-2743. - Blocker bug reported by Arpit Gupta and fixed by Jian He (resourcemanager)
- Yarn jobs via oozie fail with failed to renew token (secure) or digest mismatch (unsecure) errors when RM is being killed
-
YARN-2741. - Major bug reported by Craig Welch and fixed by Craig Welch (nodemanager)
- Windows: Node manager cannot serve up log files via the web user interface when yarn.nodemanager.log-dirs to any drive letter other than C: (or, the drive that nodemanager is running on)
-
YARN-2734. - Major bug reported by Sumit Mohanty and fixed by Xuan Gong (log-aggregation)
- If a sub-folder is encountered by log aggregator it results in invalid aggregated file
-
YARN-2732. - Major bug reported by Jian He and fixed by Jian He
- Fix syntax error in SecureContainer.apt.vm
-
YARN-2730. - Critical bug reported by Siqi Li and fixed by Siqi Li
- DefaultContainerExecutor runs only one localizer at a time
-
YARN-2726. - Minor sub-task reported by Phil D'Amore and fixed by Wangda Tan (capacityscheduler)
- CapacityScheduler should explicitly log when an accessible label has no capacity
-
YARN-2724. - Major bug reported by Sumit Mohanty and fixed by Xuan Gong (log-aggregation)
- If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed
-
YARN-2723. - Major sub-task reported by Phil D'Amore and fixed by Naganarasimha G R (client)
- rmadmin -replaceLabelsOnNode does not correctly parse port
-
YARN-2721. - Blocker bug reported by Jian He and fixed by Jian He
- Race condition: ZKRMStateStore retry logic may throw NodeExist exception
-
YARN-2720. - Major bug reported by Craig Welch and fixed by Craig Welch (nodemanager)
- Windows: Wildcard classpath variables not expanded against resources contained in archives
-
YARN-2717. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (log-aggregation)
- containerLogNotFound log shows multiple time for the same container
-
YARN-2715. - Blocker bug reported by Zhijie Shen and fixed by Zhijie Shen (resourcemanager)
- Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.
-
YARN-2711. - Major test reported by Varun Vasudev and fixed by Varun Vasudev
- TestDefaultContainerExecutor#testContainerLaunchError fails on Windows
-
YARN-2709. - Major sub-task reported by Li Lu and fixed by Li Lu
- Add retry for timeline client getDelegationToken method
-
YARN-2707. - Minor bug reported by Ted Yu and fixed by Gera Shegalov
- Potential null dereference in FSDownload
-
YARN-2705. - Critical sub-task reported by Wangda Tan and fixed by Wangda Tan (api , client , resourcemanager)
- Changes of RM node label manager default configuration
-
YARN-2704. - Critical sub-task reported by Jian He and fixed by Jian He
- Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time
-
YARN-2703. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (nodemanager , resourcemanager)
- Add logUploadedTime into LogValue for better display
-
YARN-2701. - Blocker bug reported by Xuan Gong and fixed by Xuan Gong
- Potential race condition in startLocalizer when using LinuxContainerExecutor
-
YARN-2700. - Major sub-task reported by Steve Loughran and fixed by Steve Loughran (api , resourcemanager)
- TestSecureRMRegistryOperations failing on windows: auth problems
-
YARN-2699. - Blocker sub-task reported by Wangda Tan and fixed by Wangda Tan (client)
- Fix test timeout in TestResourceTrackerOnHA#testResourceTrackerOnHA
-
YARN-2698. - Critical sub-task reported by Wangda Tan and fixed by Wangda Tan (api , client , resourcemanager)
- Move getClusterNodeLabels and getNodeToLabels to YarnClient instead of AdminService
-
YARN-2692. - Major sub-task reported by Steve Loughran and fixed by Steve Loughran
- ktutil test hanging on some machines/ktutil versions
-
YARN-2689. - Major sub-task reported by Steve Loughran and fixed by Steve Loughran (api , resourcemanager)
- TestSecureRMRegistryOperations failing on windows: secure ZK won't start
-
YARN-2685. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (api , client , resourcemanager)
- Resource on each label not correct when multiple NMs in a same host and some has label some not
-
YARN-2682. - Minor bug reported by zhihai xu and fixed by zhihai xu (nodemanager)
- WindowsSecureContainerExecutor should not depend on DefaultContainerExecutor#getFirstApplicationDir.
-
YARN-2678. - Major sub-task reported by Gour Saha and fixed by Steve Loughran (api , resourcemanager)
- Improved Yarn Registry service record structure
-
YARN-2677. - Major sub-task reported by Steve Loughran and fixed by Steve Loughran (api , resourcemanager)
- registry punycoding of usernames doesn't fix all usernames to be DNS-valid
-
YARN-2676. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)
- Timeline authentication filter should add support for proxy user
-
YARN-2673. - Major sub-task reported by Li Lu and fixed by Li Lu
- Add retry for timeline client put APIs
-
YARN-2671. - Blocker bug reported by Zhijie Shen and fixed by Wangda Tan (resourcemanager)
- ApplicationSubmissionContext change breaks the existing app submission
-
YARN-2668. - Major sub-task reported by Steve Loughran and fixed by Steve Loughran (client)
- yarn-registry JAR won't link against ZK 3.4.5
-
YARN-2667. - Minor bug reported by Yi Liu and fixed by Yi Liu
- Fix the release audit warning caused by hadoop-yarn-registry
-
YARN-2662. - Minor bug reported by Chris Nauroth and fixed by Chris Nauroth (test)
- TestCgroupsLCEResourcesHandler leaks file descriptors.
-
YARN-2656. - Major bug reported by Varun Vasudev and fixed by Zhijie Shen (resourcemanager)
- RM web services authentication filter should add support for proxy user
-
YARN-2652. - Major sub-task reported by Steve Loughran and fixed by Steve Loughran (api)
- add hadoop-yarn-registry package under hadoop-yarn
-
YARN-2651. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (nodemanager , resourcemanager)
- Spin off the LogRollingInterval from LogAggregationContext
-
YARN-2649. - Major bug reported by Ming Ma and fixed by Ming Ma
- Flaky test TestAMRMRPCNodeUpdates
-
YARN-2647. - Major sub-task reported by Wangda Tan and fixed by Sunil G (client)
- Add yarn queue CLI to get queue infos
-
YARN-2644. - Major sub-task reported by Craig Welch and fixed by Craig Welch
- Recalculate headroom more frequently to keep it accurate
-
YARN-2635. - Major bug reported by Wei Yan and fixed by Wei Yan
- TestRM, TestRMRestart, TestClientToAMTokens should run with both CS and FS
-
YARN-2632. - Blocker sub-task reported by Junping Du and fixed by Junping Du (nodemanager)
- Document NM Restart feature
-
YARN-2630. - Major bug reported by Jian He and fixed by Jian He
- TestDistributedShell#testDSRestartWithPreviousRunningContainers fails
-
YARN-2629. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)
- Make distributed shell use the domain-based timeline ACLs
-
YARN-2628. - Major bug reported by Varun Vasudev and fixed by Varun Vasudev (capacityscheduler)
- Capacity scheduler with DominantResourceCalculator carries out reservation even though slots are free
-
YARN-2627. - Major improvement reported by Xuan Gong and fixed by Xuan Gong
- Add logs when attemptFailuresValidityInterval is enabled
-
YARN-2624. - Blocker bug reported by Anubhav Dhoot and fixed by Anubhav Dhoot (nodemanager)
- Resource Localization fails on a cluster due to existing cache directories
-
YARN-2621. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)
- Simplify the output when the user doesn't have the access for getDomain(s)
-
YARN-2617. - Major bug reported by Jun Gong and fixed by Jun Gong (nodemanager)
- NM does not need to send finished container whose APP is not running to RM
-
YARN-2615. - Blocker sub-task reported by Junping Du and fixed by Junping Du
- ClientToAMTokenIdentifier and DelegationTokenIdentifier should allow extended fields
-
YARN-2611. - Major sub-task reported by Subru Krishnan and fixed by Subru Krishnan (capacityscheduler , resourcemanager , scheduler)
- Fix jenkins findbugs warning and test case failures for trunk merge patch
-
YARN-2610. - Major bug reported by Ray Chiang and fixed by Ray Chiang
- Hamlet should close table tags
-
YARN-2608. - Major bug reported by Wei Yan and fixed by Wei Yan
- FairScheduler: Potential deadlocks in loading alloc files and clock access
-
YARN-2607. - Major test reported by Ted Yu and fixed by Wangda Tan
- TestDistributedShell fails in trunk
-
YARN-2606. - Major bug reported by Mit Desai and fixed by Mit Desai (timelineserver)
- Application History Server tries to access hdfs before doing secure login
-
YARN-2602. - Major bug reported by Karam Singh and fixed by Zhijie Shen (timelineserver)
- Generic History Service of TimelineServer sometimes not able to handle NPE
-
YARN-2596. - Major test reported by Junping Du and fixed by Karthik Kambatla
- TestWorkPreservingRMRestart fails with FairScheduler
-
YARN-2594. - Blocker bug reported by Karam Singh and fixed by Wangda Tan (resourcemanager)
- Potential deadlock in RM when querying ApplicationResourceUsageReport
-
YARN-2591. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)
- AHSWebServices should return FORBIDDEN(403) if the request user doesn't have access to the history data
-
YARN-2588. - Major bug reported by Rohith and fixed by Rohith (resourcemanager)
- Standby RM does not transitionToActive if previous transitionToActive is failed with ZK exception.
-
YARN-2584. - Major test reported by Zhijie Shen and fixed by Jian He
- TestContainerManagerSecurity fails on trunk
-
YARN-2583. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (nodemanager , resourcemanager)
- Modify the LogDeletionService to support Log aggregation for LRS
-
YARN-2582. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (nodemanager , resourcemanager)
- Log related CLI and Web UI changes for Aggregated Logs in LRS
-
YARN-2581. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (nodemanager , resourcemanager)
- NMs need to find a way to get LogAggregationContext
-
YARN-2579. - Blocker bug reported by Rohith and fixed by Rohith (resourcemanager)
- Deadlock when EmbeddedElectorService and FatalEventDispatcher try to transition RM to StandBy at the same time
-
YARN-2577. - Trivial improvement reported by Miklos Christine and fixed by Miklos Christine (documentation , fairscheduler)
- Clarify ACL delimiter and how to configure ACL groups only
-
YARN-2576. - Major sub-task reported by Subru Krishnan and fixed by Subru Krishnan (capacityscheduler , resourcemanager , scheduler)
- Prepare yarn-1051 branch for merging with trunk
-
YARN-2569. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (nodemanager , resourcemanager)
- API changes for handling logs of long-running services
-
YARN-2568. - Major bug reported by Jian He and fixed by Jian He
- TestAMRMClientOnRMRestart test fails
-
YARN-2566. - Critical sub-task reported by zhihai xu and fixed by zhihai xu (nodemanager)
- DefaultContainerExecutor should pick a working directory randomly
-
YARN-2565. - Major bug reported by Karam Singh and fixed by Zhijie Shen (resourcemanager , timelineserver)
- RM shouldn't use the old RMApplicationHistoryWriter unless explicitly setting FileSystemApplicationHistoryStore
-
YARN-2563. - Blocker bug reported by Arpit Gupta and fixed by Zhijie Shen (timelineserver)
- On secure clusters call to timeline server fails with authentication errors when running a job via oozie
-
YARN-2562. - Critical bug reported by Vinod Kumar Vavilapalli and fixed by Tsuyoshi OZAWA
- ContainerId@toString() is unreadable for epoch >0 after YARN-2182
-
YARN-2561. - Blocker sub-task reported by Tassapol Athiapinya and fixed by Junping Du
- MR job client cannot reconnect to AM after NM restart.
-
YARN-2559. - Major bug reported by Karam Singh and fixed by Zhijie Shen (resourcemanager , timelineserver)
- ResourceManager sometime become un-responsive due to NPE in SystemMetricsPublisher
-
YARN-2558. - Blocker sub-task reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA
- Updating ContainerTokenIdentifier#read/write to use ContainerId#getContainerId
-
YARN-2557. - Major bug reported by Xuan Gong and fixed by Xuan Gong (applications/distributed-shell)
- Add a parameter "attempt_Failures_Validity_Interval" in DistributedShell
-
YARN-2549. - Minor test reported by Chris Nauroth and fixed by Chris Nauroth (nodemanager , test)
- TestContainerLaunch fails due to classpath problem with hamcrest classes.
-
YARN-2547. - Major sub-task reported by Jonathan Eagles and fixed by Mit Desai (timelineserver)
- Cross Origin Filter throws UnsupportedOperationException upon destroy
-
YARN-2546. - Major bug reported by Doug Haigh and fixed by Varun Vasudev (api)
- REST API for application creation/submission is using strings for numeric & boolean values
-
YARN-2544. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (api , client , resourcemanager)
- Common server side PB changes (not include user API PB changes)
-
YARN-2542. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen
- "yarn application -status <appId>" throws NPE when retrieving the app from the timelineserver
-
YARN-2541. - Major bug reported by Jian He and fixed by Jian He
- Fix ResourceManagerRest.apt.vm syntax error
-
YARN-2540. - Major bug reported by Ashwin Shankar and fixed by Ashwin Shankar (scheduler)
- FairScheduler: Queue filters not working on scheduler page in RM UI
-
YARN-2539. - Minor improvement reported by Wei Yan and fixed by Wei Yan
- FairScheduler: Set the default value for maxAMShare to 0.5
-
YARN-2538. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (resourcemanager)
- Add logs when RM send new AMRMToken to ApplicationMaster
-
YARN-2534. - Major bug reported by zhihai xu and fixed by zhihai xu (scheduler)
- FairScheduler: Potential integer overflow calculating totalMaxShare
-
YARN-2531. - Major improvement reported by Varun Vasudev and fixed by Varun Vasudev
- CGroups - Admins should be allowed to enforce strict cpu limits
-
YARN-2529. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)
- Generic history service RPC interface doesn't work when service authorization is enabled
-
YARN-2528. - Major sub-task reported by Jonathan Eagles and fixed by Jonathan Eagles (timelineserver)
- Cross Origin Filter Http response split vulnerability protection rejects valid origins
-
YARN-2527. - Major bug reported by Benoy Antony and fixed by Benoy Antony (resourcemanager)
- NPE in ApplicationACLsManager
-
YARN-2526. - Critical bug reported by Wei Yan and fixed by Wei Yan (scheduler-load-simulator)
- SLS can deadlock when all the threads are taken by AMSimulators
-
YARN-2523. - Major bug reported by Nishan Shetty and fixed by Rohith (resourcemanager , webapp)
- ResourceManager UI showing negative value for "Decommissioned Nodes" field
-
YARN-2519. - Major test reported by Xiaoyu Yao and fixed by Xiaoyu Yao (webapp)
- Credential Provider related unit tests failed on Windows
-
YARN-2515. - Major sub-task reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA (resourcemanager)
- Update ConverterUtils#toContainerId to parse epoch
-
YARN-2512. - Major sub-task reported by Jonathan Eagles and fixed by Jonathan Eagles (timelineserver)
- Allow for origin pattern matching in cross origin filter
-
YARN-2511. - Major sub-task reported by Jonathan Eagles and fixed by Jonathan Eagles (timelineserver)
- Allow All Origins by default when Cross Origin Filter is enabled
-
YARN-2509. - Major sub-task reported by Jonathan Eagles and fixed by Mit Desai (timelineserver)
- Enable Cross Origin Filter for timeline server only and not all Yarn servers
-
YARN-2508. - Major sub-task reported by Jonathan Eagles and fixed by Mit Desai (timelineserver)
- Cross Origin configuration parameters prefix are not honored
-
YARN-2507. - Major sub-task reported by Jonathan Eagles and fixed by Jonathan Eagles (documentation , timelineserver)
- Document Cross Origin Filter Configuration for ATS
-
YARN-2505. - Major sub-task reported by Wangda Tan and fixed by Craig Welch (resourcemanager)
- Support get/add/remove/change labels in RM REST API
-
YARN-2504. - Critical sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)
- Support get/add/remove/change labels in RM admin CLI
-
YARN-2503. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)
- Changes in RM Web UI to better show labels to end users
-
YARN-2502. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)
- Changes in distributed shell to support specify labels
-
YARN-2501. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)
- Changes in AMRMClient to support labels
-
YARN-2500. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)
- Miscellaneous changes in ResourceManager to support labels
-
YARN-2496. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)
- Changes for capacity scheduler to support allocate resource respect labels
-
YARN-2494. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (resourcemanager)
- Node label manager API and storage implementations
-
YARN-2493. - Major sub-task reported by Wangda Tan and fixed by Wangda Tan (api)
- API changes for users
-
YARN-2484. - Trivial bug reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA
- FileSystemRMStateStore#readFile/writeFile should close FSData(In|Out)putStream in final block
-
YARN-2475. - Major sub-task reported by Carlo Curino and fixed by Carlo Curino (resourcemanager)
- ReservationSystem: replan upon capacity reduction
-
YARN-2468. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (log-aggregation , nodemanager , resourcemanager)
- Log handling for LRS
-
YARN-2462. - Major bug reported by Jason Lowe and fixed by Eric Payne
- TestNodeManagerResync#testBlockNewContainerRequestsOnStartAndResync should have a test timeout
-
YARN-2460. - Minor bug reported by Ray Chiang and fixed by Ray Chiang
- Remove obsolete entries from yarn-default.xml
-
YARN-2459. - Major bug reported by Mayank Bansal and fixed by Mayank Bansal (resourcemanager)
- RM crashes if App gets rejected for any reason and HA is enabled
-
YARN-2456. - Major sub-task reported by Jian He and fixed by Jian He (resourcemanager)
- Possible livelock in CapacityScheduler when RM is recovering apps
-
YARN-2453. - Major bug reported by zhihai xu and fixed by zhihai xu
- TestProportionalCapacityPreemptionPolicy fails with FairScheduler
-
YARN-2452. - Major bug reported by zhihai xu and fixed by zhihai xu
- TestRMApplicationHistoryWriter fails with FairScheduler
-
YARN-2450. - Trivial bug reported by Ray Chiang and fixed by Ray Chiang
- Fix typos in log messages
-
YARN-2449. - Critical bug reported by Karam Singh and fixed by Varun Vasudev (timelineserver)
- Timelineserver returns invalid Delegation token in secure kerberos enabled cluster when hadoop.http.filter.initializers are not set
-
YARN-2448. - Major improvement reported by Varun Vasudev and fixed by Varun Vasudev
- RM should expose the resource types considered during scheduling when AMs register
-
YARN-2447. - Major bug reported by Varun Vasudev and fixed by Varun Vasudev
- RM web services app submission doesn't pass secrets correctly
-
YARN-2446. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)
- Using TimelineNamespace to shield the entities of a user
-
YARN-2440. - Major bug reported by Varun Vasudev and fixed by Varun Vasudev
- Cgroups should allow YARN containers to be limited to allocated cores
-
YARN-2434. - Major sub-task reported by Jian He and fixed by Jian He
- RM should not recover containers from previously failed attempt when AM restart is not enabled
-
YARN-2431. - Major sub-task reported by Jason Lowe and fixed by Jason Lowe (nodemanager)
- NM restart: cgroup is not removed for reacquired containers
-
YARN-2424. - Blocker bug reported by Allen Wittenauer and fixed by Allen Wittenauer (nodemanager)
- LCE should support non-cgroups, non-secure mode
-
YARN-2411. - Major improvement reported by Ram Venkatesh and fixed by Ram Venkatesh (capacityscheduler)
- [Capacity Scheduler] support simple user and group mappings to queues
-
YARN-2409. - Critical bug reported by Nishan Shetty and fixed by Rohith (resourcemanager)
- Active to StandBy transition does not stop rmDispatcher that causes 1 AsyncDispatcher thread leak.
-
YARN-2406. - Major sub-task reported by Jian He and fixed by Tsuyoshi OZAWA
- Move RM recovery related proto to yarn_server_resourcemanager_recovery.proto
-
YARN-2405. - Major bug reported by Maysam Yabandeh and fixed by Tsuyoshi OZAWA
- NPE in FairSchedulerAppsBlock
-
YARN-2400. - Major bug reported by Jian He and fixed by Jian He
- TestAMRestart fails intermittently
-
YARN-2399. - Major improvement reported by Karthik Kambatla and fixed by Karthik Kambatla (fairscheduler)
- FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt
-
YARN-2397. - Critical bug reported by Varun Vasudev and fixed by Varun Vasudev
- RM and TS web interfaces sometimes return request is a replay error in secure mode
-
YARN-2395. - Major new feature reported by Ashwin Shankar and fixed by Wei Yan (fairscheduler)
- FairScheduler: Preemption timeout should be configurable per queue
-
YARN-2394. - Major new feature reported by Ashwin Shankar and fixed by Wei Yan (fairscheduler)
- FairScheduler: Configure fairSharePreemptionThreshold per queue
-
YARN-2393. - Major new feature reported by Ashwin Shankar and fixed by Wei Yan (fairscheduler)
- FairScheduler: Add the notion of steady fair share
-
YARN-2389. - Major sub-task reported by Subru Krishnan and fixed by Subru Krishnan (capacityscheduler , fairscheduler)
- Adding support for drainig a queue, ie killing all apps in the queue
-
YARN-2388. - Major test reported by Zhijie Shen and fixed by Zhijie Shen
- TestTimelineWebServices fails on trunk after HADOOP-10791
-
YARN-2387. - Blocker bug reported by Mit Desai and fixed by Mit Desai
- Resource Manager crashes with NPE due to lack of synchronization
-
YARN-2378. - Major sub-task reported by Subru Krishnan and fixed by Subru Krishnan (capacityscheduler)
- Adding support for moving apps between queues in Capacity Scheduler
-
YARN-2377. - Major improvement reported by Gera Shegalov and fixed by Gera Shegalov (nodemanager)
- Localization exception stack traces are not passed as diagnostic info
-
YARN-2374. - Major bug reported by Varun Vasudev and fixed by Varun Vasudev
- YARN trunk build failing TestDistributedShell.testDSShell
-
YARN-2373. - Major bug reported by Larry McCay and fixed by Larry McCay
- WebAppUtils Should Use configuration.getPassword for Accessing SSL Passwords
-
YARN-2372. - Minor improvement reported by Fengdong Yu and fixed by Fengdong Yu (documentation)
- There are Chinese Characters in the FairScheduler's document
-
YARN-2370. - Trivial bug reported by Wenwu Peng and fixed by Wenwu Peng (resourcemanager)
- Fix comment in o.a.h.y.server.resourcemanager.schedulerAppSchedulingInfo
-
YARN-2363. - Major bug reported by Jason Lowe and fixed by Jason Lowe (resourcemanager)
- Submitted applications occasionally lack a tracking URL
-
YARN-2361. - Trivial improvement reported by zhihai xu and fixed by zhihai xu (resourcemanager)
- RMAppAttempt state machine entries for KILLED state has duplicate event entries
-
YARN-2360. - Major new feature reported by Ashwin Shankar and fixed by Ashwin Shankar (fairscheduler)
- Fair Scheduler: Display dynamic fair share for queues on the scheduler page
-
YARN-2359. - Critical bug reported by zhihai xu and fixed by zhihai xu (resourcemanager)
- Application hangs when it fails to launch AM container
-
YARN-2354. - Major sub-task reported by Jian He and fixed by Li Lu
- DistributedShell may allocate more containers than client specified after it restarts
-
YARN-2352. - Major improvement reported by Karthik Kambatla and fixed by Karthik Kambatla (scheduler)
- FairScheduler: Collect metrics on duration of critical methods that affect performance
-
YARN-2347. - Major sub-task reported by Junping Du and fixed by Junping Du
- Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common
-
YARN-2343. - Trivial improvement reported by Li Lu and fixed by Li Lu
- Improve error message on token expire exception
-
YARN-2337. - Trivial improvement reported by zhihai xu and fixed by zhihai xu (resourcemanager)
- ResourceManager sets ClientRMService in RMContext multiple times
-
YARN-2323. - Minor improvement reported by Hong Zhiguo and fixed by Hong Zhiguo (fairscheduler)
- FairShareComparator creates too many Resource objects
-
YARN-2321. - Major bug reported by Leitao Guo and fixed by Leitao Guo (nodemanager)
- NodeManager web UI can incorrectly report Pmem enforcement
-
YARN-2317. - Major sub-task reported by Li Lu and fixed by Li Lu (documentation)
- Update documentation about how to write YARN applications
-
YARN-2314. - Critical bug reported by Jason Lowe and fixed by Jason Lowe (client)
- ContainerManagementProtocolProxy can create thousands of threads for a large cluster
-
YARN-2313. - Major bug reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA (fairscheduler)
- Livelock can occur in FairScheduler when there are lots of running apps
-
YARN-2312. - Major sub-task reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA (resourcemanager)
- Marking ContainerId#getId as deprecated
-
YARN-2308. - Critical bug reported by Wangda Tan and fixed by chang li (resourcemanager , scheduler)
- NPE happened when RM restart after CapacityScheduler queue configuration changed
-
YARN-2302. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)
- Refactor TimelineWebServices
-
YARN-2298. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (client)
- Move TimelineClient to yarn-common project
-
YARN-2295. - Major sub-task reported by Li Lu and fixed by Li Lu
- Refactor YARN distributed shell with existing public stable API
-
YARN-2288. - Major sub-task reported by Junping Du and fixed by Junping Du (timelineserver)
- Data persistent in timelinestore should be versioned
-
YARN-2279. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen (timelineserver)
- Add UTs to cover timeline server authentication
-
YARN-2277. - Major sub-task reported by Jonathan Eagles and fixed by Jonathan Eagles (timelineserver)
- Add Cross-Origin support to the ATS REST API
-
YARN-2274. - Trivial improvement reported by Karthik Kambatla and fixed by Karthik Kambatla (fairscheduler)
- FairScheduler: Add debug information about cluster capacity, availability and reservations
-
YARN-2273. - Major bug reported by Andy Skelton and fixed by Wei Yan (fairscheduler , resourcemanager)
- NPE in ContinuousScheduling thread when we lose a node
-
YARN-2269. - Major bug reported by Yesha Vora and fixed by Craig Welch
- External links need to be removed from YARN UI
-
YARN-2264. - Major bug reported by Siddharth Seth and fixed by Li Lu
- Race in DrainDispatcher can cause random test failures
-
YARN-2260. - Major sub-task reported by Jian He and fixed by Jian He (resourcemanager)
- Add containers to launchedContainers list in RMNode on container recovery
-
YARN-2252. - Major bug reported by Ratandeep Ratti and fixed by (scheduler)
- Intermittent failure of TestFairScheduler.testContinuousScheduling
-
YARN-2251. - Major bug reported by Zhijie Shen and fixed by Zhijie Shen
- Avoid negative elapsed time in JHS/MRAM web UI and services
-
YARN-2249. - Major sub-task reported by Jian He and fixed by Jian He (resourcemanager)
- AM release request may be lost on RM restart
-
YARN-2248. - Major sub-task reported by Janos Matyas and fixed by Janos Matyas (capacityscheduler)
- Capacity Scheduler changes for moving apps between queues
-
YARN-2244. - Critical bug reported by Anubhav Dhoot and fixed by Anubhav Dhoot (fairscheduler)
- FairScheduler missing handling of containers for unknown application attempts
-
YARN-2242. - Major sub-task reported by Li Lu and fixed by Li Lu
- Improve exception information on AM launch crashes
-
YARN-2237. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (resourcemanager)
- MRAppMaster changes for AMRMToken roll-up
-
YARN-2229. - Major sub-task reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA (resourcemanager)
- ContainerId can overflow with RM restart
-
YARN-2228. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen
- TimelineServer should load pseudo authentication filter when authentication = simple
-
YARN-2219. - Major bug reported by Ashwin Shankar and fixed by Jian He (resourcemanager)
- AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts
-
YARN-2214. - Major improvement reported by Ashwin Shankar and fixed by Ashwin Shankar (scheduler)
- FairScheduler: preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness
-
YARN-2212. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (resourcemanager)
- ApplicationMaster needs to find a way to update the AMRMToken periodically
-
YARN-2211. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (resourcemanager)
- RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens
-
YARN-2209. - Major improvement reported by Jian He and fixed by Jian He
- Replace AM resync/shutdown command with corresponding exceptions
-
YARN-2208. - Major sub-task reported by Xuan Gong and fixed by Xuan Gong (resourcemanager)
- AMRMTokenManager need to have a way to roll over AMRMToken
-
YARN-2207. - Major task reported by Xuan Gong and fixed by Xuan Gong (resourcemanager)
- Add ability to roll over AMRMToken
-
YARN-2198. - Major improvement reported by Remus Rusanu and fixed by Remus Rusanu
- Remove the need to run NodeManager as privileged account for Windows Secure Container Executor
-
YARN-2197. - Minor improvement reported by Akira AJISAKA and fixed by Akira AJISAKA (documentation)
- Add a link to YARN CHANGES.txt in the left side of doc
-
YARN-2182. - Major sub-task reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA
- Update ContainerId#toString() to avoid conflicts before and after RM restart
-
YARN-2181. - Major bug reported by Wangda Tan and fixed by Wangda Tan (resourcemanager , webapp)
- Add preemption info to RM Web UI and add logs when preemption occurs
-
YARN-2174. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen
- Enabling HTTPs for the writer REST API of TimelineServer
-
YARN-2161. - Major bug reported by Binglin Chang and fixed by Binglin Chang
- Fix build on macosx: YARN parts
-
YARN-2158. - Minor test reported by Ted Yu and fixed by Varun Vasudev
- TestRMWebServicesAppsModification sometimes fails in trunk
-
YARN-2153. - Major sub-task reported by Jian He and fixed by Jian He (resourcemanager)
- Ensure distributed shell work with RM work-preserving recovery
-
YARN-2147. - Minor bug reported by Jason Lowe and fixed by Chen He (resourcemanager)
- client lacks delegation token exception details when application submit fails
-
YARN-2138. - Major bug reported by Jian He and fixed by Varun Saxena
- Cleanup notifyDone* methods in RMStateStore
-
YARN-2131. - Major new feature reported by Karthik Kambatla and fixed by Robert Kanter (resourcemanager)
- Add a way to format the RMStateStore
-
YARN-2102. - Major sub-task reported by Zhijie Shen and fixed by Zhijie Shen
- More generalized timeline ACLs
-
YARN-2088. - Major bug reported by Binglin Chang and fixed by Binglin Chang
- Fix code bug in GetApplicationsRequestPBImpl#mergeLocalToBuilder
-
YARN-2080. - Major sub-task reported by Subru Krishnan and fixed by Subru Krishnan (resourcemanager)
- Admission Control: Integrate Reservation subsystem with ResourceManager
-
YARN-2070. - Minor sub-task reported by Zhijie Shen and fixed by Robert Kanter
- DistributedShell publishes unfriendly user information to the timeline server
-
YARN-2045. - Major sub-task reported by Junping Du and fixed by Junping Du (nodemanager)
- Data persisted in NM should be versioned
-
YARN-2035. - Major sub-task reported by Jonathan Eagles and fixed by Jonathan Eagles
- FileSystemApplicationHistoryStore blocks RM and AHS while NN is in safemode
-
YARN-2034. - Minor bug reported by Jason Lowe and fixed by Chen He (nodemanager)
- Description for yarn.nodemanager.localizer.cache.target-size-mb is incorrect
-
YARN-2033. - Major sub-task reported by Vinod Kumar Vavilapalli and fixed by Zhijie Shen
- Merging generic-history into the Timeline Store
-
YARN-2026. - Major bug reported by Ashwin Shankar and fixed by Ashwin Shankar (scheduler)
- Fair scheduler: Consider only active queues for computing fairshare
-
YARN-2013. - Major sub-task reported by Zhijie Shen and fixed by Tsuyoshi OZAWA (nodemanager)
- The diagnostics is always the ExitCodeException stack when the container crashes
-
YARN-2010. - Blocker bug reported by bc Wong and fixed by Karthik Kambatla (resourcemanager)
- Handle app-recovery failures gracefully
-
YARN-2008. - Major sub-task reported by Chen He and fixed by Craig Welch
- CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure
-
YARN-2001. - Major sub-task reported by Jian He and fixed by Jian He (resourcemanager)
- Threshold for RM to accept requests from AM after failover
-
YARN-1994. - Major improvement reported by Arpit Agarwal and fixed by Craig Welch (nodemanager , resourcemanager , webapp)
- Expose YARN/MR endpoints on multiple interfaces
-
YARN-1972. - Major sub-task reported by Remus Rusanu and fixed by Remus Rusanu (nodemanager)
- Implement secure Windows Container Executor
-
YARN-1964. - Major new feature reported by Arun C Murthy and fixed by Abin Shahab
- Create Docker analog of the LinuxContainerExecutor in YARN
-
YARN-1959. - Major bug reported by Sandy Ryza and fixed by Anubhav Dhoot
- Fix headroom calculation in FairScheduler
-
YARN-1954. - Major improvement reported by Zhijie Shen and fixed by Tsuyoshi OZAWA (client)
- Add waitFor to AMRMClient(Async)
-
YARN-1922. - Major bug reported by Billie Rinaldi and fixed by Billie Rinaldi (nodemanager)
- Process group remains alive after container process is killed externally
-
YARN-1919. - Minor bug reported by Devaraj K and fixed by Tsuyoshi OZAWA (resourcemanager)
- Potential NPE in EmbeddedElectorService#stop
-
YARN-1918. - Trivial improvement reported by Devaraj K and fixed by Anandha L Ranganathan
- Typo in description and error message for 'yarn.resourcemanager.cluster-id'
-
YARN-1915. - Blocker sub-task reported by Hitesh Shah and fixed by Jason Lowe
- ClientToAMTokenMasterKey should be provided to AM at launch time
-
YARN-1879. - Critical sub-task reported by Jian He and fixed by Tsuyoshi OZAWA (resourcemanager)
- Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol for RM fail over
-
YARN-1857. - Critical sub-task reported by Thomas Graves and fixed by Chen He (capacityscheduler)
- CapacityScheduler headroom doesn't account for other AM's running
-
YARN-1796. - Minor bug reported by Aaron T. Myers and fixed by Aaron T. Myers (nodemanager)
- container-executor shouldn't require o-r permissions
-
YARN-1779. - Blocker sub-task reported by Karthik Kambatla and fixed by Jian He (resourcemanager)
- Handle AMRMTokens across RM failover
-
YARN-1769. - Major improvement reported by Thomas Graves and fixed by Thomas Graves (capacityscheduler)
- CapacityScheduler: Improve reservations
-
YARN-1712. - Major sub-task reported by Carlo Curino and fixed by Carlo Curino (capacityscheduler , resourcemanager)
- Admission Control: plan follower
-
YARN-1711. - Major sub-task reported by Carlo Curino and fixed by Carlo Curino
- CapacityOverTimePolicy: a policy to enforce quotas over time for YARN-1709
-
YARN-1710. - Major sub-task reported by Carlo Curino and fixed by Carlo Curino (resourcemanager)
- Admission Control: agents to allocate reservation
-
YARN-1709. - Major sub-task reported by Carlo Curino and fixed by Subru Krishnan (resourcemanager)
- Admission Control: Reservation subsystem
-
YARN-1708. - Major sub-task reported by Carlo Curino and fixed by Subru Krishnan (resourcemanager)
- Add a public API to reserve resources (part of YARN-1051)
-
YARN-1707. - Major sub-task reported by Carlo Curino and fixed by Carlo Curino (capacityscheduler)
- Making the CapacityScheduler more dynamic
-
YARN-1372. - Major sub-task reported by Bikas Saha and fixed by Anubhav Dhoot (resourcemanager)
- Ensure all completed containers are reported to the AMs across RM restart
-
YARN-1370. - Major sub-task reported by Bikas Saha and fixed by Anubhav Dhoot (resourcemanager)
- Fair scheduler to re-populate container allocation state
-
YARN-1367. - Major sub-task reported by Bikas Saha and fixed by Anubhav Dhoot (resourcemanager)
- After restart NM should resync with the RM without killing containers
-
YARN-1354. - Major sub-task reported by Jason Lowe and fixed by Jason Lowe (nodemanager)
- Recover applications upon nodemanager restart
-
YARN-1342. - Major sub-task reported by Jason Lowe and fixed by Jason Lowe (nodemanager)
- Recover container tokens upon nodemanager restart
-
YARN-1341. - Major sub-task reported by Jason Lowe and fixed by Jason Lowe (nodemanager)
- Recover NMTokens upon nodemanager restart
-
YARN-1337. - Major sub-task reported by Jason Lowe and fixed by Jason Lowe (nodemanager)
- Recover containers upon nodemanager restart
-
YARN-1326. - Major sub-task reported by Tsuyoshi OZAWA and fixed by Tsuyoshi OZAWA
- RM should log using RMStore at startup time
-
YARN-1250. - Major sub-task reported by Vinod Kumar Vavilapalli and fixed by Zhijie Shen
- Generic history service should support application-acls
-
YARN-1063. - Major sub-task reported by Kyle Leckie and fixed by Remus Rusanu (nodemanager)
- Winutils needs ability to create task as domain user
-
YARN-1051. - Major improvement reported by Carlo Curino and fixed by Carlo Curino (capacityscheduler , resourcemanager , scheduler)
- YARN Admission Control/Planner: enhancing the resource allocation model with time.
-
YARN-668. - Blocker sub-task reported by Siddharth Seth and fixed by Junping Du
- TokenIdentifier serialization should consider Unknown fields
-
YARN-611. - Major sub-task reported by Chris Riccomini and fixed by Xuan Gong (resourcemanager)
- Add an AM retry count reset window to YARN RM
-
YARN-415. - Major new feature reported by Kendall Thrapp and fixed by Eric Payne (resourcemanager)
- Capture aggregate memory allocation at the app-level for chargeback
-
YARN-90. - Major sub-task reported by Ravi Gummadi and fixed by Varun Vasudev (nodemanager)
- NodeManager should identify failed disks becoming good again
-
MAPREDUCE-6156. - Blocker bug reported by Sidharta Seethana and fixed by Junping Du
- Fetcher - connect() doesn't handle connection refused correctly
-
MAPREDUCE-6142. - Critical sub-task reported by Zhijie Shen and fixed by Zhijie Shen
- Test failure in TestJobHistoryEventHandler and TestMRTimelineEventHandling
-
MAPREDUCE-6126. - Major bug reported by Junping Du and fixed by Junping Du
- (Rumen) Rumen tool returns error "ava.lang.IllegalArgumentException: JobBuilder.process(HistoryEvent): unknown event type"
-
MAPREDUCE-6125. - Major bug reported by Mit Desai and fixed by Mit Desai (test)
- TestContainerLauncherImpl sometimes fails
-
MAPREDUCE-6123. - Trivial bug reported by Chris Nauroth and fixed by Chris Nauroth (test)
- TestCombineFileInputFormat incorrectly starts 2 MiniDFSCluster instances.
-
MAPREDUCE-6122. - Trivial bug reported by Chris Nauroth and fixed by Chris Nauroth (test)
- TestLineRecordReader may fail due to test data files checked out of git with incorrect line endings.
-
MAPREDUCE-6115. - Minor test reported by Ted Yu and fixed by Binglin Chang
- TestPipeApplication#testSubmitter fails in trunk
-
MAPREDUCE-6109. - Trivial bug reported by Charles Lamb and fixed by Charles Lamb (distcp)
- Fix minor typo in distcp -p usage text
-
MAPREDUCE-6104. - Major bug reported by Mit Desai and fixed by Mit Desai
- TestJobHistoryParsing.testPartialJob fails in branch-2
-
MAPREDUCE-6095. - Major bug reported by Gera Shegalov and fixed by Gera Shegalov (applicationmaster , distributed-cache)
- Enable DistributedCache for uber-mode Jobs
-
MAPREDUCE-6094. - Minor bug reported by Sangjin Lee and fixed by Akira AJISAKA (test)
- TestMRCJCFileInputFormat.testAddInputPath() fails on trunk
-
MAPREDUCE-6093. - Trivial bug reported by Charles Lamb and fixed by Charles Lamb (distcp , documentation)
- minor distcp doc edits
-
MAPREDUCE-6091. - Major bug reported by Sangjin Lee and fixed by Sangjin Lee (client)
- YARNRunner.getJobStatus() fails with ApplicationNotFoundException if the job rolled off the RM view
-
MAPREDUCE-6090. - Major bug reported by Robert Kanter and fixed by Robert Kanter (client)
- mapred hsadmin getGroups fails to connect in some cases
-
MAPREDUCE-6086. - Major improvement reported by zhihai xu and fixed by zhihai xu (security)
- mapreduce.job.credentials.binary should allow all URIs
-
MAPREDUCE-6075. - Major bug reported by Jason Lowe and fixed by Jason Lowe (jobhistoryserver)
- HistoryServerFileSystemStateStore can cre --------------------------------------------------------------------- To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org For additional commands, e-mail: common-commits-help@hadoop.apache.org