hadoop-yarn-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ming Ma (JIRA)" <j...@apache.org>
Subject [jira] [Created] (YARN-3935) Support compression for RM HA ApplicationStateData
Date Fri, 17 Jul 2015 06:34:04 GMT
Ming Ma created YARN-3935:

             Summary: Support compression for RM HA ApplicationStateData
                 Key: YARN-3935
                 URL: https://issues.apache.org/jira/browse/YARN-3935
             Project: Hadoop YARN
          Issue Type: Improvement
            Reporter: Ming Ma

If we use ZK as the RM HA, it is possible for some application state to exceed the max object
size imposed by ZK service. We can apply compression before storing the data to ZK.

We might want to add the compression functionality at RMStateStore layer so that different
store implementations can use it.

The design might also want to take care of compatibility issue. After compression is enabled
and RM restarts; the older state store should still be loaded properly.

This message was sent by Atlassian JIRA

View raw message