hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <>
Subject [jira] [Created] (HIVE-6500) Stats collection via filesystem
Date Tue, 25 Feb 2014 07:57:19 GMT
Ashutosh Chauhan created HIVE-6500:

             Summary: Stats collection via filesystem
                 Key: HIVE-6500
             Project: Hive
          Issue Type: New Feature
          Components: Statistics
            Reporter: Ashutosh Chauhan
            Assignee: Ashutosh Chauhan

Recently, support for stats gathering via counter was [added |]
Although, its useful it has following issues:
* [Length of counter group name is limited |]
* [Length of counter name is limited |]
*[Number of distinct counter groups are limited |]
*[Number of distinct counters are limited |]
Although, these limits are configurable, but setting them to higher value implies increased
memory load on AM and job history server.
Now, whether these limits makes sense or not is [debatable |]
it is desirable that Hive doesn't make use of counters features of framework so that it we
can evolve this feature without relying on support from framework. Filesystem based counter
collection is a step in that direction.

This message was sent by Atlassian JIRA

View raw message