hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Wei Zheng (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-15628) Add more logs for hybrid grace hash join during the initial hash table loading
Date Sat, 14 Jan 2017 00:05:26 GMT
Wei Zheng created HIVE-15628:
--------------------------------

             Summary: Add more logs for hybrid grace hash join during the initial hash table
loading
                 Key: HIVE-15628
                 URL: https://issues.apache.org/jira/browse/HIVE-15628
             Project: Hive
          Issue Type: Bug
          Components: Hive
    Affects Versions: 2.2.0
            Reporter: Wei Zheng
            Assignee: Wei Zheng


This can be useful for debugging memory issues.
Metrics that can be possibly added:
1. Log memory usage after say every 50M data has been loaded
2. Add a counter for number of write buffers already allocated
3. Log a snapshot of partitions (memory usage for each of them)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message