hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pengcheng Xiong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-15628) Add more logs for hybrid grace hash join during the initial hash table loading
Date Sat, 25 Mar 2017 20:27:41 GMT

    [ https://issues.apache.org/jira/browse/HIVE-15628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15941939#comment-15941939
] 

Pengcheng Xiong commented on HIVE-15628:
----------------------------------------

I am deferring this to Hive 3.0 as we are going to cut the first RC and it is not marked as
blocker. Please feel free to commit to the branch if this can be resolved before the release.

> Add more logs for hybrid grace hash join during the initial hash table loading
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-15628
>                 URL: https://issues.apache.org/jira/browse/HIVE-15628
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>    Affects Versions: 2.2.0
>            Reporter: Wei Zheng
>            Assignee: Wei Zheng
>
> This can be useful for debugging memory issues.
> Metrics that can be possibly added:
> 1. Log memory usage after say every 50M data has been loaded
> 2. Add a counter for number of write buffers already allocated
> 3. Log a snapshot of partitions (memory usage for each of them)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message