impala-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tim Armstrong (JIRA)" <>
Subject [jira] [Created] (IMPALA-5658) Report details of process memory maps via metrics
Date Wed, 12 Jul 2017 23:23:00 GMT
Tim Armstrong created IMPALA-5658:

             Summary: Report details of process memory maps via metrics
                 Key: IMPALA-5658
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
    Affects Versions: Impala 2.10.0
            Reporter: Tim Armstrong
            Assignee: Tim Armstrong

To help understand the details of process memory consumption, it would be great to have metrics
that answered questions like:
* How many anonymous huge pages are allocated?
* How many memory maps is the process using?
* What is the RSS of the process?
* What is the virtual memory consumption of the process?

It looks like /proc/<pid>/smaps is the documented interface for this:

I'm thinking that maybe we could have the memory maintenance thread periodically scrape /proc/<pid>/smaps
and update a set of metrics like:
* Number of mappings
* Total virtual address space
* Total RSS
* Total bytes of anon huge pages

This message was sent by Atlassian JIRA

View raw message