giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nitay Joffe (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (GIRAPH-505) Metrics Updates
Date Wed, 06 Feb 2013 23:06:12 GMT

     [ https://issues.apache.org/jira/browse/GIRAPH-505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Nitay Joffe updated GIRAPH-505:
-------------------------------

    Description: 
This patch adds the following:

1) Per-superstep, per-request-type counters. For example a counter for how many "SendPartitionMutationRequest"
messages are sent.
2) Per-superstep counters and gauges for how many requests are handled locally vs. sent across
network.
3) Add some helpers like MetricNames and MeterDesc to centralize definitions of metrics used in
Giraph all in one place.
4) Better input loading metrics. Track total edges/vertices loaded and overall rate regardless
of how many threads are involved. Updates the log/status message to look like (with 10 threads)
e.g:

readEdgeInputSplit: Loaded 619000000 edges at 3578098.2516499613 edges/sec Memory (free/total/max)
= 61174.90400695801M/120832.0M/120832.0M 

This is much clearer for the user and more informative.



  was:
This patch adds the following:

1) Per-superstep, per-request-type counters. For example a counter for how many "SendPartitionMutationRequest"
messages are sent.
2) Per-superstep counters and gauges for how many requests are handled locally vs. sent across
network.
3) Add some helpers like MetricNames and MeterDesc to centralize definitions of metrics used in
Giraph all in one place.
4) Better input loading metrics. Track total edges/vertices loaded and overall rate regardless
of how many threads are involved. Updates the log/status message to look like (with 10 threads)
e.g:

readEdgeInputSplit: Loaded 619000000 edges at 3578098.2516499613 edges/sec Memory (free/total/max)
= 61174.90400695801M/120832.0M/120832.0M 

This is much clearer for the user and more informative.

    
> Metrics Updates
> ---------------
>
>                 Key: GIRAPH-505
>                 URL: https://issues.apache.org/jira/browse/GIRAPH-505
>             Project: Giraph
>          Issue Type: Bug
>            Reporter: Nitay Joffe
>            Assignee: Nitay Joffe
>         Attachments: GIRAPH-505.patch
>
>
> This patch adds the following:
> 1) Per-superstep, per-request-type counters. For example a counter for how many "SendPartitionMutationRequest"
messages are sent.
> 2) Per-superstep counters and gauges for how many requests are handled locally vs. sent
across network.
> 3) Add some helpers like MetricNames and MeterDesc to centralize definitions of metrics
used in Giraph all in one place.
> 4) Better input loading metrics. Track total edges/vertices loaded and overall rate regardless
of how many threads are involved. Updates the log/status message to look like (with 10 threads)
e.g:
> readEdgeInputSplit: Loaded 619000000 edges at 3578098.2516499613 edges/sec Memory (free/total/max)
= 61174.90400695801M/120832.0M/120832.0M 
> This is much clearer for the user and more informative.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message