hadoop-common-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Robert Chansler (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-3062) Need to capture the metrics for the network ios generate by dfs reads/writes and map/reduce shuffling and break them down by racks
Date Tue, 21 Oct 2008 23:52:44 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-3062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Robert Chansler updated HADOOP-3062:
------------------------------------

    Release Note: Introduced additional log records for data transfers.
    Hadoop Flags: [Incompatible change, Reviewed]  (was: [Reviewed, Incompatible change])

> Need to capture the metrics for the network ios generate by dfs reads/writes and map/reduce
shuffling  and break them down by racks 
> ------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-3062
>                 URL: https://issues.apache.org/jira/browse/HADOOP-3062
>             Project: Hadoop Core
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Runping Qi
>            Assignee: Chris Douglas
>             Fix For: 0.19.0
>
>         Attachments: 3062-0.patch, 3062-1.patch, 3062-2.patch, 3062-3.patch, 3062-4.patch,
3062-5.patch
>
>
> In order to better understand the relationship between hadoop performance and the network
bandwidth, we need to know 
> what the aggregated traffic data in a cluster and its breakdown by racks. With these
data, we can determine whether the network 
> bandwidth is the bottleneck when certain jobs are running on a cluster.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message