hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod Kumar Vavilapalli (Updated) (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-3035) MR V2 jobhistory does not contain rack information
Date Tue, 11 Oct 2011 13:11:11 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Vinod Kumar Vavilapalli updated MAPREDUCE-3035:
-----------------------------------------------

    Status: Open  (was: Patch Available)

Karam says that till now, hostname itself used to be of the form rackid/hostname. So tools
like Rumen also depend on this format.

I for one like the separate API and the history field. Let me talk to folks taking care of
Rumen.

Chackaravarthy, in the mean while, can you also dig up Rumen related details (src/tools/org/apache/hadoop/tools/rumen/)?
My feeling is you need to fix Rumen either ways.
                
> MR V2 jobhistory does not contain rack information
> --------------------------------------------------
>
>                 Key: MAPREDUCE-3035
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3035
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Karam Singh
>            Assignee: chackaravarthy
>            Priority: Blocker
>             Fix For: 0.23.0
>
>         Attachments: MAPREDUCE-3035.patch
>
>
> When topology.node.switch.mapping.impl is set to enable rack-locality resolution via
the topology script, from the RM web-UI, we can see the rack information for each node. Running
a job also reveals the information about rack-local map tasks launched at end of job completion
on the client side.
> But the hostname field for attempts in the JobHistory does not contain this rack information.
> In case of hadoop-0.20 securiy or MRV1, hostname field of job history does contain rackid/hostname
whereas in MRV2, hostname field only contains the hostIP. Thus this is a regression.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message