hbase-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "stack (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HBASE-1672) Map tasks not local to RS
Date Tue, 21 Jul 2009 18:36:14 GMT

    [ https://issues.apache.org/jira/browse/HBASE-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12733774#action_12733774
] 

stack commented on HBASE-1672:
------------------------------

So, what is the indicator in the MR UI measuring?  TT+DN locality?  Or is it TT+RS?  If the
latter, and we are only 10% of the time doing TT mapper local to the region hosting server,
then our TT+RS locality would seem to be broke -- or ineffective (either would be good to
know).

> Map tasks not local to RS
> -------------------------
>
>                 Key: HBASE-1672
>                 URL: https://issues.apache.org/jira/browse/HBASE-1672
>             Project: Hadoop HBase
>          Issue Type: Bug
>          Components: mapred, master, regionserver
>    Affects Versions: 0.20.0, 0.19.3
>         Environment: DN, TT and RS running on the same nodes.
>            Reporter: Amandeep Khurana
>             Fix For: 0.20.0, 0.19.4
>
>
> The number of data local map tasks while scanning a table is only about 10% of the total
map tasks...
> My table had 280 regions and 13M records... The number of map tasks in the scan job were
equal to the number of regions (280). Only 25 of them were data local tasks.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message