hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amareshwari Sriramadasu (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1065) Modify the mapred tutorial documentation to use new mapreduce api.
Date Wed, 03 Mar 2010 11:54:27 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840594#action_12840594
] 

Amareshwari Sriramadasu commented on MAPREDUCE-1065:
----------------------------------------------------

Some comments:
* We should use scripts bin/hdfs for dfs commands, bin/mapred for MAPREDUCE commands, instead
of bin/hadoop script.
For ex:
The following change is looks wrong:
{code}
-          <code>$ bin/hadoop dfs -ls /usr/joe/wordcount/input/</code><br/>
+          <code>$ bin/hadoop fs -ls /user/joe/wordcount/input/</code><br/>
{code} 
It should changed as
{code}
-          <code>$ bin/hadoop dfs -ls /usr/joe/wordcount/input/</code><br/>
+          <code>$ bin/hdfs dfs -ls /user/joe/wordcount/input/</code><br/>
{code} 

* Output part files are named part-m/r-<id> in new api.
The following change should be modified to reflect the same.
{code}
-            $ bin/hadoop dfs -cat /usr/joe/wordcount/output/part-00000
+            $ bin/hadoop fs -cat /user/joe/wordcount/output/part-00000
{code}
It should be changed to
{code}
-            $ bin/hadoop dfs -cat /usr/joe/wordcount/output/part-00000
+            $ bin/hdfs dfs -cat /user/joe/wordcount/output/part-r-00000
{code}

* Minor - I guess we make sure lines are 80 characters long in documentation also.
* Job.setNumMapTasks(int) is not linked to api doc.

> Modify the mapred tutorial documentation to use new mapreduce api.
> ------------------------------------------------------------------
>
>                 Key: MAPREDUCE-1065
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1065
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: documentation
>    Affects Versions: 0.21.0
>            Reporter: Amareshwari Sriramadasu
>            Assignee: Aaron Kimball
>            Priority: Blocker
>             Fix For: 0.21.0
>
>         Attachments: MAPREDUCE-1065.patch
>
>


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message