hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-837) harchive fail when output directory has URI with default port of 8020
Date Mon, 22 Feb 2010 21:24:28 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12836910#action_12836910
] 

Tsz Wo (Nicholas), SZE commented on MAPREDUCE-837:
--------------------------------------------------

Just have tried with -p option.  It did not work.
{noformat}
-bash-3.1$ echo  hadoop archive ${Q} -archiveName ${DIR}.har -p ${PARENT} ${DIR} hdfs://${NN}${PARENT}
hadoop archive -Dmapred.job.queue.name=grideng -archiveName t20.har -p /user/tsz t20 hdfs://namenode:8020/user/tsz
-bash-3.1$  hadoop archive ${Q} -archiveName ${DIR}5.har -p ${PARENT} ${DIR} hdfs://${NN}${PARENT}
10/02/22 21:20:16 INFO mapred.JobClient: Running job: job_201002042035_75331
10/02/22 21:20:17 INFO mapred.JobClient:  map 0% reduce 0%
10/02/22 21:20:37 INFO mapred.JobClient: Task Id : attempt_201002042035_75331_m_000000_0,
Status : FAILED
java.io.IOException: Can not get the relative path:
 base = hdfs://namenode:8020/user/tsz/t20.har/_temporary/_attempt_201002042035_75331_m_000000_0
 child = hdfs://namenode/user/tsz/t20.har/_temporary/_attempt_201002042035_75331_m_000000_0/part-0
        at org.apache.hadoop.mapred.FileOutputCommitter.getFinalPath(FileOutputCommitter.java:196)
        at org.apache.hadoop.mapred.FileOutputCommitter.moveTaskOutputs(FileOutputCommitter.java:152)
        at org.apache.hadoop.mapred.FileOutputCommitter.moveTaskOutputs(FileOutputCommitter.java:172)
        at org.apache.hadoop.mapred.FileOutputCommitter.commitTask(FileOutputCommitter.java:132)
        at org.apache.hadoop.mapred.OutputCommitter.commitTask(OutputCommitter.java:223)
        at org.apache.hadoop.mapred.Task.commit(Task.java:817)
        at org.apache.hadoop.mapred.Task.done(Task.java:729)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:309)
        at org.apache.hadoop.mapred.Child.main(Child.java:159)
...
{noformat}

> harchive fail when output directory has URI with default port of 8020
> ---------------------------------------------------------------------
>
>                 Key: MAPREDUCE-837
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-837
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: harchive
>    Affects Versions: 0.20.1
>            Reporter: Koji Noguchi
>            Assignee: Mahadev konar
>            Priority: Minor
>
> % hadoop archive -archiveName abc.har /user/knoguchi/abc hdfs://mynamenode:8020/user/knoguchi
> doesn't work on 0.18 nor 0.20

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message