hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "nijel (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-413) job.jar, job.xml not deleted when JobClient submitJob method fail with exception
Date Tue, 12 May 2015 09:30:02 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539580#comment-14539580
] 

nijel commented on MAPREDUCE-413:
---------------------------------

Hi,
I tested this in trunk code. Looks like the directory is getting deleted.
There is a finally block which does this
{Code}
if (status == null) {
        LOG.info("Cleaning up the staging area " + submitJobDir);
        if (jtFs != null && submitJobDir != null)
          jtFs.delete(submitJobDir, true);

      }
{Code}

> job.jar, job.xml not deleted when JobClient submitJob method  fail with exception 
> ----------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-413
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-413
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Koji Noguchi
>            Priority: Minor
>              Labels: newbie
>
> If mapred.system.dir is set to /hadoop/mapred/system, 
> $ hadoop dfs -lsr /hadoop
> /hadoop/mapred  <dir>
> /hadoop/mapred/system   <dir>
> $ 
> $ hadoop jar hadoop-examples.jar wordcount  invaliddirectoryname  output
> org.apache.hadoop.mapred.InvalidInputException: Input path doesnt exist : /user/_____/invaliddirectoryname
>         at org.apache.hadoop.mapred.InputFormatBase.validateInput(InputFormatBase.java:138)
>         at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:316)
>         at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:371)
>         at org.apache.hadoop.examples.WordCount.main(WordCount.java:143)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:585)
>         at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
>         at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:143)
>         at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:40)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>         at java.lang.reflect.Method.invoke(Method.java:585)
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:155)
> $ hadoop dfs -lsr /hadoop
> /hadoop/mapred  <dir>
> /hadoop/mapred/system   <dir>
> /hadoop/mapred/system/submit_gpw022     <dir>
> /hadoop/mapred/system/submit_gpw022/job.jar     <r 10>  19397
> $ ls -l hadoop-examples.jar
> -rw-r--r--  1 _____ _____ 19397  hadoop-examples.jar



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message