hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vinod K V (JIRA)" <j...@apache.org>
Subject [jira] Commented: (MAPREDUCE-1858) TestCopyFiles fails consistently on trunk
Date Fri, 11 Jun 2010 11:02:16 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-1858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12877780#action_12877780
] 

Vinod K V commented on MAPREDUCE-1858:
--------------------------------------

I see more logs.

{code}
Copy failed: java.lang.NullPointerException
        at org.apache.hadoop.fs.FileStatus.readFields(FileStatus.java:280)
        at org.apache.hadoop.tools.DistCp$FilePair.readFields(DistCp.java:245)
        at org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1816)
        at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1944)
        at org.apache.hadoop.tools.DistCp$CopyInputFormat.getSplits(DistCp.java:294)
        at org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:428)
        at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:420)
        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:338)
        at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1033)
        at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1030)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:416)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:793)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1030)
        at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:536)
        at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:781)
        at org.apache.hadoop.tools.DistCp.copy(DistCp.java:795)
        at org.apache.hadoop.tools.DistCp.run(DistCp.java:1032)
{code}

Seems like a change in common project affected this. HADOOP-6796?

> TestCopyFiles fails consistently on trunk
> -----------------------------------------
>
>                 Key: MAPREDUCE-1858
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-1858
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: distcp
>    Affects Versions: 0.22.0
>            Reporter: Vinod K V
>
> All the tests in TestCopyFiles fail. For e.g.
> {code}
> Testcase: testCopyFromLocalToLocal took 10.051 sec
>         Caused an ERROR
> File /home/vinodkv/Workspace/eclipse-workspace/apache-svn-mapreduce/trunk/build/test/data/destdat/one/one/9208695393420117603
does not exist.
> java.io.FileNotFoundException: File /home/vinodkv/Workspace/eclipse-workspace/apache-svn-mapreduce/trunk/build/test/data/destdat/one/one/9208695393420117603
does not exist.
>         at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:420)
>         at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:290)
>         at org.apache.hadoop.tools.TestCopyFiles.checkFiles(TestCopyFiles.java:169)
>         at org.apache.hadoop.tools.TestCopyFiles.checkFiles(TestCopyFiles.java:159)
>         at org.apache.hadoop.tools.TestCopyFiles.testCopyFromLocalToLocal(TestCopyFiles.java:271)
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message