hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Antonio Piccolboni (Resolved) (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (MAPREDUCE-3766) dumptb fails with filenotfound
Date Tue, 31 Jan 2012 19:06:10 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-3766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Antonio Piccolboni resolved MAPREDUCE-3766.
-------------------------------------------

    Resolution: Not A Problem

Seems to be reading each part just fine. Maybe it should get a more getmerge like functionality,
maybe it should be documented, but most likely this is not a bug.
                
> dumptb fails with filenotfound
> ------------------------------
>
>                 Key: MAPREDUCE-3766
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3766
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/streaming
>    Affects Versions: 0.20.2
>         Environment: AWS, ubuntu, cdh3u3
>            Reporter: Antonio Piccolboni
>
> dumptb can't find an existing file
> antonio@ip-10-9-65-123:~$ hadoop jar /usr/lib/hadoop/contrib/streaming/hadoop-streaming-0.20.2-cdh3u3.jar
dumptb /tmp/Rtmp5h8lIO/file179e4fc
> 12/01/31 00:27:48 INFO security.UserGroupInformation: JAAS Configuration already set
up for Hadoop, not re-installing.
> 12/01/31 00:27:49 WARN snappy.LoadSnappy: Snappy native library is available
> 12/01/31 00:27:49 INFO util.NativeCodeLoader: Loaded the native-hadoop library
> 12/01/31 00:27:49 INFO snappy.LoadSnappy: Snappy native library loaded
> Exception in thread "main" java.io.FileNotFoundException: File does not exist: /tmp/Rtmp5h8lIO/file179e4fc/_logs
> 	at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:1822)
> 	at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.<init>(DFSClient.java:1813)
> 	at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:544)
> 	at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:187)
> 	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:456)
> 	at org.apache.hadoop.streaming.AutoInputFormat.getRecordReader(AutoInputFormat.java:56)
> 	at org.apache.hadoop.streaming.DumpTypedBytes.dumpTypedBytes(DumpTypedBytes.java:102)
> 	at org.apache.hadoop.streaming.DumpTypedBytes.run(DumpTypedBytes.java:83)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> 	at org.apache.hadoop.streaming.HadoopStreaming.main(HadoopStreaming.java:41)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.RunJar.main(RunJar.java:197)
> But the file is there
> antonio@ip-10-9-65-123:~$ hadoop dfs -ls /tmp/Rtmp5h8lIO/file179e4fc/_logs
> 12/01/31 00:28:47 INFO security.UserGroupInformation: JAAS Configuration already set
up for Hadoop, not re-installing.
> Found 1 items
> drwxrwxrwx   - antonio supergroup          0 2012-01-31 00:18 /tmp/Rtmp5h8lIO/file179e4fc/_logs/history

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message