hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Inna Balasanyan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2015) GridMix always throws an FileAlreadyExistsException even ouput directory is not available in HDFS.
Date Wed, 25 Jul 2012 09:34:34 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422120#comment-13422120

Inna Balasanyan commented on MAPREDUCE-2015:

Thanks I have changed the paths they are now different. But I am getting an error.

12/07/25 11:30:46 INFO gridmix.SubmitterUserResolver:  Current user resolver is SubmitterUserResolver

12/07/25 11:30:46 WARN gridmix.Gridmix: Resource null ignored
12/07/25 11:30:47 INFO gridmix.Gridmix:  Submission policy is STRESS
12/07/25 11:30:47 INFO gridmix.Gridmix: Generating 1.0m of test data...
12/07/25 11:30:47 INFO util.NativeCodeLoader: Loaded the native-hadoop library
12/07/25 11:30:47 INFO gridmix.Statistics: Not tracking job GRIDMIX_GENDATA as seq id is less
than zero: -1
12/07/25 11:30:52 INFO gridmix.JobMonitor: GRIDMIX_GENDATA (job_local_0001) success
12/07/25 11:30:57 INFO gridmix.Gridmix: Changing the permissions for inputPath hdfs://localhost:54310/user/hduser/outgrid
12/07/25 11:30:57 INFO gridmix.Gridmix: Done.
12/07/25 11:30:57 INFO gridmix.FilePool: minFileSize 1
12/07/25 11:30:57 INFO gridmix.FilePool: InnerDesc 1
12/07/25 11:30:57 INFO gridmix.FilePool: InnerDesc 2 thisDir.getPath()hdfs://localhost:54310/user/hduser/outgrid
12/07/25 11:30:57 INFO gridmix.FilePool: FilePool
12/07/25 11:30:57 ERROR gridmix.Gridmix: Startup failed
java.io.IOException: Found no satisfactory file in hdfs://localhost:54310/user/hduser/outgrid
        at org.apache.hadoop.mapred.gridmix.FilePool.refresh(FilePool.java:106)
        at org.apache.hadoop.mapred.gridmix.JobSubmitter.refreshFilePool(JobSubmitter.java:159)
        at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:286)
        at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:263)
        at org.apache.hadoop.mapred.gridmix.Gridmix.access$4(Gridmix.java:229)
        at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:217)
        at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:1)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
        at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:215)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.mapred.gridmix.Gridmix.main(Gridmix.java:390)
12/07/25 11:30:57 INFO gridmix.Gridmix: Exiting...

I have read that this is because of relatively small input data but I have set the Dgridmix.min.file.size
to 1.  Could you please help me? 

> GridMix always throws an FileAlreadyExistsException even ouput directory is not available
in HDFS.
> --------------------------------------------------------------------------------------------------
>                 Key: MAPREDUCE-2015
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2015
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/gridmix
>    Affects Versions: 0.20.1
>            Reporter: Vinay Kumar Thota
>            Assignee: Ranjit Mathew
> Gridmix always throws an FileAlreadyExistsException even ouput directory is not available
in HDFS. Actually I was launching the Gridmix in a command line for generating the data, before
launching I just make sure the output directory is not available in the HDFS by deleting the
folder if already exists.However, I could see output directory already exists exception every
time. Please see the attached logs for more information.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message