hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Inna Balasanyan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (MAPREDUCE-2015) GridMix always throws an FileAlreadyExistsException even ouput directory is not available in HDFS.
Date Wed, 25 Jul 2012 09:34:34 GMT

    [ https://issues.apache.org/jira/browse/MAPREDUCE-2015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422120#comment-13422120
] 

Inna Balasanyan commented on MAPREDUCE-2015:
--------------------------------------------

Thanks I have changed the paths they are now different. But I am getting an error.

12/07/25 11:30:46 INFO gridmix.SubmitterUserResolver:  Current user resolver is SubmitterUserResolver

12/07/25 11:30:46 WARN gridmix.Gridmix: Resource null ignored
12/07/25 11:30:47 INFO gridmix.Gridmix:  Submission policy is STRESS
12/07/25 11:30:47 INFO gridmix.Gridmix: Generating 1.0m of test data...
12/07/25 11:30:47 INFO util.NativeCodeLoader: Loaded the native-hadoop library
12/07/25 11:30:47 INFO gridmix.Statistics: Not tracking job GRIDMIX_GENDATA as seq id is less
than zero: -1
12/07/25 11:30:52 INFO gridmix.JobMonitor: GRIDMIX_GENDATA (job_local_0001) success
12/07/25 11:30:57 INFO gridmix.Gridmix: Changing the permissions for inputPath hdfs://localhost:54310/user/hduser/outgrid
12/07/25 11:30:57 INFO gridmix.Gridmix: Done.
12/07/25 11:30:57 INFO gridmix.FilePool: minFileSize 1
12/07/25 11:30:57 INFO gridmix.FilePool: InnerDesc 1
12/07/25 11:30:57 INFO gridmix.FilePool: InnerDesc 2 thisDir.getPath()hdfs://localhost:54310/user/hduser/outgrid
12/07/25 11:30:57 INFO gridmix.FilePool: FilePool
12/07/25 11:30:57 ERROR gridmix.Gridmix: Startup failed
java.io.IOException: Found no satisfactory file in hdfs://localhost:54310/user/hduser/outgrid
        at org.apache.hadoop.mapred.gridmix.FilePool.refresh(FilePool.java:106)
        at org.apache.hadoop.mapred.gridmix.JobSubmitter.refreshFilePool(JobSubmitter.java:159)
        at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:286)
        at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:263)
        at org.apache.hadoop.mapred.gridmix.Gridmix.access$4(Gridmix.java:229)
        at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:217)
        at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:1)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1093)
        at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:215)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.mapred.gridmix.Gridmix.main(Gridmix.java:390)
12/07/25 11:30:57 INFO gridmix.Gridmix: Exiting...

I have read that this is because of relatively small input data but I have set the Dgridmix.min.file.size
to 1.  Could you please help me? 

                
> GridMix always throws an FileAlreadyExistsException even ouput directory is not available
in HDFS.
> --------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2015
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2015
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/gridmix
>    Affects Versions: 0.20.1
>            Reporter: Vinay Kumar Thota
>            Assignee: Ranjit Mathew
>
> Gridmix always throws an FileAlreadyExistsException even ouput directory is not available
in HDFS. Actually I was launching the Gridmix in a command line for generating the data, before
launching I just make sure the output directory is not available in the HDFS by deleting the
folder if already exists.However, I could see output directory already exists exception every
time. Please see the attached logs for more information.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message