hadoop-mapreduce-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Light (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAPREDUCE-5016) GridMix Error: Found no satisfactory file in path
Date Wed, 20 Feb 2013 14:03:12 GMT

     [ https://issues.apache.org/jira/browse/MAPREDUCE-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Light  updated MAPREDUCE-5016:
------------------------------

    Description: 
Hello,

Everytime i launch gridmix with the command:

PAPATH=/home/light/Bureau/test_gridmix

bin/hadoop -classpath $JAR_CLASSPATH org.apache.hadoop.mapred.gridmix.Gridmix  -Dgridmix.min.file.size=10m
-Dgridmix.output.directory=/home/light/Bureau/test -generate 20m $PAPATH /home/light/Bureau/test_rumen_output/job-trace.json

I have this: Found no satisfactory file in /home/light/Bureau/test_gridmix

This happen even if i use a hdfs path.

I have exactly the same problem at first than [MAPREDUCE-2015|https://issues.apache.org/jira/browse/MAPREDUCE-2015]
(File already exist) and finish by having the same problem once my path problem was solved.


What is bugging me:
First: GRIDMIX_GENDATA (job_local_0001) success, even if it says it's a succes, in my folder
i only have a _SUCCESS file of size 0.
I added some wait at this point in GridMix and juste before the check, there is no file in
the output folder.

Second: Whatever the size asked it will do it in 1s, so i think the problem may be here: There
is a bug for me, no file is generated.

I tried with every hadoop version and none of them is working.

Here is the output:

13/02/20 14:42:47 INFO gridmix.SubmitterUserResolver:  Current user resolver is SubmitterUserResolver

13/02/20 14:42:47 WARN gridmix.Gridmix: Resource null ignored
13/02/20 14:42:47 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your
platform... using builtin-java classes where applicable
13/02/20 14:42:47 INFO gridmix.Gridmix:  Submission policy is STRESS
13/02/20 14:42:47 INFO gridmix.Gridmix: Generating 20,0m of test data...
13/02/20 14:42:47 INFO gridmix.Statistics: Not tracking job GRIDMIX_GENDATA as seq id is less
than zero: -1
13/02/20 14:42:52 INFO gridmix.JobMonitor: GRIDMIX_GENDATA (job_local_0001) success
13/02/20 14:42:57 INFO gridmix.Gridmix: Changing the permissions for inputPath /home/light/Bureau/test_gridmix
13/02/20 14:42:57 INFO gridmix.Gridmix: Done.
13/02/20 14:44:12 ERROR gridmix.Gridmix: Startup failed
java.io.IOException: Found no satisfactory file in /home/light/Bureau/test_gridmix
	at org.apache.hadoop.mapred.gridmix.FilePool.refresh(FilePool.java:105)
	at org.apache.hadoop.mapred.gridmix.JobSubmitter.refreshFilePool(JobSubmitter.java:159)
	at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:291)
	at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:264)
	at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:55)
	at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:217)
	at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:215)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:416)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
	at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:215)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
	at org.apache.hadoop.mapred.gridmix.Gridmix.main(Gridmix.java:395)
13/02/20 14:44:12 INFO gridmix.Gridmix: Exiting...

Thanks in advance for any responses
 

  was:
Hello,

Everytime i launch gridmix with the command:

bin/hadoop -classpath $JAR_CLASSPATH org.apache.hadoop.mapred.gridmix.Gridmix  -Dgridmix.min.file.size=10m
-Dgridmix.output.directory=/home/light/Bureau/test -generate 20m $PAPATH /home/light/Bureau/test_rumen_output/job-trace.json

I have this: Found no satisfactory file in /home/light/Bureau/test_gridmix

This happen even if i use a hdfs path.

I have exactly the same problem at first than [MAPREDUCE-2015|https://issues.apache.org/jira/browse/MAPREDUCE-2015]
(File already exist) and finish by having the same problem once my path problem was solved.


What is bugging me:
First: GRIDMIX_GENDATA (job_local_0001) success, even if it says it's a succes, in my folder
i only have a _SUCCESS file of size 0.
I added some wait at this point of GridMIx and juste before the check, there is no file in
the output folder.

Second: Whatever the size asked it will do it in 1s, so i think the problem may be here: There
is a bug for me, no file is generated.

I tried with every hadoop version and none of them is working.

Here is the output:

13/02/20 14:42:47 INFO gridmix.SubmitterUserResolver:  Current user resolver is SubmitterUserResolver

13/02/20 14:42:47 WARN gridmix.Gridmix: Resource null ignored
MOIIIIIII: Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml
/home/light/Bureau/test_rumen_output/job-trace.json /home/light/Bureau/test_gridmix 20971520
org.apache.hadoop.mapred.gridmix.SubmitterUserResolver@1fa1bb6
13/02/20 14:42:47 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your
platform... using builtin-java classes where applicable
13/02/20 14:42:47 INFO gridmix.Gridmix:  Submission policy is STRESS
13/02/20 14:42:47 INFO gridmix.Gridmix: Generating 20,0m of test data...
13/02/20 14:42:47 INFO gridmix.Statistics: Not tracking job GRIDMIX_GENDATA as seq id is less
than zero: -1
13/02/20 14:42:52 INFO gridmix.JobMonitor: GRIDMIX_GENDATA (job_local_0001) success
13/02/20 14:42:57 INFO gridmix.Gridmix: Changing the permissions for inputPath /home/light/Bureau/test_gridmix
13/02/20 14:42:57 INFO gridmix.Gridmix: Done.
13/02/20 14:44:12 ERROR gridmix.Gridmix: Startup failed
java.io.IOException: Found no satisfactory file in /home/light/Bureau/test_gridmix
	at org.apache.hadoop.mapred.gridmix.FilePool.refresh(FilePool.java:105)
	at org.apache.hadoop.mapred.gridmix.JobSubmitter.refreshFilePool(JobSubmitter.java:159)
	at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:291)
	at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:264)
	at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:55)
	at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:217)
	at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:215)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:416)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
	at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:215)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
	at org.apache.hadoop.mapred.gridmix.Gridmix.main(Gridmix.java:395)
13/02/20 14:44:12 INFO gridmix.Gridmix: Exiting...
 

    
> GridMix Error:  Found no satisfactory file in path 
> ---------------------------------------------------
>
>                 Key: MAPREDUCE-5016
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5016
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/gridmix
>    Affects Versions: 1.1.0, 1.1.1, 2.0.3-alpha
>         Environment: Ubuntu 12.04
>            Reporter: Light 
>
> Hello,
> Everytime i launch gridmix with the command:
> PAPATH=/home/light/Bureau/test_gridmix
> bin/hadoop -classpath $JAR_CLASSPATH org.apache.hadoop.mapred.gridmix.Gridmix  -Dgridmix.min.file.size=10m
-Dgridmix.output.directory=/home/light/Bureau/test -generate 20m $PAPATH /home/light/Bureau/test_rumen_output/job-trace.json
> I have this: Found no satisfactory file in /home/light/Bureau/test_gridmix
> This happen even if i use a hdfs path.
> I have exactly the same problem at first than [MAPREDUCE-2015|https://issues.apache.org/jira/browse/MAPREDUCE-2015]
(File already exist) and finish by having the same problem once my path problem was solved.

> What is bugging me:
> First: GRIDMIX_GENDATA (job_local_0001) success, even if it says it's a succes, in my
folder i only have a _SUCCESS file of size 0.
> I added some wait at this point in GridMix and juste before the check, there is no file
in the output folder.
> Second: Whatever the size asked it will do it in 1s, so i think the problem may be here:
There is a bug for me, no file is generated.
> I tried with every hadoop version and none of them is working.
> Here is the output:
> 13/02/20 14:42:47 INFO gridmix.SubmitterUserResolver:  Current user resolver is SubmitterUserResolver

> 13/02/20 14:42:47 WARN gridmix.Gridmix: Resource null ignored
> 13/02/20 14:42:47 WARN util.NativeCodeLoader: Unable to load native-hadoop library for
your platform... using builtin-java classes where applicable
> 13/02/20 14:42:47 INFO gridmix.Gridmix:  Submission policy is STRESS
> 13/02/20 14:42:47 INFO gridmix.Gridmix: Generating 20,0m of test data...
> 13/02/20 14:42:47 INFO gridmix.Statistics: Not tracking job GRIDMIX_GENDATA as seq id
is less than zero: -1
> 13/02/20 14:42:52 INFO gridmix.JobMonitor: GRIDMIX_GENDATA (job_local_0001) success
> 13/02/20 14:42:57 INFO gridmix.Gridmix: Changing the permissions for inputPath /home/light/Bureau/test_gridmix
> 13/02/20 14:42:57 INFO gridmix.Gridmix: Done.
> 13/02/20 14:44:12 ERROR gridmix.Gridmix: Startup failed
> java.io.IOException: Found no satisfactory file in /home/light/Bureau/test_gridmix
> 	at org.apache.hadoop.mapred.gridmix.FilePool.refresh(FilePool.java:105)
> 	at org.apache.hadoop.mapred.gridmix.JobSubmitter.refreshFilePool(JobSubmitter.java:159)
> 	at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:291)
> 	at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:264)
> 	at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:55)
> 	at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:217)
> 	at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:215)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:416)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
> 	at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:215)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.hadoop.mapred.gridmix.Gridmix.main(Gridmix.java:395)
> 13/02/20 14:44:12 INFO gridmix.Gridmix: Exiting...
> Thanks in advance for any responses
>  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message