mahout-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Summer Lee (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (MAHOUT-1231) "No input clusters found in " error in clustering
Date Wed, 29 May 2013 01:50:20 GMT

     [ https://issues.apache.org/jira/browse/MAHOUT-1231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Summer Lee updated MAHOUT-1231:
-------------------------------

    Description: 
.seqdirectory

> mahout seqdirectory --input /user/hdfs/input/new1.csv --output
> /user/hdfs/new1/seqdirectory --tempDir
> /user/hdfs/new1/seqdirectory/tempDir

2.seq2sparse 

> mahout seq2sparse --input /user/hdfs/new1/seqdirectory --output
> /user/hdfs/new1/seq2sparse -wt tfidf

3.kmeans 

> mahout kmeans --input /user/hdfs/new1/seq2sparse/tfidf-vectors
> --output /user/hdfs/new1/kmeans -c /user/hdfs/new1/clusters/kmeans -x 3 -k 3 --tempDir
/user/hdfs/new1/kmeans/tempDir

and then error is occured


Failing Oozie Launcher, Main class [org.apache.mahout.driver.MahoutDriver], main() threw exception,
No input clusters found in /user/oozie/mahout/z3/kmeansCopy/clusters/part-randomSeed. Check
your -c argument.
java.lang.IllegalStateException: No input clusters found in /user/oozie/mahout/z3/kmeansCopy/clusters/part-randomSeed.
Check your -c argument.
	at org.apache.mahout.clustering.kmeans.KMeansDriver.buildClusters(KMeansDriver.java:217)
	at org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:148)
	at org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:107)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
	at org.apache.mahout.clustering.kmeans.KMeansDriver.main(KMeansDriver.java:48)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
	at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
	at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:467)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
	at org.apache.hadoop.mapred.Child.main(Child.java:249)

Oozie Launcher failed, finishing Hadoop job gracefully


Oozie Launcher ends


=======================================================================================================

When I first tried with this input file, I succeeded on the hadoop in command.
and in Second, also I succeeded.
but in the hadoop with oozie system, Kmeans can't make clusters..
  
Where is the start point of the error?
I'm really frustrated..



  was:
<---seqdirectory output chunk-0 --->
SEQorg.apache.hadoop.io.Textorg.apache.hadoop.io.Textn�甕蛛�]∬�Y80�/mahout_input_z3.csv�0y1,2,1.31704E+12
1,17,3.23E+16
1,49,1.2863E+13
1,94,6.41839E+11
2,64,18022372449 ....

<---seq2sparse output tfidf-vectors/part-r-00000 --->
SEQorg.apache.hadoop.io.Text%org.apache.mahout.math.VectorWritable�HYM�θ9L�

<---kmeans error--->
Failing Oozie Launcher, Main class [org.apache.mahout.driver.MahoutDriver], main() threw exception,
No input clusters found in /user/oozie/mahout/z3/kmeansCopy/clusters/part-randomSeed. Check
your -c argument.
java.lang.IllegalStateException: No input clusters found in /user/oozie/mahout/z3/kmeansCopy/clusters/part-randomSeed.
Check your -c argument.
	at org.apache.mahout.clustering.kmeans.KMeansDriver.buildClusters(KMeansDriver.java:217)
	at org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:148)
	at org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:107)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
	at org.apache.mahout.clustering.kmeans.KMeansDriver.main(KMeansDriver.java:48)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
	at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
	at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:467)
	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
	at org.apache.hadoop.mapred.Child.main(Child.java:249)

Oozie Launcher failed, finishing Hadoop job gracefully


Oozie Launcher ends


=======================================================================================================

When I first tried with this input file, I succeeded on the hadoop in command.
and in Second, also I succeeded.
but in the hadoop with oozie system, Kmeans can't make clusters..
  
Where is the start point of the error?
I'm really frustrated..



    
> "No input clusters found in " error in clustering
> -------------------------------------------------
>
>                 Key: MAHOUT-1231
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1231
>             Project: Mahout
>          Issue Type: Question
>          Components: Clustering
>    Affects Versions: 0.7, 0.8
>            Reporter: Summer Lee
>
> .seqdirectory
> > mahout seqdirectory --input /user/hdfs/input/new1.csv --output
> > /user/hdfs/new1/seqdirectory --tempDir
> > /user/hdfs/new1/seqdirectory/tempDir
> 2.seq2sparse 
> > mahout seq2sparse --input /user/hdfs/new1/seqdirectory --output
> > /user/hdfs/new1/seq2sparse -wt tfidf
> 3.kmeans 
> > mahout kmeans --input /user/hdfs/new1/seq2sparse/tfidf-vectors
> > --output /user/hdfs/new1/kmeans -c /user/hdfs/new1/clusters/kmeans -x 3 -k 3 --tempDir
/user/hdfs/new1/kmeans/tempDir
> and then error is occured
> Failing Oozie Launcher, Main class [org.apache.mahout.driver.MahoutDriver], main() threw
exception, No input clusters found in /user/oozie/mahout/z3/kmeansCopy/clusters/part-randomSeed.
Check your -c argument.
> java.lang.IllegalStateException: No input clusters found in /user/oozie/mahout/z3/kmeansCopy/clusters/part-randomSeed.
Check your -c argument.
> 	at org.apache.mahout.clustering.kmeans.KMeansDriver.buildClusters(KMeansDriver.java:217)
> 	at org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:148)
> 	at org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:107)
> 	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> 	at org.apache.mahout.clustering.kmeans.KMeansDriver.main(KMeansDriver.java:48)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
> 	at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
> 	at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> 	at java.lang.reflect.Method.invoke(Method.java:597)
> 	at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:467)
> 	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
> 	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
> 	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
> 	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
> 	at java.security.AccessController.doPrivileged(Native Method)
> 	at javax.security.auth.Subject.doAs(Subject.java:396)
> 	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
> 	at org.apache.hadoop.mapred.Child.main(Child.java:249)
> Oozie Launcher failed, finishing Hadoop job gracefully
> Oozie Launcher ends
> =======================================================================================================
> When I first tried with this input file, I succeeded on the hadoop in command.
> and in Second, also I succeeded.
> but in the hadoop with oozie system, Kmeans can't make clusters..
>   
> Where is the start point of the error?
> I'm really frustrated..

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message