mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Neil Ghosh <neil.gh...@gmail.com>
Subject Re: Training not progressing
Date Fri, 19 Nov 2010 18:33:30 GMT
/hadoop-site.xm in hadoop conf dir was the culprit , it is decripited , I
removed it .It worked

 Instead use core-site.xml, mapred-site.xml and hdfs-site.xml to override
properties of core-default.xml, mapred-default.xml and hdfs-default.xml
respectively


On Fri, Nov 19, 2010 at 11:50 PM, Neil Ghosh <neil.ghosh@gmail.com> wrote:

> After sometime I get this exception
>
> Exception in thread "main" java.io.IOException: Call to localhost/
> 127.0.0.1:9001 failed on local exception: java.io.IOException: Connection
> reset by peer
>     at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
>     at org.apache.hadoop.ipc.Client.call(Client.java:743)
>     at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
>     at org.apache.hadoop.mapred.$Proxy1.getProtocolVersion(Unknown Source)
>     at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
>     at
> org.apache.hadoop.mapred.JobClient.createRPCProxy(JobClient.java:429)
>     at org.apache.hadoop.mapred.JobClient.init(JobClient.java:423)
>     at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:410)
>     at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1248)
>     at
> org.apache.mahout.classifier.bayes.mapreduce.common.BayesFeatureDriver.runJob(BayesFeatureDriver.java:63)
>     at
> org.apache.mahout.classifier.bayes.mapreduce.cbayes.CBayesDriver.runJob(CBayesDriver.java:44)
>     at
> org.apache.mahout.classifier.bayes.TrainClassifier.trainCNaiveBayes(TrainClassifier.java:59)
>     at
> org.apache.mahout.classifier.bayes.TrainClassifier.main(TrainClassifier.java:158)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
>     at
> org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
>     at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
>     at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:184)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>     at java.lang.reflect.Method.invoke(Method.java:597)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Caused by: java.io.IOException: Connection reset by peer
>     at sun.nio.ch.FileDispatcher.read0(Native Method)
>     at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:21)
>     at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:237)
>     at sun.nio.ch.IOUtil.read(IOUtil.java:210)
>     at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:236)
>     at
> org.apache.hadoop.net.SocketInputStream$Reader.performIO(SocketInputStream.java:55)
>     at
> org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
>     at
> org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:155)
>     at
> org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:128)
>     at java.io.FilterInputStream.read(FilterInputStream.java:116)
>     at
> org.apache.hadoop.ipc.Client$Connection$PingInputStream.read(Client.java:276)
>     at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
>     at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
>     at java.io.DataInputStream.readInt(DataInputStream.java:370)
>     at
> org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:501)
>     at org.apache.hadoop.ipc.Client$Connection.run(Client.java:446)
>
>
>
> On Fri, Nov 19, 2010 at 11:17 PM, Neil Ghosh <neil.ghosh@gmail.com> wrote:
>
>> Hi I am trying to train the classifier with text as bayesian format but it
>> is stuck in the following message
>>
>> Reading features
>>
>> input1 in dfs had the text files with class name as 1st word and rest the
>> documents
>>
>> Please suggest why it is not progressing .JOBTracker does not show any
>> running job
>>
>> neil@neil-laptop:~$ $MAHOUT_HOME/bin/mahout trainclassifier -i input1  -o
>> model1   -type bayes   -ng 3   -source hdfs
>> Running on hadoop, using HADOOP_HOME=/home/neil/hadoop-0.20.2
>> No HADOOP_CONF_DIR set, using /home/neil/IIIT/hadoop-0.20.2/conf
>> 10/11/19 23:06:08 WARN conf.Configuration: DEPRECATED: hadoop-site.xml
>> found in the classpath. Usage of hadoop-site.xml is deprecated. Instead use
>> core-site.xml, mapred-site.xml and hdfs-site.xml to override properties of
>> core-default.xml, mapred-default.xml and hdfs-default.xml respectively
>> 10/11/19 23:06:09 INFO bayes.TrainClassifier: Training Bayes Classifier
>> 10/11/19 23:06:10 INFO bayes.BayesDriver: Reading features...
>>
>>
>> --
>> Thanks and Regards
>> Neil
>> http://neilghosh.com
>>
>>
>>
>>
>
>
> --
> Thanks and Regards
> Neil
> http://neilghosh.com
>
>
>
>


-- 
Thanks and Regards
Neil
http://neilghosh.com

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message