mahout-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jonathan Nassau <jonathan.nas...@gmail.com>
Subject Issue with Mahout in Action Links-Simple-Sorted.txt example
Date Thu, 28 Jun 2012 16:27:10 GMT
I’m running the code and keep getting arrayindexoutofboundsexceptions.

Please let me know if you know the problem or a way to find out.



Thanks the error is below,

Jonathan Nassau



[ec2-user mahout]$ hadoop jar mahout-core-0.7-job.jar
org.apache.mahou=output --usersFile input/users.txt --booleanData
--similarityClassname SIMILARITY_COOC

Warning: $HADOOP_HOME is deprecated.

12/06/28 15:52:48 INFO common.AbstractJob: Command line arguments:
{--booleanData=[fals], --maxSimilaritiesPerItem=[100],
--minPrefsPerUser=[1], --numRecommendations=[10], --le=[input/users.txt]}

12/06/28 15:52:48 INFO common.AbstractJob: Command line arguments:
{--booleanData=[falsPerUser=[1], --output=[temp/preparePreferenceMatrix],
--ratingShift=[0.0], --startPhase

12/06/28 15:52:52 INFO input.FileInputFormat: Total input paths to process
: 1

12/06/28 15:52:52 INFO util.NativeCodeLoader: Loaded the native-hadoop
library

12/06/28 15:52:52 WARN snappy.LoadSnappy: Snappy native library not loaded

12/06/28 15:52:52 INFO mapred.JobClient: Running job: job_201206281512_0001

12/06/28 15:52:53 INFO mapred.JobClient:  map 0% reduce 0%

12/06/28 15:53:30 INFO mapred.JobClient: Task Id :
attempt_201206281512_0001_m_000000_0

java.lang.ArrayIndexOutOfBoundsException: 1

        at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp

        at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp

        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)

        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:416)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja

        at org.apache.hadoop.mapred.Child.main(Child.java:249)

12/06/28 15:53:33 INFO mapred.JobClient: Task Id :
attempt_201206281512_0001_m_000001_0

java.lang.ArrayIndexOutOfBoundsException: 1

        at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp

        at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp

        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)

        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:416)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja

        at org.apache.hadoop.mapred.Child.main(Child.java:249)

12/06/28 15:53:51 INFO mapred.JobClient: Task Id :
attempt_201206281512_0001_m_000000_1

java.lang.ArrayIndexOutOfBoundsException: 1

        at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp

        at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp

        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)

        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:416)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja

        at org.apache.hadoop.mapred.Child.main(Child.java:249)

12/06/28 15:53:52 INFO mapred.JobClient: Task Id :
attempt_201206281512_0001_m_000001_1

java.lang.ArrayIndexOutOfBoundsException: 1

        at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp

        at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp

        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)

        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:416)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja

        at org.apache.hadoop.mapred.Child.main(Child.java:249)

12/06/28 15:54:09 INFO mapred.JobClient: Task Id :
attempt_201206281512_0001_m_000000_2

java.lang.ArrayIndexOutOfBoundsException: 1

        at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp

        at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp

        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)

        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:416)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja

        at org.apache.hadoop.mapred.Child.main(Child.java:249)

12/06/28 15:54:13 INFO mapred.JobClient: Task Id :
attempt_201206281512_0001_m_000001_2

java.lang.ArrayIndexOutOfBoundsException: 1

        at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp

        at
org.apache.mahout.cf.taste.hadoop.item.ItemIDIndexMapper.map(ItemIDIndexMapp

        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)

        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)

        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)

        at org.apache.hadoop.mapred.Child$4.run(Child.java:255)

        at java.security.AccessController.doPrivileged(Native Method)

        at javax.security.auth.Subject.doAs(Subject.java:416)

        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja

        at org.apache.hadoop.mapred.Child.main(Child.java:249)

12/06/28 15:54:34 INFO mapred.JobClient: Job complete: job_201206281512_0001

12/06/28 15:54:34 INFO mapred.JobClient: Counters: 7

12/06/28 15:54:34 INFO mapred.JobClient:   Job Counters

12/06/28 15:54:34 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=157177

12/06/28 15:54:34 INFO mapred.JobClient:     Total time spent by all
reduces waiting af

12/06/28 15:54:34 INFO mapred.JobClient:     Total time spent by all maps
waiting after

12/06/28 15:54:34 INFO mapred.JobClient:     Launched map tasks=8

12/06/28 15:54:34 INFO mapred.JobClient:     Data-local map tasks=8

12/06/28 15:54:34 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0

12/06/28 15:54:34 INFO mapred.JobClient:     Failed map tasks=1

Exception in thread "main" java.io.FileNotFoundException: File does not
exist: /user/ec

        at
org.apache.hadoop.hdfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:1843

        at
org.apache.hadoop.hdfs.DFSClient$DFSInputStream.<init>(DFSClient.java:1834)

        at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:578)

        at
org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java

        at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:427)

        at org.apache.mahout.common.HadoopUtil.readInt(HadoopUtil.java:284)

        at
org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.jav

        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)

        at
org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.ja

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl

        at java.lang.reflect.Method.invoke(Method.java:616)

        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message