hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eason.Lee" <leongf...@gmail.com>
Subject Re: not a SequenceFile?
Date Thu, 18 Jun 2009 05:56:40 GMT
you'd better run it like this:

bin/hadoop jar hadoop-*-examples.jar aggregatewordcount input output
numOfReducers *textinputformat*
*
*
input textinputformat to use textinputformat instand of SequenceFile

hope it is helpful!

2009/6/18 Shravan Mahankali <shravan.mahankali@catalytic.com>

> Hi Nick,
>
>
>
> Thanks for your response.
>
>
>
> I am very new to Hadoop. I was trying to execute the "AggregateWordCount"
> example program provided by Hadoop in the distribution from the linux but
> was having the issue as stated in my earlier email.
>
>
>
> I have also tried executing the MultiFetch example with no success.
>
>
>
> If this example program needs the input file to be a sequence file. how
> should I create one, please advice?
>
>
>
> Thank You,
>
> Shravan Kumar. M
>
> Catalytic Software Ltd. [SEI-CMMI Level 5 Company]
>
> -----------------------------
>
> This email and any files transmitted with it are confidential and intended
> solely for the use of the individual or entity to whom they are addressed.
> If you have received this email in error please notify the system
> administrator -  <mailto:netopshelpdesk@catalytic.com>
> netopshelpdesk@catalytic.com
>
>   _____
>
> From: Nick Cen [mailto:cenyongh@gmail.com]
> Sent: Wednesday, June 17, 2009 6:50 PM
> To: core-user@hadoop.apache.org; shravan.mahankali@catalytic.com
> Subject: Re: not a SequenceFile?
>
>
>
> I guest you have set SequenceFileFormat as your inputformat in the
> configuration object, but the file you provide is not a sequence file.
>
> 2009/6/17 Shravan Mahankali <shravan.mahankali@catalytic.com>
>
> Hi Group,
>
>
>
> I have trouble running couple of examples provided by Hadoop. Below are the
> error messages I have from the console, could you please advise what could
> be the problem and probable solution?
>
>
>
> 09/06/17 16:30:29 INFO mapred.FileInputFormat: Total input paths to process
> : 1
>
> 09/06/17 16:30:29 INFO mapred.FileInputFormat: Total input paths to process
> : 1
>
> 09/06/17 16:30:29 INFO mapred.JobClient: Running job: job_200906171601_0009
>
> 09/06/17 16:30:30 INFO mapred.JobClient:  map 0% reduce 0%
>
> 09/06/17 16:30:38 INFO mapred.JobClient: Task Id :
> attempt_200906171601_0009_m_000000_0, Status : FAILED
>
> java.io.IOException: hdfs://localhost:9000/user/root/words not a
> SequenceFile
>
>       at
> org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1458)
>
>       at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1431)
>
>       at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1420)
>
>       at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1415)
>
>       at
>
> org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordR
> eader.java:43)
>
>       at
>
> org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFil
> eInputFormat.java:54)
>
>       at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
>
>       at
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2198)
>
>
>
> 09/06/17 16:30:39 INFO mapred.JobClient: Task Id :
> attempt_200906171601_0009_r_000000_0, Status : FAILED
>
> java.lang.RuntimeException: java.lang.ClassNotFoundException:
> org.apache.hadoop.examples.AggregateWordCount$WordCountPlugInClass
>
>       at
>
> org.apache.hadoop.mapred.lib.aggregate.UserDefinedValueAggregatorDescriptor.
> createInstance(UserDefinedValueAggregatorDescriptor.java:57)
>
>       at
>
> org.apache.hadoop.mapred.lib.aggregate.UserDefinedValueAggregatorDescriptor.
> createAggregator(UserDefinedValueAggregatorDescriptor.java:64)
>
>       at
>
> org.apache.hadoop.mapred.lib.aggregate.UserDefinedValueAggregatorDescriptor.
> <init>(UserDefinedValueAggregatorDescriptor.java:76)
>
>       at
>
> org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJobBase.getValueAggreg
> atorDescriptor(ValueAggregatorJobBase.java:54)
>
>       at
>
> org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJobBase.getAggregatorD
> escriptors(ValueAggregatorJobBase.java:65)
>
>       at
>
> org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJobBase.initializeMySp
> ec(ValueAggregatorJobBase.java:74)
>
>       at
>
> org.apache.hadoop.mapred.lib.aggregate.ValueAggregatorJobBase.configure(Valu
> eAggregatorJobBase.java:42)
>
>       at
> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
>
>       at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:82)
>
>       at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:240)
>
>       at
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2198)
>
> Caused by: java.lang.ClassNotFoundException:
> org.apache.hadoop.examples.AggregateWordCount$WordCountPlugInClass
>
>       at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>
>       at java.security.AccessController.doPrivileged(Native Method)
>
>       at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>
>       at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>
>       at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:268)
>
>       at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
>
>       at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
>
>       at java.lang.Class.forName0(Native Method)
>
>       at java.lang.Class.forName(Class.java:242)
>
>       at
>
> org.apache.hadoop.mapred.lib.aggregate.UserDefinedValueAggregatorDescriptor.
> createInstance(UserDefinedValueAggregatorDescriptor.java:52)
>
>       ... 10 more
>
>
>
> Thank You,
>
> Shravan Kumar. M
>
> Catalytic Software Ltd. [SEI-CMMI Level 5 Company]
>
> -----------------------------
>
> This email and any files transmitted with it are confidential and intended
> solely for the use of the individual or entity to whom they are addressed.
> If you have received this email in error please notify the system
> administrator -  <mailto:netopshelpdesk@catalytic.com>
> netopshelpdesk@catalytic.com
>
>
>
>
>
>
>
>
>
> --
> http://daily.appspot.com/food/
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message