hadoop-mapreduce-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Harsh J <ha...@cloudera.com>
Subject Re: Map Reduce when downloading files...
Date Wed, 25 May 2011 16:13:59 GMT
I haven't gone through the whole thing, but getting the Configuration
object via a static member "conf" set only during submission (main())
will not work - and is probably why there's an NPE.

Use the Context object in the map() call to get a configuration
instance. That is the only right way I know of.

i.e., change 124 to:
groupTask = new GroupTask(context.getConfiguration(), groupID,
PhotosDownload.outputPath, f.getPoolsInterface());

On Wed, May 25, 2011 at 9:37 PM, Michael Giannakopoulos
<miccagiann@gmail.com> wrote:
> Alright, I 'll send you the code (it's an amateur application). Any help is
> appreciated! (Don't bother with the Flickrj API)... And something else, how
> do you debug a map/reduce app so as to be sure what happens. I use eclipse
> and hadoop's plugin for eclipse (Galileo). Thanks a lot!

Harsh J

View raw message