hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shuja Rehman <shujamug...@gmail.com>
Subject Re: Including Additional Jars
Date Wed, 06 Apr 2011 18:31:33 GMT
i am using the following command

*hadoop jar myjar.jar -libjars /home/shuja/lib/mylib.jar  param1 param2
param3*

but the program still giving the error and does not find the mylib.jar. can
u confirm the syntax of command?
thnx



On Wed, Apr 6, 2011 at 8:29 PM, Bill Graham <billgraham@gmail.com> wrote:

> If you could share more specifics regarding just how it's not working
> (i.e., job specifics, stack traces, how you're invoking it, etc), you
> might get more assistance in troubleshooting.
>
>
> On Wed, Apr 6, 2011 at 1:44 AM, Shuja Rehman <shujamughal@gmail.com>
> wrote:
> > -libjars is not working nor distributed cache, any other
> > solution??????????????????????????????????????????
> >
> > On Mon, Apr 4, 2011 at 11:40 PM, James Seigel <james@tynt.com> wrote:
> >
> >> James’ quick and dirty, get your job running guideline:
> >>
> >> -libjars <-- for jars you want accessible by the mappers and reducers
> >> classpath or bundled in the main jar <-- for jars you want accessible to
> >> the runner
> >>
> >> Cheers
> >> James.
> >>
> >>
> >>
> >> On 2011-04-04, at 12:31 PM, Shuja Rehman wrote:
> >>
> >> > well...i think to put in distributed cache is good idea. do u have any
> >> > working example how to put extra jars in distributed cache and how to
> >> make
> >> > available these jars for job?
> >> > Thanks
> >> >
> >> > On Mon, Apr 4, 2011 at 10:20 PM, Mark Kerzner <markkerzner@gmail.com>
> >> wrote:
> >> >
> >> >> I think you can put them either in your jar or in distributed cache.
> >> >>
> >> >> As Allen pointed out, my idea of putting them into hadoop lib jar was
> >> >> wrong.
> >> >>
> >> >> Mark
> >> >>
> >> >> On Mon, Apr 4, 2011 at 12:16 PM, Marco Didonna <
> m.didonna86@gmail.com
> >> >>> wrote:
> >> >>
> >> >>> On 04/04/2011 07:06 PM, Allen Wittenauer wrote:
> >> >>>
> >> >>>>
> >> >>>> On Apr 4, 2011, at 8:06 AM, Shuja Rehman wrote:
> >> >>>>
> >> >>>> Hi All
> >> >>>>>
> >> >>>>> I have created a map reduce job and to run on it on the
cluster, i
> >> have
> >> >>>>> bundled all jars(hadoop, hbase etc) into single jar which
> increases
> >> the
> >> >>>>> size
> >> >>>>> of overall file. During the development process, i need
to copy
> again
> >> >> and
> >> >>>>> again this complete file which is very time consuming so
is there
> any
> >> >> way
> >> >>>>> that i just copy the program jar only and do not need to
copy the
> lib
> >> >>>>> files
> >> >>>>> again and again. i am using net beans to develop the program.
> >> >>>>>
> >> >>>>> kindly let me know how to solve this issue?
> >> >>>>>
> >> >>>>
> >> >>>>       This was in the FAQ, but in a non-obvious place.  I've
> updated
> >> it
> >> >>>> to be more visible (hopefully):
> >> >>>>
> >> >>>>
> >> >>>>
> >> >>
> >>
> http://wiki.apache.org/hadoop/FAQ#How_do_I_submit_extra_content_.28jars.2C_static_files.2C_etc.29_for_my_job_to_use_during_runtime.3F
> >> >>>>
> >> >>>
> >> >>> Does the same apply to jar containing libraries? Let's suppose
I
> need
> >> >>> lucene-core.jar to run my project. Can I put my this jar into my
job
> >> jar
> >> >> and
> >> >>> have hadoop "see" lucene's classes? Or should I use distributed
> cache??
> >> >>>
> >> >>> MD
> >> >>>
> >> >>>
> >> >>
> >> >
> >> >
> >> >
> >> > --
> >> > Regards
> >> > Shuja-ur-Rehman Baig
> >> > <http://pk.linkedin.com/in/shujamughal>
> >>
> >>
> >
> >
> > --
> > Regards
> > Shuja-ur-Rehman Baig
> > <http://pk.linkedin.com/in/shujamughal>
> >
>



-- 
Regards
Shuja-ur-Rehman Baig
<http://pk.linkedin.com/in/shujamughal>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message