hadoop-common-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mark Kerzner <markkerz...@gmail.com>
Subject Re: Giving additional jars to my job
Date Wed, 29 Jul 2009 04:02:55 GMT
Thank you, by now I package them inside the main jar, in the lib folder, but
this would also work

On Tue, Jul 28, 2009 at 10:44 PM, Amareshwari Sriramadasu <
amarsri@yahoo-inc.com> wrote:

> You can use -libjars <additional-jars> .
> See
> http://hadoop.apache.org/common/docs/r0.20.0/mapred_tutorial.html#Usagefor more details.
>
> Thanks
> Amareshwari
>
> Mark Kerzner wrote:
>
>> Thanks, toiling on the shell script now, but I agree, it's easy
>>
>> On Tue, Jul 28, 2009 at 2:57 PM, tim robertson <timrobertson100@gmail.com
>> >wrote:
>>
>>
>>
>>> I just use the assembly plugin with maven...
>>>
>>> I think you can do it pretty easily with ant as well though.
>>>
>>> Cheers
>>> Tim
>>>
>>> On Tue, Jul 28, 2009 at 9:54 PM, Mark Kerzner<markkerzner@gmail.com>
>>> wrote:
>>>
>>>
>>>> By the way, could you recommend a script for packaging up the jar with
>>>>
>>>>
>>> all
>>>
>>>
>>>> dependencies?
>>>>
>>>> On Tue, Jul 28, 2009 at 2:28 PM, Mark Kerzner <markkerzner@gmail.com>
>>>>
>>>>
>>> wrote:
>>>
>>>
>>>> I am leaning towards packaging; I see this to be the simplest
>>>>>
>>>>>
>>>>> On Tue, Jul 28, 2009 at 2:25 PM, tim robertson <
>>>>>
>>>>>
>>>> timrobertson100@gmail.com>wrote:
>>>
>>>
>>>> A couple of ways I know of is to add them to the Hadoop classpath
>>>>>> itself in the env.sh or to package up your jar with all it's
>>>>>> dependencies.  The later is the approach I take.
>>>>>>
>>>>>> Cheers
>>>>>>
>>>>>> Tim
>>>>>>
>>>>>>
>>>>>> On Tue, Jul 28, 2009 at 8:20 PM, Mark Kerzner<markkerzner@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>
>>>>>>> Hi,
>>>>>>> take for example this line
>>>>>>>
>>>>>>> bin/hadoop jar /usr/joe/wordcount.jar org.myorg.WordCount
>>>>>>> /usr/joe/wordcount/input /usr/joe/wordcount/output
>>>>>>>
>>>>>>> How do I give additional jars?
>>>>>>>
>>>>>>> Thank you,
>>>>>>> Mark
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message