oozie-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alejandro Abdelnur <t...@cloudera.com>
Subject Re: running cascading word count example as a java action
Date Wed, 02 Nov 2011 04:46:01 GMT
If cascading submits its own jobs, it must push somehow the JARs to
the DistributedCache.

When doing cascading, do you have all JARs bundled in a single JAR an
call cascading with that JAR?

If so you should put such cluster JAR in the WF lib/

Thanks.

Alejandro

On Tue, Nov 1, 2011 at 6:36 PM, Tim Chan <tim@chan.net> wrote:
> Yes, that jar is being included in the oozie lib. But it seems to not be
> available to the job that cascading spawns.
>
> On Tue, Nov 1, 2011 at 6:34 PM, Angelo K. Huang <angelohuang@gmail.com>wrote:
>
>> Do you know which jar contains MultiInputSplit?
>>
>> --angelo
>>
>> On Tue, Nov 1, 2011 at 6:29 PM, Tim Chan <tim@chan.net> wrote:
>>
>> > I've already done that. I think the problem is that cascading itself is a
>> > scheduler. It launches the m/r job on it's own. I've read from the
>> > cascading list that people often stuff all the classes from the cascading
>> > jar into the job jar.
>> >
>> > On Tue, Nov 1, 2011 at 5:44 PM, Alejandro Abdelnur <tucu@cloudera.com
>> > >wrote:
>> >
>> > > Tim,
>> > >
>> > > Try adding all cascading JARs (and its dependencies) in the WF lib/
>> > > directory
>> > >
>> > > Thanks.
>> > >
>> > > Alejandro
>> > >
>> > > On Tue, Nov 1, 2011 at 5:13 PM, Tim Chan <tim@chan.net> wrote:
>> > >
>> > > > I'm trying to run the word count example as a java action on oozie.
I
>> > > > am getting the following error:
>> > > >
>> > > > Caused by: java.lang.ClassNotFoundException:
>> > > > cascading.tap.hadoop.MultiInputSplit
>> > > >
>> > > > I have already tried adding the cascading jar to my Java action via
>> > > > file and archive tags.
>> > > >
>> > > > Has anyone else encountered this issue with cascading?
>> > > >
>> > >
>> >
>> >
>> >
>> > --
>> > [image: Monkey]  Tim Chan   //  tim@chan.net   //   213.784.2523
>> >
>>
>
>
>
> --
> [image: Monkey]  Tim Chan   //  tim@chan.net   //   213.784.2523
>

Mime
View raw message