hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thejas M Nair (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-1489) Pig MapReduceLauncher does not use jars in register statement
Date Fri, 23 Jul 2010 23:17:50 GMT

    [ https://issues.apache.org/jira/browse/PIG-1489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12891856#action_12891856

Thejas M Nair commented on PIG-1489:

You can commit after verifying that tests & checks are passing.

>  Pig MapReduceLauncher does not use jars in register statement 
> ---------------------------------------------------------------
>                 Key: PIG-1489
>                 URL: https://issues.apache.org/jira/browse/PIG-1489
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Olga Natkovich
>            Assignee: Richard Ding
>             Fix For: 0.8.0
>         Attachments: PIG-1489.patch, PIG-1489.patch, PIG-1489_1.patch
> If my Pig StorFunc has its own OutputFormat class then Pig MapReducelauncher will try
to instantiate it before
> launching the mapreduce job and fail with ClassNotFoundException.
> This happens because Pig MapReduce launcher uses its own classloader and ignores the
classes in the jars in the
> register statement.
> The effect is that the jars not only have to be in "register " statement in the script
but also in the pig
> classpath with the -classpath tag. 
> This can be remedied by making the Pig MapReduceLauncher constructing a classloader that
includes the registered jars
> and using that to instantiate the OutputFormat class.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message