hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jeff Zhang (JIRA)" <j...@apache.org>
Subject [jira] Updated: (PIG-240) Support launching concurrent Pig jobs from one VM
Date Tue, 14 Jul 2009 03:06:15 GMT

     [ https://issues.apache.org/jira/browse/PIG-240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Jeff Zhang updated PIG-240:

    Attachment: patch_240.txt

This is a init patch for supporting mutilthread pig mode.  Pig can submit jobs in each Thread.

I found the mOpToCloneMap in LogicalPlanCloneHelper is static shared, so I made some synchronization
in this variable.  I am not sure whether this patch will completely solve the multithread
problem. Because it is not easy to do test multithread program. But at least it works fine
for me at least several weeks. So if you are really want to support mulithread, you can try
this patch.

> Support launching concurrent Pig jobs from one VM
> -------------------------------------------------
>                 Key: PIG-240
>                 URL: https://issues.apache.org/jira/browse/PIG-240
>             Project: Pig
>          Issue Type: Improvement
>          Components: impl
>            Reporter: Tom White
>            Assignee: Jeff Zhang
>         Attachments: patch_240.txt, pig-240.patch
> For some applications it would be convenient to launch concurrent Pig jobs from a single
VM. This is currently not possible since Pig has static mutable state.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

View raw message