hadoop-pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pi Song (JIRA)" <j...@apache.org>
Subject [jira] Commented: (PIG-94) Pig Streaming functional spec proposal
Date Thu, 20 Mar 2008 13:39:24 GMT

    [ https://issues.apache.org/jira/browse/PIG-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12580764#action_12580764
] 

Pi Song commented on PIG-94:
----------------------------

OK I'm not defining any new terminology. There are 3 cases:-

(1) 1 input record becomes 1 output record (non-blocking)
(2) A subset of input records become output records (blocking)
(3) A subset of input records become output records via input file(blocking)

For (1) you can do what I suggested.
For (2),(3) seems what you can do is monitoring if the process still alive (But doesn't help
if the process gets stuck in itself)

Still no good solution + we can improve it incrementally.

Let's keep this as a back burner work then.

Your patch looks good.

> Pig Streaming functional spec proposal
> --------------------------------------
>
>                 Key: PIG-94
>                 URL: https://issues.apache.org/jira/browse/PIG-94
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Olga Natkovich
>            Assignee: Arun C Murthy
>         Attachments: patch.txt, PIG-94_1_1_20080304.patch, PIG-94_1_20080303.patch, PIG-94_2_0_20080317.patch,
PigStreamingTestPlan.htm
>
>
> This issue is for discussion about Pig streaming functional spec.
> http://wiki.apache.org/pig/PigStreamingFunctionalSpec

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message