pig-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Daniel Dai (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (PIG-5216) Customizable Error Handling for Loaders in Pig
Date Wed, 31 May 2017 18:58:04 GMT

     [ https://issues.apache.org/jira/browse/PIG-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Daniel Dai updated PIG-5216:
----------------------------
    Attachment: PIG-5216-4.patch

Find several issues when running unit tests:
1. In POLoad.setup, we also need to set LoadFuncDecorator
2. When serializing "pig.loads", set POLoad.parentPlan null as we don't want to serialize
all physical plan
3. In MRJobStats, we still refer "pig.inputs"
4. Some formatting issues

Attach PIG-5216-4.patch.

> Customizable Error Handling for Loaders in Pig
> ----------------------------------------------
>
>                 Key: PIG-5216
>                 URL: https://issues.apache.org/jira/browse/PIG-5216
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Iris Zeng
>            Assignee: Iris Zeng
>             Fix For: 0.18.0
>
>         Attachments: PIG-5216-1.patch, PIG-5216-2.patch, PIG-5216-3.patch, PIG-5216-4.patch
>
>
> Add Error Handling for Loaders in Pig, so that user can choose to allow errors when load
data, and set error numbers / rate
> Ideas based on error handling on store func see https://issues.apache.org/jira/browse/PIG-4704



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message