hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zheng Shao (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HIVE-869) Allow ScriptOperator to consume not all input data
Date Sat, 10 Oct 2009 00:18:31 GMT

     [ https://issues.apache.org/jira/browse/HIVE-869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Zheng Shao updated HIVE-869:
----------------------------

    Description: 
The ScriptOperator (SELECT TRANSFORM(a, b, c) USING 'myscript' AS (d, e, f) ...) has a problem:
If the user script exits without consuming all data from standard input, then we will report
an error even if the exit code from the user script is 0.

We want to have an option, when enabled, ScriptOperator will return successfully in that case.

If the option is not enabled, then we should stick to the current behavior.

The option can be called: "hive.exec.script.allow.partial.consumption ".


  was:
The ScriptOperator (SELECT TRANSFORM(a, b, c) USING 'myscript' AS (d, e, f) ...) has a problem:
If the user script exits without consuming all data from standard input, then we will report
an error even if the exit code from the user script is 0.

We want to have an option, when enabled, ScriptOperator will return successfully in that case.

If the option is not enabled, then we should stick to the current behavior.

The option can be called: "hive.script.allow.partial.consumption".



> Allow ScriptOperator to consume not all input data
> --------------------------------------------------
>
>                 Key: HIVE-869
>                 URL: https://issues.apache.org/jira/browse/HIVE-869
>             Project: Hadoop Hive
>          Issue Type: New Feature
>    Affects Versions: 0.5.0
>            Reporter: Zheng Shao
>            Assignee: Paul Yang
>             Fix For: 0.5.0
>
>         Attachments: HIVE-869.1.patch, HIVE-869.2.patch, HIVE-869.3.patch
>
>
> The ScriptOperator (SELECT TRANSFORM(a, b, c) USING 'myscript' AS (d, e, f) ...) has
a problem:
> If the user script exits without consuming all data from standard input, then we will
report an error even if the exit code from the user script is 0.
> We want to have an option, when enabled, ScriptOperator will return successfully in that
case.
> If the option is not enabled, then we should stick to the current behavior.
> The option can be called: "hive.exec.script.allow.partial.consumption ".

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message