hadoop-hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zheng Shao (JIRA)" <j...@apache.org>
Subject [jira] Commented: (HIVE-857) Transform should produce objects in the same type as specified at runtime
Date Fri, 25 Sep 2009 22:01:17 GMT

    [ https://issues.apache.org/jira/browse/HIVE-857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759774#action_12759774
] 

Zheng Shao commented on HIVE-857:
---------------------------------

This only affects 0.4.

The transaction that added the new syntax is r803371,  HIVE-743. Let user specify serde for
custom sctipts. (Namit Jain via rmurthy)
The transaction that fixed the issue is r807330, HIVE-708. Add TypedBytes SerDe for transform.
(Namit Jain via zshao).

We may either pull in the whole of HIVE-708 to branch 0.4, or split HIVE-708's transaction.



> Transform should produce objects in the same type as specified at runtime
> -------------------------------------------------------------------------
>
>                 Key: HIVE-857
>                 URL: https://issues.apache.org/jira/browse/HIVE-857
>             Project: Hadoop Hive
>          Issue Type: Bug
>    Affects Versions: 0.4.0, 0.4.1
>            Reporter: Zheng Shao
>
> The following code fails at runtime, because the "clicked" field produced by "transform"
is actually of type String at runtime, instead of boolean.
> {code}
> INSERT OVERWRITE TABLE feature_index
> SELECT
>  temp.feature,
>  temp.ad_id,
>  sum(if(temp.clicked, 1, 0)) / cast(count(temp.clicked) as DOUBLE) as clicked_percent
> FROM (
>  SELECT concat('ua:', trim(lower(ua.feature))) as feature, ua.ad_id, ua.clicked
>  FROM (
>   MAP raw_logs.user_agent, raw_logs.ad_id, raw_logs.clicked
>   USING 'my.py' as (feature STRING, ad_id STRING, clicked BOOLEAN)
>   FROM raw_logs
>  ) ua
> ) temp
> GROUP BY temp.feature, temp.ad_id;
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message