hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ashutosh Chauhan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10451) PTF deserializer fails if values are not used in reducer
Date Thu, 23 Apr 2015 23:35:38 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510065#comment-14510065
] 

Ashutosh Chauhan commented on HIVE-10451:
-----------------------------------------

{code}
hive> select row_number() over () as x, ss_sold_time_sk from store_sales where ss_sold_time_sk
== 44725 limit 10;

Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.IllegalArgumentException:
Error: name expected at the position 34 of 'struct<reducesinkkey0:int>,struct<>'
but '>' is found.
        at org.apache.hadoop.hive.ql.plan.PTFDeserializer.initialize(PTFDeserializer.java:272)
        at org.apache.hadoop.hive.ql.plan.PTFDeserializer.initialize(PTFDeserializer.java:153)
        at org.apache.hadoop.hive.ql.plan.PTFDeserializer.initializePTFChain(PTFDeserializer.java:92)
        at org.apache.hadoop.hive.ql.exec.PTFOperator.reconstructQueryDef(PTFOperator.java:144)
        at org.apache.hadoop.hive.ql.exec.PTFOperator.initializeOp(PTFOperator.java:75)
        at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:362)
        at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.init(ReduceRecordProcessor.java:160)
        at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:147)
        ... 14 more
Caused by: java.lang.IllegalArgumentException: Error: name expected at the position 34 of
'struct<reducesinkkey0:int>,struct<>' but '>' is found.
        at org.apache.hadoop.hive.serde2.typeinfo.TypeInfoUtils$TypeInfoParser.expect(TypeInfoUtils.java:354)
        at org.apache.hadoop.hive.serde2.typeinfo.TypeInfoUtils$TypeInfoParser.expect(TypeInfoUtils.java:331)
        at org.apache.hadoop.hive.serde2.typeinfo.TypeInfoUtils$TypeInfoParser.parseType(TypeInfoUtils.java:478)
        at org.apache.hadoop.hive.serde2.typeinfo.TypeInfoUtils$TypeInfoParser.parseTypeInfos(TypeInfoUtils.java:305)
        at org.apache.hadoop.hive.serde2.typeinfo.TypeInfoUtils.getTypeInfosFromTypeString(TypeInfoUtils.java:754)
        at org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe.initialize(LazyBinarySerDe.java:120)
        at org.apache.hadoop.hive.serde2.AbstractSerDe.initialize(AbstractSerDe.java:53)
        at org.apache.hadoop.hive.serde2.SerDeUtils.initializeSerDe(SerDeUtils.java:520)
        at org.apache.hadoop.hive.ql.plan.PTFDeserializer.initialize(PTFDeserializer.java:267)
{code}

>  PTF deserializer fails if values are not used in reducer 
> ----------------------------------------------------------
>
>                 Key: HIVE-10451
>                 URL: https://issues.apache.org/jira/browse/HIVE-10451
>             Project: Hive
>          Issue Type: Bug
>          Components: Logical Optimizer
>    Affects Versions: 0.14.0, 1.0.0, 1.1.0
>            Reporter: Gopal V
>            Assignee: Ashutosh Chauhan
>         Attachments: HIVE-10451.1.patch, HIVE-10451.patch
>
>
> In this particular case no values are needed from reducer to complete processing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message