hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12976) MetaStoreDirectSql doesn't batch IN lists in all cases
Date Thu, 04 Feb 2016 23:00:41 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15133263#comment-15133263
] 

Gopal V commented on HIVE-12976:
--------------------------------

[~sershe]: LGTM - +1 with some caveats.

[~ashutoshc]/[~sushanth]: any comments on the code itself? I haven't understood the original
code enough to be definite.

{code}
hive> explain select * from lineitem where l_orderkey = 1212000001;
OK
Plan optimized by CBO.

Stage-0
   Fetch Operator
      limit:-1
      Stage-1
         Map 1 vectorized, llap
         File Output Operator [FS_7]
            compressed:false
            Statistics:Num rows: 1434 Data size: 1274826 Basic stats: COMPLETE Column stats:
COMPLETE
            table:{"input format:":"org.apache.hadoop.mapred.TextInputFormat","output format:":"org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat","serde:":"org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe"}
            Select Operator [OP_6]
               outputColumnNames:["_col0","_col1","_col2","_col3","_col4","_col5","_col6","_col7","_col8","_col9","_col10","_col11","_col12","_col13","_col14","_col15"]
               Statistics:Num rows: 1434 Data size: 1274826 Basic stats: COMPLETE Column stats:
COMPLETE
               Filter Operator [FIL_5]
                  predicate:(l_orderkey = 1212000001) (type: boolean)
                  Statistics:Num rows: 1434 Data size: 1274826 Basic stats: COMPLETE Column
stats: COMPLETE
                  TableScan [TS_0]
                     alias:lineitem
                     Statistics:Num rows: 5999989709 Data size: 5333990851301 Basic stats:
COMPLETE Column stats: COMPLETE

Time taken: 1.709 seconds, Fetched: 21 row(s)
{code}

> MetaStoreDirectSql doesn't batch IN lists in all cases
> ------------------------------------------------------
>
>                 Key: HIVE-12976
>                 URL: https://issues.apache.org/jira/browse/HIVE-12976
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Gopal V
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-12976.01.patch, HIVE-12976.02.patch, HIVE-12976.patch
>
>
> That means that some RDBMS products with arbitrary limits cannot run these queries. I
hope HBase metastore comes soon and delivers us from Oracle! For now, though, we have to fix
this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message