hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "liyunzhang_intel (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-17321) HoS: analyze ORC table doesn't compute raw data size when noscan/partialscan is not specified
Date Thu, 17 Aug 2017 05:07:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16129923#comment-16129923
] 

liyunzhang_intel edited comment on HIVE-17321 at 8/17/17 5:06 AM:
------------------------------------------------------------------

[~lirui]: patch looks good. the changes about *q.out is all about orc?


was (Author: kellyzly):
[~lirui]: patch looks good. But I  have 1 question´╝î why the statistic of limitpushdown.q
changes? 
before
{code}
    if ((OrcInputFormat.class.isAssignableFrom(inputFormat) ||
          MapredParquetInputFormat.class.isAssignableFrom(inputFormat)) && (noScan
|| partialScan)) {

{code}

Now
{code}
  if ((OrcInputFormat.class.isAssignableFrom(inputFormat) ||
          MapredParquetInputFormat.class.isAssignableFrom(inputFormat))
{code}
If the InputFormat is TextFile, i think your patch will not change the result.   If my understanding
is not right, tell me.

> HoS: analyze ORC table doesn't compute raw data size when noscan/partialscan is not specified
> ---------------------------------------------------------------------------------------------
>
>                 Key: HIVE-17321
>                 URL: https://issues.apache.org/jira/browse/HIVE-17321
>             Project: Hive
>          Issue Type: Bug
>          Components: Spark
>            Reporter: Rui Li
>            Assignee: Rui Li
>            Priority: Minor
>         Attachments: HIVE-17321.1.patch, HIVE-17321.2.patch
>
>
> Need to implement HIVE-9560 for Spark.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message