hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-21305) LLAP: Option to skip cache for ETL queries
Date Sun, 24 Mar 2019 18:18:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-21305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16800137#comment-16800137
] 

Gopal V commented on HIVE-21305:
--------------------------------

{code}
diff --git a/ql/src/test/results/clientpositive/llap/tez_input_counters.q.out b/ql/src/test/results/clientpositive/llap/tez_input_counters.q.out
index 16a45feb8b..9aa6a211d8 100644
--- a/ql/src/test/results/clientpositive/llap/tez_input_counters.q.out
+++ b/ql/src/test/results/clientpositive/llap/tez_input_counters.q.out
@@ -1815,7 +1815,7 @@ Stage-1 HIVE COUNTERS:
    CREATED_DYNAMIC_PARTITIONS: 74
    CREATED_FILES: 76
    DESERIALIZE_ERRORS: 0
-   RECORDS_IN_Map_1: 240
+   RECORDS_IN_Map_1: 1
{code}

Unrelated bug?

> LLAP: Option to skip cache for ETL queries
> ------------------------------------------
>
>                 Key: HIVE-21305
>                 URL: https://issues.apache.org/jira/browse/HIVE-21305
>             Project: Hive
>          Issue Type: Improvement
>          Components: llap
>    Affects Versions: 4.0.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>            Priority: Major
>         Attachments: HIVE-21305.1.patch, HIVE-21305.2.patch, HIVE-21305.3.patch
>
>
> To avoid ETL queries from polluting the cache, would be good to detect such queries at
compile time and optional skip llap io for such queries. 
> org.apache.hadoop.hive.ql.parse.QBParseInfo.hasInsertTables() is the simplest way  to
catch ETL queries.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message