hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (HIVE-16212) MM tables: suspicious ORC HDFS counter changes
Date Wed, 15 Mar 2017 00:51:41 GMT

     [ https://issues.apache.org/jira/browse/HIVE-16212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Sergey Shelukhin resolved HIVE-16212.
-------------------------------------
    Resolution: Fixed

Turned out to be an mkdir call that was a no-op for non-MM tables but nonetheless increased
the number of ops reported in counters a lot (reads went from 2 to 10, and writes from 2 to
4). 

> MM tables: suspicious ORC HDFS counter changes
> ----------------------------------------------
>
>                 Key: HIVE-16212
>                 URL: https://issues.apache.org/jira/browse/HIVE-16212
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>
> org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[orc_llap_counters1] (batchId=136)
> org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[orc_llap_counters] (batchId=139)
> org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[orc_ppd_basic] (batchId=136)
> org.apache.hadoop.hive.cli.TestMiniLlapCliDriver.testCliDriver[orc_ppd_schema_evol_3a]
(batchId=137)
> HDFS counters for operation counts go up (which I can repro locally).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message