hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Naveen Gangam (JIRA)" <>
Subject [jira] [Updated] (HIVE-9023) HiveHistoryImpl relies on removed counters to print num rows
Date Wed, 04 Feb 2015 04:51:35 GMT


Naveen Gangam updated HIVE-9023:
    Status: Patch Available  (was: Open)

I tried to post a diff on the review board. DOesnt appear that RB is working. 

The Counter key name was changed to RECORDS_OUT. However, this cannot be a single value because
a single query could affect multiple tables. So I used the tableName as the suffix to the
counter key.

For example
from srcTable
insert overwrite table destTable1 select * where key = "value1"
insert overwrite table destTable2 select * where key = "value2"
insert overwrite table destTable3 select * where key = "value3";

The counter key names would be

The Hive History then extracts the table name and the number of rows that were inserted into
this table.

Loading data to table default.destTable2
Loading data to table default.destTable3
Table default.destTable1 stats: [numFiles=1, numRows=0, totalSize=38, rawDataSize=0]
Table default.destTable2 stats: [numFiles=1, numRows=0, totalSize=18, rawDataSize=0]
Table default.destTable3 stats: [numFiles=1, numRows=0, totalSize=20, rawDataSize=0]
3 Rows loaded to destTable1
6 Rows loaded to destTable2
3 Rows loaded to destTable3

> HiveHistoryImpl relies on removed counters to print num rows
> ------------------------------------------------------------
>                 Key: HIVE-9023
>                 URL:
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>    Affects Versions: 0.13.1, 0.14.0, 0.13.0, 0.14.1
>            Reporter: Slava Markeyev
>            Assignee: Naveen Gangam
>            Priority: Minor
>              Labels: regression
>         Attachments: HIVE-9023.patch
> HiveHistoryImpl still relies on the counters that were removed in HIVE-5982 to determine
the number of rows loaded. This results in regression of functionality. 

This message was sent by Atlassian JIRA

View raw message