hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jesus Camacho Rodriguez (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-13871) Tez exec summary does not get the HIVE counters right
Date Tue, 31 May 2016 19:00:14 GMT

     [ https://issues.apache.org/jira/browse/HIVE-13871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jesus Camacho Rodriguez updated HIVE-13871:
-------------------------------------------
    Target Version/s: 2.2.0  (was: 2.1.0)

> Tez exec summary does not get the HIVE counters right
> -----------------------------------------------------
>
>                 Key: HIVE-13871
>                 URL: https://issues.apache.org/jira/browse/HIVE-13871
>             Project: Hive
>          Issue Type: Bug
>          Components: llap, Tez
>    Affects Versions: 2.1.0
>            Reporter: Gopal V
>
> {code}
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) - HIVE:
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    CREATED_FILES: 1
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    DESERIALIZE_ERRORS: 0
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_IN_Map_1: 0
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_IN_Map_4: 0
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_IN_Map_5: 0
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_IN_Map_6: 0
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_IN_Map_7: 0
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_0: 10
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Map_1:
418284
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Map_4:
27440
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Map_5:
365
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Map_6:
101
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Map_7:
48000
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Reducer_2:
10
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) - Shuffle Errors:
> {code}
> However, the actual operator counters do indicate the total # of vectors.
> {code}
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) - TaskCounter_Map_1_INPUT_Map_4:
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    FIRST_EVENT_RECEIVED: 1
> 2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    INPUT_RECORDS_PROCESSED: 27440
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message