hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gopal V (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-13871) Tez exec summary does not get the HIVE counters right
Date Fri, 27 May 2016 02:02:12 GMT
Gopal V created HIVE-13871:
------------------------------

             Summary: Tez exec summary does not get the HIVE counters right
                 Key: HIVE-13871
                 URL: https://issues.apache.org/jira/browse/HIVE-13871
             Project: Hive
          Issue Type: Bug
          Components: llap, Tez
    Affects Versions: 2.1.0
            Reporter: Gopal V


{code}
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) - HIVE:
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    CREATED_FILES: 1
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    DESERIALIZE_ERRORS: 0
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_IN_Map_1: 0
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_IN_Map_4: 0
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_IN_Map_5: 0
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_IN_Map_6: 0
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_IN_Map_7: 0
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_0: 10
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Map_1:
418284
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Map_4:
27440
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Map_5:
365
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Map_6:
101
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Map_7:
48000
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    RECORDS_OUT_INTERMEDIATE_Reducer_2:
10
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) - Shuffle Errors:
{code}

However, the actual operator counters do indicate the total # of vectors.

{code}
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) - TaskCounter_Map_1_INPUT_Map_4:
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    FIRST_EVENT_RECEIVED: 1
2016-05-26T21:59:51,421 INFO  [main]: exec.Task (:()) -    INPUT_RECORDS_PROCESSED: 27440
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message