hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Phabricator (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HIVE-5182) log more stuff via PerfLogger
Date Fri, 06 Sep 2013 01:31:51 GMT

     [ https://issues.apache.org/jira/browse/HIVE-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Phabricator updated HIVE-5182:
------------------------------

    Attachment: HIVE-5182.D12639.3.patch

sershe updated the revision "HIVE-5182 [jira] log more stuff via PerfLogger".

  Add serialize, deserialize and clone plan with corresponding perf logs; change existing
usage of (de)serializeObject to use these where appropriate. Too bad MapRedWork/MapWork/...
don't have a common base class

Reviewers: JIRA

REVISION DETAIL
  https://reviews.facebook.net/D12639

CHANGE SINCE LAST DIFF
  https://reviews.facebook.net/D12639?vs=39495&id=39621#toc

AFFECTED FILES
  ql/src/java/org/apache/hadoop/hive/ql/Driver.java
  ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java
  ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java
  ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapRedTask.java
  ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapredLocalTask.java
  ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveInputFormat.java
  ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java
  ql/src/java/org/apache/hadoop/hive/ql/log/PerfLogger.java
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/CommonJoinTaskDispatcher.java
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/GenMRSkewJoinProcessor.java
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/SortMergeJoinTaskDispatcher.java
  ql/src/java/org/apache/hadoop/hive/ql/plan/MapredWork.java

To: JIRA, sershe

                
> log more stuff via PerfLogger
> -----------------------------
>
>                 Key: HIVE-5182
>                 URL: https://issues.apache.org/jira/browse/HIVE-5182
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-5182.D12639.1.patch, HIVE-5182.D12639.2.patch, HIVE-5182.D12639.3.patch
>
>
> PerfLogger output is useful in understanding perf. There are large gaps in it, however,
and it's not clear what is going on during these. Some sections are large and have no breakdown.
It would be nice to add more stuff. At this point I'm not certain where exactly, whoever makes
the patch (me?) will just need to look at the above gaps and fill them in.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message