hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Peter Vary (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-17078) Add more logs to MapredLocalTask
Date Thu, 10 Aug 2017 11:38:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-17078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16121503#comment-16121503
] 

Peter Vary commented on HIVE-17078:
-----------------------------------

Hi [~Yibing],

I have found this {{SparkClientImpl.Redirector}} which is called like this:
{code}
redirect("RemoteDriver-stdout-redir-" + threadName, new Redirector(child.getInputStream()));
{code}

This is essentially the same as the proposed solution here. Do you think it is worth to move
this to hive-common, and use it?
Thanks,
Peter

> Add more logs to MapredLocalTask
> --------------------------------
>
>                 Key: HIVE-17078
>                 URL: https://issues.apache.org/jira/browse/HIVE-17078
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Yibing Shi
>            Assignee: Yibing Shi
>            Priority: Minor
>         Attachments: HIVE-17078.1.patch, HIVE-17078.2.patch, HIVE-17078.3.patch, HIVE-17078.4.PATCH,
HIVE-17078.5.PATCH
>
>
> By default, {{MapredLocalTask}} is executed in a child process of Hive, in case the local
task uses too much resources that may affect Hive. Currently, the stdout and stderr information
of the child process is printed in Hive's stdout/stderr log, which doesn't have a timestamp
information, and is separated from Hive service logs. This makes it hard to troubleshoot problems
in MapredLocalTasks.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message