Mailing-List: contact issues-help@hive.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@hive.apache.org
Date: Thu, 10 Aug 2017 11:38:00 +0000 (UTC)
From: "Peter Vary (JIRA)" <jira@apache.org>
To: issues@hive.apache.org
Message-ID: <JIRA.13086575.1499864697000.137472.1502365080070@Atlassian.JIRA>
In-Reply-To: <JIRA.13086575.1499864697000@Atlassian.JIRA>
References: <JIRA.13086575.1499864697000@Atlassian.JIRA> <JIRA.13086575.1499864697341@jira-lw-us.apache.org>
Subject: [jira] [Commented] (HIVE-17078) Add more logs to MapredLocalTask
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
archived-at: Thu, 10 Aug 2017 11:38:03 -0000


    [ https://issues.apache.org/jira/browse/HIVE-17078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16121503#comment-16121503 ] 

Peter Vary commented on HIVE-17078:
-----------------------------------

Hi [~Yibing],

I have found this {{SparkClientImpl.Redirector}} which is called like this:
{code}
redirect("RemoteDriver-stdout-redir-" + threadName, new Redirector(child.getInputStream()));
{code}

This is essentially the same as the proposed solution here. Do you think it is worth to move this to hive-common, and use it?
Thanks,
Peter

> Add more logs to MapredLocalTask
> --------------------------------
>
>                 Key: HIVE-17078
>                 URL: https://issues.apache.org/jira/browse/HIVE-17078
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Yibing Shi
>            Assignee: Yibing Shi
>            Priority: Minor
>         Attachments: HIVE-17078.1.patch, HIVE-17078.2.patch, HIVE-17078.3.patch, HIVE-17078.4.PATCH, HIVE-17078.5.PATCH
>
>
> By default, {{MapredLocalTask}} is executed in a child process of Hive, in case the local task uses too much resources that may affect Hive. Currently, the stdout and stderr information of the child process is printed in Hive's stdout/stderr log, which doesn't have a timestamp information, and is separated from Hive service logs. This makes it hard to troubleshoot problems in MapredLocalTasks.


--
This message was sent by Atlassian JIRA
(v6.4.14#64029)