Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 0A48ECDE0 for ; Wed, 7 Jan 2015 21:45:36 +0000 (UTC) Received: (qmail 39900 invoked by uid 500); 7 Jan 2015 21:45:35 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 39803 invoked by uid 500); 7 Jan 2015 21:45:35 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 39652 invoked by uid 500); 7 Jan 2015 21:45:35 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 39629 invoked by uid 99); 7 Jan 2015 21:45:35 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 07 Jan 2015 21:45:35 +0000 Date: Wed, 7 Jan 2015 21:45:35 +0000 (UTC) From: "Brock Noland (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-9297) HS2 should be able to write query logs to HDFS or at least copy them there MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268300#comment-14268300 ] Brock Noland commented on HIVE-9297: ------------------------------------ The motivation would be so that support engineers can easily look at the logs associated with a given query. HDFS allows us to store a large amount of historical logs. bq. The log information would be there in the HS2 main log file as well. Yes but it's quite hard to read, intermixed, and hs2 logs roll quickly since they are on local disk. > HS2 should be able to write query logs to HDFS or at least copy them there > -------------------------------------------------------------------------- > > Key: HIVE-9297 > URL: https://issues.apache.org/jira/browse/HIVE-9297 > Project: Hive > Issue Type: Task > Reporter: Brock Noland > > In HIVE-4629 [~dongc] did some fantastic work to support log retrieval. I think a good next step is to archive these logs in HDFS. This can be done via by writing them directly to HDFS or copying them to HDFS when the query completes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)