hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Brock Noland (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-9297) HS2 should be able to write query logs to HDFS or at least copy them there
Date Wed, 07 Jan 2015 21:45:35 GMT

    [ https://issues.apache.org/jira/browse/HIVE-9297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268300#comment-14268300
] 

Brock Noland commented on HIVE-9297:
------------------------------------

The motivation would be so that support engineers can easily look at the logs associated with
a given query. HDFS allows us to store a large amount of historical logs.

bq. The log information would be there in the HS2 main log file as well.

Yes but it's quite hard to read, intermixed, and hs2 logs roll quickly since they are on local
disk.

> HS2 should be able to write query logs to HDFS or at least copy them there
> --------------------------------------------------------------------------
>
>                 Key: HIVE-9297
>                 URL: https://issues.apache.org/jira/browse/HIVE-9297
>             Project: Hive
>          Issue Type: Task
>            Reporter: Brock Noland
>
> In HIVE-4629 [~dongc] did some fantastic work to support log retrieval. I think a good
next step is to archive these logs in HDFS. This can be done via by writing them directly
to HDFS or copying them to HDFS when the query completes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message