hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eugene Chung (Jira)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-24590) Operation Logging still leaks the log4j Appenders
Date Wed, 06 Jan 2021 12:50:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-24590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17259686#comment-17259686
] 

Eugene Chung commented on HIVE-24590:
-------------------------------------

[^add_debug_log_and_trace.patch] I added some debug logs like this patch to HushableRandomAccessFileAppender.
(Note that my HushableRandomAccessFileAppender is patched with [HIVE-22753|https://issues.apache.org/jira/browse/HIVE-22753])

!Screen Shot 2021-01-06 at 21.38.32.png|width=1574,height=67!

Then it seems that operation log file with the different name is created by the same thread.

!Screen Shot 2021-01-06 at 21.47.28.png|width=1457,height=35!

> Operation Logging still leaks the log4j Appenders
> -------------------------------------------------
>
>                 Key: HIVE-24590
>                 URL: https://issues.apache.org/jira/browse/HIVE-24590
>             Project: Hive
>          Issue Type: Bug
>          Components: Logging
>            Reporter: Eugene Chung
>            Assignee: Stamatis Zampetakis
>            Priority: Major
>         Attachments: Screen Shot 2021-01-06 at 18.42.05.png, Screen Shot 2021-01-06 at
18.42.24.png, Screen Shot 2021-01-06 at 18.42.55.png, Screen Shot 2021-01-06 at 21.38.32.png,
Screen Shot 2021-01-06 at 21.47.28.png, add_debug_log_and_trace.patch
>
>
> I'm using Hive 3.1.2 with options below.
>  * hive.server2.logging.operation.enabled=true
>  * hive.server2.logging.operation.level=VERBOSE
>  * hive.async.log.enabled=false
> I already know the ticket, https://issues.apache.org/jira/browse/HIVE-17128 but HS2
still leaks log4j RandomAccessFileManager.
> !Screen Shot 2021-01-06 at 18.42.05.png|width=756,height=197!
> I checked the operation log file which is not closed/deleted properly.
> !Screen Shot 2021-01-06 at 18.42.24.png|width=603,height=272!
> Then there's the log,
> {code:java}
> client.TezClient: Shutting down Tez Session, sessionName= ....{code}
> !Screen Shot 2021-01-06 at 18.42.55.png|width=1372,height=26!



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message