hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Vaibhav Gumashta (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10453) HS2 leaking open file descriptors when using UDFs
Date Fri, 05 Jun 2015 22:03:02 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575314#comment-14575314
] 

Vaibhav Gumashta commented on HIVE-10453:
-----------------------------------------

This is a good candidate for 1.2.1. I'll commit it to the branch as well. Thanks [~ychena]
and [~szehon] for getting this in.

> HS2 leaking open file descriptors when using UDFs
> -------------------------------------------------
>
>                 Key: HIVE-10453
>                 URL: https://issues.apache.org/jira/browse/HIVE-10453
>             Project: Hive
>          Issue Type: Bug
>          Components: UDF
>            Reporter: Yongzhi Chen
>            Assignee: Yongzhi Chen
>             Fix For: 1.3.0, 2.0.0
>
>         Attachments: HIVE-10453.1.patch, HIVE-10453.2.patch
>
>
> 1. create a custom function by
> CREATE FUNCTION myfunc AS 'someudfclass' using jar 'hdfs:///tmp/myudf.jar';
> 2. Create a simple jdbc client, just do 
> connect, 
> run simple query which using the function such as:
> select myfunc(col1) from sometable
> 3. Disconnect.
> Check open file for HiveServer2 by:
> lsof -p HSProcID | grep myudf.jar
> You will see the leak as:
> {noformat}
> java      28718 ychen  txt      REG                1,4        741 212977666 /private/var/folders/6p/7_njf13d6h144wldzbbsfpz80000gp/T/1bfe3de0-ac63-4eba-a725-6a9840f1f8d5_resources/myudf.jar
> java      28718 ychen  330r     REG                1,4        741 212977666 /private/var/folders/6p/7_njf13d6h144wldzbbsfpz80000gp/T/1bfe3de0-ac63-4eba-a725-6a9840f1f8d5_resources/myudf.jar
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message