hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abdelrahman Shettia (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10121) Implement a hive --service udflint command to check UDF jars for common shading mistakes
Date Thu, 16 Apr 2015 14:17:58 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14498076#comment-14498076
] 

Abdelrahman Shettia commented on HIVE-10121:
--------------------------------------------

Hi Gopal, 

I am attaching the following use cases output files: 

bad_udfs.out
bad_udfs_verbose.out
good_udfs.out
good_udfs_verbose.out

Usage: 

Normal mode: 
$ hive --service UDFLint -file /tmp/hive_udf-1.0.0.jar 
Verbose mode: 
hive --service UDFLint -jar yi/hive-json-serde-0.3.jar -v 
Without any options:
[root@sandbox test]#  hive --service UDFLint 
usage: udflint
 -h,--help                        print help message
    --hiveconf <property=value>   Use value for given property
    --jar <arg>                   Comma separated list of jars to validate
 -v,--verbose                     Verbose mode (Run the tool in debug
                                  mode)

Please let me know if you have questions. 

Thanks
-Rahman

> Implement a hive --service udflint command to check UDF jars for common shading mistakes
> ----------------------------------------------------------------------------------------
>
>                 Key: HIVE-10121
>                 URL: https://issues.apache.org/jira/browse/HIVE-10121
>             Project: Hive
>          Issue Type: New Feature
>          Components: UDF
>            Reporter: Gopal V
>            Assignee: Abdelrahman Shettia
>             Fix For: 1.2.0
>
>         Attachments: HIVE-10121.1.patch, bad_udfs.out, bad_udfs_verbose.out, good_udfs.out,
good_udfs_verbose.out
>
>
> Several SerDe and UDF jars tend to shade in various parts of the dependencies including
hadoop-common or guava without relocation.
> Implement a simple udflint tool which automates some part of the class path and shaded
resources audit process required when upgrading a hive install from an old version to a new
one.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message