hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lefty Leverenz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-1511) Hive plan serialization is slow
Date Sat, 05 Jul 2014 08:09:34 GMT

    [ https://issues.apache.org/jira/browse/HIVE-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14052819#comment-14052819
] 

Lefty Leverenz commented on HIVE-1511:
--------------------------------------

*hive.plan.serialization.format* is documented in the wiki here:

* [Configuration Properties -- hive.plan.serialization.format | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.plan.serialization.format]

The release note ("Any 3rd party UDFs used must be declared as public classes") could be added
to these wikidocs:

* [Hive Plugins -- Creating Custom UDFs | https://cwiki.apache.org/confluence/display/Hive/HivePlugins#HivePlugins-CreatingCustomUDFs]
* [DDL -- Create Function | https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-CreateFunction]

Question:  Does the release note apply in general, or only in releases 0.13.0 and later?

> Hive plan serialization is slow
> -------------------------------
>
>                 Key: HIVE-1511
>                 URL: https://issues.apache.org/jira/browse/HIVE-1511
>             Project: Hive
>          Issue Type: Improvement
>    Affects Versions: 0.7.0, 0.11.0
>            Reporter: Ning Zhang
>            Assignee: Mohammad Kamrul Islam
>              Labels: TODOC13
>             Fix For: 0.13.0
>
>         Attachments: HIVE-1511-wip.patch, HIVE-1511-wip2.patch, HIVE-1511-wip3.patch,
HIVE-1511-wip4.patch, HIVE-1511.10.patch, HIVE-1511.11.patch, HIVE-1511.12.patch, HIVE-1511.13.patch,
HIVE-1511.14.patch, HIVE-1511.16.patch, HIVE-1511.17.patch, HIVE-1511.4.patch, HIVE-1511.5.patch,
HIVE-1511.6.patch, HIVE-1511.7.patch, HIVE-1511.8.patch, HIVE-1511.9.patch, HIVE-1511.patch,
HIVE-1511.wip.9.patch, KryoHiveTest.java, failedPlan.xml, generated_plan.xml, run.sh
>
>
> As reported by Edward Capriolo:
> For reference I did this as a test case....
> SELECT * FROM src where
> key=0 OR key=0 OR key=0 OR  key=0 OR key=0 OR key=0 OR key=0 OR key=0
> OR key=0 OR key=0 OR key=0 OR
> key=0 OR key=0 OR key=0 OR  key=0 OR key=0 OR key=0 OR key=0 OR key=0
> OR key=0 OR key=0 OR key=0 OR
> ...(100 more of these)
> No OOM but I gave up after the test case did not go anywhere for about
> 2 minutes.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message