Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id BFF2810843 for ; Fri, 6 Sep 2013 15:36:53 +0000 (UTC) Received: (qmail 2626 invoked by uid 500); 6 Sep 2013 15:36:53 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 2567 invoked by uid 500); 6 Sep 2013 15:36:53 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 2542 invoked by uid 500); 6 Sep 2013 15:36:52 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 2535 invoked by uid 99); 6 Sep 2013 15:36:52 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 06 Sep 2013 15:36:52 +0000 Date: Fri, 6 Sep 2013 15:36:52 +0000 (UTC) From: "Brock Noland (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-1511) Hive plan serialization is slow MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13760276#comment-13760276 ] Brock Noland commented on HIVE-1511: ------------------------------------ Mohammad, I don't that change works. udfnull fails the error below which is related to kryo. {noformat} [junit] Exception in thread "main" com.esotericsoftware.kryo.KryoException: Unable to find class: org.apache.hadoop.hive.contrib.udf.example.UDFExampleArraySum [junit] Serialization trace: [junit] udfClass (org.apache.hadoop.hive.ql.udf.generic.GenericUDFBridge) [junit] genericUDF (org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc) [junit] colList (org.apache.hadoop.hive.ql.plan.SelectDesc) [junit] conf (org.apache.hadoop.hive.ql.exec.SelectOperator) [junit] childOperators (org.apache.hadoop.hive.ql.exec.TableScanOperator) [junit] aliasToWork (org.apache.hadoop.hive.ql.plan.MapWork) [junit] mapWork (org.apache.hadoop.hive.ql.plan.MapredWork) [junit] at com.esotericsoftware.kryo.util.DefaultClassResolver.readName(DefaultClassResolver.java:138) {noformat} > Hive plan serialization is slow > ------------------------------- > > Key: HIVE-1511 > URL: https://issues.apache.org/jira/browse/HIVE-1511 > Project: Hive > Issue Type: Improvement > Affects Versions: 0.7.0, 0.11.0 > Reporter: Ning Zhang > Assignee: Mohammad Kamrul Islam > Attachments: failedPlan.xml, generated_plan.xml, HIVE-1511.10.patch, HIVE-1511.11.patch, HIVE-1511.12.patch, HIVE-1511.13.patch, HIVE-1511.4.patch, HIVE-1511.5.patch, HIVE-1511.6.patch, HIVE-1511.7.patch, HIVE-1511.8.patch, HIVE-1511.9.patch, HIVE-1511.patch, HIVE-1511-wip2.patch, HIVE-1511-wip3.patch, HIVE-1511-wip4.patch, HIVE-1511.wip.9.patch, HIVE-1511-wip.patch, KryoHiveTest.java, run.sh > > > As reported by Edward Capriolo: > For reference I did this as a test case.... > SELECT * FROM src where > key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 > OR key=0 OR key=0 OR key=0 OR > key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 > OR key=0 OR key=0 OR key=0 OR > ...(100 more of these) > No OOM but I gave up after the test case did not go anywhere for about > 2 minutes. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira