Return-Path: X-Original-To: apmail-hive-dev-archive@www.apache.org Delivered-To: apmail-hive-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 503EDD2FC for ; Wed, 26 Dec 2012 18:42:13 +0000 (UTC) Received: (qmail 55914 invoked by uid 500); 26 Dec 2012 18:42:12 -0000 Delivered-To: apmail-hive-dev-archive@hive.apache.org Received: (qmail 55847 invoked by uid 500); 26 Dec 2012 18:42:12 -0000 Mailing-List: contact dev-help@hive.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@hive.apache.org Delivered-To: mailing list dev@hive.apache.org Received: (qmail 55838 invoked by uid 500); 26 Dec 2012 18:42:12 -0000 Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org Received: (qmail 55835 invoked by uid 99); 26 Dec 2012 18:42:12 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 26 Dec 2012 18:42:12 +0000 Date: Wed, 26 Dec 2012 18:42:12 +0000 (UTC) From: "Deepesh Khandelwal (JIRA)" To: hive-dev@hadoop.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Commented] (HIVE-2084) Upgrade datanucleus from 2.0.3 to 3.0.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/HIVE-2084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13539634#comment-13539634 ] Deepesh Khandelwal commented on HIVE-2084: ------------------------------------------ After upgrading the datanucleus I ran into the runtime exception FCOMMENT invalid column name in COLUMNS_V2, this happens only when hive schema is pre-created with the upgrade SQL scripts (i.e. datanucleus.autoCreateSchema=false). So on MySQL, the workaround was to start with a blank schema and set datanucleus.autoCreateSchema=true but this turned out to be a problem on Oracle as the automatic creation of schema fails for the table TBLS (see HIVE-2928). To get around this on Oracle I pre-created the table TBLS and couple of other datanucleus tables (SEQUENCE_TABLE & NUCLEUS_TABLES) and let the server automatically create the other missing tables. If required, I can attach the patch for the SQL script I used for Oracle. > Upgrade datanucleus from 2.0.3 to 3.0.1 > --------------------------------------- > > Key: HIVE-2084 > URL: https://issues.apache.org/jira/browse/HIVE-2084 > Project: Hive > Issue Type: Improvement > Components: Metastore > Reporter: Ning Zhang > Assignee: Sushanth Sowmyan > Labels: datanucleus > Attachments: ASF.LICENSE.NOT.GRANTED--HIVE-2084.D2397.1.patch, HIVE-2084.1.patch.txt, HIVE-2084.2.patch.txt, HIVE-2084.D5685.1.patch, HIVE-2084.patch > > > It seems the datanucleus 2.2.3 does a better join in caching. The time it takes to get the same set of partition objects takes about 1/4 of the time it took for the first time. While with 2.0.3, it took almost the same amount of time in the second execution. We should retest the test case mentioned in HIVE-1853, HIVE-1862. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira