Return-Path: 
 <dev-return-77622-apmail-hive-dev-archive=hive.apache.org@hive.apache.org>
X-Original-To: apmail-hive-dev-archive@www.apache.org
Delivered-To: apmail-hive-dev-archive@www.apache.org
Received: from mail.apache.org (hermes.apache.org [140.211.11.3])
	by minotaur.apache.org (Postfix) with SMTP id ED64910076
	for <apmail-hive-dev-archive@www.apache.org>;
 Thu, 30 Jan 2014 11:02:13 +0000 (UTC)
Received: (qmail 67314 invoked by uid 500); 30 Jan 2014 11:02:11 -0000
Delivered-To: apmail-hive-dev-archive@hive.apache.org
Received: (qmail 67064 invoked by uid 500); 30 Jan 2014 11:02:11 -0000
Mailing-List: contact dev-help@hive.apache.org; run by ezmlm
Precedence: bulk
List-Help: <mailto:dev-help@hive.apache.org>
List-Unsubscribe: <mailto:dev-unsubscribe@hive.apache.org>
List-Post: <mailto:dev@hive.apache.org>
List-Id: <dev.hive.apache.org>
Reply-To: dev@hive.apache.org
Delivered-To: mailing list dev@hive.apache.org
Received: (qmail 66996 invoked by uid 500); 30 Jan 2014 11:02:10 -0000
Delivered-To: apmail-hadoop-hive-dev@hadoop.apache.org
Received: (qmail 66987 invoked by uid 99); 30 Jan 2014 11:02:10 -0000
Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28)
    by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 30 Jan 2014 11:02:10 +0000
Date: Thu, 30 Jan 2014 11:02:09 +0000 (UTC)
From: "Nigel Savage (JIRA)" <jira@apache.org>
To: hive-dev@hadoop.apache.org
Message-ID: <JIRA.12692212.1391055681530.9608.1391079729806@arcas>
In-Reply-To: <JIRA.12692212.1391055681530@arcas>
References: <JIRA.12692212.1391055681530@arcas>
Subject: [jira] [Updated] (HIVE-6336) Issue is hive 12 datanucleus
 incompatability with org.apache.hadoop.hive.contrib.serde2.RegexSerDe
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit
X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394


     [ https://issues.apache.org/jira/browse/HIVE-6336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nigel Savage updated HIVE-6336:
-------------------------------

    Description: 
Issue is hive 12 datanucleus incompatability with org.apache.hadoop.hive.contrib.serde2.RegexSerDe

I have hadoop and hive  running as a pseudo cluster local mode and derby as the metastore

I have the following environment variables

HADOOP_HOME=/home/ubu/hadoop
JAVA_HOME=/usr/lib/jvm/java-7-oracle

I have the RegexSerDe declared in the hive-site.xml

    <property>
        <name>hive.aux.jars.path</name>
        <value>file:///home/ubu/hadoop/lib/hive-contrib-0.12.0.jar </value>
        <description>This JAR file  available to all users for alljobs</description>
    </property>

If I run with <datanucleus.version>3.0.2</datanucleus.version> I get the following 1 exception only
java.lang.ClassNotFoundException:
org.datanucleus.store.types.backed.Map  

If I run with  <datanucleus.version>3.2.0-release</datanucleus.version> I get the following 1 exception exception only
java.lang.ClassNotFoundException:
org/apache/hadoop/hive/contrib/serde2/RegexSerDe 

basically the RegexSerDe class is picked up at run time but the datanucleus Map class is not available, I have checked in the datanucleus-core 3.0.2 jar and it is missing

upgrading to the first datanucleus above 3.0.2 that includse the Map class throws the ClassNotFoundException for RegexSerDe 


that is with the earlier 3.0.2 datanucleus the code fails with the missing Map class but the RegexSerDe class is found, then when I upgrade to the 
3.2.0-release the Map class is found but for some unkown reason the code/Hive no longer finds the RegexSerDe class

if hive 0.12.0  and datanucleus are compatabile what is the version of datanucleus I should be using with Hive 12 and Hadoop 2.2, thanks for your time and effort

I started using the same datanucleus dependencies found in this hive pom
http://maven-repository.com/artifact/org.apache.hive/hive-metastore/0.12.0/pom

below is my latest attempts to get a functioning pom

here are the dependencies from the pom
     <dependency>
            <groupId>javax.jdo</groupId>
            <artifactId>jdo-api</artifactId>
            <version>3.0.1</version>
        </dependency>

        <dependency>
            <groupId>org.datanucleus</groupId>
            <artifactId>datanucleus-core</artifactId>
            <version>${datanucleus.version}</version>
            <scope>runtime</scope>
        </dependency>

        <dependency>
            <groupId>org.datanucleus</groupId>
            <artifactId>datanucleus-rdbms</artifactId>
            <version>${datanucleus.version}</version>
            <scope>runtime</scope>
        </dependency>

        <dependency>
            <groupId>org.datanucleus</groupId>
            <artifactId>datanucleus-api-jdo</artifactId>
            <version>${datanucleus.version}</version>
        </dependency>

 <!-- hadoop -->
        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-client</artifactId>
            <version>${hadoop.version}</version>
        </dependency>
        <!-- hive -->
        <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-common</artifactId>
            <version>${hive.version}</version>
            <scope>provided</scope>
        </dependency>
        <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-serde</artifactId>
            <version>${hive.version}</version>
            <scope>provided</scope>
        </dependency>
        <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-exec</artifactId>
            <version>${hive.version}</version>
            <scope>provided</scope>
        </dependency>
        <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-jdbc</artifactId>
            <version>${hive.version}</version>
        </dependency>
        <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-contrib</artifactId>
            <version>${hive.version}</version>
        </dependency>
     <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-metastore</artifactId>
            <version>${hive.version}</version>
        </dependency>

        <dependency>
            <groupId>com.jolbox</groupId>
            <artifactId>bonecp</artifactId>
            <version>${bonecp.version}</version>
        </dependency>






  was:
Issue is hive 12 datanucleus incompatability with org.apache.hadoop.hive.contrib.serde2.RegexSerDe

I have hadoop and hive  running as a pseudo cluster local mode and derby as the metastore

I have the following environment variables

HADOOP_HOME=/home/ubu/hadoop
JAVA_HOME=/usr/lib/jvm/java-7-oracle

I have the RegexSerDe declared in the hive-site.xml

    <property>
        <name>hive.aux.jars.path</name>
        <value>file:///home/ubu/hadoop/lib/hive-contrib-0.12.0.jar </value>
        <description>This JAR file  available to all users for alljobs</description>
    </property>

If I run with <datanucleus.version>3.0.2</datanucleus.version> I get the following 1 exception only
java.lang.ClassNotFoundException:
org.datanucleus.store.types.backed.Map  

If I run with  <datanucleus.version>3.2.0-release</datanucleus.version> I get the following 1 exception exception only
java.lang.ClassNotFoundException:
org/apache/hadoop/hive/contrib/serde2/RegexSerDe 

basically the RegexSerDe class is picked up at run time but the datanucleus Map class is not available, I have checked in the datanucleus-core 3.0.2 jar and it is missing

upgrading to the first datanucleus above 3.0.2 that includse the Map class throws the ClassNotFoundException for RegexSerDe 


that is with the earlier 3.0.2 datanucleus the code fails with the missing Map class but the RegexSerDe class is found, then when I upgrade to the 
3.2.0-release the Map class is found but for some unkown reason the code/Hive no longer finds the RegexSerDe class

if hive 0.12.0  and datanucleus are compatabile what is the version of datanucleus I should be using with Hive 12 and Hadoop 2.2, thanks for your time and effort

I started using the same datanucleus dependencies found in this hive pom
http://maven-repository.com/artifact/org.apache.hive/hive-metastore/0.12.0/pom

below is my latest attempts to get a functioning pom

here are the dependencies from the pom
     <dependency>
            <groupId>javax.jdo</groupId>
            <artifactId>jdo-api</artifactId>
            <version>3.0.1</version>
        </dependency>

        <dependency>
            <groupId>org.datanucleus</groupId>
            <artifactId>datanucleus-core</artifactId>
            <version>${datanucleus.version}</version>
            <scope>runtime</scope>
        </dependency>

        <dependency>
            <groupId>org.datanucleus</groupId>
            <artifactId>datanucleus-rdbms</artifactId>
            <version>${datanucleus.version}</version>
            <scope>runtime</scope>
        </dependency>

        <dependency>
            <groupId>org.datanucleus</groupId>
            <artifactId>datanucleus-api-jdo</artifactId>
            <version>${datanucleus.version}</version>
        </dependency>

 <!-- hadoop -->
        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-client</artifactId>
            <version>${hadoop.version}</version>
        </dependency>
        <!-- hive -->
        <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-common</artifactId>
            <version>${hive.version}</version>
            <scope>provided</scope>
        </dependency>
        <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-serde</artifactId>
            <version>${hive.version}</version>
            <scope>provided</scope>
        </dependency>
        <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-exec</artifactId>
            <version>${hive.version}</version>
            <scope>provided</scope>
        </dependency>
        <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-jdbc</artifactId>
            <version>${hive.version}</version>
        </dependency>
        <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-contrib</artifactId>
            <version>${hive.version}</version>
        </dependency>

        <dependency>
            <groupId>com.jolbox</groupId>
            <artifactId>bonecp</artifactId>
            <version>${bonecp.version}</version>
        </dependency>







> Issue is hive 12 datanucleus incompatability with org.apache.hadoop.hive.contrib.serde2.RegexSerDe
> --------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-6336
>                 URL: https://issues.apache.org/jira/browse/HIVE-6336
>             Project: Hive
>          Issue Type: Wish
>          Components: HiveServer2
>    Affects Versions: 0.12.0
>         Environment:  Hadoop 2.2  local derby Meatastore embedded
>            Reporter: Nigel Savage
>            Priority: Blocker
>              Labels: HADOOP
>
> Issue is hive 12 datanucleus incompatability with org.apache.hadoop.hive.contrib.serde2.RegexSerDe
> I have hadoop and hive  running as a pseudo cluster local mode and derby as the metastore
> I have the following environment variables
> HADOOP_HOME=/home/ubu/hadoop
> JAVA_HOME=/usr/lib/jvm/java-7-oracle
> I have the RegexSerDe declared in the hive-site.xml
>     <property>
>         <name>hive.aux.jars.path</name>
>         <value>file:///home/ubu/hadoop/lib/hive-contrib-0.12.0.jar </value>
>         <description>This JAR file  available to all users for alljobs</description>
>     </property>
> If I run with <datanucleus.version>3.0.2</datanucleus.version> I get the following 1 exception only
> java.lang.ClassNotFoundException:
> org.datanucleus.store.types.backed.Map  
> If I run with  <datanucleus.version>3.2.0-release</datanucleus.version> I get the following 1 exception exception only
> java.lang.ClassNotFoundException:
> org/apache/hadoop/hive/contrib/serde2/RegexSerDe 
> basically the RegexSerDe class is picked up at run time but the datanucleus Map class is not available, I have checked in the datanucleus-core 3.0.2 jar and it is missing
> upgrading to the first datanucleus above 3.0.2 that includse the Map class throws the ClassNotFoundException for RegexSerDe 
> that is with the earlier 3.0.2 datanucleus the code fails with the missing Map class but the RegexSerDe class is found, then when I upgrade to the 
> 3.2.0-release the Map class is found but for some unkown reason the code/Hive no longer finds the RegexSerDe class
> if hive 0.12.0  and datanucleus are compatabile what is the version of datanucleus I should be using with Hive 12 and Hadoop 2.2, thanks for your time and effort
> I started using the same datanucleus dependencies found in this hive pom
> http://maven-repository.com/artifact/org.apache.hive/hive-metastore/0.12.0/pom
> below is my latest attempts to get a functioning pom
> here are the dependencies from the pom
>      <dependency>
>             <groupId>javax.jdo</groupId>
>             <artifactId>jdo-api</artifactId>
>             <version>3.0.1</version>
>         </dependency>
>         <dependency>
>             <groupId>org.datanucleus</groupId>
>             <artifactId>datanucleus-core</artifactId>
>             <version>${datanucleus.version}</version>
>             <scope>runtime</scope>
>         </dependency>
>         <dependency>
>             <groupId>org.datanucleus</groupId>
>             <artifactId>datanucleus-rdbms</artifactId>
>             <version>${datanucleus.version}</version>
>             <scope>runtime</scope>
>         </dependency>
>         <dependency>
>             <groupId>org.datanucleus</groupId>
>             <artifactId>datanucleus-api-jdo</artifactId>
>             <version>${datanucleus.version}</version>
>         </dependency>
>  <!-- hadoop -->
>         <dependency>
>             <groupId>org.apache.hadoop</groupId>
>             <artifactId>hadoop-client</artifactId>
>             <version>${hadoop.version}</version>
>         </dependency>
>         <!-- hive -->
>         <dependency>
>             <groupId>org.apache.hive</groupId>
>             <artifactId>hive-common</artifactId>
>             <version>${hive.version}</version>
>             <scope>provided</scope>
>         </dependency>
>         <dependency>
>             <groupId>org.apache.hive</groupId>
>             <artifactId>hive-serde</artifactId>
>             <version>${hive.version}</version>
>             <scope>provided</scope>
>         </dependency>
>         <dependency>
>             <groupId>org.apache.hive</groupId>
>             <artifactId>hive-exec</artifactId>
>             <version>${hive.version}</version>
>             <scope>provided</scope>
>         </dependency>
>         <dependency>
>             <groupId>org.apache.hive</groupId>
>             <artifactId>hive-jdbc</artifactId>
>             <version>${hive.version}</version>
>         </dependency>
>         <dependency>
>             <groupId>org.apache.hive</groupId>
>             <artifactId>hive-contrib</artifactId>
>             <version>${hive.version}</version>
>         </dependency>
>      <dependency>
>             <groupId>org.apache.hive</groupId>
>             <artifactId>hive-metastore</artifactId>
>             <version>${hive.version}</version>
>         </dependency>
>         <dependency>
>             <groupId>com.jolbox</groupId>
>             <artifactId>bonecp</artifactId>
>             <version>${bonecp.version}</version>
>         </dependency>



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)