hive-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Nigel Savage (JIRA)" <j...@apache.org>
Subject [jira] [Created] (HIVE-6336) Issue is hive 12 datanucleus incompatability with org.apache.hadoop.hive.contrib.serde2.RegexSerDe
Date Thu, 30 Jan 2014 04:22:09 GMT
Nigel Savage created HIVE-6336:
----------------------------------

             Summary: Issue is hive 12 datanucleus incompatability with org.apache.hadoop.hive.contrib.serde2.RegexSerDe
                 Key: HIVE-6336
                 URL: https://issues.apache.org/jira/browse/HIVE-6336
             Project: Hive
          Issue Type: Wish
          Components: HiveServer2
    Affects Versions: 0.12.0
         Environment:  Hadoop 2.2  local derby Meatastore embedded
            Reporter: Nigel Savage
            Priority: Blocker


Issue is hive 12 datanucleus incompatability with org.apache.hadoop.hive.contrib.serde2.RegexSerDe

I have hadoop and hive  running as a pseudo cluster local mode and derby as the metastore

I have the following environment variables

HADOOP_HOME=/home/ubu/hadoop
JAVA_HOME=/usr/lib/jvm/java-7-oracle

I have the RegexSerDe declared in thew hive-site.xml

    <property>
        <name>hive.aux.jars.path</name>
        <value>file:///home/ubu/hadoop/lib/hive-contrib-0.12.0.jar </value>
        <description>This JAR file  available to all users for alljobs</description>
    </property>

If I run with <datanucleus.version>3.0.2</datanucleus.version> I get the following
exception
java.lang.ClassNotFoundException:
org.datanucleus.store.types.backed.Map  
If I run with  <datanucleus.version>3.2.0-release</datanucleus.version> I get
the following exception
java.lang.ClassNotFoundException:
org/apache/hadoop/hive/contrib/serde2/RegexSerDe 

basically the RegexSerDe class is picked up at run time but the datanucleus Map class is not
available, I have checked in the
datanucleus-core 3.0.2 jar and it is missing

upgrading to the first datanucleus above 3.0.2 that incluse the Map class throws the ClassNotFoundException
for RegexSerDe 

what is the version of datanucleus I should be using with Hive 12 and Hadoop 2.2, thanks for
your time and effort

here are the dependencies from the pom
     <dependency>
            <groupId>javax.jdo</groupId>
            <artifactId>jdo-api</artifactId>
            <version>3.0.1</version>
        </dependency>

        <dependency>
            <groupId>org.datanucleus</groupId>
            <artifactId>datanucleus-core</artifactId>
            <version>${datanucleus.version}</version>
            <scope>runtime</scope>
        </dependency>

        <dependency>
            <groupId>org.datanucleus</groupId>
            <artifactId>datanucleus-rdbms</artifactId>
            <version>${datanucleus.version}</version>
            <scope>runtime</scope>
        </dependency>

        <dependency>
            <groupId>org.datanucleus</groupId>
            <artifactId>datanucleus-api-jdo</artifactId>
            <version>${datanucleus.version}</version>
        </dependency>

 <!-- hadoop -->
        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-client</artifactId>
            <version>${hadoop.version}</version>
        </dependency>
        <!-- hive -->
        <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-common</artifactId>
            <version>${hive.version}</version>
            <scope>provided</scope>
        </dependency>
        <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-serde</artifactId>
            <version>${hive.version}</version>
            <scope>provided</scope>
        </dependency>
        <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-exec</artifactId>
            <version>${hive.version}</version>
            <scope>provided</scope>
        </dependency>
        <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-jdbc</artifactId>
            <version>${hive.version}</version>
        </dependency>
        <dependency>
            <groupId>org.apache.hive</groupId>
            <artifactId>hive-contrib</artifactId>
            <version>${hive.version}</version>
        </dependency>

        <dependency>
            <groupId>com.jolbox</groupId>
            <artifactId>bonecp</artifactId>
            <version>${bonecp.version}</version>
        </dependency>








--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Mime
View raw message