hive-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Severance <ssevera...@alphaheavy.com>
Subject Re: INSERT INTO Overwriting Data
Date Tue, 28 Feb 2012 02:21:28 GMT
system:java.class.path=/opt/hadoop/conf:/usr/lib/jvm/sun-jdk-1.6/lib/tools.jar:/opt/hadoop:/opt/hadoop/hadoop-core-0.20.2-cdh3u3.jar:/opt/hadoop/lib/ant-contrib-1.0b3.jar:/opt/hadoop/lib/aspectjrt-1.6.5.jar:/opt/hadoop/lib/aspectjtools-1.6.5.jar:/opt/hadoop/lib/commons-cli-1.2.jar:/opt/hadoop/lib/commons-codec-1.4.jar:/opt/hadoop/lib/commons-daemon-1.0.1.jar:/opt/hadoop/lib/commons-el-1.0.jar:/opt/hadoop/lib/commons-httpclient-3.1.jar:/opt/hadoop/lib/commons-lang-2.4.jar:/opt/hadoop/lib/commons-logging-1.0.4.jar:/opt/hadoop/lib/commons-logging-api-1.0.4.jar:/opt/hadoop/lib/commons-net-1.4.1.jar:/opt/hadoop/lib/core-3.1.1.jar:/opt/hadoop/lib/guava-r09-jarjar.jar:/opt/hadoop/lib/hadoop-fairscheduler-0.20.2-cdh3u2.jar:/opt/hadoop/lib/hadoop-fairscheduler-0.20.2-cdh3u3.jar:/opt/hadoop/lib/hsqldb-1.8.0.10.jar:/opt/hadoop/lib/jackson-core-asl-1.5.2.jar:/opt/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/opt/hadoop/lib/jasper-compiler-5.5.12.jar:/opt/hadoop/lib/jasper-runtime-5.5.12.jar:/opt/hadoop/lib/jets3t-0.6.1.jar:/opt/hadoop/lib/jetty-6.1.26.cloudera.1.jar:/opt/hadoop/lib/jetty-servlet-tester-6.1.26.cloudera.1.jar:/opt/hadoop/lib/jetty-util-6.1.26.cloudera.1.jar:/opt/hadoop/lib/jsch-0.1.42.jar:/opt/hadoop/lib/junit-4.5.jar:/opt/hadoop/lib/kfs-0.2.2.jar:/opt/hadoop/lib/log4j-1.2.15.jar:/opt/hadoop/lib/mockito-all-1.8.2.jar:/opt/hadoop/lib/oro-2.0.8.jar:/opt/hadoop/lib/servlet-api-2.5-20081211.jar:/opt/hadoop/lib/servlet-api-2.5-6.1.14.jar:/opt/hadoop/lib/slf4j-api-1.4.3.jar:/opt/hadoop/lib/slf4j-log4j12-1.4.3.jar:/opt/hadoop/lib/xmlenc-0.52.jar:/opt/hadoop/lib/jsp-2.1/jsp-2.1.jar:/opt/hadoop/lib/jsp-2.1/jsp-api-2.1.jar::/opt/hive/conf:/opt/hive/lib/ant-contrib-1.0b3.jar:/opt/hive/lib/antlr-2.7.7.jar:/opt/hive/lib/antlr-3.0.1.jar:/opt/hive/lib/antlr-runtime-3.0.1.jar:/opt/hive/lib/asm-3.1.jar:/opt/hive/lib/commons-cli-1.2.jar:/opt/hive/lib/commons-codec-1.3.jar:/opt/hive/lib/commons-collections-3.2.1.jar:/opt/hive/lib/commons-dbcp-1.4.jar:/opt/hive/lib/commons-lang-2.4.jar:/opt/hive/lib/commons-logging-1.0.4.jar:/opt/hive/lib/commons-logging-api-1.0.4.jar:/opt/hive/lib/commons-pool-1.5.4.jar:/opt/hive/lib/datanucleus-connectionpool-2.0.3.jar:/opt/hive/lib/datanucleus-core-2.0.3.jar:/opt/hive/lib/datanucleus-enhancer-2.0.3.jar:/opt/hive/lib/datanucleus-rdbms-2.0.3.jar:/opt/hive/lib/derby-10.4.2.0.jar:/opt/hive/lib/guava-r06.jar:/opt/hive/lib/hbase-0.89.0-SNAPSHOT-tests.jar:/opt/hive/lib/hbase-0.89.0-SNAPSHOT.jar:/opt/hive/lib/hive-anttasks-0.9.0-SNAPSHOT.jar:/opt/hive/lib/hive-builtins-0.9.0-SNAPSHOT.jar:/opt/hive/lib/hive-cli-0.9.0-SNAPSHOT.jar:/opt/hive/lib/hive-common-0.9.0-SNAPSHOT.jar:/opt/hive/lib/hive-contrib-0.9.0-SNAPSHOT.jar:/opt/hive/lib/hive-exec-0.9.0-SNAPSHOT.jar:/opt/hive/lib/hive-hbase-handler-0.9.0-SNAPSHOT.jar:/opt/hive/lib/hive-hwi-0.9.0-SNAPSHOT.jar:/opt/hive/lib/hive-jdbc-0.9.0-SNAPSHOT.jar:/opt/hive/lib/hive-metastore-0.9.0-SNAPSHOT.jar:/opt/hive/lib/hive-pdk-0.9.0-SNAPSHOT.jar:/opt/hive/lib/hive-serde-0.9.0-SNAPSHOT.jar:/opt/hive/lib/hive-service-0.9.0-SNAPSHOT.jar:/opt/hive/lib/hive-shims-0.9.0-SNAPSHOT.jar:/opt/hive/lib/hive_contrib.jar:/opt/hive/lib/javaewah-0.3.jar:/opt/hive/lib/jdo2-api-2.3-ec.jar:/opt/hive/lib/jline-0.9.94.jar:/opt/hive/lib/json-20090211.jar:/opt/hive/lib/junit-4.10.jar:/opt/hive/lib/libfb303-0.7.0.jar:/opt/hive/lib/libfb303.jar:/opt/hive/lib/libthrift-0.7.0.jar:/opt/hive/lib/libthrift.jar:/opt/hive/lib/log4j-1.2.16.jar:/opt/hive/lib/mockito-all-1.8.2.jar:/opt/hive/lib/mysql-connector-java-5.1.18-bin.jar:/opt/hive/lib/slf4j-api-1.6.1.jar:/opt/hive/lib/slf4j-log4j12-1.6.1.jar:/opt/hive/lib/stringtemplate-3.1-b1.jar:/opt/hive/lib/velocity-1.5.jar:/opt/hive/lib/zookeeper-3.3.1.jar:

On Mon, Feb 27, 2012 at 1:17 PM, Carl Steinbach <carl@cloudera.com> wrote:

> Hi Steve,
>
> It's possible that Hive is still picking up some old JARs on its
> classpath. Can you please try dumping the classpath from within the HiveCLI
> and respond with the output, e.g.
>
> % hive -e 'set system:java.class.path'
>
> Thanks.
>
> Carl
>
>
> On Sat, Feb 25, 2012 at 4:42 PM, Steve Severance <
> sseverance@alphaheavy.com> wrote:
>
>> Hi,
>>
>> I have a job that use INSERT INTO from Hive 0.8. The query is something
>> like:
>>
>> INSERT INTO TABLE MyTable PARTITION (dt='2012-01-01) SELECT ...
>>
>> When I run this query both with and without dynamic partitioning it
>> overwrites the data that was already in the partition.
>>
>> I am running Hive 0.8 on CDH3u2. I have confirmed that append is enabled
>> in the job conf.
>>
>> Is there anything else I need to do that would enable appending to my
>> hive table?
>>
>> Thanks.
>>
>> Steve
>>
>
>


-- 
---------------------------------------------
Steve Severance
Alpha Heavy Industries
sseverance@alphaheavy.com
(240) 472 - 9645
---------------------------------------------

Mime
View raw message