spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From dataginjaninja <rickett.stepha...@gmail.com>
Subject Re: Timestamp support in v1.0
Date Thu, 29 May 2014 16:55:22 GMT
Yes, I get the same error:

scala> val hc = new org.apache.spark.sql.hive.HiveContext(sc)
14/05/29 16:53:40 INFO deprecation: mapred.input.dir.recursive is
deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive
14/05/29 16:53:40 INFO deprecation: mapred.max.split.size is deprecated.
Instead, use mapreduce.input.fileinputformat.split.maxsize
14/05/29 16:53:40 INFO deprecation: mapred.min.split.size is deprecated.
Instead, use mapreduce.input.fileinputformat.split.minsize
14/05/29 16:53:40 INFO deprecation: mapred.min.split.size.per.rack is
deprecated. Instead, use
mapreduce.input.fileinputformat.split.minsize.per.rack
14/05/29 16:53:40 INFO deprecation: mapred.min.split.size.per.node is
deprecated. Instead, use
mapreduce.input.fileinputformat.split.minsize.per.node
14/05/29 16:53:40 INFO deprecation: mapred.reduce.tasks is deprecated.
Instead, use mapreduce.job.reduces
14/05/29 16:53:40 INFO deprecation:
mapred.reduce.tasks.speculative.execution is deprecated. Instead, use
mapreduce.reduce.speculative
14/05/29 16:53:41 WARN HiveConf: DEPRECATED: Configuration property
hive.metastore.local no longer has any effect. Make sure to provide a valid
value for hive.metastore.uris if you are connecting to a remote metastore.
14/05/29 16:53:42 WARN HiveConf: DEPRECATED: Configuration property
hive.metastore.local no longer has any effect. Make sure to provide a valid
value for hive.metastore.uris if you are connecting to a remote metastore.
hc: org.apache.spark.sql.hive.HiveContext =
org.apache.spark.sql.hive.HiveContext@36482814

scala> val results = hc.hql("SELECT COUNT(*) FROM aol").collect() 
14/05/29 16:53:46 INFO ParseDriver: Parsing command: SELECT COUNT(*) FROM
aol
14/05/29 16:53:46 INFO ParseDriver: Parse Completed
14/05/29 16:53:47 INFO metastore: Trying to connect to metastore with URI th
14/05/29 16:53:47 INFO metastore: Waiting 1 seconds before next connection
attempt.
14/05/29 16:53:48 INFO metastore: Connected to metastore.
java.lang.RuntimeException: Unsupported dataType: timestamp
	at scala.sys.package$.error(package.scala:27)




--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Timestamp-support-in-v1-0-tp6850p6853.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

Mime
View raw message