carbondata-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Liang Chen (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CARBONDATA-1105) Remove the fixed spark.version in submodule for supporting new spark version.
Date Sat, 01 Jul 2017 14:45:00 GMT

     [ https://issues.apache.org/jira/browse/CARBONDATA-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Liang Chen updated CARBONDATA-1105:
-----------------------------------
    Summary: Remove the fixed spark.version in submodule for supporting new spark version.
 (was: ClassNotFoundException: org.apache.spark.sql.catalyst.CatalystConf)

> Remove the fixed spark.version in submodule for supporting new spark version.
> -----------------------------------------------------------------------------
>
>                 Key: CARBONDATA-1105
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1105
>             Project: CarbonData
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 1.2.0
>         Environment: spark 2.1.1
>            Reporter: cen yuhai
>            Assignee: cen yuhai
>             Fix For: 1.2.0
>
>          Time Spent: 2h
>  Remaining Estimate: 0h
>
> I think it is related to SPARK-19944
> https://github.com/apache/spark/pull/17301
> {code}
> scala> carbon.sql("create table temp.test_carbon(id int, name string, scale decimal,
country string, salary double) STORED BY 'carbondata'")
> java.lang.NoClassDefFoundError: org/apache/spark/sql/catalyst/CatalystConf
>   at org.apache.spark.sql.hive.CarbonSessionState.analyzer$lzycompute(CarbonSessionState.scala:127)
>   at org.apache.spark.sql.hive.CarbonSessionState.analyzer(CarbonSessionState.scala:126)
>   at org.apache.spark.sql.execution.QueryExecution.analyzed$lzycompute(QueryExecution.scala:69)
>   at org.apache.spark.sql.execution.QueryExecution.analyzed(QueryExecution.scala:67)
>   at org.apache.spark.sql.execution.QueryExecution.assertAnalyzed(QueryExecution.scala:50)
>   at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:63)
>   at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:593)
>   ... 52 elided
> Caused by: java.lang.ClassNotFoundException: org.apache.spark.sql.catalyst.CatalystConf
>   at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
>   at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>   at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>   ... 59 more
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message