spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Thomas Sebastian (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-12982) SQLContext: temporary table registration does not accept valid identifier
Date Wed, 03 Feb 2016 14:32:39 GMT

    [ https://issues.apache.org/jira/browse/SPARK-12982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15130471#comment-15130471
] 

Thomas Sebastian commented on SPARK-12982:
------------------------------------------

Adding changes in the SQLContext.scala and testing in progress with DataFrameSuite.scala with
[~jayadevan.maymala@ibsplc.com]

> SQLContext: temporary table registration does not accept valid identifier
> -------------------------------------------------------------------------
>
>                 Key: SPARK-12982
>                 URL: https://issues.apache.org/jira/browse/SPARK-12982
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 1.6.0
>            Reporter: Grzegorz Chilkiewicz
>            Priority: Minor
>              Labels: sql
>
> We have encountered very strange behavior of SparkSQL temporary table registration.
> What identifiers for temporary table should be valid?
> Alphanumerical + '_' with at least one non-digit?
> Valid identifiers:
> df
> 674123a
> 674123_
> a0e97c59_4445_479d_a7ef_d770e3874123
> 1ae97c59_4445_479d_a7ef_d770e3874123
> Invalid identifier:
> 10e97c59_4445_479d_a7ef_d770e3874123
> Stack trace:
> {code:xml}
> java.lang.RuntimeException: [1.1] failure: identifier expected
> 10e97c59_4445_479d_a7ef_d770e3874123
> ^
> 	at scala.sys.package$.error(package.scala:27)
> 	at org.apache.spark.sql.catalyst.SqlParser$.parseTableIdentifier(SqlParser.scala:58)
> 	at org.apache.spark.sql.SQLContext.table(SQLContext.scala:827)
> 	at org.apache.spark.sql.SQLContext.dropTempTable(SQLContext.scala:763)
> 	at SparkSqlContextTempTableIdentifier$.identifierCheck(SparkSqlContextTempTableIdentifier.scala:9)
> 	at SparkSqlContextTempTableIdentifier$.main(SparkSqlContextTempTableIdentifier.scala:42)
> 	at SparkSqlContextTempTableIdentifier.main(SparkSqlContextTempTableIdentifier.scala)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at sbt.Run.invokeMain(Run.scala:67)
> 	at sbt.Run.run0(Run.scala:61)
> 	at sbt.Run.sbt$Run$$execute$1(Run.scala:51)
> 	at sbt.Run$$anonfun$run$1.apply$mcV$sp(Run.scala:55)
> 	at sbt.Run$$anonfun$run$1.apply(Run.scala:55)
> 	at sbt.Run$$anonfun$run$1.apply(Run.scala:55)
> 	at sbt.Logger$$anon$4.apply(Logger.scala:85)
> 	at sbt.TrapExit$App.run(TrapExit.scala:248)
> 	at java.lang.Thread.run(Thread.java:745)
> {code}
> Code to reproduce this bug:
> https://github.com/grzegorz-chilkiewicz/SparkSqlContextTempTableIdentifier



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message