spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (SPARK-11737) String may not be serialized correctly with Kyro
Date Fri, 13 Nov 2015 21:14:11 GMT

     [ https://issues.apache.org/jira/browse/SPARK-11737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Apache Spark reassigned SPARK-11737:
------------------------------------

    Assignee: Apache Spark  (was: Davies Liu)

> String may not be serialized correctly with Kyro
> ------------------------------------------------
>
>                 Key: SPARK-11737
>                 URL: https://issues.apache.org/jira/browse/SPARK-11737
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 1.5.1, 1.6.0
>            Reporter: Davies Liu
>            Assignee: Apache Spark
>            Priority: Critical
>
> When run in cluster mode, the driver may have different memory (and configs) than executor,
also if Kyro is used, then string can not be collected back to driver:
> {code}
> >>> sqlContext.range(10).selectExpr("repeat(cast(id as string), 9)").show()
> +----------------------------+
> |repeat(cast(id as string),9)|
> +----------------------------+
> |                   	0|
> |                   	1|
> |                   	2|
> |                   	3|
> |                   	4|
> |                   	5|
> |                   	6|
> |                   	7|
> |                   	8|
> |                   	9|
> +----------------------------+
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message