spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "jalendhar Baddam (JIRA)" <j...@apache.org>
Subject [jira] [Reopened] (SPARK-21951) Unable to add the new column and writing into the Hive using spark
Date Fri, 08 Sep 2017 11:25:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-21951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

jalendhar Baddam reopened SPARK-21951:
--------------------------------------

This is still exist. And it's getting the AnalysisException.

> Unable to add the new column and writing into the Hive using spark
> ------------------------------------------------------------------
>
>                 Key: SPARK-21951
>                 URL: https://issues.apache.org/jira/browse/SPARK-21951
>             Project: Spark
>          Issue Type: Bug
>          Components: Java API
>    Affects Versions: 2.1.1
>            Reporter: jalendhar Baddam
>
> I am creating one new column to the Existing Dataset and unable to write into the Hive
using the Spark.
> Ex: Dataset<Row> ds=spark.sql("select *from Table");
>      ds= ds.withColumn("newColumn",newColumnvalues);
>     ds.write().saveMode("overwite").format("parquet').saveAsTable("Table"); //Here I
am getting the Exception
> I am loading the Table from Hive using Spark, and  adding the new Column to that Dataset
and again write the same table into Hive with the "OverWrite" option



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message