spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kant kodali <kanth...@gmail.com>
Subject Re: Wrting data from Spark streaming to AWS Redshift?
Date Sun, 11 Dec 2016 14:31:19 GMT
@shyla  a side question: What does Redshift can do that Spark cannot do?
Trying to understand your use case.

On Fri, Dec 9, 2016 at 8:47 PM, ayan guha <guha.ayan@gmail.com> wrote:

> Ideally, saving data to external sources should not be any different. give
> the write options as stated in the bloga shot, but changing mode to append.
>
> On Sat, Dec 10, 2016 at 8:25 AM, shyla deshpande <deshpandeshyla@gmail.com
> > wrote:
>
>> Hello all,
>>
>> Is it possible to Write data from Spark streaming to AWS Redshift?
>>
>> I came across the following article, so looks like it works from a Spark
>> batch program.
>>
>> https://databricks.com/blog/2015/10/19/introducing-redshift-
>> data-source-for-spark.html
>>
>> I want to write to AWS Redshift from Spark Stream. Please share your
>> experience and reference docs.
>>
>> Thanks
>>
>
>
>
> --
> Best Regards,
> Ayan Guha
>

Mime
View raw message