spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ayan guha <guha.a...@gmail.com>
Subject Re: Convert DStream to DataFrame
Date Wed, 22 Apr 2015 13:19:18 GMT
What about sqlcontext.createDataframe(rdd)?
On 22 Apr 2015 23:04, "Sergio Jiménez Barrio" <drarse.ames@gmail.com> wrote:

> Hi,
>
> I am using Kafka with Apache Stream to send JSON to Apache Spark:
>
> val messages = KafkaUtils.createDirectStream[String, String, StringDecoder, StringDecoder](ssc,
kafkaParams, topicsSet)
>
> Now, I want parse the DStream created to DataFrame, but I don't know if
> Spark 1.3 have some easy way for this. ¿Any suggestion? I can get the
> message with:
>
> val lines = messages.map(_._2)
>
> Thank u for all. Sergio J.
>
>
>

Mime
View raw message