spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Akhil Das <ak...@sigmoidanalytics.com>
Subject Re: Getting data into Spark Streaming
Date Fri, 08 May 2015 07:38:03 GMT
I don't think you can use rawSocketStream since the RSVP is from a web
server and you will have to send a GET request first to initialize the
communication. You are better off writing a custom receiver
<https://spark.apache.org/docs/latest/streaming-custom-receivers.html> for
your usecase. For a start, you can actually look at the
TwitterUtils.createTwitterStream
<https://github.com/apache/spark/blob/master/external/twitter/src/main/scala/org/apache/spark/streaming/twitter/TwitterInputDStream.scala#L71>
.



Thanks
Best Regards

On Fri, May 8, 2015 at 4:29 AM, Sathaye <saurabhsrs@gmail.com> wrote:

> Hi I am pretty new to spark and I am trying to implement a simple spark
> streaming application using Meetup's RSVP stream:
> stream.meetup.com/2/rsvps
> Any idea how to connect the stream to Spark Streaming?
> I am trying out rawSocketStream but not sure what the parameters are(viz.
> port)
>
> Thank you
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Getting-data-into-Spark-Streaming-tp22806.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>

Mime
View raw message