spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nuthan Kumar <mnut...@gmail.com>
Subject RE: Best practices to call small spark jobs as part of REST api
Date Mon, 12 Oct 2015 04:00:07 GMT
If the data is also on-demand, spark as back end is also good option..

Sent from Outlook Mail for Windows 10 phone



From: Akhil Das
Sent: Sunday, October 11, 2015 1:32 AM
To: unk1102
Cc: user@spark.apache.org
Subject: Re: Best practices to call small spark jobs as part of REST api


One approach would be to make your spark job push the computed results (json) to a database
and your reset server can pull it from there and power the UI. 


Thanks
Best Regards

On Wed, Sep 30, 2015 at 12:26 AM, unk1102 <umesh.kacha@gmail.com> wrote:
Hi I would like to know any best practices to call spark jobs in rest api. My
Spark jobs returns results as json and that json can be used by UI
application.

Should we even have direct HDFS/Spark backend layer in UI for on demand
queries? Please guide. Thanks much.



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Best-practices-to-call-small-spark-jobs-as-part-of-REST-api-tp24872.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org




Mime
View raw message