cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ben Bromhead <...@instaclustr.com>
Subject Re: Spark SQL JDBC Server + DSE
Date Tue, 02 Jun 2015 21:05:18 GMT
If you want a web based notebook style approach (similar to ipython) check
out https://github.com/apache/incubator-zeppelin

And https://github.com/apache/incubator-zeppelin/pull/86

Bonus free pretty graphs!

On 1 June 2015 at 11:41, Sebastian Estevez <sebastian.estevez@datastax.com>
wrote:

> Have you looked at job server?
>
> https://github.com/spark-jobserver/spark-jobserver
> https://www.youtube.com/watch?v=8k9ToZ4m6os
>
> http://planetcassandra.org/blog/post/fast-spark-queries-on-in-memory-datasets/
>
> All the best,
>
>
> [image: datastax_logo.png] <http://www.datastax.com/>
>
> Sebastián Estévez
>
> Solutions Architect | 954 905 8615 | sebastian.estevez@datastax.com
>
> [image: linkedin.png] <https://www.linkedin.com/company/datastax> [image:
> facebook.png] <https://www.facebook.com/datastax> [image: twitter.png]
> <https://twitter.com/datastax> [image: g+.png]
> <https://plus.google.com/+Datastax/about>
> <http://feeds.feedburner.com/datastax>
>
> <http://cassandrasummit-datastax.com/>
>
> DataStax is the fastest, most scalable distributed database technology,
> delivering Apache Cassandra to the world’s most innovative enterprises.
> Datastax is built to be agile, always-on, and predictably scalable to any
> size. With more than 500 customers in 45 countries, DataStax is the
> database technology and transactional backbone of choice for the worlds
> most innovative companies such as Netflix, Adobe, Intuit, and eBay.
>
> On Mon, Jun 1, 2015 at 8:13 AM, Mohammed Guller <mohammed@glassbeam.com>
> wrote:
>
>>  Brian,
>>
>> We haven’t open sourced the REST server, but not  opposed to doing it.
>> Just need to carve out some time to clean up the code and carve it out from
>> all the other stuff that we do in that REST server.  Will try to do it in
>> the next few weeks. If you need it sooner, let me know.
>>
>>
>>
>> I did consider the option of writing our own Spark SQL JDBC driver for
>> C*, but it is lower on the priority list right now.
>>
>>
>>
>> Mohammed
>>
>>
>>
>> *From:* Brian O'Neill [mailto:boneill42@gmail.com] *On Behalf Of *Brian
>> O'Neill
>> *Sent:* Saturday, May 30, 2015 3:12 AM
>>
>> *To:* user@cassandra.apache.org
>> *Subject:* Re: Spark SQL JDBC Server + DSE
>>
>>
>>
>>
>>
>> Any chance you open-sourced, or could open-source the REST server? ;)
>>
>>
>>
>> In thinking about it…
>>
>> It doesn’t feel like it would be that hard to write a Spark SQL JDBC
>> driver against Cassandra, akin to what they have for hive:
>>
>>
>> https://spark.apache.org/docs/latest/sql-programming-guide.html#running-the-thrift-jdbcodbc-server
>>
>>
>>
>> I wouldn’t mind collaborating on that, if you are headed in that
>> direction.
>>
>> (and then I could write the REST server on top of that)
>>
>>
>>
>> LMK,
>>
>>
>>
>> -brian
>>
>>
>>
>> ---
>>
>> *Brian O'Neill *
>>
>> Chief Technology Officer
>>
>> Health Market Science, a LexisNexis Company
>>
>> 215.588.6024 Mobile • @boneill42 <http://www.twitter.com/boneill42>
>>
>>
>>
>> This information transmitted in this email message is for the intended
>> recipient only and may contain confidential and/or privileged material. If
>> you received this email in error and are not the intended recipient, or the
>> person responsible to deliver it to the intended recipient, please contact
>> the sender at the email above and delete this email and any attachments and
>> destroy any copies thereof. Any review, retransmission, dissemination,
>> copying or other use of, or taking any action in reliance upon, this
>> information by persons or entities other than the intended recipient is
>> strictly prohibited.
>>
>>
>>
>>
>>
>> *From: *Mohammed Guller <mohammed@glassbeam.com>
>> *Reply-To: *<user@cassandra.apache.org>
>> *Date: *Friday, May 29, 2015 at 2:15 PM
>> *To: *"user@cassandra.apache.org" <user@cassandra.apache.org>
>> *Subject: *RE: Spark SQL JDBC Server + DSE
>>
>>
>>
>> Brian,
>>
>> I implemented a similar REST server last year and it works great. Now we
>> have a requirement to support JDBC connectivity in addition to the REST
>> API. We want to allow users to use tools like Tableau to connect to C*
>> through the Spark SQL JDBC/Thift server.
>>
>>
>>
>> Mohammed
>>
>>
>>
>> *From:* Brian O'Neill [mailto:boneill42@gmail.com <boneill42@gmail.com>] *On
>> Behalf Of *Brian O'Neill
>> *Sent:* Thursday, May 28, 2015 6:16 PM
>> *To:* user@cassandra.apache.org
>> *Subject:* Re: Spark SQL JDBC Server + DSE
>>
>>
>>
>> Mohammed,
>>
>>
>>
>> This doesn’t really answer your question, but I’m working on a new REST
>> server that allows people to submit SQL queries over REST, which get
>> executed via Spark SQL.   Based on what I started here:
>>
>>
>> http://brianoneill.blogspot.com/2015/05/spark-sql-against-cassandra-example.html
>>
>>
>>
>> I assume you need JDBC connectivity specifically?
>>
>>
>>
>> -brian
>>
>>
>>
>> ---
>>
>> *Brian O'Neill *
>>
>> Chief Technology Officer
>>
>> Health Market Science, a LexisNexis Company
>>
>> 215.588.6024 Mobile • @boneill42 <http://www.twitter.com/boneill42>
>>
>>
>>
>> This information transmitted in this email message is for the intended
>> recipient only and may contain confidential and/or privileged material. If
>> you received this email in error and are not the intended recipient, or the
>> person responsible to deliver it to the intended recipient, please contact
>> the sender at the email above and delete this email and any attachments and
>> destroy any copies thereof. Any review, retransmission, dissemination,
>> copying or other use of, or taking any action in reliance upon, this
>> information by persons or entities other than the intended recipient is
>> strictly prohibited.
>>
>>
>>
>>
>>
>> *From: *Mohammed Guller <mohammed@glassbeam.com>
>> *Reply-To: *<user@cassandra.apache.org>
>> *Date: *Thursday, May 28, 2015 at 8:26 PM
>> *To: *"user@cassandra.apache.org" <user@cassandra.apache.org>
>> *Subject: *RE: Spark SQL JDBC Server + DSE
>>
>>
>>
>> Anybody out there using DSE + Spark SQL JDBC server?
>>
>>
>>
>> Mohammed
>>
>>
>>
>> *From:* Mohammed Guller [mailto:mohammed@glassbeam.com
>> <mohammed@glassbeam.com>]
>> *Sent:* Tuesday, May 26, 2015 6:17 PM
>> *To:* user@cassandra.apache.org
>> *Subject:* Spark SQL JDBC Server + DSE
>>
>>
>>
>> Hi –
>>
>> As I understand, the Spark SQL Thrift/JDBC server cannot be used with the
>> open source C*. Only DSE supports  the Spark SQL JDBC server.
>>
>>
>>
>> We would like to find out whether how many organizations are using this
>> combination. If you do use DSE + Spark SQL JDBC server, it would be great
>> if you could share your experience. For example, what kind of issues you
>> have run into? How is the performance? What reporting tools you are using?
>>
>>
>>
>> Thank  you!
>>
>>
>>
>> Mohammed
>>
>>
>>
>
>


-- 

Ben Bromhead

Instaclustr | www.instaclustr.com | @instaclustr
<http://twitter.com/instaclustr> | (650) 284 9692

Mime
View raw message