ctakes-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jay vyas <jayunit100.apa...@gmail.com>
Subject SparkStreaming -> CTakes -> Cassandra ETL.
Date Thu, 11 Dec 2014 00:26:36 GMT
Hi folks..  Just an FYI for those interested in running CTakes in a BigData
context.

Ive been working on using CTakes inside Apache BigTop, so that you can do
big data stuff with the CTakes API.

I rewrote the CTakes spark streaming demo here:

https://github.com/jayunit100/SparkStreamingCassandraDemo/tree/master/src

It exemplifies how to stream data using spark, from twitter, and then
process it with CTakes, as well as how to Ultimately forward the results
into Cassandra as well.

Its a work in progress, but feel free to grab it as a template if looking
to integrate all these APIs.

ill brush of my SVN credentials and commit it to directly to CTakes as an
update to the streaming example in sandbox/ that is already there.

https://svn.apache.org/repos/asf/ctakes/sandbox/ctakes-spark-streaming-twitter/


-- 
jay vyas

Mime
View raw message