Return-Path: X-Original-To: apmail-ctakes-notifications-archive@www.apache.org Delivered-To: apmail-ctakes-notifications-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 8FF5C17D8F for ; Tue, 28 Oct 2014 22:53:35 +0000 (UTC) Received: (qmail 8691 invoked by uid 500); 28 Oct 2014 22:53:35 -0000 Delivered-To: apmail-ctakes-notifications-archive@ctakes.apache.org Received: (qmail 8596 invoked by uid 500); 28 Oct 2014 22:53:34 -0000 Mailing-List: contact notifications-help@ctakes.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ctakes.apache.org Delivered-To: mailing list notifications@ctakes.apache.org Received: (qmail 8459 invoked by uid 99); 28 Oct 2014 22:53:34 -0000 Received: from arcas.apache.org (HELO arcas.apache.org) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 28 Oct 2014 22:53:34 +0000 Date: Tue, 28 Oct 2014 22:53:34 +0000 (UTC) From: "jay vyas (JIRA)" To: notifications@ctakes.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Updated] (CTAKES-314) BigTop/Hadoop cTAKES integration MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/CTAKES-314?page=3Dcom.atlassia= n.jira.plugin.system.issuetabpanels:all-tabpanel ] jay vyas updated CTAKES-314: ---------------------------- Attachment: spark-streaming-twitter.tar heres the patch . just untar it and the README should explain everything .= Let me know if it looks good ! Should have a tree like this under ctakes-= examples (or wherever you decide to put the sparkStreaming app).=20 {noformat} [jay@rhbd ctakes]$ tree . =E2=94=9C=E2=94=80=E2=94=80 build.sbt =E2=94=9C=E2=94=80=E2=94=80 org =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 apache =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 ctakes =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 dictionary =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 lookup =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 LookupDes= c_Db.xml =E2=94=9C=E2=94=80=E2=94=80 README.md =E2=94=9C=E2=94=80=E2=94=80 spark-streaming-twitter.tar =E2=94=9C=E2=94=80=E2=94=80 src =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 main =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 jav= a =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 res= ources =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 sca= la =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80= sparkapps =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2= =94=80 ctakes =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 = =E2=94=9C=E2=94=80=E2=94=80 CTakesExample.scala =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 = =E2=94=9C=E2=94=80=E2=94=80 CTakesTwitterStreamingApp.scala =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 = =E2=94=9C=E2=94=80=E2=94=80 Parser.scala =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 = =E2=94=9C=E2=94=80=E2=94=80 TermAnalyzer.scala =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 = =E2=94=9C=E2=94=80=E2=94=80 TwitterInputDStreamCTakes.scala =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 = =E2=94=9C=E2=94=80=E2=94=80 TwitterUtilsJ.scala =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 = =E2=94=94=E2=94=80=E2=94=80 Utils.scala =E2=94=82=C2=A0=C2=A0 =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2= =94=80 SparkApp1.scala =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 test =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 java =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 resources =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 scala =E2=94=82=C2=A0=C2=A0 =E2=94=9C=E2=94=80=E2=94=80 TestSpark.scala =E2=94=82=C2=A0=C2=A0 =E2=94=94=E2=94=80=E2=94=80 TestStreaming.sca= la =E2=94=94=E2=94=80=E2=94=80 twitter {noformat}=20 > BigTop/Hadoop cTAKES integration > -------------------------------- > > Key: CTAKES-314 > URL: https://issues.apache.org/jira/browse/CTAKES-314 > Project: cTAKES > Issue Type: New Feature > Affects Versions: 3.2.0 > Reporter: Pei Chen > Fix For: 3.2.3 > > Attachments: Napkin_cTAKES_Hadoop.JPG, fix.diff, spark-streaming-= twitter.tar > > > Placeholder to- > Create a simple application that can take in different datasources (publi= c forums, twitter, etc.), scale up cTAKES using BigTop/Hadoop ecosystem. -- This message was sent by Atlassian JIRA (v6.3.4#6332)