pirk-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PIRK-21) Apache Spark Streaming Implementation
Date Tue, 23 Aug 2016 14:32:21 GMT

    [ https://issues.apache.org/jira/browse/PIRK-21?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432899#comment-15432899
] 

ASF GitHub Bot commented on PIRK-21:
------------------------------------

Github user ellisonanne commented on a diff in the pull request:

    https://github.com/apache/incubator-pirk/pull/76#discussion_r75877912
  
    --- Diff: src/main/resources/pirk.properties ---
    @@ -28,7 +28,8 @@ local.pirk.properties.dir=/root/
     ##
     ##Spark path for SparkLauncher
     ##
    -spark.home = /usr
    +#spark.home = /usr
    +spark.home=/opt/cloudera/parcels/CDH/lib/spark
    --- End diff --
    
    Yes, this is for the CDH cluster that I am doing some of the testing on - I will remove
it 
    
    (It is, however, an example of how to alternately set the spark.home property for different
cluster configurations)


> Apache Spark Streaming Implementation
> -------------------------------------
>
>                 Key: PIRK-21
>                 URL: https://issues.apache.org/jira/browse/PIRK-21
>             Project: PIRK
>          Issue Type: Improvement
>          Components: Responder
>            Reporter: Ellison Anne Williams
>            Assignee: Ellison Anne Williams
>
> Provide a Spark streaming implementation for Pirk. 
> Although there is discussion and a forthcoming JIRA issue for Pirk integration with Apache
Beam, we can, at the very least, use this implementation to benchmark straight Spark Streaming
vs Beam + Spark Streaming.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message