spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Saisai Shao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-4960) Interceptor pattern in receivers
Date Mon, 29 Dec 2014 09:44:13 GMT

    [ https://issues.apache.org/jira/browse/SPARK-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259976#comment-14259976
] 

Saisai Shao commented on SPARK-4960:
------------------------------------

Hi Hari, I think ReliableKafkaReciever only called once about store() APIs, one is BlockGenerator's
addDataWithCallback, another is store(ArrayBuffer[T]) :).

> Interceptor pattern in receivers
> --------------------------------
>
>                 Key: SPARK-4960
>                 URL: https://issues.apache.org/jira/browse/SPARK-4960
>             Project: Spark
>          Issue Type: New Feature
>          Components: Streaming
>            Reporter: Tathagata Das
>
> Sometimes it is good to intercept a message received through a receiver and modify /
do something with the message before it is stored into Spark. This is often referred to as
the interceptor pattern. There should be general way to specify an interceptor function that
gets applied to all receivers. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message