spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Weiqing Yang (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-24093) Make some fields of KafkaStreamWriter/InternalRowMicroBatchWriter visible to outside of the classes
Date Wed, 25 Apr 2018 21:02:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-24093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Weiqing Yang updated SPARK-24093:
---------------------------------
    Description: To make third parties able to get the information of streaming writer,
for example, the information of "writer" and "topic" which streaming data are written into, this
jira is created to make relevant fields of KafkaStreamWriter and InternalRowMicroBatchWriter
visible to outside of the classes.  (was: We are working on Spark Atlas Connector([https://github.com/hortonworks-spark/spark-atlas-connector)|https://github.com/hortonworks-spark/spark-atlas-connector).],
and adding supports for Spark Streaming. As SAC needs the information of "writer" and "topic"
which streaming data are written into, this jira is created to make relevant fields of KafkaStreamWriter
and InternalRowMicroBatchWriter visible to outside of the classes.)

> Make some fields of KafkaStreamWriter/InternalRowMicroBatchWriter visible to outside
of the classes
> ---------------------------------------------------------------------------------------------------
>
>                 Key: SPARK-24093
>                 URL: https://issues.apache.org/jira/browse/SPARK-24093
>             Project: Spark
>          Issue Type: Wish
>          Components: Structured Streaming
>    Affects Versions: 2.3.0
>            Reporter: Weiqing Yang
>            Priority: Minor
>
> To make third parties able to get the information of streaming writer, for example,
the information of "writer" and "topic" which streaming data are written into, this jira
is created to make relevant fields of KafkaStreamWriter and InternalRowMicroBatchWriter
visible to outside of the classes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message