pulsar-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] erenavsarogullari opened a new pull request #3039: [Pulsar-Flink] Add Batch Csv Sink Support
Date Wed, 21 Nov 2018 20:57:56 GMT
erenavsarogullari opened a new pull request #3039: [Pulsar-Flink] Add Batch Csv Sink Support
URL: https://github.com/apache/pulsar/pull/3039
 
 
   ### Motivation
   This PR aims to add Flink - Pulsar Batch Csv Sink Support. If user works with Flink DataSet
API and would like to write the DataSets to Pulsar in Csv format, this sink can help.
   
   Ref: [Flink Batch Sink API](https://ci.apache.org/projects/flink/flink-docs-stable/dev/batch/#data-sinks)
   
   ### Modifications
   Please find the change-set as follows:
   
   **1-** Defines `PulsarCsvOutputFormat` to write Flink Batch `DataSets` into Pulsar by providing
ready `CsvSerializationSchema`.
   **2-** Abstracts current implementation to support both `PulsarOutputFormat` (which supports
for user-defined serialization schema) and `PulsarCsvOutputFormat`
   **3-** UT Coverages
   **4-** `FlinkPulsarBatchCsvSinkExample` to show how to be used by users.
   **5-** `README.md `documentation
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message