pulsar-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] erenavsarogullari opened a new pull request #3179: [Pulsar-IO] Add Netty Tcp Source Support
Date Wed, 12 Dec 2018 22:08:38 GMT
erenavsarogullari opened a new pull request #3179: [Pulsar-IO] Add Netty Tcp Source Support
URL: https://github.com/apache/pulsar/pull/3179
 
 
   ### Motivation
   Netty is NIO client server framework by supporting asynchronous event-driven communication
and custom protocol implementation.
   Ref: https://netty.io/
   
   This PR proposes Pulsar-IO Netty Source Connector by aiming the Tcp clients. It enables
an embedded Tcp Server to listen incoming Tcp messages and writes them to user-defined Pulsar
topic.
   
   There are also other potential use-cases(Tcp, Http and Udp messages) for this module as
follows:
   - Tcp Client (Pulsar-IO Sink): It can listen Pulsar messages and can write to remote Tcp
Server.
   - Http Server and Client (Pulsar-IO Source and Sink)
   - Udp Server and Client (Pulsar-IO Source and Sink)
   
   This is following PR with #3095. Module has been rolled to Pulsar-IO in the light of the
previous discussion.
   
   ### Modifications
   1- `NettyTcpServer`: Initializes an embedded Tcp Server to listen incoming Tcp Requests
   2- `NettyTcpServerHandler`: Inbound Channel Handler to handle incoming Tcp Requests
   3- `NettyChannelInitializer`: Channel Initializer to support different types of decoders
and handlers
   4- `NettyTcpSource`: A push-based Source to listen Tcp messages and write them to user-defined
Pulsar topic
   5- `NettyTcpSourceConfig`: To support user-defined config for both Map and Yaml. 
   6- UT Coverages

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

Mime
View raw message