pulsar-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] merlimat opened a new issue #3554: Pulsar SQL support for Protobuf
Date Fri, 08 Feb 2019 20:52:13 GMT
merlimat opened a new issue #3554: Pulsar SQL support for Protobuf
URL: https://github.com/apache/pulsar/issues/3554
   Currently Pulsar SQL support querying topics where the schema is set on JSON or Avro format,
but not on Protobuf.
   Main reason is that regular Protobuf library doesn't support to deserialize binary proto
data without having the Java (C++/Python) generated code for the POJOs. 
   We should support this by having a protobuf binary parser that deserializes into a `GenericObject`.
The information for mapping a protobuf field tag id into a field name is already present in
the Pulsar schema. This was done explicitely for supporting this scenario.  Ref: https://github.com/apache/pulsar/blob/c40bb08f7e00b6e9dca2ca5f1a0a321113aab9a7/pulsar-client/src/main/java/org/apache/pulsar/client/impl/schema/ProtobufSchema.java#L82-L98

This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:

With regards,
Apache Git Services

View raw message