Hi,
As per the documentation, Writing to an ORC File <https://gobblin.readthedocs.io/en/latest/case-studies/Writing-ORC-Data/#writing-to-an-orc-file>,
"In order to configure the HiveSerDeConverter avro.schema.url must be set when using this
deserializer so that the Hive SerDe knows what Avro Schema to use when converting the record."
If the URL is set to a Confluent Schema Registry (used for storing and retrieving Avro schemas)
address, it fails with below exception.
org.apache.avro.SchemaParseException: No type: {"subject":"localhost.demo.Demo-value","version":1,"id":4,"schema":"{\"type\":\"record\",\"name\":\"Value\",\"namespace\":\"localhost.demo.Demo\",\"fields\":[{\"name\":\"id\",\"type\":\"int\"},{\"name\":\"Name\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"Age\",\"type\":[\"null\",{\"type\":\"int\",\"connect.type\":\"int16\"}],\"default\":null},{\"name\":\"Department\",\"type\":[\"null\",\"string\"],\"default\":null}],\"connect.name
<http://connect.name/>\":\"localhost.demo.Demo.Value\"}"}
Please provide assistance in resolution for the same.
Regards,
Prateek Gupta
|