gobblin-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Prateek Gupta <prateek.gup...@myntra.com>
Subject SchemaParseException When Writing to ORC File
Date Wed, 15 Nov 2017 09:14:28 GMT
Hi,

As per the documentation, Writing to an ORC File <https://gobblin.readthedocs.io/en/latest/case-studies/Writing-ORC-Data/#writing-to-an-orc-file>,
"In order to configure the HiveSerDeConverter avro.schema.url must be set when using this
deserializer so that the Hive SerDe knows what Avro Schema to use when converting the record."

If the URL is set to a Confluent Schema Registry (used for storing and retrieving Avro schemas)
address, it fails with below exception.

org.apache.avro.SchemaParseException: No type: {"subject":"localhost.demo.Demo-value","version":1,"id":4,"schema":"{\"type\":\"record\",\"name\":\"Value\",\"namespace\":\"localhost.demo.Demo\",\"fields\":[{\"name\":\"id\",\"type\":\"int\"},{\"name\":\"Name\",\"type\":[\"null\",\"string\"],\"default\":null},{\"name\":\"Age\",\"type\":[\"null\",{\"type\":\"int\",\"connect.type\":\"int16\"}],\"default\":null},{\"name\":\"Department\",\"type\":[\"null\",\"string\"],\"default\":null}],\"connect.name
<http://connect.name/>\":\"localhost.demo.Demo.Value\"}"}

Please provide assistance in resolution for the same.

Regards,
Prateek Gupta
Mime
View raw message