avro-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Roger Hoover <roger.hoo...@gmail.com>
Subject Encoding Avro schema as binary
Date Mon, 08 Sep 2014 22:07:04 GMT
Hi,

I wanted to see how much overhead would be involved if we ship an avro
schema along with message in a messaging context.  Seems like it might
simplify things to not always need a schema registry available with all
schema versions.

I found an old thread (
http://search-hadoop.com/m/zmrzAWDkbt1/noble+paul/v=threaded) referencing
this issue. (https://issues.apache.org/jira/browse/AVRO-251)

A couple questions?
1) Any particular reason the patch was never merged?  Can anyone foresee
major issues with this approach?
2) I applied this patch to the 1.5 branch thinking that I'd have the best
luck there (both are from 2011).  I'm having trouble building anything that
depends on the avro-maven-plugin (see errors below).  Any help would be
appreciated testing this out.

Thanks!

I'm getting this error trying to use the avro-maven-plugin to compile the
ipc module. Any ideas?

[ERROR] Failed to execute goal
org.apache.avro:avro-maven-plugin:1.5.5-SNAPSHOT:schema (schemas) on
project avro-ipc: Execution schemas of goal
org.apache.avro:avro-maven-plugin:1.5.5-SNAPSHOT:schema failed: An API
incompatibility was encountered while executing
org.apache.avro:avro-maven-plugin:1.5.5-SNAPSHOT:schema:
java.lang.ExceptionInInitializerError: null
[ERROR] -----------------------------------------------------
[ERROR] realm = plugin>org.apache.avro:avro-maven-plugin:1.5.5-SNAPSHOT
[ERROR] strategy =
org.codehaus.plexus.classworlds.strategy.SelfFirstStrategy
[ERROR] urls[0] =
file:/Users/rhoover/.m2/repository/org/apache/avro/avro-maven-plugin/1.5.5-SNAPSHOT/avro-maven-plugin-1.5.5-SNAPSHOT.jar
<file:///Users/rhoover/.m2/repository/org/apache/avro/avro-maven-plugin/1.5.5-SNAPSHOT/avro-maven-plugin-1.5.5-SNAPSHOT.jar>
[ERROR] urls[1] =
file:/Users/rhoover/.m2/repository/org/codehaus/plexus/plexus-interpolation/1.1/plexus-interpolation-1.1.jar
<file:///Users/rhoover/.m2/repository/org/codehaus/plexus/plexus-interpolation/1.1/plexus-interpolation-1.1.jar>
[ERROR] urls[2] =
file:/Users/rhoover/.m2/repository/org/codehaus/plexus/plexus-utils/1.5.5/plexus-utils-1.5.5.jar
<file:///Users/rhoover/.m2/repository/org/codehaus/plexus/plexus-utils/1.5.5/plexus-utils-1.5.5.jar>
[ERROR] urls[3] =
file:/Users/rhoover/.m2/repository/junit/junit/3.8.1/junit-3.8.1.jar
<file:///Users/rhoover/.m2/repository/junit/junit/3.8.1/junit-3.8.1.jar>
[ERROR] urls[4] =
file:/Users/rhoover/.m2/repository/org/apache/maven/shared/file-management/1.2.1/file-management-1.2.1.jar
<file:///Users/rhoover/.m2/repository/org/apache/maven/shared/file-management/1.2.1/file-management-1.2.1.jar>
[ERROR] urls[5] =
file:/Users/rhoover/.m2/repository/org/apache/maven/shared/maven-shared-io/1.1/maven-shared-io-1.1.jar
<file:///Users/rhoover/.m2/repository/org/apache/maven/shared/maven-shared-io/1.1/maven-shared-io-1.1.jar>
[ERROR] urls[6] =
file:/Users/rhoover/.m2/repository/org/apache/avro/avro-compiler/1.5.5-SNAPSHOT/avro-compiler-1.5.5-SNAPSHOT.jar
<file:///Users/rhoover/.m2/repository/org/apache/avro/avro-compiler/1.5.5-SNAPSHOT/avro-compiler-1.5.5-SNAPSHOT.jar>
[ERROR] urls[7] =
file:/Users/rhoover/.m2/repository/org/apache/avro/avro/1.5.5-SNAPSHOT/avro-1.5.5-SNAPSHOT.jar
<file:///Users/rhoover/.m2/repository/org/apache/avro/avro/1.5.5-SNAPSHOT/avro-1.5.5-SNAPSHOT.jar>
[ERROR] urls[8] =
file:/Users/rhoover/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.7.3/jackson-mapper-asl-1.7.3.jar
<file:///Users/rhoover/.m2/repository/org/codehaus/jackson/jackson-mapper-asl/1.7.3/jackson-mapper-asl-1.7.3.jar>
[ERROR] urls[9] =
file:/Users/rhoover/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.7.3/jackson-core-asl-1.7.3.jar
<file:///Users/rhoover/.m2/repository/org/codehaus/jackson/jackson-core-asl/1.7.3/jackson-core-asl-1.7.3.jar>
[ERROR] urls[10] =
file:/Users/rhoover/.m2/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar
<file:///Users/rhoover/.m2/repository/com/thoughtworks/paranamer/paranamer/2.3/paranamer-2.3.jar>
[ERROR] urls[11] =
file:/Users/rhoover/.m2/repository/org/xerial/snappy/snappy-java/1.0.3.2/snappy-java-1.0.3.2.jar
<file:///Users/rhoover/.m2/repository/org/xerial/snappy/snappy-java/1.0.3.2/snappy-java-1.0.3.2.jar>
[ERROR] urls[12] =
file:/Users/rhoover/.m2/repository/commons-lang/commons-lang/2.5/commons-lang-2.5.jar
<file:///Users/rhoover/.m2/repository/commons-lang/commons-lang/2.5/commons-lang-2.5.jar>
[ERROR] urls[13] =
file:/Users/rhoover/.m2/repository/org/apache/velocity/velocity/1.7/velocity-1.7.jar
<file:///Users/rhoover/.m2/repository/org/apache/velocity/velocity/1.7/velocity-1.7.jar>
[ERROR] urls[14] =
file:/Users/rhoover/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar
<file:///Users/rhoover/.m2/repository/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar>
[ERROR] urls[15] =
file:/Users/rhoover/.m2/repository/org/slf4j/slf4j-api/1.6.1/slf4j-api-1.6.1.jar
<file:///Users/rhoover/.m2/repository/org/slf4j/slf4j-api/1.6.1/slf4j-api-1.6.1.jar>
[ERROR] urls[16] =
file:/Users/rhoover/.m2/repository/org/slf4j/slf4j-simple/1.6.1/slf4j-simple-1.6.1.jar
<file:///Users/rhoover/.m2/repository/org/slf4j/slf4j-simple/1.6.1/slf4j-simple-1.6.1.jar>
[ERROR] Number of foreign imports: 1
[ERROR] import: Entry[import from realm ClassRealm[maven.api, parent: null]]
[ERROR]
[ERROR] -----------------------------------------------------:
java.io.EOFException: No content to map to Object due to end of input

Mime
View raw message