avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Busbey (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-1694) Support for schema fingerprints in the Ruby library
Date Sat, 12 Sep 2015 17:24:46 GMT

    [ https://issues.apache.org/jira/browse/AVRO-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742140#comment-14742140
] 

Sean Busbey commented on AVRO-1694:
-----------------------------------

copy of my comment from PR-40:

{quote}
I used the proposed tool in [AVRO-1738]() and IRB to verify the given MD5 and SHA-256 for
the int schema and things look fine.

{code}
busbey2-MBA:avro-help busbey$ echo '"int"' | java -jar avro-tools-1.9.0-SNAPSHOT.jar fingerprint
 -
8f5c393f1ad57572 -
busbey2-MBA:avro-help busbey$ echo '{"type":"int"}' | java -jar avro-tools-1.9.0-SNAPSHOT.jar
fingerprint  -
8f5c393f1ad57572 -
busbey2-MBA:avro-help busbey$ echo '{"type":"int"}' | java -jar avro-tools-1.9.0-SNAPSHOT.jar
fingerprint --fingerprint MD5 -
ef524ea1b91e73173d938ade36c1db32 -
busbey2-MBA:avro-help busbey$ echo '"int"' | java -jar avro-tools-1.9.0-SNAPSHOT.jar fingerprint
--fingerprint MD5  -
ef524ea1b91e73173d938ade36c1db32 -
busbey2-MBA:avro-help busbey$ echo '"int"' | java -jar avro-tools-1.9.0-SNAPSHOT.jar fingerprint
--fingerprint SHA-256  -
3f2b87a9fe7cc9b13835598c3981cd45e3e355309e5090aa0933d7becb6fba45 -
busbey2-MBA:avro-help busbey$ irb
jruby-1.7.3 :001 > 'ef524ea1b91e73173d938ade36c1db32'.to_i(16)
 => 318112854175969537208795771590915775282 
jruby-1.7.3 :002 > '3f2b87a9fe7cc9b13835598c3981cd45e3e355309e5090aa0933d7becb6fba45'.to_i(16)
 => 28572620203319713300323544804233350633246234624932075150020181448463213378117 
{code}

I'd like some additional test schemas, but I'm fine with those as a follow-on.

As an aside, from looking at the shared test data for schema normalization it's going to be
awkward to use as-is since it relies on converting to signed-longs instead of a hex string.

I'll push this in a bit unless someone else has concerns.
{quote}

> Support for schema fingerprints in the Ruby library
> ---------------------------------------------------
>
>                 Key: AVRO-1694
>                 URL: https://issues.apache.org/jira/browse/AVRO-1694
>             Project: Avro
>          Issue Type: Wish
>          Components: ruby
>            Reporter: Daniel Schierbeck
>            Assignee: Daniel Schierbeck
>             Fix For: 1.7.8, 1.8.0, 1.9.0
>
>         Attachments: AVRO-1694.1.patch
>
>
> There does not seem to be any support for generating schema fingerprints in the Ruby
library. In order to avoid inlining schemas in my Avro-encoded messages I'd like to store
them separately and instead write the fingerprint in the Avro metadata, thus allowing a reader
to fetch and cache the actual schema from the schema registry.
> In order for that to work, my Ruby writer needs to be able to actually generate a fingerprint
for a schema.
> Is the Ruby library being actively maintained? I would be willing to work on this myself
if someone would review and merge the work.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message