avro-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tophe Vigny (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (AVRO-1206) utf-8 serialisation problems
Date Thu, 22 Nov 2012 08:42:58 GMT

    [ https://issues.apache.org/jira/browse/AVRO-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13502649#comment-13502649
] 

Tophe Vigny commented on AVRO-1206:
-----------------------------------

Hi Doug

that's amazing. 
for me the test don't work with a compiled ruby 1.9.1.
anyway, thank's you for the commit.



Tophe@info3:~/work/svn_1/trunk/lang/ruby$ rvm use 1.9.1
Using /home/Tophe/.rvm/gems/ruby-1.9.1-p431
Tophe@info3:~/work/svn_1/trunk/lang/ruby$ rake test
/home/Tophe/.rvm/rubies/ruby-1.9.1-p431/bin/ruby -I"lib:ext:bin:test" -I"/home/Tophe/.rvm/gems/ruby-1.9.1-p431@global/gems/rake-10.0.2/lib"
"/home/Tophe/.rvm/gems/ruby-1.9.1-p431@global/gems/rake-10.0.2/lib/rake/rake_test_loader.rb"
"test/test_socket_transport.rb" "test/test_io.rb" "test/test_datafile.rb" "test/test_help.rb"
"test/test_protocol.rb" 
Loaded suite /home/Tophe/.rvm/gems/ruby-1.9.1-p431@global/gems/rake-10.0.2/lib/rake/rake_test_loader
Started
...F............................
Finished in 0.221537 seconds.

  1) Failure:
test_utf8(TestDataFile) [/home/Tophe/work/svn_1/trunk/lang/ruby/test/test_datafile.rb:156]:
<"家"> expected but was
<"\xE5">.

32 tests, 710 assertions, 1 failures, 0 errors, 0 skips
rake aborted!

                
> utf-8 serialisation problems 
> -----------------------------
>
>                 Key: AVRO-1206
>                 URL: https://issues.apache.org/jira/browse/AVRO-1206
>             Project: Avro
>          Issue Type: Bug
>          Components: ruby
>    Affects Versions: 1.7.2
>         Environment: ruby-1.9.3p194, avro gem 1.7.2.
>            Reporter: Tophe Vigny
>         Attachments: AVRO-1206.patch
>
>
> some serialized utf-8 characters like "家" cannot be read latter, avro break with 
> /gems/ruby-1.9.3-p194/gems/avro-1.7.2/lib/avro/io.rb:230:in `match_schemas': undefined
method `type' for nil:NilClass (NoMethodError)
> 	from /home/Tophe/.rvm/gems/ruby-1.9.3-p194/gems/avro-1.7.2/lib/avro/io.rb:288:in `read_data'
> 	from /home/Tophe/.rvm/gems/ruby-1.9.3-p194/gems/avro-1.7.2/lib/avro/io.rb:384:in `read_union'
> 	from /home/Tophe/.rvm/gems/ruby-1.9.3-p194/gems/avro-1.7.2/lib/avro/io.rb:317:in `read_data'
> 	from /home/Tophe/.rvm/gems/ruby-1.9.3-p194/gems/avro-1.7.2/lib/avro/io.rb:392:in `block
in read_record'
> 	from /home/Tophe/.rvm/gems/ruby-1.9.3-p194/gems/avro-1.7.2/lib/avro/io.rb:390:in `each'
> 	from /home/Tophe/.rvm/gems/ruby-1.9.3-p194/gems/avro-1.7.2/lib/avro/io.rb:390:in `read_record'
> 	from /home/Tophe/.rvm/gems/ruby-1.9.3-p194/gems/avro-1.7.2/lib/avro/io.rb:318:in `read_data'
> 	from /home/Tophe/.rvm/gems/ruby-1.9.3-p194/gems/avro-1.7.2/lib/avro/io.rb:283:in `read'
> 	from /home/Tophe/.rvm/gems/ruby-1.9.3-p194/gems/avro-1.7.2/lib/avro/data_file.rb:223:in
`block in each'
> 	from /home/Tophe/.rvm/gems/ruby-1.9.3-p194/gems/avro-1.7.2/lib/avro/data_file.rb:211:in
`loop'
> 	from /home/Tophe/.rvm/gems/ruby-1.9.3-p194/gems/avro-1.7.2/lib/avro/data_file.rb:211:in
`each'
> 	from avr_err_example.rb:42:in `block in <main>'

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message