cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paulo Motta (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-10875) cqlsh fails to decode utf-8 characters for text typed columns.
Date Fri, 18 Dec 2015 12:50:46 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15063919#comment-15063919
] 

Paulo Motta commented on CASSANDRA-10875:
-----------------------------------------

Also, please include this in your patch:
{noformat}
diff --git a/bin/cqlsh b/bin/cqlsh
index 651420d..e852a8b 100755
--- a/bin/cqlsh
+++ b/bin/cqlsh
@@ -668,6 +668,8 @@ class Shell(cmd.Cmd):
         self.session.max_trace_wait = max_trace_wait
         if encoding is None:
             encoding = locale.getpreferredencoding()
+            if encoding is None:
+              encoding = 'utf-8'
         self.encoding = encoding
         self.output_codec = codecs.lookup(encoding)
{noformat}

As apparently {{locale.getpreferredencoding()}} may [not be available|https://docs.python.org/2/library/locale.html#locale.getpreferredencoding]
in some platforms.

> cqlsh fails to decode utf-8 characters for text typed columns.
> --------------------------------------------------------------
>
>                 Key: CASSANDRA-10875
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-10875
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Tools
>            Reporter: Yasuharu Goto
>            Assignee: Yasuharu Goto
>            Priority: Minor
>             Fix For: 2.1.13, 3.1
>
>         Attachments: 10875-2.1.12.txt, 10875-3.1.txt
>
>
> Hi, we've found a bug that cqlsh can't handle unicode text in select conditions even
if it were text type.
> {noformat}
> $ ./bin/cqlsh
> Connected to Test Cluster at 127.0.0.1:9042.
> [cqlsh 5.0.1 | Cassandra 3.2-SNAPSHOT | CQL spec 3.3.1 | Native protocol v4]
> Use HELP for help.
> cqlsh> create KEYSPACE test WITH replication = {'class': 'SimpleStrategy', 'replication_factor':
1};
> cqlsh> create table test.test(txt text primary key);
> cqlsh> insert into test.test (txt) values('日本語');
> cqlsh> select * from test.test where txt='日本語';
> 'ascii' codec can't decode byte 0xe6 in position 35: ordinal not in range(128)
> cqlsh> 
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message