cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mikhail Stepura (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (CASSANDRA-7477) JSON to SSTable import failing
Date Tue, 15 Jul 2014 08:48:04 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-7477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14061844#comment-14061844
] 

Mikhail Stepura edited comment on CASSANDRA-7477 at 7/15/14 8:46 AM:
---------------------------------------------------------------------

[~kishkaru] I've found that at https://github.com/riptano/cassandra-dtest/tree/json_tools.
But it gives me a different error (I'm using the latest {{ccm}} from git, and latest changes
from 2.1.0 branch
{code}
mstepura-mac:cassandra-dtest mikhail$ PRINT_DEBUG=true nosetests -x -s -v json_tools_test.py
json_tools_test (json_tools_test.TestJson) ... cluster ccm directory: /var/folders/xl/w12639217y3041zwnjstr3lc0000gn/T/dtest-yrqnIG
Starting cluster...
[node1 ERROR] objc[52456]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/bin/java
and /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/jre/lib/libinstrument.dylib.
One of the two will be used. Which one is undefined.
Version: 2.1.0
Getting CQLSH...
Inserting data...
Flushing and stopping cluster...
objc[52474]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/bin/java
and /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/jre/lib/libinstrument.dylib.
One of the two will be used. Which one is undefined.
Exporting to JSON file...
-- test-users-ka-1-Data.db -----
objc[52476]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/bin/java
and /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/jre/lib/libinstrument.dylib.
One of the two will be used. Which one is undefined.

Deleting cluster and creating new...
Inserting data...
objc[52510]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/bin/java
and /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/jre/lib/libinstrument.dylib.
One of the two will be used. Which one is undefined.
Importing JSON file...
objc[52512]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/bin/java
and /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/jre/lib/libinstrument.dylib.
One of the two will be used. Which one is undefined.
WARN  08:35:00 JNA link failure, one or more native method will be unavailable.
Counting keys to import, please wait... (NOTE: to skip this use -n <num_keys>)
org.codehaus.jackson.JsonParseException: Unexpected character ('W' (code 87)): expected a
valid value (number, String, array, object, 'true', 'false' or 'null')
 at [Source: /var/folders/xl/w12639217y3041zwnjstr3lc0000gn/T/tmppUlYbe.schema.json; line:
1, column: 2]
	at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1432)
	at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
	at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
	at org.codehaus.jackson.impl.Utf8StreamParser._handleUnexpectedValue(Utf8StreamParser.java:2084)
	at org.codehaus.jackson.impl.Utf8StreamParser._nextTokenNotInObject(Utf8StreamParser.java:600)
	at org.codehaus.jackson.impl.Utf8StreamParser.nextToken(Utf8StreamParser.java:486)
	at org.apache.cassandra.tools.SSTableImport.importSorted(SSTableImport.java:360)
	at org.apache.cassandra.tools.SSTableImport.importJson(SSTableImport.java:282)
	at org.apache.cassandra.tools.SSTableImport.main(SSTableImport.java:494)
ERROR: Unexpected character ('W' (code 87)): expected a valid value (number, String, array,
object, 'true', 'false' or 'null')
 at [Source: /var/folders/xl/w12639217y3041zwnjstr3lc0000gn/T/tmppUlYbe.schema.json; line:
1, column: 2]
Verifying import...
data: [[u'gandalf', 1955, u'male', u'p@$$', u'WA']]
FAIL
removing ccm cluster test at: /var/folders/xl/w12639217y3041zwnjstr3lc0000gn/T/dtest-yrqnIG

======================================================================
FAIL: json_tools_test (json_tools_test.TestJson)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/mikhail/Documents/workspace/cassandra-dtest/json_tools_test.py", line 91, in
json_tools_test
    [u'gandalf', 1955, u'male', u'p@$$', u'WA'] ] )
AssertionError: Element counts were not equal:
First has 0, Second has 1:  [u'frodo', 1985, u'male', u'pass@', u'CA']
First has 0, Second has 1:  [u'sam', 1980, u'male', u'@pass', u'NY']
-------------------- >> begin captured logging << --------------------
dtest: DEBUG: cluster ccm directory: /var/folders/xl/w12639217y3041zwnjstr3lc0000gn/T/dtest-yrqnIG
dtest: DEBUG: Starting cluster...
dtest: DEBUG: Version: 2.1.0
dtest: DEBUG: Getting CQLSH...
dtest: DEBUG: Inserting data...
dtest: DEBUG: Flushing and stopping cluster...
dtest: DEBUG: Exporting to JSON file...
dtest: DEBUG: Deleting cluster and creating new...
dtest: DEBUG: Inserting data...
dtest: DEBUG: Importing JSON file...
dtest: DEBUG: Verifying import...
dtest: DEBUG: data: [[u'gandalf', 1955, u'male', u'p@$$', u'WA']]
--------------------- >> end captured logging << ---------------------

----------------------------------------------------------------------
Ran 1 test in 26.402s

FAILED (failures=1)
{code}


was (Author: mishail):
[~kishkaru] I've found that at https://github.com/riptano/cassandra-dtest/tree/json_tools.
But it gives me a different error (I'm using the latest {ccm} from git, and latest changes
from 2.1.0 branch
{code}
mstepura-mac:cassandra-dtest mikhail$ PRINT_DEBUG=true nosetests -x -s -v json_tools_test.py
json_tools_test (json_tools_test.TestJson) ... cluster ccm directory: /var/folders/xl/w12639217y3041zwnjstr3lc0000gn/T/dtest-yrqnIG
Starting cluster...
[node1 ERROR] objc[52456]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/bin/java
and /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/jre/lib/libinstrument.dylib.
One of the two will be used. Which one is undefined.
Version: 2.1.0
Getting CQLSH...
Inserting data...
Flushing and stopping cluster...
objc[52474]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/bin/java
and /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/jre/lib/libinstrument.dylib.
One of the two will be used. Which one is undefined.
Exporting to JSON file...
-- test-users-ka-1-Data.db -----
objc[52476]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/bin/java
and /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/jre/lib/libinstrument.dylib.
One of the two will be used. Which one is undefined.

Deleting cluster and creating new...
Inserting data...
objc[52510]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/bin/java
and /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/jre/lib/libinstrument.dylib.
One of the two will be used. Which one is undefined.
Importing JSON file...
objc[52512]: Class JavaLaunchHelper is implemented in both /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/bin/java
and /Library/Java/JavaVirtualMachines/jdk1.7.0_55.jdk/Contents/Home/jre/lib/libinstrument.dylib.
One of the two will be used. Which one is undefined.
WARN  08:35:00 JNA link failure, one or more native method will be unavailable.
Counting keys to import, please wait... (NOTE: to skip this use -n <num_keys>)
org.codehaus.jackson.JsonParseException: Unexpected character ('W' (code 87)): expected a
valid value (number, String, array, object, 'true', 'false' or 'null')
 at [Source: /var/folders/xl/w12639217y3041zwnjstr3lc0000gn/T/tmppUlYbe.schema.json; line:
1, column: 2]
	at org.codehaus.jackson.JsonParser._constructError(JsonParser.java:1432)
	at org.codehaus.jackson.impl.JsonParserMinimalBase._reportError(JsonParserMinimalBase.java:385)
	at org.codehaus.jackson.impl.JsonParserMinimalBase._reportUnexpectedChar(JsonParserMinimalBase.java:306)
	at org.codehaus.jackson.impl.Utf8StreamParser._handleUnexpectedValue(Utf8StreamParser.java:2084)
	at org.codehaus.jackson.impl.Utf8StreamParser._nextTokenNotInObject(Utf8StreamParser.java:600)
	at org.codehaus.jackson.impl.Utf8StreamParser.nextToken(Utf8StreamParser.java:486)
	at org.apache.cassandra.tools.SSTableImport.importSorted(SSTableImport.java:360)
	at org.apache.cassandra.tools.SSTableImport.importJson(SSTableImport.java:282)
	at org.apache.cassandra.tools.SSTableImport.main(SSTableImport.java:494)
ERROR: Unexpected character ('W' (code 87)): expected a valid value (number, String, array,
object, 'true', 'false' or 'null')
 at [Source: /var/folders/xl/w12639217y3041zwnjstr3lc0000gn/T/tmppUlYbe.schema.json; line:
1, column: 2]
Verifying import...
data: [[u'gandalf', 1955, u'male', u'p@$$', u'WA']]
FAIL
removing ccm cluster test at: /var/folders/xl/w12639217y3041zwnjstr3lc0000gn/T/dtest-yrqnIG

======================================================================
FAIL: json_tools_test (json_tools_test.TestJson)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/mikhail/Documents/workspace/cassandra-dtest/json_tools_test.py", line 91, in
json_tools_test
    [u'gandalf', 1955, u'male', u'p@$$', u'WA'] ] )
AssertionError: Element counts were not equal:
First has 0, Second has 1:  [u'frodo', 1985, u'male', u'pass@', u'CA']
First has 0, Second has 1:  [u'sam', 1980, u'male', u'@pass', u'NY']
-------------------- >> begin captured logging << --------------------
dtest: DEBUG: cluster ccm directory: /var/folders/xl/w12639217y3041zwnjstr3lc0000gn/T/dtest-yrqnIG
dtest: DEBUG: Starting cluster...
dtest: DEBUG: Version: 2.1.0
dtest: DEBUG: Getting CQLSH...
dtest: DEBUG: Inserting data...
dtest: DEBUG: Flushing and stopping cluster...
dtest: DEBUG: Exporting to JSON file...
dtest: DEBUG: Deleting cluster and creating new...
dtest: DEBUG: Inserting data...
dtest: DEBUG: Importing JSON file...
dtest: DEBUG: Verifying import...
dtest: DEBUG: data: [[u'gandalf', 1955, u'male', u'p@$$', u'WA']]
--------------------- >> end captured logging << ---------------------

----------------------------------------------------------------------
Ran 1 test in 26.402s

FAILED (failures=1)
{code}

> JSON to SSTable import failing
> ------------------------------
>
>                 Key: CASSANDRA-7477
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-7477
>             Project: Cassandra
>          Issue Type: Bug
>         Environment: Linux Mint 17 64-bit | 16GiB | C* 2.1
>            Reporter: Kishan Karunaratne
>            Assignee: Mikhail Stepura
>             Fix For: 2.1.0
>
>         Attachments: log2.log
>
>
> Issue affects C* version >= 2.1. Commit found by using git bisect. The previous commit
to this one also fails, but due to other reasons (CCM server won't start). This commit is
the one that give the same error as 2.1 HEAD:
> {noformat}
> 02d1e7497a9930120fac367ce82a3b22940acafb is the first bad commit
> commit 02d1e7497a9930120fac367ce82a3b22940acafb
> Author: Brandon Williams <brandonwilliams@apache.org>
> Date:   Mon Apr 21 14:42:29 2014 -0500
>     Default flush dir to data dir.
>     Patch by brandonwilliams, reviewed by yukim for CASSANDRA-7064
> :040000 040000 c50a123f305b73583ccbfa9c455efc4e4cee228f 507a90290dccb8a929afadf1f833d926049c46ad
M	conf
> {noformat}
> {noformat}
> $ PRINT_DEBUG=true nosetests -x -s -v json_tools_test.py 
> json_tools_test (json_tools_test.TestJson) ... cluster ccm directory: /tmp/dtest-8WVBq9
> Starting cluster...
> Version: 2.1.0
> Getting CQLSH...
> Inserting data...
> Flushing and stopping cluster...
> Exporting to JSON file...
> -- test-users-ka-1-Data.db -----
> Deleting cluster and creating new...
> Inserting data...
> Importing JSON file...
> Counting keys to import, please wait... (NOTE: to skip this use -n <num_keys>)
> Importing 2 keys...
> java.lang.ClassCastException: org.apache.cassandra.db.composites.Composites$EmptyComposite
cannot be cast to org.apache.cassandra.db.composites.CellName
> 	at org.apache.cassandra.db.composites.AbstractCellNameType.cellFromByteBuffer(AbstractCellNameType.java:168)
> 	at org.apache.cassandra.tools.SSTableImport$JsonColumn.<init>(SSTableImport.java:165)
> 	at org.apache.cassandra.tools.SSTableImport.addColumnsToCF(SSTableImport.java:242)
> 	at org.apache.cassandra.tools.SSTableImport.addToStandardCF(SSTableImport.java:225)
> 	at org.apache.cassandra.tools.SSTableImport.importSorted(SSTableImport.java:464)
> 	at org.apache.cassandra.tools.SSTableImport.importJson(SSTableImport.java:351)
> 	at org.apache.cassandra.tools.SSTableImport.main(SSTableImport.java:575)
> ERROR: org.apache.cassandra.db.composites.Composites$EmptyComposite cannot be cast to
org.apache.cassandra.db.composites.CellName
> Verifying import...
> data: [[u'gandalf', 1955, u'male', u'p@$$', u'WA']]
> FAIL
> removing ccm cluster test at: /tmp/dtest-8WVBq9
> ERROR
> ======================================================================
> ERROR: json_tools_test (json_tools_test.TestJson)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>   File "/home/kishan/git/cstar/cassandra-dtest/dtest.py", line 214, in tearDown
>     raise AssertionError('Unexpected error in %s node log: %s' % (node.name, errors))
> AssertionError: Unexpected error in node1 node log: ['ERROR [SSTableBatchOpen:1] 2014-06-30
13:56:01,032 CassandraDaemon.java:166 - Exception in thread Thread[SSTableBatchOpen:1,5,main]\n']
> -------------------- >> begin captured logging << --------------------
> dtest: DEBUG: cluster ccm directory: /tmp/dtest-8WVBq9
> dtest: DEBUG: Starting cluster...
> dtest: DEBUG: Version: 2.1.0
> dtest: DEBUG: Getting CQLSH...
> dtest: DEBUG: Inserting data...
> dtest: DEBUG: Flushing and stopping cluster...
> dtest: DEBUG: Exporting to JSON file...
> dtest: DEBUG: Deleting cluster and creating new...
> dtest: DEBUG: Inserting data...
> dtest: DEBUG: Importing JSON file...
> dtest: DEBUG: Verifying import...
> dtest: DEBUG: data: [[u'gandalf', 1955, u'male', u'p@$$', u'WA']]
> dtest: DEBUG: removing ccm cluster test at: /tmp/dtest-8WVBq9
> --------------------- >> end captured logging << ---------------------
> ======================================================================
> FAIL: json_tools_test (json_tools_test.TestJson)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
>   File "/home/kishan/git/cstar/cassandra-dtest/json_tools_test.py", line 91, in json_tools_test
>     [u'gandalf', 1955, u'male', u'p@$$', u'WA'] ] )
> AssertionError: Element counts were not equal:
> First has 0, Second has 1:  [u'frodo', 1985, u'male', u'pass@', u'CA']
> First has 0, Second has 1:  [u'sam', 1980, u'male', u'@pass', u'NY']
> -------------------- >> begin captured logging << --------------------
> dtest: DEBUG: cluster ccm directory: /tmp/dtest-8WVBq9
> dtest: DEBUG: Starting cluster...
> dtest: DEBUG: Version: 2.1.0
> dtest: DEBUG: Getting CQLSH...
> dtest: DEBUG: Inserting data...
> dtest: DEBUG: Flushing and stopping cluster...
> dtest: DEBUG: Exporting to JSON file...
> dtest: DEBUG: Deleting cluster and creating new...
> dtest: DEBUG: Inserting data...
> dtest: DEBUG: Importing JSON file...
> dtest: DEBUG: Verifying import...
> dtest: DEBUG: data: [[u'gandalf', 1955, u'male', u'p@$$', u'WA']]
> --------------------- >> end captured logging << ---------------------
> ----------------------------------------------------------------------
> Ran 1 test in 28.636s
> FAILED (errors=1, failures=1)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message