cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paulo Motta (JIRA)" <>
Subject [jira] [Commented] (CASSANDRA-10104) Windows dtest 3.0: fails
Date Fri, 21 Aug 2015 17:29:45 GMT


Paulo Motta commented on CASSANDRA-10104:

The initial error was related to hinted handoff failure, but that error [went away in the
latest build|]
with the introduction of the new [hinted handoff implementation|].
There is now a new problem:

{noformat} - Exception encountered during startup java.lang.IllegalArgumentException:
Unknown CF 5bc52802-de25-35ed-aeab-188eecebb090 \\tat org.apache.cassandra.db.Keyspace.getColumnFamilyStore(
at org.apache.cassandra.db.Keyspace.getColumnFamilyStore( ~[main/:na]
at org.apache.cassandra.cql3.restrictions.StatementRestrictions.<init>(
at org.apache.cassandra.cql3.statements.SelectStatement$RawStatement.prepareRestrictions(
at org.apache.cassandra.cql3.statements.SelectStatement$RawStatement.prepare(
at org.apache.cassandra.auth.CassandraRoleManager.prepare( ~[main/:na]
at org.apache.cassandra.auth.CassandraRoleManager.setup( ~[main/:na]
at org.apache.cassandra.service.StorageService.doAuthSetup( ~[main/:na]
at org.apache.cassandra.service.StorageService.joinTokenRing( ~[main/:na]
at org.apache.cassandra.service.StorageService.initServer( ~[main/:na]
at org.apache.cassandra.service.StorageService.initServer( ~[main/:na]
at org.apache.cassandra.service.CassandraDaemon.setup( [main/:na]
at org.apache.cassandra.service.CassandraDaemon.activate( [main/:na]
at org.apache.cassandra.service.CassandraDaemon.main( [main/:na]

It seems this is a race similar to [CASSANDRA-9201|],
that happens when multiple nodes are started concurrently. Apparently the new auth schema
is already available but the ColumnFamilyStore is not yet created when retrieving roles on

The not-so-elegant fix is to wait until the CFS is available in a busy loop before calling
{{CassandraRoleManager.setup()}}. Maybe there's a better way of synchronizing this, so I'm
open to suggestions.

The patch is available [here|]
for review.Tests will be available shortly below:
* [3.0 testall|]
* [3.0 dtest|]
* [trunk testall|]
* [trunk dtest|]

> Windows dtest 3.0: fails
> ----------------------------------------------------------
>                 Key: CASSANDRA-10104
>                 URL:
>             Project: Cassandra
>          Issue Type: Sub-task
>            Reporter: Joshua McKenzie
>            Assignee: Paulo Motta
>              Labels: Windows
>             Fix For: 3.0.x
> {noformat}
> Unexpected error in node1 node log: ['ERROR [HintedHandoff:2] 2015-08-16 23:14:04,419 - Exception in thread Thread[HintedHandoff:2,1,main] org.apache.cassandra.exceptions.WriteFailureException:
Operation failed - received 0 responses and 1 failures \tat org.apache.cassandra.service.AbstractWriteResponseHandler.get(
~[main/:na] \tat org.apache.cassandra.db.HintedHandOffManager.checkDelivered(
~[main/:na] \tat org.apache.cassandra.db.HintedHandOffManager.doDeliverHintsToEndpoint(
~[main/:na] \tat org.apache.cassandra.db.HintedHandOffManager.deliverHintsToEndpoint(
~[main/:na] \tat org.apache.cassandra.db.HintedHandOffManager.access$400(
~[main/:na] \tat org.apache.cassandra.db.HintedHandOffManager$
~[main/:na] \tat java.util.concurrent.ThreadPoolExecutor.runWorker(
~[na:1.8.0_45] \tat java.util.concurrent.ThreadPoolExecutor$
~[na:1.8.0_45] \tat ~[na:1.8.0_45]']
> -------------------- >> begin captured logging << --------------------
> dtest: DEBUG: cluster ccm directory: d:\temp\dtest-j1ttp3
> dtest: DEBUG: Nodetool command 'D:\jenkins\workspace\cassandra-3.0_dtest_win32\cassandra\bin\nodetool.bat
-h localhost -p 7100 netstats' failed; exit status: 1; stdout: Starting NodeTool
> ; stderr: nodetool: Failed to connect to 'localhost:7100' - ConnectException: 'Connection
refused: connect'.
> dtest: DEBUG: removing ccm cluster test at: d:\temp\dtest-j1ttp3
> dtest: DEBUG: clearing ssl stores from [d:\temp\dtest-j1ttp3] directory
> --------------------- >> end captured logging << ---------------------
> {noformat}
> Failure history: [consistent|].
Looks to have regressed on build [#5|]
which seems unlikely given the commit.
> Env: Both, though on a local run the test fails due to:
> {noformat}
> Traceback (most recent call last):
>   File "c:\src\cassandra-dtest\", line 532, in tearDown
>     raise AssertionError('Unexpected error in %s node log: %s' % (, errors))
> AssertionError: Unexpected error in node1 node log: ['ERROR [main] 2015-08-17 15:42:07,717 - This platform does not support atomic directory streams (SecureDirectoryStream);
race conditions when loading sstable files could occurr', 'ERROR [main] 2015-08-17 15:50:43,978 - This platform does not support atomic directory streams (SecureDirectoryStream);
race conditions when loading sstable files could occurr']
> {noformat}

This message was sent by Atlassian JIRA

View raw message