cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Paulo Motta (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (CASSANDRA-10037) Auth upgrade test failing on Windows 2.2
Date Thu, 27 Aug 2015 16:27:46 GMT

    [ https://issues.apache.org/jira/browse/CASSANDRA-10037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716991#comment-14716991
] 

Paulo Motta commented on CASSANDRA-10037:
-----------------------------------------

Reopening due to a [regression|http://cassci.datastax.com/view/cassandra-3.0/job/cassandra-3.0_dtest_win32/32/testReport/upgrade_internal_auth_test/TestAuthUpgrade/upgrade_to_22_test/history/]
on this test:
{noformat}
Unexpected error in node3 node log: ['ERROR [InternalResponseStage:1] 2015-08-26 20:58:52,042
CassandraDaemon.java:223 Exception in thread Thread[InternalResponseStage:1,5,main] java.lang.RuntimeException:
java.lang.RuntimeException: java.io.FileNotFoundException: d:\\temp\\dtest-h6pke6\\test\\node3\\data\\system\\schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697\\system-schema_columnfamilies-tmplink-ka-9-Data.db
(The process cannot access the file because it is being used by another process)
at org.apache.cassandra.config.Schema.updateVersion(Schema.java:390) ~[main/:na] 
at org.apache.cassandra.config.Schema.updateVersionAndAnnounce(Schema.java:399) ~[main/:na]

at org.apache.cassandra.db.DefsTables.mergeSchema(DefsTables.java:167) ~[main/:na] 
at org.apache.cassandra.service.MigrationTask$1.response(MigrationTask.java:75) ~[main/:na]

at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:54) ~[main/:na]

at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:64) ~[main/:na]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[na:1.8.0_51]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[na:1.8.0_51]

at java.lang.Thread.run(Thread.java:745) ~[na:1.8.0_51] Caused by: java.lang.RuntimeException:
java.io.FileNotFoundException: d:\\temp\\dtest-h6pke6\\test\\node3\\data\\system\\schema_columnfamilies-45f5b36024bc3f83a3631034ea4fa697\\system-schema_columnfamilies-tmplink-ka-9-Data.db
(The process cannot access the file because it is being used by another process)
at org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:52)
~[main/:na] 
at org.apache.cassandra.io.util.CompressedPoolingSegmentedFile.createReader(CompressedPoolingSegmentedFile.java:85)
~[main/:na] 
at org.apache.cassandra.io.sstable.SSTableReader.openDataReader(SSTableReader.java:2063) ~[main/:na]

at org.apache.cassandra.io.sstable.SSTableScanner.<init>(SSTableScanner.java:84) ~[main/:na]

at org.apache.cassandra.io.sstable.SSTableScanner.getScanner(SSTableScanner.java:63) ~[main/:na]

at org.apache.cassandra.io.sstable.SSTableReader.getScanner(SSTableReader.java:1847) ~[main/:na]

at org.apache.cassandra.db.RowIteratorFactory.getIterator(RowIteratorFactory.java:67) ~[main/:na]

at org.apache.cassandra.db.ColumnFamilyStore.getSequentialIterator(ColumnFamilyStore.java:2106)
~[main/:na] 
at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2223) ~[main/:na]

at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2155) ~[main/:na]

at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:786) ~[main/:na]

at org.apache.cassandra.db.SystemKeyspace.serializedSchema(SystemKeyspace.java:773) ~[main/:na]

at org.apache.cassandra.config.Schema.updateVersion(Schema.java:374)
{noformat}

I was able to reproduce it locally and the error also happens on 2.1 before upgrading.

Instead of using the error whitelist approach, I added a new method to ccm {{node.mark_log_for_errors()}}
on this [PR|https://github.com/pcmanus/ccm/pull/370], that ignore all errors before this mark
on {{node.grep_log_for_errors()}}. With this in hand, the idea is to mark the log for errors
just before upgrading to 2.2 on Windows, effectivelly ignoring all errors happening on 2.1.
I create a [cassandra-dtest PR|https://github.com/riptano/cassandra-dtest/pull/515] with this
modification. Do you have any objections against this approach [~JoshuaMcKenzie]?

> Auth upgrade test failing on Windows 2.2
> ----------------------------------------
>
>                 Key: CASSANDRA-10037
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-10037
>             Project: Cassandra
>          Issue Type: Sub-task
>            Reporter: Philip Thompson
>            Assignee: Joshua McKenzie
>              Labels: Windows
>             Fix For: 2.2.1
>
>
> {{upgrade_internal_auth_test.TestAuthUpgrade.upgrade_to_22_test}} is failing on 2.2-HEAD,
with the following error message:
> {code}
> Unexpected error in node1 node log: ["ERROR [NonPeriodicTasks:1] 2015-08-10 11:18:58,464
SSTableDeletingTask.java:85 - Unable to delete d:\\temp\\dtest-dwg3cr\\test\\node1\\data\\system\\schema_keyspaces-b0f2235744583cdb9631c43e59ce3676\\system-schema_keyspaces-tmplink-ka-9-Data.db
(it will be removed on server restart; we'll also retry after GC) WARN  [GossipTasks:1] 2015-08-10
11:18:58,466 FailureDetector.java:249 - Not marking nodes down due to local pause of 6214735232
> 5000000000", "ERROR [NonPeriodicTasks:1] 2015-08-10 11:19:27,625 SSTableDeletingTask.java:85
- Unable to delete d:\\temp\\dtest-dwg3cr\\test\\node1\\data\\system\\schema_columns-296e9c049bec3085827dc17d3df2122a\\system-schema_columns-tmplink-ka-9-Data.db
(it will be removed on server restart; we'll also retry after GC)"]
> {code}
> I think this is largely due to the fact that it upgrades from 2.1, and this error occurs
on 2.1. It doesn't seem to be a big issue, but letting you decide.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message