cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tom van der Woerdt (JIRA)" <>
Subject [jira] [Commented] (CASSANDRA-12114) Cassandra startup takes an hour because of
Date Thu, 30 Jun 2016 15:24:10 GMT


Tom van der Woerdt commented on CASSANDRA-12114:

Forgot to mention :
$ java -version
java version "1.8.0_77"
Java(TM) SE Runtime Environment (build 1.8.0_77-b03)
Java HotSpot(TM) 64-Bit Server VM (build 25.77-b03, mixed mode)

> Cassandra startup takes an hour because of
> -----------------------------------------------------------------
>                 Key: CASSANDRA-12114
>                 URL:
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Core
>            Reporter: Tom van der Woerdt
> A Cassandra cluster of ours has nodes with up to 4TB of data, in a single table using
leveled compaction having 200k files. While upgrading from 2.2.6 to 3.0.7 we noticed that
it took a while to restart a node. And with "a while" I mean we measured it at more than 60
> jstack shows something interesting :
> {code}
> "main" #1 prio=5 os_prio=0 tid=0x00007f30db0ea400 nid=0xdb22 runnable [0x00007f30de122000]
>    java.lang.Thread.State: RUNNABLE
>     at Method)
>     at
>     at
>     at
>     at org.apache.cassandra.db.ColumnFamilyStore.scrubDataDirectories(
>     at org.apache.cassandra.service.CassandraDaemon.setup(
>     at org.apache.cassandra.service.CassandraDaemon.activate(
>     at org.apache.cassandra.service.CassandraDaemon.main(
> {code}
> Going by the source of File.listFiles, it puts every file in a directory into an array
and *then* applies the filter.
> This is actually a known Java issue from 1999:
-- their "solution" was to introduce new APIs in JRE7. I guess that makes listFiles deprecated
for larger directories (like when using LeveledCompactionStrategy).
> tl;dr: because Cassandra uses, service startup can take an hour
for larger data sets.

This message was sent by Atlassian JIRA

View raw message