cassandra-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Benedict (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (CASSANDRA-8619) using CQLSSTableWriter gives ConcurrentModificationException
Date Wed, 21 Jan 2015 12:33:34 GMT

     [ https://issues.apache.org/jira/browse/CASSANDRA-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Benedict updated CASSANDRA-8619:
--------------------------------
    Attachment: 8619

It's a pretty simple problem, introduced by CASSANDRA-7360. Since we now sync intra-partition,
we need to refresh the buffered column family when we start a sync. 

Marking [~slebresne] reviewer, since he wrote the original patch, and I may have missed something.
For instance, glancing at this code, it looks to me like we may also be counting additions
twice in the BufferedWriter, causing flushes to occur twice as often as desired.

> using CQLSSTableWriter gives ConcurrentModificationException
> ------------------------------------------------------------
>
>                 Key: CASSANDRA-8619
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-8619
>             Project: Cassandra
>          Issue Type: Bug
>          Components: Tools
>         Environment: sun jdk 7
> linux - ubuntu
>            Reporter: Igor Berman
>            Assignee: Benjamin Lerer
>             Fix For: 2.1.3, 2.0.13
>
>         Attachments: 8619, TimeSeriesCassandraLoaderTest.java
>
>
> Using CQLSSTableWriter gives ConcurrentModificationException 
> I'm trying to load many timeseries into cassandra 2.0.11-1
> using  'org.apache.cassandra:cassandra-all:2.0.11'
> {noformat}
> java.util.ConcurrentModificationException
> 	at java.util.TreeMap$PrivateEntryIterator.nextEntry(TreeMap.java:1115)
> 	at java.util.TreeMap$ValueIterator.next(TreeMap.java:1160)
> 	at org.apache.cassandra.db.ColumnIndex$Builder.build(ColumnIndex.java:126)
> 	at org.apache.cassandra.io.sstable.SSTableWriter.rawAppend(SSTableWriter.java:202)
> 	at org.apache.cassandra.io.sstable.SSTableWriter.append(SSTableWriter.java:187)
> 	at org.apache.cassandra.io.sstable.SSTableSimpleUnsortedWriter$DiskWriter.run(SSTableSimpleUnsortedWriter.java:215)
> schema
> CREATE TABLE test.sample (ts_id bigint, yr int, t timestamp, v double, tgs set<varchar>,
PRIMARY KEY((ts_id,yr), t)) WITH CLUSTERING ORDER BY (t DESC) AND COMPRESSION = {'sstable_compression':
'LZ4Compressor'};
> statement:
> INSERT INTO  test.sample(ts_id, yr, t, v) VALUES (?,?,?,?)
> {noformat}
> with .withBufferSizeInMB(128); it happens more than with
> .withBufferSizeInMB(256);
> code based on http://planetcassandra.org/blog/using-the-cassandra-bulk-loader-updated/
> writer.addRow(tsId, year, new Date(time), value);
> Any suggestions will be highly appreciated



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message