Return-Path: Delivered-To: apmail-cassandra-commits-archive@www.apache.org Received: (qmail 80188 invoked from network); 10 Mar 2011 10:05:25 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (140.211.11.3) by minotaur.apache.org with SMTP; 10 Mar 2011 10:05:25 -0000 Received: (qmail 33434 invoked by uid 500); 10 Mar 2011 10:05:25 -0000 Delivered-To: apmail-cassandra-commits-archive@cassandra.apache.org Received: (qmail 33414 invoked by uid 500); 10 Mar 2011 10:05:25 -0000 Mailing-List: contact commits-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@cassandra.apache.org Delivered-To: mailing list commits@cassandra.apache.org Received: (qmail 33406 invoked by uid 99); 10 Mar 2011 10:05:25 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Mar 2011 10:05:25 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [140.211.11.116] (HELO hel.zones.apache.org) (140.211.11.116) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 10 Mar 2011 10:05:22 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [140.211.11.116]) by hel.zones.apache.org (Postfix) with ESMTP id 0314E3A2323 for ; Thu, 10 Mar 2011 10:05:00 +0000 (UTC) Date: Thu, 10 Mar 2011 10:05:00 +0000 (UTC) From: "Sylvain Lebresne (JIRA)" To: commits@cassandra.apache.org Message-ID: <1318726698.10344.1299751500009.JavaMail.tomcat@hel.zones.apache.org> In-Reply-To: <1177783249.7004.1296727769308.JavaMail.tomcat@hel.zones.apache.org> Subject: [jira] Commented: (CASSANDRA-2104) IndexOutOfBoundsException during lazy row compaction of supercolumns MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/CASSANDRA-2104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005015#comment-13005015 ] Sylvain Lebresne commented on CASSANDRA-2104: --------------------------------------------- Can you open a new ticket with the description of the problem then. If you're at liberty to attach an bad sstable to reproduce the problem, that would clearly help. > IndexOutOfBoundsException during lazy row compaction of supercolumns > -------------------------------------------------------------------- > > Key: CASSANDRA-2104 > URL: https://issues.apache.org/jira/browse/CASSANDRA-2104 > Project: Cassandra > Issue Type: Bug > Components: Core > Affects Versions: 0.7.0 > Reporter: Daniel Lundin > Assignee: Sylvain Lebresne > Fix For: 0.7.3 > > Attachments: 0001-Use-the-right-comparator-when-deserializing-superCol.patch, Unit-test.patch > > Original Estimate: 8h > Remaining Estimate: 8h > > I ran into an exception when lazily compacting wide rows of TimeUUID columns. > It seems to trigger when a row is larger than {{in_memory_compaction_limit_in_mb}}. > Traceback: > {noformat} > INFO [CompactionExecutor:1] 2011-02-03 10:59:59,262 CompactionIterator.java (line 135) Compacting large row XXXXXXXXXXXXX (76999384 bytes) incrementally > ERROR [CompactionExecutor:1] 2011-02-03 10:59:59,266 AbstractCassandraDaemon.java (line 114) Fatal exception in thread T > hread[CompactionExecutor:1,1,main] > java.lang.IndexOutOfBoundsException > at java.nio.Buffer.checkIndex(Buffer.java:514) > at java.nio.HeapByteBuffer.get(HeapByteBuffer.java:121) > at org.apache.cassandra.db.marshal.TimeUUIDType.compareTimestampBytes(TimeUUIDType.java:56) > at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:45) > at org.apache.cassandra.db.marshal.TimeUUIDType.compare(TimeUUIDType.java:29) > at java.util.concurrent.ConcurrentSkipListMap$ComparableUsingComparator.compareTo(ConcurrentSkipListMap.java:606 > ) > at java.util.concurrent.ConcurrentSkipListMap.findPredecessor(ConcurrentSkipListMap.java:685) > at java.util.concurrent.ConcurrentSkipListMap.doPut(ConcurrentSkipListMap.java:864) > at java.util.concurrent.ConcurrentSkipListMap.putIfAbsent(ConcurrentSkipListMap.java:1893) > at org.apache.cassandra.db.SuperColumn.addColumn(SuperColumn.java:170) > at org.apache.cassandra.db.SuperColumn.putColumn(SuperColumn.java:195) > at org.apache.cassandra.db.ColumnFamily.addColumn(ColumnFamily.java:221) > at org.apache.cassandra.io.LazilyCompactedRow$LazyColumnIterator.reduce(LazilyCompactedRow.java:204) > at org.apache.cassandra.io.LazilyCompactedRow$LazyColumnIterator.reduce(LazilyCompactedRow.java:185) > at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:62) > at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:136) > at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:131) > at com.google.common.collect.Iterators$7.computeNext(Iterators.java:604) > at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:136) > at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:131) > at org.apache.cassandra.db.ColumnIndexer.serializeInternal(ColumnIndexer.java:76) > at org.apache.cassandra.db.ColumnIndexer.serialize(ColumnIndexer.java:50) > at org.apache.cassandra.io.LazilyCompactedRow.(LazilyCompactedRow.java:88) > at org.apache.cassandra.io.CompactionIterator.getCompactedRow(CompactionIterator.java:137) > at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:108) > at org.apache.cassandra.io.CompactionIterator.getReduced(CompactionIterator.java:43) > at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:73) > at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:136) > at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:131) > at org.apache.commons.collections.iterators.FilterIterator.setNextObject(FilterIterator.java:183) > at org.apache.commons.collections.iterators.FilterIterator.hasNext(FilterIterator.java:94) > at org.apache.cassandra.db.CompactionManager.doCompaction(CompactionManager.java:426) > at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:122) > at org.apache.cassandra.db.CompactionManager$1.call(CompactionManager.java:92) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > {noformat} -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira