From user-return-21953-apmail-cassandra-user-archive=cassandra.apache.org@cassandra.apache.org Wed Nov 2 12:36:22 2011 Return-Path: X-Original-To: apmail-cassandra-user-archive@www.apache.org Delivered-To: apmail-cassandra-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7ED0D9BA5 for ; Wed, 2 Nov 2011 12:36:22 +0000 (UTC) Received: (qmail 56757 invoked by uid 500); 2 Nov 2011 12:36:20 -0000 Delivered-To: apmail-cassandra-user-archive@cassandra.apache.org Received: (qmail 56734 invoked by uid 500); 2 Nov 2011 12:36:20 -0000 Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@cassandra.apache.org Delivered-To: mailing list user@cassandra.apache.org Received: (qmail 56726 invoked by uid 99); 2 Nov 2011 12:36:20 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Nov 2011 12:36:20 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=FREEMAIL_FROM,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of bsheep@gmail.com designates 209.85.216.179 as permitted sender) Received: from [209.85.216.179] (HELO mail-qy0-f179.google.com) (209.85.216.179) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 02 Nov 2011 12:36:12 +0000 Received: by qyk31 with SMTP id 31so129116qyk.10 for ; Wed, 02 Nov 2011 05:35:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; bh=7a6RCJvy/9KvpmdN4pxOYc8omNQGMqMoZ6H4vqG7+uY=; b=LrDopLlCeajr7BrPoaZNMaMd2o75hYTrtQDFyf0fwjeNektnSrlyE/N7n1c0k0ROOd 0jkMAVFQDy3GoXKq4B4GuCdNbomCF+uKDhtYCR1D0et5hQAvh7SCnHT0czKJWhhjEdeN 9bD6aXoUL7eNzyKUSNpKCLmklzV4LwfeUZjOo= MIME-Version: 1.0 Received: by 10.68.6.234 with SMTP id e10mr4063469pba.90.1320237351635; Wed, 02 Nov 2011 05:35:51 -0700 (PDT) Received: by 10.68.40.5 with HTTP; Wed, 2 Nov 2011 05:35:51 -0700 (PDT) Date: Wed, 2 Nov 2011 21:35:51 +0900 Message-ID: Subject: missing a sub column From: Jeesoo Shin To: user@cassandra.apache.org Content-Type: text/plain; charset=ISO-8859-1 X-Virus-Checked: Checked by ClamAV on apache.org Hi, I'm using Hector 0.8.0-2 & Cassandra 0.8.6 on EC2 XLarge systems. I have a Supercolumn with 10 sub columns. Most of times it works, but occasionally I find last sub column is missing completely. I checked our program that it's successfully inserting all 10 sub columns into HColumn just before mutator.insert or mutator.addInsertion (call execute at count 50). To check if Cassandra is losing the data, I made a small program to read commitlog file. Well, I found logs with only 9 sub columns. Now I'm lost... I have no idea where and why a sub column is missing. Could there be a problem in thrift transition? (which happens to work most of times.. ) ANY IDEAS? plz. one strange thing I notice in commitlog, 4 - total length 8 - unknown 2 - length of keyspace # - keyspace 2 - length of row key of column family # - row key of column family 9 - unknown : 8,9th is column family id. 16 - unknown (if supercolumn) 2 - length of super column name # - super column name 14 - unknown 2 - number of batch In local system, using TC, number of batch displays number of mutator. when mutator.insert, it's 1 when mutator.addInsertion(50 or less), it's 50 or less I presume 0 is delete. The strange part is I see much larger number of batch, 149, 201,~ up to 1024. Does hector merge insert for optimization? Could this optimization part lose a sub column? I don't think cassandra will check last commit, merge, +1 batch#,.. I'm very very lost. :( any comment will help. Thank you.