Mailing-List: contact user-help@cassandra.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@cassandra.apache.org
Received-SPF: pass (nike.apache.org: local policy)
Message-ID: <4DECB9CA.6060506@ihep.ac.cn>
Date: Mon, 06 Jun 2011 13:28:10 +0200
From: Donal Zang <zangds@ihep.ac.cn>
Reply-To: zangds@ihep.ac.cn
Organization: IHEP
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US;
 rv:1.9.2.17) Gecko/20110414 Thunderbird/3.1.10
MIME-Version: 1.0
To: user@cassandra.apache.org
Subject: Re: [SPAM] Re: slow insertion rate with secondary index
References: <4DEC077A.5030208@ihep.ac.cn>
	<BANLkTikHvy5-8Oi6Nmd2m9OkWwevOi5a_Q@mail.gmail.com>
	<4DEC8A3A.7010107@ihep.ac.cn>
 <BANLkTimDdYkTnhcZA2Jj2VSaOQttsi3HGg@mail.gmail.com>
In-Reply-To: <BANLkTimDdYkTnhcZA2Jj2VSaOQttsi3HGg@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

On 06/06/2011 10:15, David Boxenhorn wrote:
> Is there really a 10x difference between indexed CFs and non-indexed CFs? 
Well, as for my test, it is!
I'm using 0.7.6-2, 9 nodes, 3 replicas, write_consistency_level QUORUM, 
about 90,000,000 rows (~ 1K per row)
I use 20 process, 20rows for each insertion.
the insertion time for the whole row is about 0.02 seconds without index
and then I add a secondary index, and update every row with the indexed 
column, the insertion time is about 2 seconds
and if I remove the index, and update the column, the time is about 0.002

Another thing I noticed is : if you first do insertion, and then build 
the secondary index use "update column family ...", and then do select 
based on the index, the result is not right (seems the index is still 
being built though the "update" commands returns quickly). And after a 
while, the get_indexed_slices() goes time out from time to time (with 
pycassa.ConnectionPool('keyspace1', ['host1','host2'], timeout=600, 
pool_size=1) ).

Does some one else have some same experiences using the secondary indexes?

-- 
Donal Zang
Computing Center, IHEP
19B YuquanLu, Shijingshan District,Beijing, 100049
zangds@ihep.ac.cn
86 010 8823 6018