cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Brian O'Neill <b...@alumni.brown.edu>
Subject Re: Frequent timeout issues
Date Wed, 01 Apr 2015 15:45:24 GMT

Are you using the storm-cassandra-cql driver?
(https://github.com/hmsonline/storm-cassandra-cql)

If so, what version?
Batching or no batching?

-brian

---
Brian O'Neill 
Chief Technology Officer
Health Market Science, a LexisNexis Company
215.588.6024 Mobile € @boneill42 <http://www.twitter.com/boneill42>


This information transmitted in this email message is for the intended
recipient only and may contain confidential and/or privileged material. If
you received this email in error and are not the intended recipient, or the
person responsible to deliver it to the intended recipient, please contact
the sender at the email above and delete this email and any attachments and
destroy any copies thereof. Any review, retransmission, dissemination,
copying or other use of, or taking any action in reliance upon, this
information by persons or entities other than the intended recipient is
strictly prohibited.
 


From:  Amlan Roy <amlan.roy@cleartrip.com>
Reply-To:  <user@cassandra.apache.org>
Date:  Wednesday, April 1, 2015 at 11:37 AM
To:  <user@cassandra.apache.org>
Subject:  Re: Frequent timeout issues

Replication factor is 2.
CREATE KEYSPACE ct_keyspace WITH replication = {
  'class': 'NetworkTopologyStrategy',
  'DC1': '2'
};

Inserts are happening from Storm using java driver. Using prepared statement
without batch.


On 01-Apr-2015, at 8:42 pm, Brice Dutheil <brice.dutheil@gmail.com> wrote:

> And the keyspace? What is the replication factor.
> 
> Also how are the inserts done?
> 
> On Wednesday, April 1, 2015, Amlan Roy <amlan.roy@cleartrip.com> wrote:
>> Write consistency level is ONE.
>> 
>> This is the describe output for one of the tables.
>> 
>> CREATE TABLE event_data (
>>   event text,
>>   week text,
>>   bucket int,
>>   date timestamp,
>>   unique text,
>>   adt int,
>>   age list<int>,
>>   arrival list<timestamp>,
>>   bank text,
>>   bf double,
>>   cabin text,
>>   card text,
>>   carrier list<text>,
>>   cb double,
>>   channel text,
>>   chd int,
>>   company text,
>>   cookie text,
>>   coupon list<text>,
>>   depart list<timestamp>,
>>   dest list<text>,
>>   device text,
>>   dis double,
>>   domain text,
>>   duration bigint,
>>   emi int,
>>   expressway boolean,
>>   flight list<text>,
>>   freq_flyer list<text>,
>>   host text,
>>   host_ip text,
>>   inf int,
>>   instance text,
>>   insurance text,
>>   intl boolean,
>>   itinerary text,
>>   journey text,
>>   meal_pref list<text>,
>>   mkp double,
>>   name list<text>,
>>   origin list<text>,
>>   pax_type list<text>,
>>   payment text,
>>   pref_carrier list<text>,
>>   referrer text,
>>   result_cnt int,
>>   search text,
>>   src text,
>>   src_ip text,
>>   stops int,
>>   supplier list<text>,
>>   tags list<text>,
>>   total double,
>>   trip text,
>>   user text,
>>   user_agent text,
>>   PRIMARY KEY ((event, week, bucket), date, unique)
>> ) WITH CLUSTERING ORDER BY (date DESC, unique ASC) AND
>>   bloom_filter_fp_chance=0.010000 AND
>>   caching='KEYS_ONLY' AND
>>   comment='' AND
>>   dclocal_read_repair_chance=0.100000 AND
>>   gc_grace_seconds=864000 AND
>>   index_interval=128 AND
>>   read_repair_chance=0.000000 AND
>>   replicate_on_write='true' AND
>>   populate_io_cache_on_flush='false' AND
>>   default_time_to_live=0 AND
>>   speculative_retry='99.0PERCENTILE' AND
>>   memtable_flush_period_in_ms=0 AND
>>   compaction={'class': 'SizeTieredCompactionStrategy'} AND
>>   compression={'sstable_compression': 'LZ4Compressor¹};
>> 
>> 
>> On 01-Apr-2015, at 8:00 pm, Eric R Medley <emedley@xylocore.com
>> <javascript:_e(%7B%7D,'cvml','emedley@xylocore.com');> > wrote:
>> 
>>> Also, can you provide the table details and the consistency level you are
>>> using?
>>> 
>>> Regards,
>>> 
>>> Eric R Medley
>>> 
>>>> On Apr 1, 2015, at 9:13 AM, Eric R Medley <emedley@xylocore.com
>>>> <javascript:_e(%7B%7D,'cvml','emedley@xylocore.com');> > wrote:
>>>> 
>>>> Amlan,
>>>> 
>>>> Can you provide information on how much data is being written? Are any of
>>>> the columns really large? Are any writes succeeding or are all timing out?
>>>> 
>>>> Regards,
>>>> 
>>>> Eric R Medley
>>>> 
>>>>> On Apr 1, 2015, at 9:03 AM, Amlan Roy <amlan.roy@cleartrip.com
>>>>> <javascript:_e(%7B%7D,'cvml','amlan.roy@cleartrip.com');> >
wrote:
>>>>> 
>>>>> Hi,
>>>>> 
>>>>> I am new to Cassandra. I have setup a cluster with Cassandra 2.0.13.
I am
>>>>> writing the same data in HBase and Cassandra and find that the writes
are
>>>>> extremely slow in Cassandra and frequently seeing exception ³Cassandra
>>>>> timeout during write query at consistency ONE". The cluster size for
both
>>>>> HBase and Cassandra are same.
>>>>> 
>>>>> Looks like something is wrong with my cluster setup. What can be the
>>>>> possible issue? Data and commit logs are written into two separate disks.
>>>>> 
>>>>> Regards,
>>>>> Amlan
>>>> 
>>> 
>> 
> 
> 
> -- 
> Brice




Mime
View raw message