incubator-cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nick Summerlin <nick.summer...@internetidentity.com>
Subject Re: Failure in Cassandra Ring Running on ESXi (Ubuntu 11.10)
Date Thu, 15 Mar 2012 16:47:10 GMT
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Found the debian init script, you'll probably need to change the paths:

http://svn.apache.org/repos/asf/cassandra/trunk/debian/init

You can find the init script for other distros if you peel back to
'/cassandra/trunk/'.

- -- 
- -----
Nick Summerlin
Security Engineer
IID -- Actively Securing the Extended Enterprise
E-mail: nick.summerlin@internetidentity.com
Office: +1.253.590.4100 ext 7498 | Fax: +1.425.699.6597

On 3/15/12 5:48 AM, Hontvári József Levente wrote:
> It is in the DEB package, and I guess it is also in the RPM.
> 
> On 2012.03.15. 12:02, Tamar Fraenkel wrote:
>> I don't see it in dsc-cassandra-1.0.7-bin.tar.gz. Thanks *Tamar
>> Fraenkel * Senior Software Engineer, TOK Media
>> 
>> Inline image 1
>> 
>> tamar@tok-media.com <mailto:tamar@tok-media.com> Tel: +972 2
>> 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956
>> 
>> 
>> 
>> 
>> 
>> 2012/3/15 Hontvári József Levente <hontvari@flyordie.com 
>> <mailto:hontvari@flyordie.com>>
>> 
>> You can copy the init.d script from the DataStax package.
>> 
>> On 2012.03.15. 11 <tel:2012.03.15.%2011>:06, Tamar Fraenkel
>> wrote:
>>> Yes I am using the cassandra community. Re-installing will be a
>>> hassle... Any idea how to just fix the daemon issue? Thanks 
>>> *Tamar Fraenkel * Senior Software Engineer, TOK Media
>>> 
>>> Inline image 1
>>> 
>>> tamar@tok-media.com <mailto:tamar@tok-media.com> Tel: +972 2
>>> 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956
>>> 
>>> 
>>> 
>>> 
>>> 
>>> On Thu, Mar 15, 2012 at 11:56 AM, aaron morton
>>> <aaron@thelastpickle.com <mailto:aaron@thelastpickle.com>>
>>> wrote:
>>> 
>>>> I have a problem though. I installed cassandra following
>>>> DataStax, and cassandra is not a daemon
>>> Are you using Cassandra for Data Stax Community ?
>>> 
>>> This will give you a nice install 
>>> http://wiki.apache.org/cassandra/DebianPackaging
>>> 
>>> Cheers
>>> 
>>> ----------------- Aaron Morton Freelance Developer 
>>> @aaronmorton http://www.thelastpickle.com
>>> 
>>> On 15/03/2012, at 10:38 PM, Tamar Fraenkel wrote:
>>> 
>>>> Thanks for your prompt response. I have a problem though. I
>>>> installed cassandra following DataStax, and cassandra is not
>>>> a daemon. i.e. I have to manyally start it, and I don't have
>>>> a script /etc/init.d/cassandra.
>>>> 
>>>> For this reason, I need to restart it after rebooting my vm 
>>>> manually, and it is not part of the rc...
>>>> 
>>>> Any good points on how to set up cassandra as a daemon?
>>>> 
>>>> Thanks,
>>>> 
>>>> *Tamar Fraenkel * Senior Software Engineer, TOK Media
>>>> 
>>>> <tokLogo.png>
>>>> 
>>>> tamar@tok-media.com <mailto:tamar@tok-media.com> Tel: +972 2
>>>> 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956
>>>> 
>>>> 
>>>> 
>>>> 
>>>> 
>>>> On Thu, Mar 15, 2012 at 11:34 AM, aaron morton 
>>>> <aaron@thelastpickle.com <mailto:aaron@thelastpickle.com>>
>>>> wrote:
>>>> 
>>>>> 1. How can I prevent this? I guess my setup is limited,
>>>>> and this may happen, but is there a way to improve things.
>>>> Not really, you need more memory on the box.
>>>>> 2. Assuming that I will run out of memory from time to
>>>>> time, how do I setup a monit \ god task to restart
>>>>> cassandra in case it does.
>>>> Super simple, to the point of not been very good, 
>>>> /etc/monit/conf.d/cassandra.monitrc The monit docs are pretty
>>>> good.
>>>> 
>>>> check process cassandra with pidfile /var/run/cassandra.pid 
>>>> start program = "/etc/init.d/cassandra start" stop program =
>>>> "/etc/init.d/cassandra stop"
>>>> 
>>>> You will also need to prevent the init.d script from
>>>> starting, i used update-rc.d
>>>> 
>>>> I'm not an ops guy; google is your friend; the monit docs are
>>>> good.
>>>> 
>>>> Cheers
>>>> 
>>>> 
>>>> ----------------- Aaron Morton Freelance Developer 
>>>> @aaronmorton http://www.thelastpickle.com
>>>> <http://www.thelastpickle.com/>
>>>> 
>>>> On 15/03/2012, at 8:44 PM, Tamar Fraenkel wrote:
>>>> 
>>>>> I added a third node to the cluster. Sure enough, this
>>>>> morning I come and only one node is up, in the other two
>>>>> the cassandra process is not running.
>>>>> 
>>>>> In the cassandra log there is nothing, but in
>>>>> /var/log/syslog I see In one node: Mar 15 07:50:51
>>>>> Cassandra3 kernel: [58566.666906] Out of memory: Kill
>>>>> process 2840 (java) score 383 or sacrifice child Mar 15
>>>>> 07:50:51 Cassandra3 kernel: [58566.667066] Killed process
>>>>> 2840 (java) total-vm:956792kB, anon-rss:689752kB, 
>>>>> file-rss:21680kB And in the other: Mar 14 18:36:02
>>>>> Cassandra2 kernel: [16262.267300 <tel:%5B16262.267300>] Out
>>>>> of memory: Kill process 2611 (java) score 409 or sacrifice
>>>>> child Mar 14 18:36:02 Cassandra2 kernel: [16262.267325 
>>>>> <tel:%5B16262.267325>] Killed process 2611 (java) 
>>>>> total-vm:968040kB, anon-rss:748644kB, file-rss:18436kB
>>>>> 
>>>>> Two questions: 1. How can I prevent this? I guess my setup
>>>>> is limited, and this may happen, but is there a way to
>>>>> improve things. 2. Assuming that I will run out of memory
>>>>> from time to time, how do I setup a monit \ god task to
>>>>> restart cassandra in case it does.
>>>>> 
>>>>> Thanks,
>>>>> 
>>>>> *Tamar Fraenkel * Senior Software Engineer, TOK Media
>>>>> 
>>>>> <tokLogo.png>
>>>>> 
>>>>> tamar@tok-media.com <mailto:tamar@tok-media.com> Tel: +972
>>>>> 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956
>>>>> 
>>>>> 
>>>>> 
>>>>> 
>>>>> 
>>>>> On Tue, Mar 13, 2012 at 11:12 AM, aaron morton 
>>>>> <aaron@thelastpickle.com <mailto:aaron@thelastpickle.com>>
>>>>> wrote:
>>>>> 
>>>>> If you are on Ubuntu it may be this 
>>>>> http://wiki.apache.org/cassandra/FAQ#ubuntu_hangs
>>>>> 
>>>>> otherwise I would look for GC problems.
>>>>> 
>>>>> Cheers
>>>>> 
>>>>> 
>>>>> ----------------- Aaron Morton Freelance Developer 
>>>>> @aaronmorton http://www.thelastpickle.com
>>>>> <http://www.thelastpickle.com/>
>>>>> 
>>>>> On 13/03/2012, at 7:53 PM, Tamar Fraenkel wrote:
>>>>> 
>>>>>> Done it. Now it generally runs ok, till one of the nodes 
>>>>>> get's stuck with 100% cpu and I need to reboot it.
>>>>>> 
>>>>>> Last lines in the system.log just before are: INFO
>>>>>> [OptionalTasks:1] 2012-03-13 07:36:43,850 
>>>>>> MeteredFlusher.java (line 62) flushing high-traffic
>>>>>> column family CFS(Keyspace='tok', 
>>>>>> ColumnFamily='tk_vertical_tag_story_indx') (estimated 
>>>>>> 35417890 bytes) INFO [OptionalTasks:1] 2012-03-13
>>>>>> 07:36:43,869 ColumnFamilyStore.java (line 704) Enqueuing
>>>>>> flush of 
>>>>>> Memtable-tk_vertical_tag_story_indx@2002820169(1620316/35417890
>>>>>>
>>>>>> 
serialized/live bytes, 30572 ops)
>>>>>> INFO [FlushWriter:76] 2012-03-13 07:36:43,869 
>>>>>> Memtable.java (line 246) Writing 
>>>>>> Memtable-tk_vertical_tag_story_indx@2002820169(1620316/35417890
>>>>>>
>>>>>> 
serialized/live bytes, 30572 ops)
>>>>>> INFO [FlushWriter:76] 2012-03-13 07:36:44,015 
>>>>>> Memtable.java (line 283) Completed flushing 
>>>>>> /opt/cassandra/data/tok/tk_vertical_tag_story_indx-hc-191-Data.db
>>>>>>
>>>>>> 
(2134123 bytes)
>>>>>> INFO [OptionalTasks:1] 2012-03-13 07:37:37,886 
>>>>>> MeteredFlusher.java (line 62) flushing high-traffic
>>>>>> column family CFS(Keyspace='tok', 
>>>>>> ColumnFamily='tk_vertical_tag_story_indx') (estimated 
>>>>>> 34389135 bytes) INFO [OptionalTasks:1] 2012-03-13
>>>>>> 07:37:37,887 ColumnFamilyStore.java (line 704) Enqueuing
>>>>>> flush of 
>>>>>> Memtable-tk_vertical_tag_story_indx@1869953681(1573252/34389135
>>>>>>
>>>>>> 
serialized/live bytes, 29684 ops)
>>>>>> INFO [FlushWriter:76] 2012-03-13 07:37:37,887 
>>>>>> Memtable.java (line 246) Writing 
>>>>>> Memtable-tk_vertical_tag_story_indx@1869953681(1573252/34389135
>>>>>>
>>>>>> 
serialized/live bytes, 29684 ops)
>>>>>> INFO [FlushWrit
>>>>>> 
>>>>>> Any idea? I am considering adding a third node, so that
>>>>>> replication factor of 2 won't stuck my system when one
>>>>>> node goes down. Does it make sense?
>>>>>> 
>>>>>> Thanks
>>>>>> 
>>>>>> 
>>>>>> *Tamar Fraenkel * Senior Software Engineer, TOK Media
>>>>>> 
>>>>>> <tokLogo.png>
>>>>>> 
>>>>>> tamar@tok-media.com <mailto:tamar@tok-media.com> Tel:
>>>>>> +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956
>>>>>> 
>>>>>> 
>>>>>> 
>>>>>> 
>>>>>> 
>>>>>> On Tue, Mar 6, 2012 at 7:51 PM, aaron morton 
>>>>>> <aaron@thelastpickle.com
>>>>>> <mailto:aaron@thelastpickle.com>> wrote:
>>>>>> 
>>>>>> Reduce these settings for the CF row_cache (disable it) 
>>>>>> key_cache (disable it)
>>>>>> 
>>>>>> Increase these settings for the CF 
>>>>>> bloom_filter_fp_chance
>>>>>> 
>>>>>> Reduce these settings in cassandra.yaml
>>>>>> 
>>>>>> flush_largest_memtables_at memtable_flush_queue_size 
>>>>>> sliced_buffer_size_in_kb 
>>>>>> in_memory_compaction_limit_in_mb concurrent_compactors
>>>>>> 
>>>>>> 
>>>>>> Increase these settings index_interval
>>>>>> 
>>>>>> 
>>>>>> While it obviously depends on load, I would not be 
>>>>>> surprised if you had a lot of trouble running cassandra
>>>>>> with that setup.
>>>>>> 
>>>>>> Cheers A
>>>>>> 
>>>>>> 
>>>>>> ----------------- Aaron Morton Freelance Developer 
>>>>>> @aaronmorton http://www.thelastpickle.com 
>>>>>> <http://www.thelastpickle.com/>
>>>>>> 
>>>>>> On 6/03/2012, at 11:02 PM, Tamar Fraenkel wrote:
>>>>>> 
>>>>>>> Arron, Thanks for your response. I was afraid this is 
>>>>>>> the issue. Can you give me some direction regarding the
>>>>>>> fine tuning of my VMs, I would like to explore that
>>>>>>> option some more. Thanks!
>>>>>>> 
>>>>>>> *Tamar Fraenkel * Senior Software Engineer, TOK Media
>>>>>>> 
>>>>>>> <tokLogo.png>
>>>>>>> 
>>>>>>> tamar@tok-media.com <mailto:tamar@tok-media.com> Tel:
>>>>>>> +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2
>>>>>>> 5612956
>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>>> On Tue, Mar 6, 2012 at 11:58 AM, aaron morton 
>>>>>>> <aaron@thelastpickle.com 
>>>>>>> <mailto:aaron@thelastpickle.com>> wrote:
>>>>>>> 
>>>>>>> You do not have enough memory allocated to the JVM and
>>>>>>> are suffering from excessive GC as a result.
>>>>>>> 
>>>>>>> There are some tuning things you can try, but 480MB is
>>>>>>> not enough. 1GB would be a better start, 2 better than
>>>>>>> that.
>>>>>>> 
>>>>>>> Consider using https://github.com/pcmanus/ccm for 
>>>>>>> testing multiple instances on a single server rather
>>>>>>> than a VM.
>>>>>>> 
>>>>>>> Cheers
>>>>>>> 
>>>>>>> ----------------- Aaron Morton Freelance Developer 
>>>>>>> @aaronmorton http://www.thelastpickle.com 
>>>>>>> <http://www.thelastpickle.com/>
>>>>>>> 
>>>>>>> On 6/03/2012, at 10:21 PM, Tamar Fraenkel wrote:
>>>>>>> 
>>>>>>>> I have some more info, after couple of hours running
>>>>>>>> the problematic node became again 100% CPU and I had
>>>>>>>> to reboot it, last lines from log show it did GC:
>>>>>>>> 
>>>>>>>> INFO [ScheduledTasks:1] 2012-03-06 10:28:00,880 
>>>>>>>> GCInspector.java (line 122) GC for Copy: 203 ms for 1
>>>>>>>> collections, 185983456 used; max is 513802240 INFO
>>>>>>>> [ScheduledTasks:1] 2012-03-06 10:28:50,595 
>>>>>>>> GCInspector.java (line 122) GC for Copy: 3927 ms for
>>>>>>>> 1 collections, 156572576 used; max is 513802240 INFO
>>>>>>>> [ScheduledTasks:1] 2012-03-06 10:28:55,434 
>>>>>>>> StatusLogger.java (line 50) Pool Name Active Pending
>>>>>>>> Blocked INFO [ScheduledTasks:1] 2012-03-06
>>>>>>>> 10:29:03,298 StatusLogger.java (line 65) ReadStage 2
>>>>>>>> 2 0 INFO [ScheduledTasks:1] 2012-03-06 10:29:03,499 
>>>>>>>> StatusLogger.java (line 65) RequestResponseStage 0 0
>>>>>>>> 0 INFO [ScheduledTasks:1] 2012-03-06 10:29:03,500 
>>>>>>>> StatusLogger.java (line 65) ReadRepairStage 0 0 0 
>>>>>>>> INFO [ScheduledTasks:1] 2012-03-06 10:29:03,500 
>>>>>>>> StatusLogger.java (line 65) MutationStage 0 0 0 INFO
>>>>>>>> [ScheduledTasks:1] 2012-03-06 10:29:03,500 
>>>>>>>> StatusLogger.java (line 65) ReplicateOnWriteStage 0 0
>>>>>>>> 0 INFO [ScheduledTasks:1] 2012-03-06 10:29:03,500 
>>>>>>>> StatusLogger.java (line 65) GossipStage 0 0 0 INFO
>>>>>>>> [ScheduledTasks:1] 2012-03-06 10:29:03,501 
>>>>>>>> StatusLogger.java (line 65) AntiEntropyStage 0 0 0 
>>>>>>>> INFO [ScheduledTasks:1] 2012-03-06 10:29:03,501 
>>>>>>>> StatusLogger.java (line 65) MigrationStage 0 0 0 INFO
>>>>>>>> [ScheduledTasks:1] 2012-03-06 10:29:03,501 
>>>>>>>> StatusLogger.java (line 65) StreamStage 0 0 0 INFO
>>>>>>>> [ScheduledTasks:1] 2012-03-06 10:29:03,501 
>>>>>>>> StatusLogger.java (line 65) MemtablePostFlusher 0 0
>>>>>>>> 0 INFO [ScheduledTasks:1] 2012-03-06 10:29:03,502 
>>>>>>>> StatusLogger.java (line 65) FlushWriter 0 0 0 INFO
>>>>>>>> [ScheduledTasks:1] 2012-03-06 10:29:03,502 
>>>>>>>> StatusLogger.java (line 65) MiscStage 0 0 0 INFO
>>>>>>>> [ScheduledTasks:1] 2012-03-06 10:29:03,502 
>>>>>>>> StatusLogger.java (line 65) InternalResponseStage 0 0
>>>>>>>> 0 INFO [ScheduledTasks:1] 2012-03-06 10:29:03,502 
>>>>>>>> StatusLogger.java (line 65) HintedHandoff 0 0 0 INFO
>>>>>>>> [ScheduledTasks:1] 2012-03-06 10:29:03,553 
>>>>>>>> StatusLogger.java (line 69) CompactionManager n/a 0
>>>>>>>> 
>>>>>>>> Thanks,
>>>>>>>> 
>>>>>>>> *Tamar Fraenkel * Senior Software Engineer, TOK
>>>>>>>> Media
>>>>>>>> 
>>>>>>>> <tokLogo.png>
>>>>>>>> 
>>>>>>>> tamar@tok-media.com <mailto:tamar@tok-media.com> Tel:
>>>>>>>> +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2
>>>>>>>> 5612956
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> On Tue, Mar 6, 2012 at 9:12 AM, Tamar Fraenkel 
>>>>>>>> <tamar@tok-media.com <mailto:tamar@tok-media.com>>
>>>>>>>> wrote:
>>>>>>>> 
>>>>>>>> Works..
>>>>>>>> 
>>>>>>>> But during the night my setup encountered a problem. 
>>>>>>>> I have two VMs on my cluster (running on VmWare
>>>>>>>> ESXi). Each VM has1GB memory, and two Virtual Disks 
>>>>>>>> of 16 GB They are running on a small server with 
>>>>>>>> 4CPUs (2.66 GHz), and 4 GB memory (together with two
>>>>>>>> other VMs) I put cassandra data on the second disk
>>>>>>>> of each machine. VMs are running Ubuntu 11.10 and
>>>>>>>> cassandra 1.0.7.
>>>>>>>> 
>>>>>>>> I left them running overnight and this morning when I
>>>>>>>> came: In one node cassandra was down, and the last 
>>>>>>>> thing in the system.log is:
>>>>>>>> 
>>>>>>>> INFO [CompactionExecutor:150] 2012-03-06 00:55:04,821
>>>>>>>> CompactionTask.java (line 113) Compacting 
>>>>>>>> [SSTableReader(path='/opt/cassandra/data/tok/tk_vertical_tag_story_indx-hc-1243-Data.db'),
>>>>>>>>
>>>>>>>> 
SSTableReader(path='/opt/cassandra/data/tok/tk_vertical_tag_story_indx-hc-1245-Data.db'),
>>>>>>>> SSTableReader(path='/opt/cassandra/data/tok/tk_vertical_tag_story_indx-hc-1242-Data.db'),
>>>>>>>>
>>>>>>>> 
SSTableReader(path='/opt/cassandra/data/tok/tk_vertical_tag_story_indx-hc-1244-Data.db')]
>>>>>>>> INFO [CompactionExecutor:150] 2012-03-06 00:55:07,919
>>>>>>>> CompactionTask.java (line 221) Compacted to 
>>>>>>>> [/opt/cassandra/data/tok/tk_vertical_tag_story_indx-hc-1246-Data.db,].
>>>>>>>>
>>>>>>>> 
32,424,771 to 26,447,685 (~81% of original)
>>>>>>>> bytes for 58,938 keys at 8.144165MB/s. Time: 
>>>>>>>> 3,097ms.
>>>>>>>> 
>>>>>>>> 
>>>>>>>> The other node was using all it's CPU and I had to
>>>>>>>> restart it. After that, I can see that the last lines
>>>>>>>> in it's system.log are that the other node is 
>>>>>>>> down...
>>>>>>>> 
>>>>>>>> INFO [FlushWriter:142] 2012-03-06 00:55:02,418
>>>>>>>> Memtable.java (line 246) Writing 
>>>>>>>> Memtable-tk_vertical_tag_story_indx@1365852701(1122169/25154556
>>>>>>>>
>>>>>>>> 
serialized/live bytes, 21173 ops)
>>>>>>>> INFO [FlushWriter:142] 2012-03-06 00:55:02,742
>>>>>>>> Memtable.java (line 283) Completed flushing 
>>>>>>>> /opt/cassandra/data/tok/tk_vertical_tag_story_indx-hc-1244-Data.db
>>>>>>>>
>>>>>>>> 
(2075930 bytes)
>>>>>>>> INFO [GossipTasks:1] 2012-03-06 08:02:18,584 
>>>>>>>> Gossiper.java (line 818) InetAddress /10.0.0.31
>>>>>>>> <http://10.0.0.31/> is now dead.
>>>>>>>> 
>>>>>>>> How can I trace why that happened? Also, I brought
>>>>>>>> cassandra up in both nodes. They both spend long time
>>>>>>>> reading commit logs, but now they seem to run. Any
>>>>>>>> idea how to debug or improve my setup? Thanks, Tamar
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> *Tamar Fraenkel * Senior Software Engineer, TOK
>>>>>>>> Media
>>>>>>>> 
>>>>>>>> <tokLogo.png>
>>>>>>>> 
>>>>>>>> 
>>>>>>>> tamar@tok-media.com <mailto:tamar@tok-media.com> Tel:
>>>>>>>> +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2
>>>>>>>> 5612956
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> On Mon, Mar 5, 2012 at 7:30 PM, aaron morton 
>>>>>>>> <aaron@thelastpickle.com 
>>>>>>>> <mailto:aaron@thelastpickle.com>> wrote:
>>>>>>>> 
>>>>>>>> Create nodes that do not share seeds, and give the
>>>>>>>> clusters different names as a safety measure.
>>>>>>>> 
>>>>>>>> Cheers
>>>>>>>> 
>>>>>>>> ----------------- Aaron Morton Freelance Developer 
>>>>>>>> @aaronmorton http://www.thelastpickle.com 
>>>>>>>> <http://www.thelastpickle.com/>
>>>>>>>> 
>>>>>>>> On 6/03/2012, at 12:04 AM, Tamar Fraenkel wrote:
>>>>>>>> 
>>>>>>>>> I want tow separate clusters. *Tamar Fraenkel * 
>>>>>>>>> Senior Software Engineer, TOK Media
>>>>>>>>> 
>>>>>>>>> <tokLogo.png>
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> tamar@tok-media.com <mailto:tamar@tok-media.com>

>>>>>>>>> Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972
>>>>>>>>> 2 5612956
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> On Mon, Mar 5, 2012 at 12:48 PM, aaron morton
>>>>>>>>> <aaron@thelastpickle.com 
>>>>>>>>> <mailto:aaron@thelastpickle.com>> wrote:
>>>>>>>>> 
>>>>>>>>> Do you want to create two separate clusters or a
>>>>>>>>> single cluster with two data centres ?
>>>>>>>>> 
>>>>>>>>> If it's the later, token selection is discussed
>>>>>>>>> here 
>>>>>>>>> http://www.datastax.com/docs/1.0/install/cluster_init#token-gen-cassandra
>>>>>>>>>>
>>>>>>>>> 
Moreover all tokens must be unique
>>>>>>>>>> (even across datacenters), although - from pure
>>>>>>>>>> curiosity - I wonder what is the rationale behind
>>>>>>>>>> this.
>>>>>>>>> Otherwise data is not evenly distributed.
>>>>>>>>> 
>>>>>>>>>> By the way, can someone enlighten me about the
>>>>>>>>>> first line in the output of the nodetool.
>>>>>>>>>> Obviously it contains a token, but nothing else.
>>>>>>>>>> It seems like a formatting glitch, but maybe it
>>>>>>>>>> has a role.
>>>>>>>>> It's the exclusive lower bound token for the first
>>>>>>>>> node in the ring. This also happens to be the token
>>>>>>>>> for the last node in the ring.
>>>>>>>>> 
>>>>>>>>> In your setup 10.0.0.19 "owns" 
>>>>>>>>> (85070591730234615865843651857942052864+1) to 0 
>>>>>>>>> 10.0.0.28 "owns" (0 + 1) to 
>>>>>>>>> 85070591730234615865843651857942052864
>>>>>>>>> 
>>>>>>>>> (does not imply primary replica, just used to map
>>>>>>>>> keys to nodes.)
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> ----------------- Aaron Morton Freelance Developer 
>>>>>>>>> @aaronmorton http://www.thelastpickle.com 
>>>>>>>>> <http://www.thelastpickle.com/>
>>>>>>>>> 
>>>>>>>>> On 5/03/2012, at 11:38 PM, Hontvári József Levente
>>>>>>>>> wrote:
>>>>>>>>> 
>>>>>>>>>> You have to use PropertyFileSnitch and
>>>>>>>>>> NetworkTopologyStrategy to create a
>>>>>>>>>> multi-datacenter setup with two circles. You can
>>>>>>>>>> start reading from this page: 
>>>>>>>>>> http://www.datastax.com/docs/1.0/cluster_architecture/replication#about-replica-placement-strategy
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> 
Moreover all tokens must be unique
>>>>>>>>>> (even across datacenters), although - from pure
>>>>>>>>>> curiosity - I wonder what is the rationale behind
>>>>>>>>>> this.
>>>>>>>>>> 
>>>>>>>>>> By the way, can someone enlighten me about the
>>>>>>>>>> first line in the output of the nodetool.
>>>>>>>>>> Obviously it contains a token, but nothing else.
>>>>>>>>>> It seems like a formatting glitch, but maybe it
>>>>>>>>>> has a role.
>>>>>>>>>> 
>>>>>>>>>> On 2012.03.05. 11 <tel:2012.03.05.%2011>:06,
>>>>>>>>>> Tamar Fraenkel wrote:
>>>>>>>>>>> Hi! I have a Cassandra cluster with two nodes
>>>>>>>>>>> 
>>>>>>>>>>> nodetool ring -h localhost Address DC Rack
>>>>>>>>>>> Status State Load Owns Token 
>>>>>>>>>>> 85070591730234615865843651857942052864 
>>>>>>>>>>> 10.0.0.19 datacenter1 rack1 Up Normal 488.74
KB
>>>>>>>>>>> 50.00% 0 10.0.0.28 datacenter1 rack1 Up Normal
>>>>>>>>>>> 504.63 KB 50.00% 
>>>>>>>>>>> 85070591730234615865843651857942052864
>>>>>>>>>>> 
>>>>>>>>>>> I want to create a second ring with the same
>>>>>>>>>>> name but two different nodes. using
>>>>>>>>>>> tokengentool I get the same tokens as they are
>>>>>>>>>>> affected from the number of nodes in a ring.
>>>>>>>>>>> 
>>>>>>>>>>> My question is like this: Lets say I create two
>>>>>>>>>>> new VMs, with IPs: 10.0.0.31 and 10.0.0.11 _In
>>>>>>>>>>> 10.0.0.31 cassandra.yaml I will set_ 
>>>>>>>>>>> initial_token: 0 seeds: "10.0.0.31" 
>>>>>>>>>>> listen_address: 10.0.0.31 rpc_address: 0.0.0.0
>>>>>>>>>>> 
>>>>>>>>>>> _In 10.0.0.11 cassandra.yaml I will set_ 
>>>>>>>>>>> initial_token: 
>>>>>>>>>>> 85070591730234615865843651857942052864 seeds:
>>>>>>>>>>> "10.0.0.31" listen_address: 10.0.0.11 
>>>>>>>>>>> rpc_address: 0.0.0.0
>>>>>>>>>>> 
>>>>>>>>>>> *Would the rings be separate?*
>>>>>>>>>>> 
>>>>>>>>>>> Thanks,
>>>>>>>>>>> 
>>>>>>>>>>> *Tamar Fraenkel * Senior Software Engineer, TOK
>>>>>>>>>>> Media
>>>>>>>>>>> 
>>>>>>>>>>> <Mail Attachment.png>
>>>>>>>>>>> 
>>>>>>>>>>> 
>>>>>>>>>>> tamar@tok-media.com 
>>>>>>>>>>> <mailto:tamar@tok-media.com> Tel: +972
2
>>>>>>>>>>> 6409736 Mob: +972 54 8356490 Fax: +972 2
>>>>>>>>>>> 5612956
>>>>>>>>>>> 
>>>>>>>>>>> 
>>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>> 
>>>>>> 
>>>>> 
>>>>> 
>>>> 
>>>> 
>>> 
>>> 
>> 
>> 
> 
-----BEGIN PGP SIGNATURE-----
Version: GnuPG/MacGPG2 v2.0.14 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQEcBAEBAgAGBQJPYh0OAAoJEFktYMMdQBIsge0H/Rn9MTd62Px1PPAcZ61LlEWz
PT92rYjqsUE6fyM1N8+4Gm63TTCZ7wwCW/BB0ItoA/dkzgVj4ZTWpuvuIIkY4kVp
0uMUVJ9YJu8Q4OgLNVv514OkSRLkeyW9RObfo1ecE8gz8dHHiWmZMf3WsVAdQR2u
pldTec+e3n9tdduumISV4uSvVeAJ1MJDtuolZBR3/Q263zaxfH1D79FFZp6ByefV
vQ6cps/KjxJs8aoxFYymNU3hwM3lbjn+yh3OExgxxutgncycLiSwduzGy8KYbbFX
XL4E90oHGrs8IXf9OyeDcYHlTPiq4WVcwBCABVK2dX3hoA2kzsPfa52QLyHg/mM=
=zCiP
-----END PGP SIGNATURE-----

Mime
View raw message