cassandra-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ted Yu <yuzhih...@gmail.com>
Subject Re: CASSANDRA-8072
Date Wed, 10 Feb 2016 02:26:22 GMT
Forgot to update this thread.

Early afternoon I was able to get 5 node cluster up and running by
following the guideline below.

Thanks for the help.

On Tue, Feb 9, 2016 at 5:09 PM, Stefania Alborghetti <
stefania.alborghetti@datastax.com> wrote:

> Can you make sure you changed the listen address on both hosts, using
> their respective public IP address and that the seeds and cluster name are
> the same on both hosts. The seeds should contain the public IP of the seed
> node.
>
> Then verify you can telnet from one host to the other and vice-versa using
> the internode port. This is normally 7000, the storage port in the yaml
> file.
>
> If you are still having problems,  you can log at TRACE level in
> conf/logback.xml, this should log connection errors and gossip exchanges.
>
>
>
>
> On Wed, Feb 10, 2016 at 2:28 AM, Ted Yu <yuzhihong@gmail.com> wrote:
>
>> On XX.YY :
>>
>> #  service iptables status
>> iptables: Firewall is not running.
>>
>> I put public IP address for listen address on a non-seed node. I still
>> got:
>>
>> INFO  18:14:17  OutboundTcpConnection using coalescing strategy DISABLED
>> ERROR 18:14:48  Exception encountered during startup
>> java.lang.RuntimeException: Unable to gossip with any seeds
>> at org.apache.cassandra.gms.Gossiper.doShadowRound(Gossiper.java:1337)
>> ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
>> at
>> org.apache.cassandra.service.StorageService.checkForEndpointCollision(StorageService.java:541)
>> ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
>> at
>> org.apache.cassandra.service.StorageService.prepareToJoin(StorageService.java:789)
>> ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
>>
>> Cheers
>>
>> On Mon, Feb 8, 2016 at 5:36 PM, Stefania Alborghetti <
>> stefania.alborghetti@datastax.com> wrote:
>>
>>> Have you checked that you can telnet from one node to the other using
>>> the same ip and the internode port?
>>>
>>> I would put the public IP addresses of the seeds in the seed list and
>>> set the listen address to the public IP address for each node.
>>>
>>> There was a similar discussion
>>> <https://mail-archives.apache.org/mod_mbox/cassandra-user/201602.mbox/%3CCAEQiCCVC3AygJAiPOVJJ4uG2wYQbgihEkbA_1BoBNUYc1uKaLw%40mail.gmail.com%3E>
>>> recently that might help.
>>>
>>> On Tue, Feb 9, 2016 at 8:48 AM, Ted Yu <yuzhihong@gmail.com> wrote:
>>>
>>>> Thanks for the help, Stefania.
>>>> By using "127.0.0.1" , I was able to start Cassandra on that seed node
>>>> (XX.YY).
>>>> However, on other nodes, I pointed seed to XX.YY and observed the
>>>> following ?
>>>> What did I miss ?
>>>>
>>>>
>>>> INFO  [main] 2016-02-08 16:44:56,607  OutboundTcpConnection.java:97 -
>>>> OutboundTcpConnection using coalescing strategy DISABLED
>>>> ERROR [main] 2016-02-08 16:45:27,626  CassandraDaemon.java:581 -
>>>> Exception encountered during startup
>>>> java.lang.RuntimeException: Unable to gossip with any seeds
>>>>         at
>>>> org.apache.cassandra.gms.Gossiper.doShadowRound(Gossiper.java:1337)
>>>> ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
>>>>         at
>>>> org.apache.cassandra.service.StorageService.checkForEndpointCollision(StorageService.java:541)
>>>> ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
>>>>         at
>>>> org.apache.cassandra.service.StorageService.prepareToJoin(StorageService.java:789)
>>>> ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
>>>>         at
>>>> org.apache.cassandra.service.StorageService.initServer(StorageService.java:721)
>>>> ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
>>>>         at
>>>> org.apache.cassandra.service.StorageService.initServer(StorageService.java:612)
>>>> ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
>>>>         at
>>>> org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:389)
>>>> ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
>>>>         at com.datastax.bdp.server.DseDaemon.setup(DseDaemon.java:335)
>>>> ~[dse-core-4.8.4.jar:4.8.4]
>>>>         at
>>>> org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:564)
>>>> ~[cassandra-all-2.1.12.1046.jar:2.1.12.1046]
>>>>         at com.datastax.bdp.DseModule.main(DseModule.java:74)
>>>> [dse-core-4.8.4.jar:4.8.4]
>>>> INFO  [Thread-2] 2016-02-08 16:45:27,629  DseDaemon.java:418 - DSE
>>>> shutting down...
>>>>
>>>> On Mon, Feb 8, 2016 at 4:25 PM, Stefania Alborghetti <
>>>> stefania.alborghetti@datastax.com> wrote:
>>>>
>>>>> CASSANDRA-8072 is not going to help you because the code that fails
>>>>> (checkForEndpointCollision()) should not execute for seeds.
>>>>>
>>>>> I think the problem is that there are no seeds in cassandra.yaml:
>>>>>
>>>>> - seeds: "XX.YY"
>>>>>
>>>>> If listen_address is localhost then try:
>>>>>
>>>>> - seeds: "127.0.0.1"
>>>>>
>>>>>
>>>>> On Tue, Feb 9, 2016 at 5:58 AM, Ted Yu <yuzhihong@gmail.com> wrote:
>>>>>
>>>>>> If I apply the fix from CASSANDRA-8072 onto a 2.1.12 cluster, which
>>>>>> files should I replace ?
>>>>>>
>>>>>> Thanks
>>>>>>
>>>>>> On Mon, Feb 8, 2016 at 1:07 PM, Bhuvan Rawal <bhu1rawal@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Your config looks fine to me,  i tried reproducing the scenario
by
>>>>>>> setting localhost in listen_address,rpc_address and seed list,
and it
>>>>>>> worked fine, I had earlier the node local ip in the 3 fields
and it was
>>>>>>> working fine.
>>>>>>>
>>>>>>> Looks like there is some other issue here.
>>>>>>>
>>>>>>> On Tue, Feb 9, 2016 at 12:49 AM, Ted Yu <yuzhihong@gmail.com>
wrote:
>>>>>>>
>>>>>>>> Here it is:
>>>>>>>> http://pastebin.com/QEdjtAj6
>>>>>>>>
>>>>>>>> XX.YY is localhost in this case.
>>>>>>>>
>>>>>>>> On Mon, Feb 8, 2016 at 11:03 AM, Bhuvan Rawal <bhu1rawal@gmail.com>
>>>>>>>> wrote:
>>>>>>>>
>>>>>>>>> could you paste your cassandra.yaml here, except for
commented out
>>>>>>>>> lines?
>>>>>>>>>
>>>>>>>>> On Tue, Feb 9, 2016 at 12:30 AM, Ted Yu <yuzhihong@gmail.com>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> The issue I described was observed on the seed node.
>>>>>>>>>>
>>>>>>>>>> Both rpc_address and listen_address point to localhost.
>>>>>>>>>>
>>>>>>>>>> bq. What addresses are there in the seed list?
>>>>>>>>>>
>>>>>>>>>> The IP of the seed node.
>>>>>>>>>>
>>>>>>>>>> I haven't come to starting non-seed node(s) yet.
>>>>>>>>>>
>>>>>>>>>> Thanks for the quick response.
>>>>>>>>>>
>>>>>>>>>> On Mon, Feb 8, 2016 at 10:50 AM, Bhuvan Rawal <
>>>>>>>>>> bhu1rawal@gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Ted,
>>>>>>>>>>>
>>>>>>>>>>> Have you specified the listen_address and rpc_address?
What
>>>>>>>>>>> addresses are there in the seed list?
>>>>>>>>>>>
>>>>>>>>>>> Have you started seed first and after waiting
for 30 seconds
>>>>>>>>>>> started other nodes?
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On Tue, Feb 9, 2016 at 12:14 AM, Ted Yu <yuzhihong@gmail.com>
>>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi,
>>>>>>>>>>>> I am trying to setup a cluster with DSE 4.8.4
>>>>>>>>>>>>
>>>>>>>>>>>> I added the following
>>>>>>>>>>>> in resources/cassandra/conf/cassandra.yaml
:
>>>>>>>>>>>>
>>>>>>>>>>>> cluster_name: 'cass'
>>>>>>>>>>>>
>>>>>>>>>>>> which resulted in:
>>>>>>>>>>>>
>>>>>>>>>>>> http://pastebin.com/27adxKTM
>>>>>>>>>>>>
>>>>>>>>>>>> This seems to be resolved by CASSANDRA-8072
>>>>>>>>>>>>
>>>>>>>>>>>> My question is whether there is workaround
?
>>>>>>>>>>>> If not, when can I expect 2.1.13 release
?
>>>>>>>>>>>>
>>>>>>>>>>>> Thanks
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>>
>>>>> [image: datastax_logo.png] <http://www.datastax.com/>
>>>>>
>>>>> Stefania Alborghetti
>>>>>
>>>>> Apache Cassandra Software Engineer
>>>>>
>>>>> |+852 6114 9265| stefania.alborghetti@datastax.com
>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>> --
>>>
>>>
>>> [image: datastax_logo.png] <http://www.datastax.com/>
>>>
>>> Stefania Alborghetti
>>>
>>> Apache Cassandra Software Engineer
>>>
>>> |+852 6114 9265| stefania.alborghetti@datastax.com
>>>
>>>
>>>
>>>
>>
>
>
> --
>
>
> [image: datastax_logo.png] <http://www.datastax.com/>
>
> Stefania Alborghetti
>
> Apache Cassandra Software Engineer
>
> |+852 6114 9265| stefania.alborghetti@datastax.com
>
>
>
>

Mime
View raw message