ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From visagan <visagan1...@gmail.com>
Subject Re: Cluster Formation between nodes in different data centers
Date Wed, 25 May 2016 00:33:24 GMT
Hi,

I tried the option you told me. But it dint work. It happened to do the
same thing again.

So can i use the cloud based configuration. My machines are in open-stack i
think it should be the public/private address issue.
https://apacheignite.readme.io/v1.6/docs/generic-cloud-configuration

If i replace
  <property name="provider" value="google-compute-engine"/>

<property name="provider" value="openstack-nova"/>

And provide the rest of the information as required by ignite. Will that
pick up the open stack configuration? Or should i write my own custom
interface to that for openstack ?

On Thu, May 12, 2016 at 10:47 AM, vdpyatkov [via Apache Ignite Users] <
ml-node+s70518n4903h42@n6.nabble.com> wrote:

> Hello,
>
> Can you check ping between data centers?
> If delay of network may be long, you can incrase FailureDetectionTimeout
> (use
> org.apache.ignite.configuration.IgniteConfiguration#setFailureDetectionTimeout)
>
>
> In additional you need make sure what communication ports are available in
> all nodes (by default
> org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi#DFLT_PORT) .
> You can see all ports, which are will by used, in debug level logger.
>
> If nothing to help, please provide log files from all nodes and I could
> see details.
>
> Also I see you are not subscribed on users mail list. Can you please
> subscribe?
> You can do it from this page
> https://ignite.apache.org/community/resources.html
>
> Also I see you are not subscribed on users mail list. Can you please
> subscribe?
> You can do it from this page
> https://ignite.apache.org/community/resources.html
>
> visagan wrote
> Hi,
>
> I have two nodes in data center A and two nodes in Data center B.  I have
> opened up the ignite default ports and i am able to talk to all nodes and
> ports if i use  "nc" command.
>
> But when i try to make the ignite cluster work, the four nodes join and
> form a cluster and then they leave.
>
> I am able to see the total memory to increase from 24GB (when two nodes
> are in the cluster) to 36 and then to 48GB and then the other two nodes
> leave with an event NODE_FAILED.
> But the nodes in the corresponding data center forms the cluster within
> themselves and lives there happily.
> When i turn on the cross data center, though it is able to discover the
> nodes, it fails after joining with the other nodes.
> Is there any possibly know reason for this ?
>
> {"@timestamp":"2016-05-05T17:26:50.586-04:00","@version":1,"message":"Added new node
to topology: TcpDiscoveryNode [id=5f0315fe-94c8-4b87-b839-7aa9847c94c1, addrs=[0:0:0:0:0:0:0:1%lo,
127.0.0.1, 192.168.16.116], sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500, /0:0:0:0:0:0:0:1%lo:47500,
/127.0.0.1:47500, /192.168.16.116:47500], discPort=47500, order=969, intOrder=569, lastExchangeTime=1462483600560,
loc=false, ver=1.5.0#20151229-sha1:f1f8cda2, isClient=false]","logger_name":"org.apache.ignite.internal.managers.discovery.GridDiscoveryManager","thread_name":"disco-event-worker-#48%null%","level":"INFO","level_value":20000,"HOSTNAME":"XXX35.datacenter2.stage.es.XXXXX.com"}
> [17:26:50] Topology snapshot [ver=969, servers=3, clients=0, CPUs=24, heap=36.0GB]
> {"@timestamp":"2016-05-05T17:26:50.586-04:00","@version":1,"message":"Topology snapshot
[ver=969, servers=3, clients=0, CPUs=24, heap=36.0GB]","logger_name":"org.apache.ignite.internal.managers.discovery.GridDiscoveryManager","thread_name":"disco-event-worker-#48%null%","level":"INFO","level_value":20000,"HOSTNAME":"XXX35.datacenter2.stage.es.XXXXX.com"}
> {"@timestamp":"2016-05-05T17:26:50.597-04:00","@version":1,"message":"Added new node
to topology: TcpDiscoveryNode [id=0d9d891d-809c-4b72-9ba3-6b89804e280f, addrs=[0:0:0:0:0:0:0:1%lo,
127.0.0.1, 192.168.16.115], sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500, /0:0:0:0:0:0:0:1%lo:47500,
/127.0.0.1:47500, /192.168.16.115:47500], discPort=47500, order=970, intOrder=570, lastExchangeTime=1462483605307,
loc=false, ver=1.5.0#20151229-sha1:f1f8cda2, isClient=false]","logger_name":"org.apache.ignite.internal.managers.discovery.GridDiscoveryManager","thread_name":"disco-event-worker-#48%null%","level":"INFO","level_value":20000,"HOSTNAME":"XXX35.datacenter2.stage.es.XXXXX.com"}
> [17:26:50] Topology snapshot [ver=970, servers=4, clients=0, CPUs=32, heap=48.0GB]
> {"@timestamp":"2016-05-05T17:26:50.598-04:00","@version":1,"message":"Topology snapshot
[ver=970, servers=4, clients=0, CPUs=32, heap=48.0GB]","logger_name":"org.apache.ignite.internal.managers.discovery.GridDiscoveryManager","thread_name":"disco-event-worker-#48%null%","level":"INFO","level_value":20000,"HOSTNAME":"XXX35.datacenter2.stage.es.XXXXX.com"}
> {"@timestamp":"2016-05-05T17:26:50.625-04:00","@version":1,"message":"Skipping rebalancing
(nothing scheduled) [top=AffinityTopologyVersion [topVer=966, minorTopVer=0], evt=NODE_FAILED,
node=0d9d891d-809c-4b72-9ba3-6b89804e280f]","logger_name":"org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager","thread_name":"exchange-worker-#81%null%","level":"INFO","level_value":20000,"HOSTNAME":"XXX35.datacenter2.stage.es.XXXXX.com"}
> {"@timestamp":"2016-05-05T17:26:50.636-04:00","@version":1,"message":"Node FAILED: TcpDiscoveryNode
[id=0d9d891d-809c-4b72-9ba3-6b89804e280f, addrs=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 192.168.16.115],
sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500, /0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500, /192.168.16.115:47500],
discPort=47500, order=970, intOrder=570, lastExchangeTime=1462483605307, loc=false, ver=1.5.0#20151229-sha1:f1f8cda2,
isClient=false]","logger_name":"org.apache.ignite.internal.managers.discovery.GridDiscoveryManager","thread_name":"disco-event-worker-#48%null%","level":"WARN","level_value":30000,"HOSTNAME":"XXX35.datacenter2.stage.es.XXXXX.com"}
> [17:26:50] Topology snapshot [ver=971, servers=3, clients=0, CPUs=24, heap=36.0GB]
> {"@timestamp":"2016-05-05T17:26:50.636-04:00","@version":1,"message":"Topology snapshot
[ver=971, servers=3, clients=0, CPUs=24, heap=36.0GB]","logger_name":"org.apache.ignite.internal.managers.discovery.GridDiscoveryManager","thread_name":"disco-event-worker-#48%null%","level":"INFO","level_value":20000,"HOSTNAME":"XXX35.datacenter2.stage.es.XXXXX.com"}
> {"@timestamp":"2016-05-05T17:26:50.638-04:00","@version":1,"message":"Node FAILED: TcpDiscoveryNode
[id=5f0315fe-94c8-4b87-b839-7aa9847c94c1, addrs=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 192.168.16.116],
sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500, /0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500, /192.168.16.116:47500],
discPort=47500, order=969, intOrder=569, lastExchangeTime=1462483600560, loc=false, ver=1.5.0#20151229-sha1:f1f8cda2,
isClient=false]","logger_name":"org.apache.ignite.internal.managers.discovery.GridDiscoveryManager","thread_name":"disco-event-worker-#48%null%","level":"WARN","level_value":30000,"HOSTNAME":"XXX35.datacenter2.stage.es.XXXXX.com"}
> [17:26:50] Topology snapshot [ver=972, servers=2, clients=0, CPUs=16, heap=24.0GB]
> {"@timestamp":"2016-05-05T17:26:50.638-04:00","@version":1,"message":"Topology snapshot
[ver=972, servers=2, clients=0, CPUs=16, heap=24.0GB]","logger_name":"org.apache.ignite.internal.managers.discovery.GridDiscoveryManager","thread_name":"disco-event-worker-#48%null%","level":"INFO","level_value":20000,"HOSTNAME":"XXX35.datacenter2.stage.es.XXXXX.com"}
> {"@timestamp":"2016-05-05T17:26:50.657-04:00","@version":1,"message":"Skipping rebalancing
(nothing scheduled) [top=AffinityTopologyVersion [topVer=967, minorTopVer=0], evt=NODE_JOINED,
node=5f0315fe-94c8-4b87-b839-7aa9847c94c1]","logger_name":"org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager","thread_name":"exchange-worker-#81%null%","level":"INFO","level_value":20000,"HOSTNAME":"XXX35.datacenter2.stage.es.XXXXX.com"}
> {"@timestamp":"2016-05-05T17:26:50.687-04:00","@version":1,"message":"Skipping rebalancing
(nothing scheduled) [top=AffinityTopologyVersion [topVer=968, minorTopVer=0], evt=NODE_FAILED,
node=5f0315fe-94c8-4b87-b839-7aa9847c94c1]","logger_name":"org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager","thread_name":"exchange-worker-#81%null%","level":"INFO","level_value":20000,"HOSTNAME":"XXX35.datacenter2.stage.es.XXXXX.com"}
>
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-ignite-users.70518.x6.nabble.com/Cluster-Formation-between-nodes-in-different-data-centers-tp4838p4903.html
> To unsubscribe from Cluster Formation between nodes in different data
> centers, click here
> <http://apache-ignite-users.70518.x6.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4838&code=dmlzYWdhbjE5ODlAZ21haWwuY29tfDQ4Mzh8MTExNjE2OTkzNQ==>
> .
> NAML
> <http://apache-ignite-users.70518.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>



-- 
Regards
V.Visagan




--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Cluster-Formation-between-nodes-in-different-data-centers-tp4838p5157.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Mime
View raw message