ignite-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alexey Goncharuk <alexey.goncha...@gmail.com>
Subject Re: Using IgniteContext
Date Wed, 19 Aug 2015 02:44:07 GMT
Cos,

You have created IgniteContext in client mode (it is a default mode), so
IgniteContext waits until at least one server node is started. I thought we
fixed the message for a client that cannot find server nodes, but
apparently the message is not clear yet. To fix this, just start
additionally an ignite node with ignite.sh and the same config.

Also, let me know how I can improve the documentation about Igntie-Spark
integration - you are one of the first persons trying it by yourself, so
your feedback is priceless :)

2015-08-18 16:42 GMT-07:00 Konstantin Boudnik <cos@apache.org>:

> Guys,
>
> I am running a simple example to check the latest Spark acceleration
> module in
> Ignite and am hitting some strange stuff (which musta be my configuration
> issue, but I can not figure out what is this).
>
> This is how I run spark-shell in my docker container (spark-master and
> worker
> are started in the same container)
>
> % spark-shell --packages org.apache.ignite:ignite-spark:1.3.3-p2-SNAPSHOT
> --repositories https://repository.apache.org/content/groups/snapshots
> --master spark://ignite.docker:7077
>
> then I execute this:
>
> scala>
> import org.apache.ignite.spark._
> import org.apache.ignite.configuration._
> val ic = new IgniteContext[Integer, Integer](sc,
> "/bigtop/spark-ignite-config.xml")
>
> 15/08/18 23:26:52 INFO XmlBeanDefinitionReader: Loading XML bean
> definitions from URL [file:/bigtop/spark-ignite-config.xml]
> 15/08/18 23:26:52 INFO GenericApplicationContext: Refreshing
> org.springframework.context.support.GenericApplicationContext@7f85c5d1:
> startup date [Tue Aug 18 2
> 3:26:52 UTC 2015]; root of context hierarchy
> 15/08/18 23:26:53 INFO IgniteKernal:
>
> >>>    __________  ________________
> >>>   /  _/ ___/ |/ /  _/_  __/ __/
> >>>  _/ // (7 7    // /  / / / _/
> >>> /___/\___/_/|_/___/ /_/ /___/
> >>>
> >>> ver. 1.3.3-p2-SNAPSHOT#20150814-sha1:9300bbc7
> >>> 2015 Copyright(C) Apache Software Foundation
> >>>
> >>> Ignite documentation: http://ignite.incubator.apache.org
>
> 15/08/18 23:26:53 INFO IgniteKernal: Config URL: n/a
> 15/08/18 23:26:53 INFO IgniteKernal: Daemon mode: off
> 15/08/18 23:26:53 INFO IgniteKernal: OS: Linux 3.13.0-61-generic amd64
> 15/08/18 23:26:53 INFO IgniteKernal: OS user: root
> 15/08/18 23:26:53 INFO IgniteKernal: Language runtime: Scala ver. 2.10.4
> 15/08/18 23:26:53 INFO IgniteKernal: VM information: Java(TM) SE Runtime
> Environment 1.7.0_60-b19 Oracle Corporation Java HotSpot(TM) 64-Bit Server
> VM 24.60-b0
> 9
> 15/08/18 23:26:53 INFO IgniteKernal: VM total memory: 0.48GB
> 15/08/18 23:26:53 INFO IgniteKernal: Remote Management [restart: off,
> REST: on, JMX (remote: off)]
> 15/08/18 23:26:53 INFO IgniteKernal: IGNITE_HOME=null
> 15/08/18 23:26:53 INFO IgniteKernal: VM arguments: [-XX:MaxPermSize=128m,
> -Dscala.usejavacp=true, -Xms512m, -Xmx512m]
> 15/08/18 23:26:53 INFO IgniteKernal: Configured caches
> ['ignite-marshaller-sys-cache', 'ignite-sys-cache',
> 'ignite-atomics-sys-cache', 'SharedNumbers']
> 15/08/18 23:26:53 INFO IgniteKernal: Non-loopback local IPs: 172.17.0.1,
> fe80:0:0:0:42:acff:fe11:1%4
> 15/08/18 23:26:53 INFO IgniteKernal: Enabled local MACs: 0242AC110001
> 15/08/18 23:26:53 INFO IgnitePluginProcessor: Configured plugins:
> 15/08/18 23:26:53 INFO IgnitePluginProcessor:   ^-- None
> 15/08/18 23:26:53 INFO IgnitePluginProcessor:
> 15/08/18 23:26:53 INFO TcpCommunicationSpi: IPC shared memory server
> endpoint started [port=48100,
> tokDir=/tmp/ignite/work/ipc/shmem/9fa0e60d-8d5a-4606-9797-4dc86c683a32-10416]
> 15/08/18 23:26:53 INFO TcpCommunicationSpi: Successfully bound shared
> memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0]
> 15/08/18 23:26:53 INFO TcpCommunicationSpi: Successfully bound to TCP port
> [port=47100, locHost=0.0.0.0/0.0.0.0]
> 15/08/18 23:26:53 WARN NoopCheckpointSpi: Checkpoints are disabled (to
> enable configure any GridCheckpointSpi implementation)
> 15/08/18 23:26:53 WARN GridCollisionManager: Collision resolution is
> disabled (all jobs will be activated upon arrival).
> 15/08/18 23:26:53 WARN NoopSwapSpaceSpi: Swap space is disabled. To enable
> use FileSwapSpaceSpi.
> 15/08/18 23:26:53 INFO IgniteKernal: Security status [authentication=off,
> communication encryption=off]
> 15/08/18 23:26:53 INFO GridTcpRestProtocol: Command protocol successfully
> started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211]
> 15/08/18 23:26:53 WARN TcpDiscoveryMulticastIpFinder:
> TcpDiscoveryMulticastIpFinder has no pre-configured addresses (it is
> recommended in production to specify at least one address in
> TcpDiscoveryMulticastIpFinder.getAddresses() configuration property)
> 15/08/18 23:26:53 WARN TcpDiscoverySpi: No addresses registered in the IP
> finder (will retry in 2000ms): TcpDiscoveryMulticastIpFinder
> [mcastGrp=228.1.2.4, mcastPort=47400, resWaitTime=500, addrReqAttempts=2,
> locAddr=null, super=TcpDiscoveryVmIpFinder [addrs=[],
> super=TcpDiscoveryIpFinderAdapter [shared=true]]]
> [23:27:03] New version is available at ....
>
> and after that the process is just hanging there without any progress. The
> spark-ignite-config is below
>
> <beans xmlns="http://www.springframework.org/schema/beans"
>        xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
>        xsi:schemaLocation="
>        http://www.springframework.org/schema/beans
>        http://www.springframework.org/schema/beans/spring-beans.xsd">
>     <!--
>         Alter configuration below as needed.
>     -->
>     <bean id="grid.cfg"
> class="org.apache.ignite.configuration.IgniteConfiguration">
>       <property name="cacheConfiguration">
>         <list>
>             <!-- Partitioned cache example configuration (Atomic mode). -->
>             <bean
> class="org.apache.ignite.configuration.CacheConfiguration">
>                 <property name="name" value="SharedNumbers"/>
>                 <property name="affinity">
>                   <bean
> class="org.apache.ignite.cache.affinity.rendezvous.RendezvousAffinityFunction">
>                     <property name="partitions" value="32"/>
>                   </bean>
>                 </property>
>                 <property name="indexedTypes">
>                     <array>
>                         <value>java.lang.Integer</value>
>                         <value>java.lang.Integer</value>
>                     </array>
>                 </property>
>             </bean>
>         </list>
>       </property>
>     </bean>
> </beans>
>
> What shall I do at this point? Thanks in advance!
>   Cos
>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message