ignite-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ilya Suntsov (JIRA)" <j...@apache.org>
Subject [jira] [Created] (IGNITE-1198) Spark integration: problem when create instance with ignite default config
Date Wed, 05 Aug 2015 08:25:05 GMT
Ilya Suntsov created IGNITE-1198:
------------------------------------

             Summary: Spark integration: problem when create instance with ignite default config
                 Key: IGNITE-1198
                 URL: https://issues.apache.org/jira/browse/IGNITE-1198
             Project: Ignite
          Issue Type: Bug
          Components: general
    Affects Versions: ignite-1.4
         Environment: Cent OS
jdk 1.7
            Reporter: Ilya Suntsov
            Assignee: Alexey Goncharuk
            Priority: Blocker
             Fix For: ignite-1.4


I try to create an instance of IgniteContext is to use a configuration file:
*Step 0*
Start spark master, worker and ignite node with default-config.xml
*Step1*
{noformat}
$export IGNITE_HOME=/home/gridgain/isuntsov/gridgain-community-fabric-1.3.2/
$ echo $IGNITE_HOME 
/home/gridgain/isuntsov/gridgain-community-fabric-1.3.2/
{noformat}
*Step2*
{noformat}
./spark-shell  --packages org.apache.ignite:ignite-spark:1.3.2  --master spark://fosters-218:7077 --repositories http://www.gridgainsystems.com/nexus/content/repositories/external
Ivy Default Cache set to: /home/gridgain/.ivy2/cache
The jars for the packages stored in: /home/gridgain/.ivy2/jars
http://www.gridgainsystems.com/nexus/content/repositories/external added as a remote repository with the name: repo-1
:: loading settings :: url = jar:file:/home/gridgain/isuntsov/spark-1.3.1-bin-hadoop2.6/lib/spark-assembly-1.3.1-hadoop2.6.0.jar!/org/apache/ivy/core/settings/ivysettings.xml
org.apache.ignite#ignite-spark added as a dependency
:: resolving dependencies :: org.apache.spark#spark-submit-parent;1.0
	confs: [default]
	found org.apache.ignite#ignite-spark;1.3.2 in repo-1
	found org.apache.ignite#ignite-core;1.3.2 in repo-1
	found javax.cache#cache-api;1.0.0 in central
	found org.gridgain#ignite-shmem;1.0.0 in central
	found org.apache.ignite#ignite-indexing;1.3.2 in repo-1
	found commons-codec#commons-codec;1.6 in central
	found org.apache.lucene#lucene-core;3.5.0 in central
	found com.h2database#h2;1.3.175 in central
	found org.apache.ignite#ignite-spring;1.3.2 in repo-1
	found org.springframework#spring-core;4.1.0.RELEASE in central
	found org.springframework#spring-aop;4.1.0.RELEASE in central
	found aopalliance#aopalliance;1.0 in central
	found org.springframework#spring-beans;4.1.0.RELEASE in central
	found org.springframework#spring-context;4.1.0.RELEASE in central
	found org.springframework#spring-expression;4.1.0.RELEASE in central
	found org.springframework#spring-tx;4.1.0.RELEASE in central
	found org.springframework#spring-jdbc;4.1.0.RELEASE in central
	found commons-logging#commons-logging;1.1.1 in central
	found org.apache.ignite#ignite-log4j;1.3.2 in repo-1
	found log4j#log4j;1.2.17 in central
:: resolution report :: resolve 811ms :: artifacts dl 23ms
	:: modules in use:
	aopalliance#aopalliance;1.0 from central in [default]
	com.h2database#h2;1.3.175 from central in [default]
	commons-codec#commons-codec;1.6 from central in [default]
	commons-logging#commons-logging;1.1.1 from central in [default]
	javax.cache#cache-api;1.0.0 from central in [default]
	log4j#log4j;1.2.17 from central in [default]
	org.apache.ignite#ignite-core;1.3.2 from repo-1 in [default]
	org.apache.ignite#ignite-indexing;1.3.2 from repo-1 in [default]
	org.apache.ignite#ignite-log4j;1.3.2 from repo-1 in [default]
	org.apache.ignite#ignite-spark;1.3.2 from repo-1 in [default]
	org.apache.ignite#ignite-spring;1.3.2 from repo-1 in [default]
	org.apache.lucene#lucene-core;3.5.0 from central in [default]
	org.gridgain#ignite-shmem;1.0.0 from central in [default]
	org.springframework#spring-aop;4.1.0.RELEASE from central in [default]
	org.springframework#spring-beans;4.1.0.RELEASE from central in [default]
	org.springframework#spring-context;4.1.0.RELEASE from central in [default]
	org.springframework#spring-core;4.1.0.RELEASE from central in [default]
	org.springframework#spring-expression;4.1.0.RELEASE from central in [default]
	org.springframework#spring-jdbc;4.1.0.RELEASE from central in [default]
	org.springframework#spring-tx;4.1.0.RELEASE from central in [default]
	:: evicted modules:
	commons-logging#commons-logging;1.1.3 by [commons-logging#commons-logging;1.1.1] in [default]
	---------------------------------------------------------------------
	|                  |            modules            ||   artifacts   |
	|       conf       | number| search|dwnlded|evicted|| number|dwnlded|
	---------------------------------------------------------------------
	|      default     |   21  |   0   |   0   |   1   ||   20  |   0   |
	---------------------------------------------------------------------
:: retrieving :: org.apache.spark#spark-submit-parent
	confs: [default]
	0 artifacts copied, 20 already retrieved (0kB/16ms)
log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
15/07/30 02:25:01 INFO SecurityManager: Changing view acls to: gridgain
15/07/30 02:25:01 INFO SecurityManager: Changing modify acls to: gridgain
15/07/30 02:25:01 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(gridgain); users with modify permissions: Set(gridgain)
15/07/30 02:25:01 INFO HttpServer: Starting HTTP Server
15/07/30 02:25:01 INFO Server: jetty-8.y.z-SNAPSHOT
15/07/30 02:25:01 INFO AbstractConnector: Started SocketConnector@0.0.0.0:45663
15/07/30 02:25:01 INFO Utils: Successfully started service 'HTTP class server' on port 45663.
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 1.3.1
      /_/

Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java 1.7.0_75)
Type in expressions to have them evaluated.
Type :help for more information.
15/07/30 02:25:04 INFO SparkContext: Running Spark version 1.3.1
15/07/30 02:25:04 INFO SecurityManager: Changing view acls to: gridgain
15/07/30 02:25:04 INFO SecurityManager: Changing modify acls to: gridgain
15/07/30 02:25:04 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(gridgain); users with modify permissions: Set(gridgain)
15/07/30 02:25:04 INFO Slf4jLogger: Slf4jLogger started
15/07/30 02:25:04 INFO Remoting: Starting remoting
15/07/30 02:25:04 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriver@fosters-221:59114]
15/07/30 02:25:04 INFO Utils: Successfully started service 'sparkDriver' on port 59114.
15/07/30 02:25:04 INFO SparkEnv: Registering MapOutputTracker
15/07/30 02:25:04 INFO SparkEnv: Registering BlockManagerMaster
15/07/30 02:25:04 INFO DiskBlockManager: Created local directory at /tmp/spark-f45b7974-83aa-4523-915d-0547ecaaec48/blockmgr-6ca6af17-57bb-4a24-b621-79ea23b6bc69
15/07/30 02:25:04 INFO MemoryStore: MemoryStore started with capacity 265.4 MB
15/07/30 02:25:04 INFO HttpFileServer: HTTP File server directory is /tmp/spark-5a1bab16-2a8d-4f1b-89b9-49dc2c9d5621/httpd-3363f5ca-2c27-4c86-8c3a-790a5f7b1c54
15/07/30 02:25:04 INFO HttpServer: Starting HTTP Server
15/07/30 02:25:04 INFO Server: jetty-8.y.z-SNAPSHOT
15/07/30 02:25:04 INFO AbstractConnector: Started SocketConnector@0.0.0.0:52473
15/07/30 02:25:04 INFO Utils: Successfully started service 'HTTP file server' on port 52473.
15/07/30 02:25:04 INFO SparkEnv: Registering OutputCommitCoordinator
15/07/30 02:25:04 INFO Server: jetty-8.y.z-SNAPSHOT
15/07/30 02:25:04 INFO AbstractConnector: Started SelectChannelConnector@0.0.0.0:4040
15/07/30 02:25:04 INFO Utils: Successfully started service 'SparkUI' on port 4040.
15/07/30 02:25:04 INFO SparkUI: Started SparkUI at http://fosters-221:4040
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-spark.jar at http://10.20.0.221:52473/jars/ignite-spark.jar with timestamp 1438248304953
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-core.jar at http://10.20.0.221:52473/jars/ignite-core.jar with timestamp 1438248304963
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-indexing.jar at http://10.20.0.221:52473/jars/ignite-indexing.jar with timestamp 1438248304963
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-spring.jar at http://10.20.0.221:52473/jars/ignite-spring.jar with timestamp 1438248304964
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-log4j.jar at http://10.20.0.221:52473/jars/ignite-log4j.jar with timestamp 1438248304964
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/cache-api.jar at http://10.20.0.221:52473/jars/cache-api.jar with timestamp 1438248304964
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-shmem.jar at http://10.20.0.221:52473/jars/ignite-shmem.jar with timestamp 1438248304964
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/commons-codec.jar at http://10.20.0.221:52473/jars/commons-codec.jar with timestamp 1438248304965
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/lucene-core.jar at http://10.20.0.221:52473/jars/lucene-core.jar with timestamp 1438248304967
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/h2.jar at http://10.20.0.221:52473/jars/h2.jar with timestamp 1438248304970
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-core.jar at http://10.20.0.221:52473/jars/spring-core.jar with timestamp 1438248304971
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-aop.jar at http://10.20.0.221:52473/jars/spring-aop.jar with timestamp 1438248304972
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-beans.jar at http://10.20.0.221:52473/jars/spring-beans.jar with timestamp 1438248304973
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-context.jar at http://10.20.0.221:52473/jars/spring-context.jar with timestamp 1438248304975
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-expression.jar at http://10.20.0.221:52473/jars/spring-expression.jar with timestamp 1438248304975
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-tx.jar at http://10.20.0.221:52473/jars/spring-tx.jar with timestamp 1438248304976
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-jdbc.jar at http://10.20.0.221:52473/jars/spring-jdbc.jar with timestamp 1438248304977
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/commons-logging.jar at http://10.20.0.221:52473/jars/commons-logging.jar with timestamp 1438248304977
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/aopalliance.jar at http://10.20.0.221:52473/jars/aopalliance.jar with timestamp 1438248304977
15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/log4j.jar at http://10.20.0.221:52473/jars/log4j.jar with timestamp 1438248304978
15/07/30 02:25:05 INFO AppClient$ClientActor: Connecting to master akka.tcp://sparkMaster@fosters-218:7077/user/Master...
15/07/30 02:25:05 INFO SparkDeploySchedulerBackend: Connected to Spark cluster with app ID app-20150730022602-0005
15/07/30 02:25:05 INFO AppClient$ClientActor: Executor added: app-20150730022602-0005/0 on worker-20150730014728-fosters-221-58923 (fosters-221:58923) with 16 cores
15/07/30 02:25:05 INFO SparkDeploySchedulerBackend: Granted executor ID app-20150730022602-0005/0 on hostPort fosters-221:58923 with 16 cores, 512.0 MB RAM
15/07/30 02:25:05 INFO AppClient$ClientActor: Executor updated: app-20150730022602-0005/0 is now LOADING
15/07/30 02:25:05 INFO AppClient$ClientActor: Executor updated: app-20150730022602-0005/0 is now RUNNING
15/07/30 02:25:05 INFO NettyBlockTransferService: Server created on 51493
15/07/30 02:25:05 INFO BlockManagerMaster: Trying to register BlockManager
15/07/30 02:25:05 INFO BlockManagerMasterActor: Registering block manager fosters-221:51493 with 265.4 MB RAM, BlockManagerId(<driver>, fosters-221, 51493)
15/07/30 02:25:05 INFO BlockManagerMaster: Registered BlockManager
15/07/30 02:25:05 INFO SparkDeploySchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.0
15/07/30 02:25:05 INFO SparkILoop: Created spark context..
Spark context available as sc.
15/07/30 02:25:05 INFO SparkILoop: Created sql context (with Hive support)..
SQL context available as sqlContext.
15/07/30 02:25:07 INFO SparkDeploySchedulerBackend: Registered executor: Actor[akka.tcp://sparkExecutor@fosters-221:33293/user/Executor#271769703] with ID 0

scala> 15/07/30 02:25:07 INFO BlockManagerMasterActor: Registering block manager fosters-221:41747 with 265.4 MB RAM, BlockManagerId(0, fosters-221, 41747)
{noformat}

*Step 3*
{noformat}
scala> import org.apache.ignite.spark._
import org.apache.ignite.spark._

scala> import org.apache.ignite.configuration._
import org.apache.ignite.configuration._
{noformat}

*Step 4*
{noformat}scala> val ic = new IgniteContext[Integer, Integer](sc, "config/default-config.xml")
15/07/30 02:26:36 INFO XmlBeanDefinitionReader: Loading XML bean definitions from URL [file:/home/gridgain/isuntsov/gridgain-community-fabric-1.3.2/config/default-config.xml]
15/07/30 02:26:36 INFO GenericApplicationContext: Refreshing org.springframework.context.support.GenericApplicationContext@35816f1c: startup date [Thu Jul 30 02:26:36 PDT 2015]; root of context hierarchy
15/07/30 02:26:36 INFO IgniteKernal: 

>>>    __________  ________________  
>>>   /  _/ ___/ |/ /  _/_  __/ __/  
>>>  _/ // (7 7    // /  / / / _/    
>>> /___/\___/_/|_/___/ /_/ /___/   
>>> 
>>> ver. 1.3.2#20150717-sha1:6711d2c7
>>> 2015 Copyright(C) Apache Software Foundation
>>> 
>>> Ignite documentation: http://ignite.incubator.apache.org

15/07/30 02:26:36 INFO IgniteKernal: Config URL: n/a
15/07/30 02:26:36 INFO IgniteKernal: Daemon mode: off
15/07/30 02:26:36 INFO IgniteKernal: OS: Linux 2.6.32-358.el6.x86_64 amd64
15/07/30 02:26:36 INFO IgniteKernal: OS user: gridgain
15/07/30 02:26:36 INFO IgniteKernal: Language runtime: Scala ver. 2.10.4
15/07/30 02:26:36 INFO IgniteKernal: VM information: Java(TM) SE Runtime Environment 1.7.0_75-b13 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 24.75-b04
15/07/30 02:26:36 INFO IgniteKernal: VM total memory: 0.48GB
15/07/30 02:26:36 INFO IgniteKernal: Remote Management [restart: off, REST: on, JMX (remote: off)]
15/07/30 02:26:36 INFO IgniteKernal: IGNITE_HOME=/home/gridgain/isuntsov/gridgain-community-fabric-1.3.2/
15/07/30 02:26:36 INFO IgniteKernal: VM arguments: [-XX:MaxPermSize=128m, -Dscala.usejavacp=true, -Xms512m, -Xmx512m]
15/07/30 02:26:36 INFO IgniteKernal: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache']
15/07/30 02:26:36 INFO IgniteKernal: 3-rd party licenses can be found at: /home/gridgain/isuntsov/gridgain-community-fabric-1.3.2//libs/licenses
15/07/30 02:26:36 INFO IgniteKernal: Non-loopback local IPs: 10.20.0.221, fe80:0:0:0:21b:21ff:fe5b:eeab%6
15/07/30 02:26:36 INFO IgniteKernal: Enabled local MACs: 001B215BEEAB
15/07/30 02:26:36 INFO IgnitePluginProcessor: Configured plugins:
15/07/30 02:26:36 INFO IgnitePluginProcessor:   ^-- None
15/07/30 02:26:36 INFO IgnitePluginProcessor: 
15/07/30 02:26:36 INFO TcpCommunicationSpi: IPC shared memory server endpoint started [port=48101, tokDir=/home/gridgain/isuntsov/gridgain-community-fabric-1.3.2/work/ipc/shmem/d21417e8-1bdc-4f83-b131-b016c40d0f6a-26106]
15/07/30 02:26:36 INFO TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48101, locHost=0.0.0.0/0.0.0.0]
15/07/30 02:26:36 INFO TcpCommunicationSpi: Successfully bound to TCP port [port=47101, locHost=0.0.0.0/0.0.0.0]
15/07/30 02:26:36 WARN NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation)
15/07/30 02:26:36 WARN GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival).
15/07/30 02:26:36 WARN NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi.
15/07/30 02:26:36 INFO IgniteKernal: Security status [authentication=off]
15/07/30 02:26:36 INFO GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11212]
15/07/30 02:26:36 WARN TcpDiscoveryMulticastIpFinder: TcpDiscoveryMulticastIpFinder has no pre-configured addresses (it is recommended in production to specify at least one address in TcpDiscoveryMulticastIpFinder.getAddresses() configuration property)
15/07/30 02:26:36 WARN TcpDiscoverySpi: No addresses registered in the IP finder (will retry in 2000ms): TcpDiscoveryMulticastIpFinder [mcastGrp=228.1.2.4, mcastPort=47400, resWaitTime=500, addrReqAttempts=2, locAddr=null, super=TcpDiscoveryVmIpFinder [addrs=[], super=TcpDiscoveryIpFinderAdapter [shared=true]]]
15/07/30 02:26:39 INFO GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED]
15/07/30 02:26:39 INFO GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED]
15/07/30 02:26:39 INFO GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED]
15/07/30 02:26:39 WARN TcpCommunicationSpi: Failed to allocate shared memory segment (switching to TCP, may be slower).
15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-marshaller-sys-cache> Starting rebalancing in SYNC mode: ignite-marshaller-sys-cache
15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-marshaller-sys-cache> Completed rebalancing in SYNC mode [cache=ignite-marshaller-sys-cache, time=0 ms]
15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-atomics-sys-cache> Starting rebalancing in SYNC mode: ignite-atomics-sys-cache
15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-atomics-sys-cache> Completed rebalancing in SYNC mode [cache=ignite-atomics-sys-cache, time=0 ms]
15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-sys-cache> Starting rebalancing in SYNC mode: ignite-sys-cache
15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-sys-cache> Completed rebalancing in SYNC mode [cache=ignite-sys-cache, time=0 ms]
15/07/30 02:26:39 INFO IgniteKernal: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat}
15/07/30 02:26:39 INFO IgniteKernal: 
15/07/30 02:26:39 INFO IgniteKernal: 

>>> +----------------------------------------------------------------------+
>>> Ignite ver. 1.3.2#20150717-sha1:6711d2c799b99d7a0ae3855475cccafbf362f5dd
>>> +----------------------------------------------------------------------+
>>> OS name: Linux 2.6.32-358.el6.x86_64 amd64
>>> CPU(s): 16
>>> Heap: 0.5GB
>>> VM name: 26106@fosters-221
>>> Grid name: null
>>> Local node [ID=D21417E8-1BDC-4F83-B131-B016C40D0F6A, order=17, clientMode=true]
>>> Local node addresses: [fosters-221/0:0:0:0:0:0:0:1%1, /10.20.0.221, /127.0.0.1]
>>> Local ports: TCP:11212 TCP:47101 UDP:47400 TCP:48101 

15/07/30 02:26:39 INFO GridDiscoveryManager: Topology snapshot [ver=17, server nodes=1, client nodes=1, CPUs=16, heap=1.5GB]
ic: org.apache.ignite.spark.IgniteContext[Integer,Integer] = org.apache.ignite.spark.IgniteContext@74be0783{noformat}

*Step 5*
{noformat}
scala> val sharedRDD = ic.fromCache("partitioned")
sharedRDD: org.apache.ignite.spark.IgniteRDD[Integer,Integer] = IgniteRDD[0] at RDD at IgniteAbstractRDD.scala:31
{noformat}

*Step 6*
{noformat}
scala> sharedRDD.filter(_._2 < 10).collect()
15/07/30 02:27:58 INFO GridCacheProcessor: Started cache [name=partitioned, mode=PARTITIONED]
15/07/30 02:27:58 INFO GridDhtPreloader: <partitioned> Starting rebalancing in ASYNC mode: partitioned
15/07/30 02:27:58 INFO GridDhtPreloader: <partitioned> Completed rebalancing in ASYNC mode [cache=partitioned, time=0 ms]
15/07/30 02:27:58 INFO SparkContext: Starting job: collect at <console>:32
15/07/30 02:27:58 INFO DAGScheduler: Got job 0 (collect at <console>:32) with 1024 output partitions (allowLocal=false)
15/07/30 02:27:58 INFO DAGScheduler: Final stage: Stage 0(collect at <console>:32)
15/07/30 02:27:58 INFO DAGScheduler: Parents of final stage: List()
15/07/30 02:27:58 INFO DAGScheduler: Missing parents: List()
15/07/30 02:27:58 INFO DAGScheduler: Submitting Stage 0 (MapPartitionsRDD[1] at filter at <console>:32), which has no missing parents
15/07/30 02:27:59 INFO MemoryStore: ensureFreeSpace(2368) called with curMem=0, maxMem=278302556
15/07/30 02:27:59 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.3 KB, free 265.4 MB)
15/07/30 02:27:59 INFO MemoryStore: ensureFreeSpace(1714) called with curMem=2368, maxMem=278302556
15/07/30 02:27:59 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1714.0 B, free 265.4 MB)
15/07/30 02:27:59 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on fosters-221:51493 (size: 1714.0 B, free: 265.4 MB)
15/07/30 02:27:59 INFO BlockManagerMaster: Updated info of block broadcast_0_piece0
15/07/30 02:27:59 INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:839
15/07/30 02:27:59 INFO DAGScheduler: Submitting 1024 missing tasks from Stage 0 (MapPartitionsRDD[1] at filter at <console>:32)
15/07/30 02:27:59 INFO TaskSchedulerImpl: Adding task set 0.0 with 1024 tasks
15/07/30 02:27:59 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 1.0 in stage 0.0 (TID 1, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 2.0 in stage 0.0 (TID 2, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 3.0 in stage 0.0 (TID 3, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 4.0 in stage 0.0 (TID 4, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 5.0 in stage 0.0 (TID 5, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 6.0 in stage 0.0 (TID 6, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 7.0 in stage 0.0 (TID 7, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 8.0 in stage 0.0 (TID 8, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 9.0 in stage 0.0 (TID 9, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 10.0 in stage 0.0 (TID 10, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 11.0 in stage 0.0 (TID 11, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 12.0 in stage 0.0 (TID 12, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 13.0 in stage 0.0 (TID 13, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 14.0 in stage 0.0 (TID 14, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 15.0 in stage 0.0 (TID 15, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on fosters-221:41747 (size: 1714.0 B, free: 265.4 MB)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 16.0 in stage 0.0 (TID 16, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 17.0 in stage 0.0 (TID 17, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 18.0 in stage 0.0 (TID 18, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 19.0 in stage 0.0 (TID 19, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 20.0 in stage 0.0 (TID 20, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 WARN TaskSetManager: Lost task 5.0 in stage 0.0 (TID 5, fosters-221): class org.apache.ignite.IgniteCheckedException: Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.
	at org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:596)
	at org.apache.ignite.internal.IgnitionEx.loadConfiguration(IgnitionEx.java:640)
	at org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$1.apply(IgniteContext.scala:69)
	at org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$1.apply(IgniteContext.scala:69)
	at org.apache.ignite.spark.Once.apply(IgniteContext.scala:155)
	at org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:114)
	at org.apache.ignite.spark.impl.IgniteAbstractRDD.ensureCache(IgniteAbstractRDD.scala:37)
	at org.apache.ignite.spark.IgniteRDD.compute(IgniteRDD.scala:58)
	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
	at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
	at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
	at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
	at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
	at org.apache.spark.scheduler.Task.run(Task.scala:64)
	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.MalformedURLException: no protocol: config/default-config.xml
	at java.net.URL.<init>(URL.java:585)
	at java.net.URL.<init>(URL.java:482)
	at java.net.URL.<init>(URL.java:431)
	at org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:590)
	... 18 more

15/07/30 02:27:59 INFO TaskSetManager: Lost task 6.0 in stage 0.0 (TID 6) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 1]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 1.0 in stage 0.0 (TID 1) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 2]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 11.0 in stage 0.0 (TID 11) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 3]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 15.0 in stage 0.0 (TID 15) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 4]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 15.1 in stage 0.0 (TID 21, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 11.1 in stage 0.0 (TID 22, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 13.0 in stage 0.0 (TID 13) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 5]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 13.1 in stage 0.0 (TID 23, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 0.0 in stage 0.0 (TID 0) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 6]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 0.1 in stage 0.0 (TID 24, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 10.0 in stage 0.0 (TID 10) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 7]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 10.1 in stage 0.0 (TID 25, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 12.0 in stage 0.0 (TID 12) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 8]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 12.1 in stage 0.0 (TID 26, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 2.0 in stage 0.0 (TID 2) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 9]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 2.1 in stage 0.0 (TID 27, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 3.0 in stage 0.0 (TID 3) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 10]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 7.0 in stage 0.0 (TID 7) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 11]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 7.1 in stage 0.0 (TID 28, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 3.1 in stage 0.0 (TID 29, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 4.0 in stage 0.0 (TID 4) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 12]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 9.0 in stage 0.0 (TID 9) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 13]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 9.1 in stage 0.0 (TID 30, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 4.1 in stage 0.0 (TID 31, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 8.0 in stage 0.0 (TID 8) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 14]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 14.0 in stage 0.0 (TID 14) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 15]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 14.1 in stage 0.0 (TID 32, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 8.1 in stage 0.0 (TID 33, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 16.0 in stage 0.0 (TID 16) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 16]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 17.0 in stage 0.0 (TID 17) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 17]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 17.1 in stage 0.0 (TID 34, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 18.0 in stage 0.0 (TID 18) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 18]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 18.1 in stage 0.0 (TID 35, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 19.0 in stage 0.0 (TID 19) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 19]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 19.1 in stage 0.0 (TID 36, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 20.0 in stage 0.0 (TID 20) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 20]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 20.1 in stage 0.0 (TID 37, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 15.1 in stage 0.0 (TID 21) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 21]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 15.2 in stage 0.0 (TID 38, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 11.1 in stage 0.0 (TID 22) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 22]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 11.2 in stage 0.0 (TID 39, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 13.1 in stage 0.0 (TID 23) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 23]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 13.2 in stage 0.0 (TID 40, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 12.1 in stage 0.0 (TID 26) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 24]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 12.2 in stage 0.0 (TID 41, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 10.1 in stage 0.0 (TID 25) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 25]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 10.2 in stage 0.0 (TID 42, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 2.1 in stage 0.0 (TID 27) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 26]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 2.2 in stage 0.0 (TID 43, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 0.1 in stage 0.0 (TID 24) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 27]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 0.2 in stage 0.0 (TID 44, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 16.1 in stage 0.0 (TID 45, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 7.1 in stage 0.0 (TID 28) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 28]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 7.2 in stage 0.0 (TID 46, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 3.1 in stage 0.0 (TID 29) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 29]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 4.1 in stage 0.0 (TID 31) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 30]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 4.2 in stage 0.0 (TID 47, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 9.1 in stage 0.0 (TID 30) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 31]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 9.2 in stage 0.0 (TID 48, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 14.1 in stage 0.0 (TID 32) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 32]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 14.2 in stage 0.0 (TID 49, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 3.2 in stage 0.0 (TID 50, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 17.1 in stage 0.0 (TID 34) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 33]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 17.2 in stage 0.0 (TID 51, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 8.1 in stage 0.0 (TID 33) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 34]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 19.1 in stage 0.0 (TID 36) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 35]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 19.2 in stage 0.0 (TID 52, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 18.1 in stage 0.0 (TID 35) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 36]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 18.2 in stage 0.0 (TID 53, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 20.1 in stage 0.0 (TID 37) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 37]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 20.2 in stage 0.0 (TID 54, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 8.2 in stage 0.0 (TID 55, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 15.2 in stage 0.0 (TID 38) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 38]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 11.2 in stage 0.0 (TID 39) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 39]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 11.3 in stage 0.0 (TID 56, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 13.2 in stage 0.0 (TID 40) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 40]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 13.3 in stage 0.0 (TID 57, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 12.2 in stage 0.0 (TID 41) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 41]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 12.3 in stage 0.0 (TID 58, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 10.2 in stage 0.0 (TID 42) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 42]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 10.3 in stage 0.0 (TID 59, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 2.2 in stage 0.0 (TID 43) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 43]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 2.3 in stage 0.0 (TID 60, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 0.2 in stage 0.0 (TID 44) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 44]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 0.3 in stage 0.0 (TID 61, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 15.3 in stage 0.0 (TID 62, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 16.1 in stage 0.0 (TID 45) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 45]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 7.2 in stage 0.0 (TID 46) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 46]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 7.3 in stage 0.0 (TID 63, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 4.2 in stage 0.0 (TID 47) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 47]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 4.3 in stage 0.0 (TID 64, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Starting task 16.2 in stage 0.0 (TID 65, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 9.2 in stage 0.0 (TID 48) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 48]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 14.2 in stage 0.0 (TID 49) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 49]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 14.3 in stage 0.0 (TID 66, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 3.2 in stage 0.0 (TID 50) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 50]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 3.3 in stage 0.0 (TID 67, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 17.2 in stage 0.0 (TID 51) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 51]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 17.3 in stage 0.0 (TID 68, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 19.2 in stage 0.0 (TID 52) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 52]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 19.3 in stage 0.0 (TID 69, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 18.2 in stage 0.0 (TID 53) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 53]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 18.3 in stage 0.0 (TID 70, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 20.2 in stage 0.0 (TID 54) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 54]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 20.3 in stage 0.0 (TID 71, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 8.2 in stage 0.0 (TID 55) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 55]
15/07/30 02:27:59 INFO TaskSetManager: Starting task 8.3 in stage 0.0 (TID 72, fosters-221, NODE_LOCAL, 2152 bytes)
15/07/30 02:27:59 INFO TaskSetManager: Lost task 11.3 in stage 0.0 (TID 56) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 56]
15/07/30 02:27:59 ERROR TaskSetManager: Task 11 in stage 0.0 failed 4 times; aborting job
15/07/30 02:27:59 INFO TaskSetManager: Lost task 13.3 in stage 0.0 (TID 57) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 57]
15/07/30 02:27:59 INFO TaskSchedulerImpl: Cancelling stage 0
15/07/30 02:27:59 INFO TaskSchedulerImpl: Stage 0 was cancelled
15/07/30 02:27:59 INFO DAGScheduler: Stage 0 (collect at <console>:32) failed in 0.839 s
15/07/30 02:27:59 INFO TaskSetManager: Lost task 12.3 in stage 0.0 (TID 58) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 58]
15/07/30 02:27:59 INFO DAGScheduler: Job 0 failed: collect at <console>:32, took 1.058878 s
15/07/30 02:27:59 INFO TaskSetManager: Lost task 0.3 in stage 0.0 (TID 61) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 59]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 10.3 in stage 0.0 (TID 59) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 60]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 15.3 in stage 0.0 (TID 62) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 61]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 2.3 in stage 0.0 (TID 60) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 62]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 7.3 in stage 0.0 (TID 63) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 63]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 4.3 in stage 0.0 (TID 64) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 64]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 14.3 in stage 0.0 (TID 66) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 65]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 16.2 in stage 0.0 (TID 65) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 66]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 3.3 in stage 0.0 (TID 67) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 67]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 17.3 in stage 0.0 (TID 68) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 68]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 19.3 in stage 0.0 (TID 69) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 69]
15/07/30 02:27:59 INFO TaskSetManager: Lost task 18.3 in stage 0.0 (TID 70) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 70]
15/07/30 02:28:00 INFO TaskSetManager: Lost task 20.3 in stage 0.0 (TID 71) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 71]
15/07/30 02:28:00 INFO TaskSetManager: Lost task 8.3 in stage 0.0 (TID 72) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 72]
15/07/30 02:28:00 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool 
org.apache.spark.SparkException: Job aborted due to stage failure: Task 11 in stage 0.0 failed 4 times, most recent failure: Lost task 11.3 in stage 0.0 (TID 56, fosters-221): class org.apache.ignite.IgniteCheckedException: Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.
	at org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:596)
	at org.apache.ignite.internal.IgnitionEx.loadConfiguration(IgnitionEx.java:640)
	at org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$1.apply(IgniteContext.scala:69)
	at org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$1.apply(IgniteContext.scala:69)
	at org.apache.ignite.spark.Once.apply(IgniteContext.scala:155)
	at org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:114)
	at org.apache.ignite.spark.impl.IgniteAbstractRDD.ensureCache(IgniteAbstractRDD.scala:37)
	at org.apache.ignite.spark.IgniteRDD.compute(IgniteRDD.scala:58)
	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
	at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
	at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
	at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
	at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
	at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
	at org.apache.spark.scheduler.Task.run(Task.scala:64)
	at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.MalformedURLException: no protocol: config/default-config.xml
	at java.net.URL.<init>(URL.java:585)
	at java.net.URL.<init>(URL.java:482)
	at java.net.URL.<init>(URL.java:431)
	at org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:590)
	... 18 more

Driver stacktrace:
	at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1204)
	at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1193)
	at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1192)
	at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
	at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)
	at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1192)
	at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:693)
	at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:693)
	at scala.Option.foreach(Option.scala:236)
	at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:693)
	at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1393)
	at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1354)
	at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)

{noformat}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message