ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From prasanth <manch.cont...@gmail.com>
Subject Re: ignition on yarn taking up all memory
Date Fri, 19 Aug 2016 19:09:10 GMT
Nevermind, from https://github.com/apache/ignite/pull/740 , it looks like
parameters were taken off. 

The following works:
val ic = new IgniteContext(sc, "config/default-config.xml") 

Now, when I execute, the following line:

sharedRDD.filter(_._2 < 10).collect()

I get errors: 

[Stage 0:>                                                       (0 + 2) /
1024]16/08/19 19:02:02 WARN scheduler.TaskSetManager: Lost task 0.0 in stage
0.0 (TID 0, ec2.internal): class org.apache.ignite.IgniteCheckedException:
Spring XML configuration path is invalid: config/default-config.xml. Note
that this path should be either absolute or a relative local file system
path, relative to META-INF in classpath or valid URL to IGNITE_HOME.

Do I have to put the default-config.xml on all nodes of the cluster? Can I
put it in HDFS and use 
val ic = new IgniteContext(sc, "hdfs:/tmp/config/default-config.xml")
instead and get rid of the above error?

View this message in context: http://apache-ignite-users.70518.x6.nabble.com/ignition-on-yarn-taking-up-all-memory-tp7161p7174.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

View raw message