ignite-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From roshan joe <impdocs2...@gmail.com>
Subject Re: Ignite with Spark on Yarn
Date Sat, 04 Nov 2017 00:21:40 GMT
Thanks Alexey. I believe I have tried all the 4 methods you suggested below
without any success.

1. Specified the absolute path of the default-config.xml using the file:///
as well as hdfs:///

2. passed the config file as file parameter to spark-submit as

3. exported IGNITE_HOME=/..../..../apache-ignite-fabric-2.1.0-bin/ in all
the spark nodes and passed "config/default-config.xml" as relative path

4. created the config file under "src/resources/" but no luck.

Please see the complete logs.

Also, I have the default-config.xml file at the default location on all
spark nodes. Do I need to pass it in the code then? If I do not pass it, ""it
cannot find any IPs from multicast or IPFinder. "

Thank you.

On Fri, Nov 3, 2017 at 6:52 AM, Alexey Kukushkin <kukushkinalexey@gmail.com>

> Hi,
> The problem is Ignite cannot find your configuration file.
> Ignite tries these 3 steps to find configuration file:
>    1. Try to resolve it as a URI
>    2. If previous step fails, try to resolve it as $IGNITE_HOME + <the
>    path you specified>
>    3. If previous step fails, try to resolve it in CLASSPATH.
> Thus, you have multiple options to specify config path:
>    1. Specify an absolute path
>    2. Pass the config path as a command line parameter
>    3. Create your path relative to $IGNITE_HOME
>    4. If you use maven or gradle java plugin, then you can create file
>    under "resources/path-to-ignite-config.xml". On the "process
>    resources" phase maven will copy it under target/classes/path-to-ignite-config.xml"
>    and then it will go into JAR. Your app will find it by
>    "path-to-ignite-config.xml" since it will be in CLASSPATH.

View raw message