systemml-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Krishna Kalyan <krishnakaly...@gmail.com>
Subject Re: PCA data gen script, no output
Date Sat, 16 Sep 2017 06:08:51 GMT
Thanks for the reply,
I have tested with systemml-standalone.py too. I am still faced with the
same problem. Currently my spark is configured to work on local fs instead
of HDFS hence I did not have a problem with the ~.

Regards,
Krishna




On Sat, Sep 16, 2017 at 7:24 AM, Matthias Boehm <mboehm7@googlemail.com>
wrote:

> well, I don't think any HDFS fs implementation resolves '~' - so it has
> probably created a directory called '~/open-source/scripts/PCA_data' in
> your user path in HDFS or current directory in local FS.
>
> Regards,
> Matthias
>
> On Fri, Sep 15, 2017 at 5:47 PM, Krishna Kalyan <krishnakalyan3@gmail.com>
> wrote:
>
> > Hello,
> > I using PCA
> > <https://github.com/apache/systemml/blob/master/scripts/
> > datagen/genRandData4PCA.dml>
> > data
> > generation scripts to generate data. Unfortunately they do not produce
> any
> > output in the specified target directory.
> >
> > Command used:
> >
> > systemml/bin/systemml-spark-submit.py -f genRandData4PCA.dml -nvargs
> > R=1000000 C=1000 OUT=~/open-source/scripts/PCA_data
> >
> > logs
> > https://gist.github.com/krishnakalyan3/70796b13735743886e41d3da6b75d7d5
> >
> > This job also does not throw any errors during exection.
> >
> > Thank you so much,
> > Krishna
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message