systemml-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From dusenberr...@gmail.com
Subject Re: Setting up python3 dev environment
Date Sun, 10 Sep 2017 07:47:01 GMT
Hi Krishna,

When using a dev install of the package with `pip3 install -e .`, you just need to supply
the jar when you start Spark, i.e., `spark-submit script.py --jars SystemML.jar`.

When we package up the Python package officially for PyPy, we include the jar file inside
the package so that the user doesn't have to bother with the jar at runtime.  That build can
be created using the command Niketan shared.  However, for a live-edit dev install of the
package, it's up to the user to supply the jar.


- Mike

--

Mike Dusenberry
GitHub: github.com/dusenberrymw
LinkedIn: linkedin.com/in/mikedusenberry

Sent from my iPhone.


> On Sep 9, 2017, at 9:15 PM, Niketan Pansare <npansar@us.ibm.com> wrote:
> 
> 
> 
> Hi Krishna,
> 
> I would recommend installing SystemML using our Python package:
> mvn -P distribution package
> pip install target/systemml-*-python.tgz
> 
> Thanks
> 
> Niketan
> 
>> On Sep 9, 2017, at 8:10 PM, Krishna Kalyan <krishnakalyan3@gmail.com>
> wrote:
>> 
>> Hello,
>> I have problems setting up dev environment to work with python DML.
>> 
>> Step taken:
>> 
>> cd systemml
>> mvn clean package
>> cd src/main/python/
>> sudo pip3 install -e .
>> 
>> Sample Code that I ran,
>> 
>> #!/usr/bin/env python3
>> 
>> import numpy as np
>> import systemml as sml
>> from pyspark import SparkContext
>> 
>> sc = SparkContext("local")
>> ml = sml.MLContext(sc)
>> m1 = sml.matrix(np.ones((3, 3)) + 2)
>> 
>> 
>> Error:
>> 
> https://urldefense.proofpoint.com/v2/url?u=https-3A__gist.github.com_krishnakalyan3_efa93053a1c4fa88fa2569c71ff24069&d=DwIBaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=HzVC6v79boGYQrpc383_Kao_6a6SaOkZrfiSrYZVby0&m=T_BG3WMxC61WSOK_M_wXwR7Q5rW_n4Smkg2QE2UrmsM&s=_WAiZb9HlxstPpJ1zAYCQ6G7UoVTK32PHxJF9dAuu2M&e=
> 
>> (TypeError: 'JavaPackage' object is not callable)
>> 
>> Some Questions
>> a) How can I resolve this error?.
>> b) Can I use MLContext context in standalone mode?.
>> 
>> Basically I want to work on this
>> 
> https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_SYSTEMML-2D976&d=DwIBaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=HzVC6v79boGYQrpc383_Kao_6a6SaOkZrfiSrYZVby0&m=T_BG3WMxC61WSOK_M_wXwR7Q5rW_n4Smkg2QE2UrmsM&s=m8jthKacmPerBpc8VKP4n0C15-zZolydkjBivqy51ZQ&e=
.
> So that I can test my
>> changes.
>> 
>> Thank you so much,
>> Krishna

Mime
  • Unnamed multipart/alternative (inline, 7-Bit, 0 bytes)
View raw message