predictionio-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marius Rabenarivo <mariusrabenar...@gmail.com>
Subject Re: Need a Suggessations
Date Thu, 23 Mar 2017 17:45:53 GMT
You have to copy it to a file named pio-env.sh in the same directory.

The pio-env.sh.template one is provided as an example.

You have to personalize it.

2017-03-23 21:43 GMT+04:00 Vaghawan Ojha <vaghawan781@gmail.com>:

> There is no file called pio-env.sh however there is pio-env.sh.template.
> Are they the same?
>
> On Thu, Mar 23, 2017 at 11:11 PM, Marius Rabenarivo <
> mariusrabenarivo@gmail.com> wrote:
>
>> # Default is to use PostgreSQL
>> PIO_STORAGE_REPOSITORIES_METADATA_NAME=pio_meta
>> PIO_STORAGE_REPOSITORIES_METADATA_SOURCE=MYSQL
>>
>> PIO_STORAGE_REPOSITORIES_EVENTDATA_NAME=pio_event
>> PIO_STORAGE_REPOSITORIES_EVENTDATA_SOURCE=MYSQL
>>
>> PIO_STORAGE_REPOSITORIES_MODELDATA_NAME=pio_model
>> PIO_STORAGE_REPOSITORIES_MODELDATA_SOURCE=MYSQL
>>
>>
>> 2017-03-23 21:24 GMT+04:00 Marius Rabenarivo <mariusrabenarivo@gmail.com>
>> :
>>
>>> You have to change the config in pio-env.sh to use MYSQL instead of PGSQL
>>>
>>> In the pasted response above I can read Verifying Meta Data Backend
>>> (Source: PGSQL)...
>>>
>>> 2017-03-23 21:19 GMT+04:00 Vaghawan Ojha <vaghawan781@gmail.com>:
>>>
>>>> Yes following is the response of pio status
>>>>
>>>> sudo PredictionIO-0.10.0-incubating/bin/pio status
>>>> [INFO] [Console$] Inspecting PredictionIO...
>>>> [INFO] [Console$] PredictionIO 0.10.0-incubating is installed at
>>>> /home/ekbana-php/Downloads/apache-predictionio-0.10.0-incuba
>>>> ting/PredictionIO-0.10.0-incubating
>>>> [INFO] [Console$] Inspecting Apache Spark...
>>>> [INFO] [Console$] Apache Spark is installed at
>>>> /home/ekbana-php/Downloads/apache-predictionio-0.10.0-incuba
>>>> ting/PredictionIO-0.10.0-incubating/vendors/spark-1.5.1-bin-hadoop2.6
>>>> [INFO] [Console$] Apache Spark 1.5.1 detected (meets minimum
>>>> requirement of 1.3.0)
>>>> [INFO] [Console$] Inspecting storage backend connections...
>>>> [INFO] [Storage$] Verifying Meta Data Backend (Source: PGSQL)...
>>>> [ERROR] [Console$] Unable to connect to all storage backends
>>>> successfully. The following shows the error message from the storage
>>>> backend.
>>>> [ERROR] [Console$] FATAL: password authentication failed for user "pio"
>>>> (org.postgresql.util.PSQLException)
>>>> [ERROR] [Console$] Dumping configuration of initialized storage backend
>>>> sources. Please make sure they are correct.
>>>> [ERROR] [Console$] Source Name: PGSQL; Type: jdbc; Configuration: URL
>>>> -> jdbc:postgresql://localhost/pio, PASSWORD -> pio, TYPE -> jdbc,
>>>> USERNAME -> pio
>>>>
>>>> Which says that postgresql authentication failed. Ok I'm trying to go
>>>> for postgresql this time instead of mysql, I don't wanna lose much time
>>>> fighting with this two sql. I can use any of them, it just need to work.
>>>>
>>>> Thanks
>>>>
>>>> On Thu, Mar 23, 2017 at 11:00 PM, Marius Rabenarivo <
>>>> mariusrabenarivo@gmail.com> wrote:
>>>>
>>>>> How do you start the services?
>>>>>
>>>>> The is a script named pio-start-all in $PIO_HOME/bin to do it you can
>>>>> check it to see what you have to start before using pio commands.
>>>>>
>>>>> Try doing pio status to check if all required services are running
>>>>> properly.
>>>>>
>>>>> 2017-03-23 21:04 GMT+04:00 Vaghawan Ojha <vaghawan781@gmail.com>:
>>>>>
>>>>>> Yes that's what I wanted to do, but couldn't come out to configure
>>>>>> it. No matter how much I change in the pio-env.sh.template, when
I start
>>>>>> the event server it always pops up with the posgresql error of
>>>>>> authentication.
>>>>>>
>>>>>> I even tried with posgresql and it shows the same things. Party
>>>>>> something to do with my dumbness I guess.
>>>>>>
>>>>>> Thank you very much Marius.
>>>>>>
>>>>>> On Thu, Mar 23, 2017 at 10:39 PM, Marius Rabenarivo <
>>>>>> mariusrabenarivo@gmail.com> wrote:
>>>>>>
>>>>>>> You can use MySQL as event store but you need ElasticSearch to
store
>>>>>>> the model metadata and index used by UR Engine.
>>>>>>>
>>>>>>> 2017-03-23 20:25 GMT+04:00 Vaghawan Ojha <vaghawan781@gmail.com>:
>>>>>>>
>>>>>>>> But I wanted to use mysql as default. Should I switch it?
I can do
>>>>>>>> that, but I was just wondering since the documentation says
that I could
>>>>>>>> use mysql.
>>>>>>>>
>>>>>>>> On Thu, Mar 23, 2017 at 10:03 PM, Marius Rabenarivo <
>>>>>>>> mariusrabenarivo@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> I think pio-start-all start PostgreSQL by default
>>>>>>>>>
>>>>>>>>> 2017-03-23 20:16 GMT+04:00 Vaghawan Ojha <vaghawan781@gmail.com>:
>>>>>>>>>
>>>>>>>>>> Hi,
>>>>>>>>>>
>>>>>>>>>> Yes I did that but still I get the same output, it's
weird.
>>>>>>>>>>
>>>>>>>>>> Thanks
>>>>>>>>>>
>>>>>>>>>> On Thu, Mar 23, 2017 at 10:00 PM, Marius Rabenarivo
<
>>>>>>>>>> mariusrabenarivo@gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> You have to change this section
>>>>>>>>>>>
>>>>>>>>>>> # Default is to use PostgreSQL
>>>>>>>>>>> PIO_STORAGE_REPOSITORIES_METADATA_NAME=pio_meta
>>>>>>>>>>> PIO_STORAGE_REPOSITORIES_METADATA_SOURCE=PGSQL
>>>>>>>>>>>
>>>>>>>>>>> PIO_STORAGE_REPOSITORIES_EVENTDATA_NAME=pio_event
>>>>>>>>>>> PIO_STORAGE_REPOSITORIES_EVENTDATA_SOURCE=PGSQL
>>>>>>>>>>>
>>>>>>>>>>> PIO_STORAGE_REPOSITORIES_MODELDATA_NAME=pio_model
>>>>>>>>>>> PIO_STORAGE_REPOSITORIES_MODELDATA_SOURCE=PGSQL
>>>>>>>>>>>
>>>>>>>>>>> Put MYSQL in place of PGSQL
>>>>>>>>>>>
>>>>>>>>>>> 2017-03-23 20:07 GMT+04:00 Vaghawan Ojha <vaghawan781@gmail.com>
>>>>>>>>>>> :
>>>>>>>>>>>
>>>>>>>>>>>> Hi, Thank you!
>>>>>>>>>>>>
>>>>>>>>>>>> I came into further more confusion here,
actually I installed
>>>>>>>>>>>> prediction IO version 0.10.0 from here
>>>>>>>>>>>> http://predictionio.incubator.apache.org/install/instal
>>>>>>>>>>>> l-sourcecode/  and have been fighting to
configure mysql as a
>>>>>>>>>>>> storage in my local linux machine.
>>>>>>>>>>>>
>>>>>>>>>>>> But I see there is a different documentation
of installing in
>>>>>>>>>>>> actionml website, I'm not sure for which
I would have to go. Currently
>>>>>>>>>>>> there is no "pio-env.sh".  file inside conf
folder however
>>>>>>>>>>>> there is pio-env.sh.template file. I commented
the pgsql section and
>>>>>>>>>>>> uncommented the mysql section with the username
and password, but whenever
>>>>>>>>>>>> I do . sudo PredictionIO-0.10.0-incubating/bin/pio
eventserver
>>>>>>>>>>>> there seems to be an error that says that
authentication failed with pgsql,
>>>>>>>>>>>> however I don't want to use pgsql.
>>>>>>>>>>>>
>>>>>>>>>>>> # Storage Repositories
>>>>>>>>>>>>
>>>>>>>>>>>> # Default is to use PostgreSQL
>>>>>>>>>>>> PIO_STORAGE_REPOSITORIES_METADATA_NAME=pio_meta
>>>>>>>>>>>> PIO_STORAGE_REPOSITORIES_METADATA_SOURCE=PGSQL
>>>>>>>>>>>>
>>>>>>>>>>>> PIO_STORAGE_REPOSITORIES_EVENTDATA_NAME=pio_event
>>>>>>>>>>>> PIO_STORAGE_REPOSITORIES_EVENTDATA_SOURCE=PGSQL
>>>>>>>>>>>>
>>>>>>>>>>>> PIO_STORAGE_REPOSITORIES_MODELDATA_NAME=pio_model
>>>>>>>>>>>> PIO_STORAGE_REPOSITORIES_MODELDATA_SOURCE=PGSQL
>>>>>>>>>>>>
>>>>>>>>>>>> # Storage Data Sources
>>>>>>>>>>>>
>>>>>>>>>>>> # PostgreSQL Default Settings
>>>>>>>>>>>> # Please change "pio" to your database name
in
>>>>>>>>>>>> PIO_STORAGE_SOURCES_PGSQL_URL
>>>>>>>>>>>> # Please change PIO_STORAGE_SOURCES_PGSQL_USERNAME
and
>>>>>>>>>>>> # PIO_STORAGE_SOURCES_PGSQL_PASSWORD accordingly
>>>>>>>>>>>> #PIO_STORAGE_SOURCES_PGSQL_TYPE=jdbc
>>>>>>>>>>>> #PIO_STORAGE_SOURCES_PGSQL_URL=jdbc:postgresql://localhost/pio
>>>>>>>>>>>> #PIO_STORAGE_SOURCES_PGSQL_USERNAME=pio
>>>>>>>>>>>> #PIO_STORAGE_SOURCES_PGSQL_PASSWORD=pio
>>>>>>>>>>>>
>>>>>>>>>>>> # MySQL Example
>>>>>>>>>>>>  PIO_STORAGE_SOURCES_MYSQL_TYPE=jdbc
>>>>>>>>>>>>  PIO_STORAGE_SOURCES_MYSQL_URL=jdbc:mysql://localhost/pio
>>>>>>>>>>>>  PIO_STORAGE_SOURCES_MYSQL_USERNAME=root
>>>>>>>>>>>>  PIO_STORAGE_SOURCES_MYSQL_PASSWORD=root
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> This is how the pio-env.sh.template looks
like. And again when
>>>>>>>>>>>> I visited the actionml site, it suggests
that I do have to have
>>>>>>>>>>>> ELASTICSEARCH. but prediction.io site doesn't
tells us the
>>>>>>>>>>>> same. Which one should I follow and where
would I find the current working
>>>>>>>>>>>> version of installation guide. I actually
wanaa use
>>>>>>>>>>>> prediction.io in my production shortly after
I implemented in
>>>>>>>>>>>> local.
>>>>>>>>>>>>
>>>>>>>>>>>> Please help me, thank you very much for your
help, I appreciate
>>>>>>>>>>>> it so much.
>>>>>>>>>>>> Vaghawan
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On Thu, Mar 23, 2017 at 9:27 PM, Pat Ferrel
<
>>>>>>>>>>>> pat@occamsmachete.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Since PIO has moved to Apache, the namespace
of PIO code
>>>>>>>>>>>>> changed and so all templates need to
be updated. None of the ones in
>>>>>>>>>>>>> https://github.com/PredictionIO/
>>>>>>>>>>>>> <https://github.com/PredictionIO/template-scala-parallel-universal-recommendation>
will
>>>>>>>>>>>>> work with Apache PIO. For the upgraded
UR see:
>>>>>>>>>>>>> https://github.com/actionml/universal-recommender
Docs for
>>>>>>>>>>>>> the UR are here: http://actionml.com/docs/ur
>>>>>>>>>>>>>
>>>>>>>>>>>>> Also look on the Template gallery page
here for a description
>>>>>>>>>>>>> of template status. Some have not been
moved to the new namespace and
>>>>>>>>>>>>> converted to run with PIO but this is
pretty easy to do yourself.
>>>>>>>>>>>>> http://predictionio.incubator.apache.org/gallery/t
>>>>>>>>>>>>> emplate-gallery/
>>>>>>>>>>>>>
>>>>>>>>>>>>> user_id, product_id and purchase_date
is all you need to use
>>>>>>>>>>>>> any recommender. If you plan to gather
other events in the future, use the
>>>>>>>>>>>>> UR. As far as item or user based recommendations,
the UR will give either
>>>>>>>>>>>>> based on the query with the same data
and model, as some others will do.
>>>>>>>>>>>>> The UR allows you to mix both types in
a single query, which may be useful
>>>>>>>>>>>>> with small amounts of individual user
data.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Also the accepted wisdom about this it
to put item-based recs
>>>>>>>>>>>>> on item detail pages, and user-based
recs elsewhere, when you don’t have an
>>>>>>>>>>>>> item to base recs on, or in another placement
on any page.
>>>>>>>>>>>>>
>>>>>>>>>>>>> You can have many different placements
of recs in any page by
>>>>>>>>>>>>> changing the queries. This is how Netflix
gets rows and rows of specialized
>>>>>>>>>>>>> recs for different things all based on
the same data. The UR queries are
>>>>>>>>>>>>> quite flexible.
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Mar 23, 2017, at 7:08 AM, Vaghawan
Ojha <
>>>>>>>>>>>>> vaghawan781@gmail.com> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>>
>>>>>>>>>>>>> I've been trying to deploy a recommendation
system using
>>>>>>>>>>>>> https://github.com/PredictionIO/template-scala-paralle
>>>>>>>>>>>>> l-universal-recommendation.
>>>>>>>>>>>>>
>>>>>>>>>>>>> I've purchase history of user something
like this:
>>>>>>>>>>>>> user_id, product_id and purchase_date,
so I will be using
>>>>>>>>>>>>> user_id and product_id to determine the
recommendation. I'm not sure if I
>>>>>>>>>>>>> would be able to customize the default
even parameter.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Do you have any suggestions like which
template would be more
>>>>>>>>>>>>> suitable for my problem. I don't have
data like rating or view state, I
>>>>>>>>>>>>> only have data about user and product
they purchased. I need something like
>>>>>>>>>>>>> item based similarity as well as user
based item similarity.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Any help would be great
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thank you
>>>>>>>>>>>>> Vaghawan
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>

Mime
View raw message