Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 131B8200C3A for ; Fri, 31 Mar 2017 09:52:56 +0200 (CEST) Received: by cust-asf.ponee.io (Postfix) id 11932160B8C; Fri, 31 Mar 2017 07:52:56 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id 03CE3160B80 for ; Fri, 31 Mar 2017 09:52:54 +0200 (CEST) Received: (qmail 87272 invoked by uid 500); 31 Mar 2017 07:52:54 -0000 Mailing-List: contact user-help@predictionio.incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@predictionio.incubator.apache.org Delivered-To: mailing list user@predictionio.incubator.apache.org Received: (qmail 87262 invoked by uid 99); 31 Mar 2017 07:52:54 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 31 Mar 2017 07:52:54 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 9427EC0750 for ; Fri, 31 Mar 2017 07:52:53 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.353 X-Spam-Level: X-Spam-Status: No, score=0.353 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, JMQ_TRACKER=0.5, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-2.796, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id VLF44JpYvfPs for ; Fri, 31 Mar 2017 07:52:51 +0000 (UTC) Received: from mail-io0-f173.google.com (mail-io0-f173.google.com [209.85.223.173]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 143F65F666 for ; Fri, 31 Mar 2017 07:52:51 +0000 (UTC) Received: by mail-io0-f173.google.com with SMTP id f84so34710538ioj.0 for ; Fri, 31 Mar 2017 00:52:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=s+SVhkkmLKgiFpTjTX62/RC+ZhFHx/KQqyNW3WDlJXA=; b=btX3F8H/jIBsJGAX6h4sbhVQ88+OlubsLjEk55gtPuuLIeYV79ZZoMc3nulwReBQ6f HMvmXW3Se1YoZaP0FI09kcM1dVo9oqeePyOktsOGcW7LcYURerz9ZRqKHDEqxk0uEFkv Qu/XJ5wSSuLCVyQ+fDIdBYZRoF6i5MP4+sCZGRAjMAwHVPCyt7ektIsoHuQCDvgRy8Cr QROgv51bg25NKh+DW9pC25jYpr8GsadJThFoddIv13Lg7bD7Aq1iIV9lBAMKcyS7srZT RojDvZgSovAj028Hd94rNXeonOpQgJ0p/6jf0R1wommbBlGKfPtb2TeYm2XaMWQL4wR1 +nhQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=s+SVhkkmLKgiFpTjTX62/RC+ZhFHx/KQqyNW3WDlJXA=; b=P1Xoh5hwPF6VqC6rXKZymMP1zsEb77SQiL55l/ITMIAGlWq5MnCOfMlZJguq3PhaU/ A16yo5vOgqENt0melOjOxla7Waxtp0ML+jzBc/oe9rm5RktwpT1l6ek2H8Blf0qyjErb MB81rGqUflJKG5Tr+Gu3kFLhZRnkhzbiYUaetFn8fcfpeKJftH9pWj5/g617BuyZQa6b spFyGBoIfMoVeZ14/nxdCVp4v4ym/ClpZX/ZnBQFFpHUTKo3J1JQD1utmXRMdC4XMbIV YufB+Txt3CGel84EJKrq8l9AFTCmXX1Xv5sEDVTfZb9KljBlNoc5BRTvdz7OxselDtsx fBeA== X-Gm-Message-State: AFeK/H1rcTrcD7QWfP1IJ172ZTvq2YhRe82/wSkDG6Ev3lGl+pZCYkQGEDHNWO70+YG7UPFPPbU1IdG9INYp2A== X-Received: by 10.107.176.79 with SMTP id z76mr1694140ioe.223.1490946769947; Fri, 31 Mar 2017 00:52:49 -0700 (PDT) MIME-Version: 1.0 Received: by 10.107.6.219 with HTTP; Fri, 31 Mar 2017 00:52:49 -0700 (PDT) In-Reply-To: References: From: Vaghawan Ojha Date: Fri, 31 Mar 2017 13:37:49 +0545 Message-ID: Subject: Re: Empty result even though there are events To: user@predictionio.incubator.apache.org, actionml-user Content-Type: multipart/alternative; boundary=001a114520449a1333054c0218a5 archived-at: Fri, 31 Mar 2017 07:52:56 -0000 --001a114520449a1333054c0218a5 Content-Type: text/plain; charset=UTF-8 More info: I don't have the secondary event like "View" in my data, I just don't collect the view event, since I'm using old purchased history of the user. With integration test data everything is Ok, but with my real data, it's not. All the data looks like this with varying item_id and user_id. There is no view events. {"entityId":"00068116","entityType":"user","event":"purchase","targetEntityType":"item","targetEntityId":"BM8941"} {"entityId":"00068116","entityType":"user","event":"purchase","targetEntityType":"item","targetEntityId":"BM8920"} {"entityId":"00088894","entityType":"user","event":"purchase","targetEntityType":"item","targetEntityId":"BM66336"} {"entityId":"00097710","entityType":"user","event":"purchase","targetEntityType":"item","targetEntityId":"BM42110"} {"entityId":"00097710","entityType":"user","event":"purchase","targetEntityType":"item","targetEntityId":"BM61833"} {"entityId":"00097710","entityType":"user","event":"purchase","targetEntityType":"item","targetEntityId":"BM65826"} {"entityId":"00097710","entityType":"user","event":"purchase","targetEntityType":"item","targetEntityId":"BM40182"} {"entityId":"00097710","entityType":"user","event":"purchase","targetEntityType":"item","targetEntityId":"BM5001"} Is my data wrong? I am able to successfully train and deploy the engine. On Fri, Mar 31, 2017 at 11:40 AM, Vaghawan Ojha wrote: > I've 50000 transection data for experiment. I don't think it's the data > because with the same data I could get recommendation using Recommendation > template. > > On Fri, Mar 31, 2017 at 11:29 AM, Vaghawan Ojha > wrote: > >> Hi, >> >> I imported the bulk data using pio import --appid (id) --input data.json >> . The import was successful, then I build and trained and deployed the UR, >> but when I query the server, it always returns a empty >> json {"itemScores":[]} . >> >> >> I think, I must be missing something in the config, here is my >> engine.json >> >> { >> "comment":" This config file uses default settings for all but the >> required values see README.md for docs", >> "id": "default", >> "description": "Default settings", >> "engineFactory": "org.template.RecommendationEngine", >> "datasource": { >> "params" : { >> "name": "sample-handmade-data.txt", >> "appName": "handmade", >> "eventNames": ["purchase", "view"] >> } >> }, >> "sparkConf": { >> "spark.serializer": "org.apache.spark.serializer.KryoSerializer", >> "spark.kryo.registrator": "org.apache.mahout.sparkbindings.io >> .MahoutKryoRegistrator", >> "spark.kryo.referenceTracking": "false", >> "spark.kryoserializer.buffer": "300m", >> "es.index.auto.create": "true" >> }, >> "algorithms": [ >> { >> "comment": "simplest setup where all values are default, popularity >> based backfill, must add eventsNames", >> "name": "ur", >> "params": { >> "appName": "handmade", >> "indexName": "urindex", >> "typeName": "items", >> "comment": "must have data for the first event or the model will >> not build, other events are optional", >> "indicators": [ >> { >> "name": "purchase" >> },{ >> "name": "view", >> "maxCorrelatorsPerItem": 50 >> } >> ], >> "availableDateName": "available", >> "expireDateName": "expires", >> "dateName": "date", >> "num": 4 >> } >> } >> ] >> } >> >> is the data supposed to come from the sample-handmade-data.txt? I'm not >> sure this is weird. My json data import and trains correctly without an >> error. And example integration runs fine. >> > > --001a114520449a1333054c0218a5 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
More info: I don't have the secondary event like "= ;View" in my data, I just don't collect the view event, since I= 9;m using old purchased history of the user.=C2=A0

With = integration test data everything is Ok, but with my real data, it's not= .=C2=A0 All the data looks like this with varying item_id and user_id. Ther= e is no view events.=C2=A0

{"entityId&qu= ot;:"00068116","entityType":"user","even= t":"purchase","targetEntityType":"item",= "targetEntityId":"BM8941"}
{"entityId&qu= ot;:"00068116","entityType":"user","even= t":"purchase","targetEntityType":"item",= "targetEntityId":"BM8920"}
{"entityId&qu= ot;:"00088894","entityType":"user","even= t":"purchase","targetEntityType":"item",= "targetEntityId":"BM66336"}
{"entityId&q= uot;:"00097710","entityType":"user","eve= nt":"purchase","targetEntityType":"item"= ,"targetEntityId":"BM42110"}
{"entityId&= quot;:"00097710","entityType":"user","ev= ent":"purchase","targetEntityType":"item"= ;,"targetEntityId":"BM61833"}
{"entityId= ":"00097710","entityType":"user","e= vent":"purchase","targetEntityType":"item&quo= t;,"targetEntityId":"BM65826"}
{"entityI= d":"00097710","entityType":"user","= event":"purchase","targetEntityType":"item&qu= ot;,"targetEntityId":"BM40182"}
{"entity= Id":"00097710","entityType":"user","= ;event":"purchase","targetEntityType":"item&q= uot;,"targetEntityId":"BM5001"}

Is my data wrong? I am able to successfully =C2=A0train and deploy = the engine.=C2=A0

On Fri, Mar 31, 2017 at 11:40 = AM, Vaghawan Ojha <vaghawan781@gmail.com> wrote:
I've 50000 transection data= for experiment. I don't =C2=A0think it's the data because with the= same data I could get recommendation using Recommendation template.=C2=A0<= img src=3D"http://t.sidekickopen69.com/e1t/o/5/f18dQhb0S7ks8dDMPbW2n0x6l2B9= gXrN7sKj6v5dpCFVdnscn3M2z18W63Bb_s3LvrVvW3ZBnHX1k1H6H0?si=3D511028666735001= 6&pi=3D6b2321bc-88e1-4d6a-c2db-b310a363058c" style=3D"display:none!impo= rtant" height=3D"1" width=3D"1">

On Fri, Mar 31= , 2017 at 11:29 AM, Vaghawan Ojha <vaghawan781@gmail.com> wrote:
Hi,=C2=A0
<= br>
I imported the bulk data using pio import --appid (id) --inpu= t =C2=A0data.json . The import was successful, then I build and trained and= deployed the UR, but when I query the server, it always returns a empty js= on=C2=A0{"itemScores":[]} .=C2=A0


I think, =C2=A0I must be missing something in the config, here is = my engine.json=C2=A0

{
=C2=A0 "= ;comment":" This config file uses default settings for all but th= e required values see README.md for docs",
=C2=A0 "id&q= uot;: "default",
=C2=A0 "description": "= Default settings",
=C2=A0 "engineFactory": "o= rg.template.RecommendationEngine",
=C2=A0 "datasou= rce": {
=C2=A0 =C2=A0 "params" : {
=C2= =A0 =C2=A0 =C2=A0 "name": "sample-handmade-data.txt",
=C2=A0 =C2=A0 =C2=A0 "appName": "handmade",
=C2=A0 =C2=A0 =C2=A0 "eventNames": ["purchase",= "view"]
=C2=A0 =C2=A0 }
=C2=A0 },
= =C2=A0 "sparkConf": {
=C2=A0 =C2=A0 "spark.seriali= zer": "org.apache.spark.serializer.KryoSerializer",
=C2=A0 =C2=A0 "spark.kryo.registrator": "org.apache.m= ahout.sparkbindings.io.MahoutKryoRegistrator",
=C2=A0 =C2=A0 "spark= .kryo.referenceTracking": "false",
=C2=A0 =C2= =A0 "spark.kryoserializer.buffer": "300m",
= =C2=A0 =C2=A0 "es.index.auto.create": "true"
= =C2=A0 },
=C2=A0 "algorithms": [
=C2=A0 =C2= =A0 {
=C2=A0 =C2=A0 =C2=A0 "comment": "simplest se= tup where all values are default, popularity based backfill, must add event= sNames",
=C2=A0 =C2=A0 =C2=A0 "name": "ur&quo= t;,
=C2=A0 =C2=A0 =C2=A0 "params": {
=C2=A0 = =C2=A0 =C2=A0 =C2=A0 "appName": "handmade",
= =C2=A0 =C2=A0 =C2=A0 =C2=A0 "indexName": "urindex",
=C2=A0 =C2=A0 =C2=A0 =C2=A0 "typeName": "items",=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 "comment": "must have= data for the first event or the model will not build, other events are opt= ional",
=C2=A0 =C2=A0 =C2=A0 =C2=A0 "indicators": = [
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 {
=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 "name": "purchase"
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 },{
=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 "name": "view",
=C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 "maxCorrelatorsPerItem": 50
=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 }
=C2=A0 =C2=A0 =C2=A0 = =C2=A0 ],
=C2=A0 =C2=A0 =C2=A0 =C2=A0 "availableDateName&quo= t;: "available",
=C2=A0 =C2=A0 =C2=A0 =C2=A0 "expi= reDateName": "expires",
=C2=A0 =C2=A0 =C2=A0 =C2= =A0 "dateName": "date",
=C2=A0 =C2=A0 =C2=A0 = =C2=A0 "num": 4
=C2=A0 =C2=A0 =C2=A0 }
=C2=A0= =C2=A0 }
=C2=A0 ]
}

is = the data supposed to come from the sample-handmade-data.txt? I'm not su= re this is weird. My json data import and trains correctly without an error= . And example integration runs fine.
=


--001a114520449a1333054c0218a5--