Mailing-List: contact user-help@predictionio.apache.org; run by ezmlm
Precedence: bulk
Reply-To: user@predictionio.apache.org
MIME-Version: 1.0
In-Reply-To: <CA+VXBtsv-ewK2aUx3e+VqK-xdrenrdcKUBeo_PG=aUZvtSOZsw@mail.gmail.com>
References: <CA+VXBtsv-ewK2aUx3e+VqK-xdrenrdcKUBeo_PG=aUZvtSOZsw@mail.gmail.com>
From: Donald Szeto <donald@apache.org>
Date: Tue, 21 Nov 2017 11:28:40 -0800
Message-ID: <CAD8z1JL3xzv-E5eGfbAYOf2FqfughNevt-H2zDqw9tQORaoKVQ@mail.gmail.com>
Subject: Re: pio batchpredict fix & changes
To: user@predictionio.apache.org
Content-Type: multipart/alternative; boundary="001a114fc8320cde65055e833781"
archived-at: Tue, 21 Nov 2017 19:29:03 -0000

--001a114fc8320cde65055e833781
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hi Mars,

Thanks for the PR! I am still reviewing the code change, but at the high
level it will take away the ability to run "batchpredict" remotely on a
Spark cluster + HDFS/S3 setup, and requires extra steps of downloading
input and uploading output files for such setup. It will unlikely scale to
much larger dataset.

That said, this is a very important and convenient feature. I'll help make
it as good as possible.

Regards,
Donald

On Mon, Nov 20, 2017 at 10:21 AM, Mars Hall <mars.hall@salesforce.com>
wrote:

> Hi PIO folks!
>
> Curious to hear from anyone using the new (as of PredictionIO 0.12.0)
> batch predict command.
>
>    - Do you use `pio batchpredict`?
>    - What is your use-case? (Which Engine template or algorithm?)
>    - Does it work for your use-case? (Details please)
>
> Batch predict is currently broken for engines using a custom
> PersistentModel. I've been working on a fix for this issue:
>   https://github.com/apache/incubator-predictionio/pull/447
>
> Because that changeset alters the way the command works, I'd appreciate
> feedback on that pull request. *Especially if you use `pio batchpredict`
> today*, please try it out, and post feedback to that Github issue.
>
> Thanks for your attention =F0=9F=98=84
>
> --
> *Mars Hall
> Customer Facing Architect
> Salesforce Platform / Heroku
> San Francisco, California
>

--001a114fc8320cde65055e833781
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi Mars,<div><br></div><div>Thanks for the PR! I am still =
reviewing the code change, but at the high level it will take away the abil=
ity to run &quot;batchpredict&quot; remotely on a Spark cluster + HDFS/S3 s=
etup, and requires extra steps of downloading input and uploading output fi=
les for such setup. It will unlikely scale to much larger dataset.</div><di=
v><br></div><div>That said, this is a very important and convenient feature=
. I&#39;ll help make it as good as possible.</div><div><br></div><div>Regar=
ds,</div><div>Donald</div></div><div class=3D"gmail_extra"><br><div class=
=3D"gmail_quote">On Mon, Nov 20, 2017 at 10:21 AM, Mars Hall <span dir=3D"l=
tr">&lt;<a href=3D"mailto:mars.hall@salesforce.com" target=3D"_blank">mars.=
hall@salesforce.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quo=
te" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"=
><div dir=3D"ltr"><div>Hi PIO folks!</div><div><br></div><div>Curious to he=
ar from anyone using the new (as of PredictionIO 0.12.0) batch predict comm=
and.=C2=A0</div><div><ul><li>Do you use `pio batchpredict`?</li><li>What is=
 your use-case? (Which Engine template or algorithm?)</li><li>Does it work =
for your use-case? (Details please)</li></ul></div><div>Batch predict is cu=
rrently broken for engines using a custom PersistentModel. I&#39;ve been wo=
rking on a fix for this issue:</div><div>=C2=A0 <a href=3D"https://github.c=
om/apache/incubator-predictionio/pull/447" target=3D"_blank">https://github=
.com/apache/<wbr>incubator-predictionio/pull/<wbr>447</a><br></div><div><di=
v><br></div><div>Because that changeset alters the way the command works, I=
&#39;d appreciate feedback on that pull request.=C2=A0<b>Especially if you =
use `pio batchpredict` today</b>, please try it out, and post feedback to t=
hat Github issue.</div><div><br></div><div>Thanks for your attention =F0=9F=
=98=84<span class=3D"HOEnZb"><font color=3D"#888888"><br clear=3D"all"><div=
><br></div>-- <br><div class=3D"m_-3815680159309339644gmail_signature"><div=
 dir=3D"ltr"><div><div dir=3D"ltr"><div>*Mars Hall</div><div>Customer Facin=
g Architect</div><div>Salesforce Platform / Heroku</div><div>San Francisco,=
 California</div></div></div></div></div>
</font></span></div></div></div>
</blockquote></div><br></div>

--001a114fc8320cde65055e833781--