hivemall-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Makoto Yui (Jira)" <j...@apache.org>
Subject [jira] [Commented] (HIVEMALL-134) Create Stanalone API for Scala/Java
Date Sat, 25 Apr 2020 08:17:00 GMT

    [ https://issues.apache.org/jira/browse/HIVEMALL-134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17092125#comment-17092125
] 

Makoto Yui commented on HIVEMALL-134:
-------------------------------------

[~Tammik]

Implementing simple [Estimator interface|https://github.com/myui/mli4j/blob/master/src/main/java/antml/Estimator.java]
and calling it from python using [py4j|https://github.com/bartdag/py4j] is my current plan.

Then, we can leverage scikit and python stacks.

Some Hivemall users are exporting linear models (feature/weight generated by GeneralClassifier)
using SQL and running prediction in Python. 

Here is an example to create CSR matrix from Hive table.
https://gist.github.com/myui/8724902af53491201a34dba01071c88e

> Create Stanalone API for Scala/Java
> -----------------------------------
>
>                 Key: HIVEMALL-134
>                 URL: https://issues.apache.org/jira/browse/HIVEMALL-134
>             Project: Hivemall
>          Issue Type: Wish
>            Reporter: Makoto Yui
>            Priority: Major
>
> Standalone API of Hivemall would be useful for standalone application with enough local
memory.
> A good example of a standalone API is Smile's Scala API.
> https://haifengl.github.io/smile/
> https://github.com/haifengl/smile/tree/master/scala/src/main/scala/smile



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message