Mailing-List: contact dev-help@mahout.apache.org; run by ezmlm
Precedence: bulk
Reply-To: dev@mahout.apache.org
Date: Tue, 20 Oct 2015 05:42:27 +0000 (UTC)
From: "ASF GitHub Bot (JIRA)" <jira@apache.org>
To: dev@mahout.apache.org
Message-ID: <JIRA.12718142.1401799681000.4655.1445319747933@Atlassian.JIRA>
In-Reply-To: <JIRA.12718142.1401799681000@Atlassian.JIRA>
References: <JIRA.12718142.1401799681000@Atlassian.JIRA>
 <JIRA.12718142.1401799681968@arcas>
Subject: [jira] [Commented] (MAHOUT-1570) Adding support for Apache Flink as
 a backend for the Mahout DSL
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 7bit


    [ https://issues.apache.org/jira/browse/MAHOUT-1570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964566#comment-14964566 ] 

ASF GitHub Bot commented on MAHOUT-1570:
----------------------------------------

Github user dlyubimov commented on the pull request:

    https://github.com/apache/mahout/pull/137#issuecomment-149438804
  
    ok i pushed that branch (which is very nicely rebased, by the way, thank you!) to apache repo. I may want to make few changes.  When i do, i will be submitting PRs against this branch in mahout repo (and commit if ok'd). 
    
     
> Adding support for Apache Flink as a backend for the Mahout DSL
> ---------------------------------------------------------------
>
>                 Key: MAHOUT-1570
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1570
>             Project: Mahout
>          Issue Type: Improvement
>            Reporter: Till Rohrmann
>            Assignee: Alexey Grigorev
>              Labels: DSL, flink, scala
>             Fix For: 0.11.1
>
>
> With the finalized abstraction of the Mahout DSL plans from the backend operations (MAHOUT-1529), it should be possible to integrate further backends for the Mahout DSL. Apache Flink would be a suitable candidate to act as a good execution backend. 
> With respect to the implementation, the biggest difference between Spark and Flink at the moment is probably the incremental rollout of plans, which is triggered by Spark's actions and which is not supported by Flink yet. However, the Flink community is working on this issue. For the moment, it should be possible to circumvent this problem by writing intermediate results required by an action to HDFS and reading from there.


--
This message was sent by Atlassian JIRA
(v6.3.4#6332)