Return-Path: X-Original-To: apmail-mahout-user-archive@www.apache.org Delivered-To: apmail-mahout-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 2452317949 for ; Tue, 20 Oct 2015 21:53:26 +0000 (UTC) Received: (qmail 58734 invoked by uid 500); 20 Oct 2015 21:53:24 -0000 Delivered-To: apmail-mahout-user-archive@mahout.apache.org Received: (qmail 58677 invoked by uid 500); 20 Oct 2015 21:53:24 -0000 Mailing-List: contact user-help@mahout.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@mahout.apache.org Delivered-To: mailing list user@mahout.apache.org Received: (qmail 58665 invoked by uid 99); 20 Oct 2015 21:53:24 -0000 Received: from Unknown (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 20 Oct 2015 21:53:24 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 06DF7C3BA2 for ; Tue, 20 Oct 2015 21:53:24 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 4.809 X-Spam-Level: **** X-Spam-Status: No, score=4.809 tagged_above=-999 required=6.31 tests=[BAD_CREDIT=1.658, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=3, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-us-west.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id gpCEmhXcxKul for ; Tue, 20 Oct 2015 21:53:09 +0000 (UTC) Received: from mail-vk0-f41.google.com (mail-vk0-f41.google.com [209.85.213.41]) by mx1-us-west.apache.org (ASF Mail Server at mx1-us-west.apache.org) with ESMTPS id 6B4B1206A7 for ; Tue, 20 Oct 2015 21:53:09 +0000 (UTC) Received: by vkex70 with SMTP id x70so18557648vke.3 for ; Tue, 20 Oct 2015 14:53:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=e2ATd8MTzaEgucZeUKMO2xNhFJXmaM7KOam3ZQT48pU=; b=hbkbv0ghrO2WyPGWcrdVBs0lhIeRA7FDjSmlWLZxvjCqSdP5R6cY4QMyUJUpOHSIK9 ODdpkAsBw67pUiD1enJMBvcT2+d9A6bUfVt2ad28QnyJRfODRIAI9LMP6tD3pHcL5SmJ 5dUPnrWVtx3mtN5dqCgPRvmAgM/mbXzdXL/uppG+vgRrzPXIzZVAy37KuH6QdtS0JV1Q GgLsaTwcL1l5EYjF4rwSidjo1pblrpNeBlblTYDO1sx/qKI4Uk+BwTEJpgo90lc7M8zt 4mWOQeahANGyF+UlDkvSlqeKFFLuSJYQIdNc+lEWjuIWdZqvBcgRsje3W6Hac0urr4ad 63xw== MIME-Version: 1.0 X-Received: by 10.31.33.75 with SMTP id h72mr3643627vkh.144.1445377988490; Tue, 20 Oct 2015 14:53:08 -0700 (PDT) Received: by 10.31.177.201 with HTTP; Tue, 20 Oct 2015 14:53:08 -0700 (PDT) In-Reply-To: References: Date: Tue, 20 Oct 2015 14:53:08 -0700 Message-ID: Subject: Re: Is Mahout obsolete now? From: Dmitriy Lyubimov To: "user@mahout.apache.org" Content-Type: multipart/alternative; boundary=001a11c01bca92006d0522904990 --001a11c01bca92006d0522904990 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Pavan, I guess part of the documentation difficulty is in that Mahout Samsara environment is only used for "training" but external components are used for "scoring". So it is not 100% end-to-end Mahout solution to document. Pat, it would be nice though to put some of your docs on to Mahout site though, what you think? They will be bound by Apache ICLA though after that (meaning anyone can cut-and-paste it and put it in their books, with or -- in practice -- without any attribution). On Tue, Oct 20, 2015 at 12:05 PM, Pavan K Narayanan < pavan.narayanan@gmail.com> wrote: > Perhaps this page > needs > to be updated with algorithms and features of 0.11.0? > > On 19 October 2015 at 18:29, Pat Ferrel wrote: > > > BTW this use of Mahout-Samsara on Spark for recs has really expanded. T= he > > Samsara part I=E2=80=99m calling a Correlation Engine, it can be used t= o mix > usage, > > content, and context to make recs. I look back on 2 years ago as pretty > > much groping around for solutions. Things are much clearer now (for me = at > > least) > > > > Check out some slides about the math, leading to the =E2=80=9Cwhole enc= hilada=E2=80=9D > > equation. Ted Dunning, Sean Owen, and Sebastian Schelter get no small > > credit. > > http://www.slideshare.net/pferrel/unified-recommender-39986309 > > > > Even have code running using the PredicitonIO framework. This includesa > > SDK to event store to realtime query. Loosely speaking a lambda > > architecture. Most of the whole enchilada running except the content pa= rt > > of the equation, which only works on metadata for how. > > https://github.com/pferrel/scala-parallel-universal-recommendation > > > > We even do custom versions at actionML.com > > > > > > On Oct 19, 2015, at 6:42 AM, Sean Owen wrote: > > > > No, this is pretty wrong. Spark is not, in general, a real-time > > anything. Spark Streaming is a near-real-time streaming framework, but > > it is not something you can build models with. Spark MLlib / ML are > > offline / batch. Not sure what you mean by Hadoop engine, but Spark > > does not build on MapReduce, if that's what you mean. > > > > The "classic" Mahout code (<=3D 0.9) is definitely deprecated. The "new= " > > Mahout is not. It has a fairly different new recommender system called > > Samsara. It has Scala APIs. In fact, it uses Spark. I think you're > > somehow talking about the "classic" Mahout code here only. > > > > On Mon, Oct 19, 2015 at 2:38 PM, Fei Shan > > wrote: > > > Spark is a in memory , near realtime Machine Learning frameowork , ha= s > > > scala and java interface > > > Mahout is an offline Machine Learning framework, no scala apis > > > > > > they both built on the HDFS and Hadoop engine > > > > > > Spark has an ecosystem like Hadoop > > > Mahout is part of of Hadoop ecosystem > > > > > > Spark could beat Mahout on processing speed > > > and concise programming APIs > > > > > > for online data anaysis , Spark is a better choice. > > > for offline data analysis, both fits well. > > > > > > > > > > > > On Mon, Oct 19, 2015 at 9:14 PM, Prasad Priyadarshana Fernando < > > > bppf16@gmail.com> wrote: > > > > > >> Hi, > > >> > > >> If I have used Mahout for my recommendation application, should I > > migrate > > >> into Spark MLib technology? Is the mahout still supported and > migrated? > > >> > > >> Thanks > > >> > > >> *Prasad Priyadarshana Fernando < > > http://www.linkedin.com/in/prasadfernando > > >>> * > > >> Mobile: +1 330 283 5827 > > >> > > > > > --001a11c01bca92006d0522904990--