Return-Path: X-Original-To: apmail-mahout-user-archive@www.apache.org Delivered-To: apmail-mahout-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C0D6C996A for ; Thu, 27 Oct 2011 17:40:13 +0000 (UTC) Received: (qmail 25737 invoked by uid 500); 27 Oct 2011 17:40:10 -0000 Delivered-To: apmail-mahout-user-archive@mahout.apache.org Received: (qmail 25677 invoked by uid 500); 27 Oct 2011 17:40:10 -0000 Mailing-List: contact user-help@mahout.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@mahout.apache.org Delivered-To: mailing list user@mahout.apache.org Received: (qmail 25643 invoked by uid 99); 27 Oct 2011 17:40:10 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 27 Oct 2011 17:40:10 +0000 X-ASF-Spam-Status: No, hits=-0.0 required=5.0 tests=RCVD_IN_DNSWL_NONE,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of charlescearl@me.com designates 17.148.16.105 as permitted sender) Received: from [17.148.16.105] (HELO asmtpout030.mac.com) (17.148.16.105) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 27 Oct 2011 17:40:03 +0000 MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; CHARSET=US-ASCII Received: from [192.168.1.173] (99-104-32-192.lightspeed.tukrga.sbcglobal.net [99.104.32.192]) by asmtp030.mac.com (Oracle Communications Messaging Server 7u4-23.01(7.0.4.23.0) 64bit (built Aug 10 2011)) with ESMTPSA id <0LTQ000MMJQ2F050@asmtp030.mac.com> for user@mahout.apache.org; Thu, 27 Oct 2011 10:39:42 -0700 (PDT) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:5.4.6813,1.0.211,0.0.0000 definitions=2011-10-27_05:2011-10-27,2011-10-27,1970-01-01 signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 ipscore=0 suspectscore=0 phishscore=0 bulkscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=6.0.2-1012030000 definitions=main-1110270185 Subject: Re: Monte Carlo toolkits in Mahout? References: <4B6509AB-2056-417E-8020-FD038B1E6139@me.com> From: Charles Earl X-Mailer: iPhone Mail (8L1) In-reply-to: Message-id: Date: Thu, 27 Oct 2011 13:39:35 -0400 To: "user@mahout.apache.org" X-Virus-Checked: Checked by ClamAV on apache.org Thanks. I have read R has some collab with Clodera. Is there a "mapreduce R" that is stable (apart from streaming). C On Oct 27, 2011, at 10:16 AM, Ted Dunning wrote: > If you are doing particle event simulation simply using forward inference, > then map-only tasks are just fine and almost anything will do. Mahout has > decent random number generators. > > If you want modern MCMC codes for reverse inference, I would go elsewhere. > Radford Neal has some good stuff and Andrew Gelman's group has been doing > some good work. Both of these are ultimately accessible from R. > > On Thu, Oct 27, 2011 at 7:03 AM, Charles Earl wrote: > >> Hi Ted, >> This is mostly for particle event simulation, I'll give the FOAM toolkit as >> an example >> http://jadach.home.cern.ch/jadach/Foam/Index.html >> But I'm trying to determine if there might be commonalities for other >> domains, options pricing as one. >> Yes, you are right about GNU SL. I have also wonder whether Colt or >> Parallel Colt might be worth investigating. >> Thanks >> Charles >> >> On Oct 26, 2011, at 5:47 PM, Ted Dunning wrote: >> >>> We have no significant monte carlo methods in Mahout. >>> >>> We do have a reasonable evolutionary optimizer, but randomness isn't the >>> same as a real Monte Carlo code in the sense of Metropolis-Hastings or >> Gibbs >>> sampling. >>> >>> What do you mean by "capability of GNU scientific computing library"? I >>> don't know of any significant MCMC code there either. >>> >>> In general, efficient MonteCarlo codes can be tricky to get to work in >> the >>> map-reduce paradigm. You can start multiple chains, but that doesn't >>> necessarily help if all have to spend a long time burning in. >>> >>> Can you say more about what you are looking for? >>> >>> On Wed, Oct 26, 2011 at 2:34 PM, Charles Earl >> wrote: >>> >>>> I'm interested to learn if there is a general monte carlo methods >> package >>>> that has been developed for Mahout or Hadoop. For example, having the >>>> capability of GNU scientific computing library. This might be off the >>>> machine learning focus of Mahout, but thought there might be overlap. >>>> Thanks. >>>> Charles Earl >>>> >>>> >> >>