Return-Path: X-Original-To: apmail-mahout-dev-archive@www.apache.org Delivered-To: apmail-mahout-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 7883BF775 for ; Fri, 19 Apr 2013 18:33:23 +0000 (UTC) Received: (qmail 16987 invoked by uid 500); 19 Apr 2013 18:33:22 -0000 Delivered-To: apmail-mahout-dev-archive@mahout.apache.org Received: (qmail 16919 invoked by uid 500); 19 Apr 2013 18:33:22 -0000 Mailing-List: contact dev-help@mahout.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@mahout.apache.org Delivered-To: mailing list dev@mahout.apache.org Received: (qmail 16909 invoked by uid 99); 19 Apr 2013 18:33:22 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Apr 2013 18:33:22 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of robin.anil@gmail.com designates 209.85.220.177 as permitted sender) Received: from [209.85.220.177] (HELO mail-vc0-f177.google.com) (209.85.220.177) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 19 Apr 2013 18:33:16 +0000 Received: by mail-vc0-f177.google.com with SMTP id hr11so4192547vcb.36 for ; Fri, 19 Apr 2013 11:32:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:mime-version:in-reply-to:references:from:date:message-id :subject:to:content-type; bh=yPjVYTOhz4pzKdtbrco38/p+ZseXJXctJ+kAcxZwL9s=; b=JE9vNSi+EDvmBKaOrdihNk3svpYyoKgr6lmShKHS+wl+1UYB8DfyXMR2GyZBCaDHwB /R3imbOFbX9QyCyzDvL60+6uOIlAU3tzVy4lDNMQThWXN85WoLmOHJ5Nmz9lTEx8Z3aA /JavoSj/4HMzlmtJV1SFvcy8efBqQeXhs7SCbBTGaAoZURwA/iR0z3ppWnbRXV8qhgYb M+GAg+LH0y6RImOJckyq4ayowRQHM/q/ELY9lngt+PqQtmv4Oi5n9Kgzs+MexZ5QjIYT Y6pEEkIyVqD17WLZj1VQa0v7TvMsUJe1+CRCRjgp+z3BuvyGi/MpPi6700VV79cBqtL3 FXpQ== X-Received: by 10.220.151.203 with SMTP id d11mr12602892vcw.9.1366396374946; Fri, 19 Apr 2013 11:32:54 -0700 (PDT) MIME-Version: 1.0 Received: by 10.221.8.131 with HTTP; Fri, 19 Apr 2013 11:32:34 -0700 (PDT) In-Reply-To: References: From: Robin Anil Date: Fri, 19 Apr 2013 13:32:34 -0500 Message-ID: Subject: Re: Vector and Matrices - The Next Gen To: Mahout-Dev Content-Type: multipart/alternative; boundary=f46d043c7c908d6bd204dabaf248 X-Virus-Checked: Checked by ClamAV on apache.org --f46d043c7c908d6bd204dabaf248 Content-Type: text/plain; charset=UTF-8 Yes, that may be a better approach. Do we in any part of our code share the vectors across threads? Our Vector implementations are thread-unsafe. Maybe making it threadsafe or having a threadsafe version maybe one more thing we can build. Robin Anil | Software Engineer | +1 312 869 2602 | Google Inc. On Thu, Apr 18, 2013 at 6:37 PM, Ted Dunning wrote: > On Thu, Apr 18, 2013 at 1:41 PM, Robin Anil wrote: > > > 4) Parallelize operations: Use a consistent sharding function to > trivially > > parallelize certain iterative operations across multiple threads. > > > > I have done this with good results, but I find it is usually better to > thread higher up the stack because coarse threading is often easier than > fine grain threading. > --f46d043c7c908d6bd204dabaf248--