Return-Path: X-Original-To: archive-asf-public-internal@cust-asf2.ponee.io Delivered-To: archive-asf-public-internal@cust-asf2.ponee.io Received: from cust-asf.ponee.io (cust-asf.ponee.io [163.172.22.183]) by cust-asf2.ponee.io (Postfix) with ESMTP id 6E5DF200BF8 for ; Fri, 13 Jan 2017 18:40:37 +0100 (CET) Received: by cust-asf.ponee.io (Postfix) id 6CE26160B3F; Fri, 13 Jan 2017 17:40:37 +0000 (UTC) Delivered-To: archive-asf-public@cust-asf.ponee.io Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by cust-asf.ponee.io (Postfix) with SMTP id B6D00160B2E for ; Fri, 13 Jan 2017 18:40:36 +0100 (CET) Received: (qmail 6517 invoked by uid 500); 13 Jan 2017 17:40:34 -0000 Mailing-List: contact user-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@hadoop.apache.org Received: (qmail 6505 invoked by uid 99); 13 Jan 2017 17:40:34 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 13 Jan 2017 17:40:34 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id DC703C062B for ; Fri, 13 Jan 2017 17:40:33 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.498 X-Spam-Level: ** X-Spam-Status: No, score=2.498 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=usc-edu.20150623.gappssmtp.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id OEQ6F6QCMsB4 for ; Fri, 13 Jan 2017 17:40:32 +0000 (UTC) Received: from mail-vk0-f43.google.com (mail-vk0-f43.google.com [209.85.213.43]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 09EA35F3A1 for ; Fri, 13 Jan 2017 17:40:32 +0000 (UTC) Received: by mail-vk0-f43.google.com with SMTP id x75so37969896vke.2 for ; Fri, 13 Jan 2017 09:40:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=usc-edu.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to:cc; bh=+DAdBdvB+/ykC2RhDGPQQhnw87rKKzf2rbvF5g0RmQ4=; b=U4h9itTSyQzyDRGrSdTiLPRPnM7RUNyE+ysQpQDfUD1ssWBZiLepQKa9e8Rr67rqaU FFLqvJvjgrF0RafKRv4KjIDBoQu6NSfN/ewdxqmzoQj+O+x0K7Gh0vtuVgYrxuOuI5yi /eaDpIorJwe2kp6CQQbiFQ/DNa+mSM/w+MHV/w/dyO4WgScd2N1vWt/WSMRGiB5plXCc BhgvFuG4oew1pSv23axo+tZAUl9vFB8TF2jh0REB/CDsn0xEuk5ckcNgIdJKjxz5NM+v 6FxjfiboxjylFDd5WiTYdH2pBUL2TX9cQTR1H9wW8UaJQvz1ahbV6LOBl5erFRv9zZde mW5Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc; bh=+DAdBdvB+/ykC2RhDGPQQhnw87rKKzf2rbvF5g0RmQ4=; b=ugZoIWNecs1KrlvS2o2n1Mqf3V0Aho6PasMQt4bqEsr6t7vVl9xrjuLMCFeTODCpNg wuUbaYYPwRB79aO076t+Jx12ZcONlVZ+qh5yayQvV2CNWWf0/itlIAFswnkvOcQ4G6uL bu1L3q8yeKtrodetuOsF8Z6m7G42j/IPdDfRU1n4W5EwrfPNU22sM1vIlj4Zs9OENODp Bi/UXsnNu0F6FPrO8hQZRr+oXXeO0V5ioG80gPGT9IcYyJxe4htCL2kx44WU8oKLPg7Q lwr9vGC6jtt0hmFKnb6hJ6SU4jkFe1BTOLSFCRattfLQSnveFb2wM/OXicZp75/cMxuw gaJQ== X-Gm-Message-State: AIkVDXIi8TH7gK01xcUUPpWQlK5gbRa7L7wTNqNV2XTBHFU6lvUubzR3/CZs04lMazbamSXJTQ0ultbIsSV9qhN9 X-Received: by 10.31.114.133 with SMTP id n127mr10488012vkc.129.1484329231133; Fri, 13 Jan 2017 09:40:31 -0800 (PST) MIME-Version: 1.0 Received: by 10.103.50.15 with HTTP; Fri, 13 Jan 2017 09:40:10 -0800 (PST) From: Madhav Sharan Date: Fri, 13 Jan 2017 09:40:10 -0800 Message-ID: Subject: Does anyone know how to use caffe through hadoop MR jobs? To: user Cc: Chris Mattmann Content-Type: multipart/alternative; boundary=94eb2c1497b48d446a0545fd5478 archived-at: Fri, 13 Jan 2017 17:40:37 -0000 --94eb2c1497b48d446a0545fd5478 Content-Type: text/plain; charset=UTF-8 Hi hadoop users - I am trying to extract features from some thousands of videos. I want to try caffe and utilize multiple GPU. As caffe is a python library I am not sure if I can couple it with hadoop and run multiple feature extraction jobs in parallel on a hadoop cluster. Will be great if someone who has experience with caffe and hadoop can share their thoughts on this. Our project is at [0] in case more detail on use case is required. [0] - https://github.com/USCDataScience/hadoop-pot/ Thanks -- Madhav Sharan --94eb2c1497b48d446a0545fd5478 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi hadoop users -

I am trying to extrac= t features from some thousands of videos. I want to try caffe and utilize m= ultiple GPU. As caffe is a python library I am not sure if I can couple it = with hadoop and run multiple feature extraction jobs in parallel on a hadoo= p cluster.

Will be great if someone who has experi= ence with caffe and hadoop can share their thoughts on this. Our project is= at [0] in case more detail on use case is required.

[0] -=C2=A0htt= ps://github.com/USCDataScience/hadoop-pot/

Tha= nks
<= div>
--<= /div>
Madhav Sharan

--94eb2c1497b48d446a0545fd5478--