Return-Path: X-Original-To: apmail-incubator-cloudstack-dev-archive@minotaur.apache.org Delivered-To: apmail-incubator-cloudstack-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 20C1BE83F for ; Wed, 6 Mar 2013 10:16:04 +0000 (UTC) Received: (qmail 39717 invoked by uid 500); 6 Mar 2013 10:16:03 -0000 Delivered-To: apmail-incubator-cloudstack-dev-archive@incubator.apache.org Received: (qmail 39685 invoked by uid 500); 6 Mar 2013 10:16:03 -0000 Mailing-List: contact cloudstack-dev-help@incubator.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: cloudstack-dev@incubator.apache.org Delivered-To: mailing list cloudstack-dev@incubator.apache.org Received: (qmail 39662 invoked by uid 99); 6 Mar 2013 10:16:02 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Mar 2013 10:16:02 +0000 X-ASF-Spam-Status: No, hits=-0.7 required=5.0 tests=RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of salsa-dev@tut.by designates 209.85.214.53 as permitted sender) Received: from [209.85.214.53] (HELO mail-bk0-f53.google.com) (209.85.214.53) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 06 Mar 2013 10:15:57 +0000 Received: by mail-bk0-f53.google.com with SMTP id j10so279161bkw.12 for ; Wed, 06 Mar 2013 02:15:36 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=x-received:message-id:date:from:user-agent:mime-version:to:subject :references:in-reply-to:content-type:content-transfer-encoding :x-gm-message-state; bh=ujnyKQTeVXiZbcXbl1zH0qw/s4GSc+Yo3fAyWN+xZKI=; b=MM8tXjOtAdhl+p3IQy0gILmTjuy1Lq5h5nwjvPm8GQjTwg9lM/jX6pDcsv/GSDN3Fu 4H4vil1ouh5MlSDV3c8XnTVChx6RXa1RFLlSAuL5eWf8vxBVKzdt8pZJRWJPBONTUS7/ IHVCEFcmbjFa/2eXns4wxJeSn8pe8BEyAYzKyxN+QjQK1C/3yU0BJWehPhgS0Mgd8EpQ 9dP/SRVP2fDcbxDmOrdsXdyWqubk+Jry/nf1ves+j2r1T+GijJdVa86bywi567b/7ms/ Kr2ngluTon3Hqc09WQ0PEjJbo/Es7aQBGz6q7InVk41TbWkISTyphXh2hAtb+r8bsTzC u5LQ== X-Received: by 10.204.151.9 with SMTP id a9mr10889995bkw.90.1362564936076; Wed, 06 Mar 2013 02:15:36 -0800 (PST) Received: from [192.168.1.102] ([93.84.120.205]) by mx.google.com with ESMTPS id r17sm8105253bkw.21.2013.03.06.02.15.34 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 06 Mar 2013 02:15:35 -0800 (PST) Message-ID: <51371745.9080205@tut.by> Date: Wed, 06 Mar 2013 13:15:33 +0300 From: "Serge A. Salamanka" User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: cloudstack-dev@incubator.apache.org Subject: Re: Building on Cloudstack References: <5136644D.7050207@tut.by> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Gm-Message-State: ALoCoQl9hJ8i9wJx9U9YfX/A9G34KrmoHyS0Lv+ws5AFiwIv3ZFhnRd4HdgAAsENUe+9rJBiEmzs X-Virus-Checked: Checked by ClamAV on apache.org On 06.03.2013 08:50, Seif Eddine Jemli wrote: > You asked me about the scheduler i would like to implement. > > In fact, i have a school project: i have to divide matrix calculus on > several VM's, the VM's have to calculate then return the results to the > scheduler for aggregation. > The scheduler have then to send the aggregated results to the user who > typed the matrices. > > so the scheduler: > * > * > *-have to contact cloudstack and ask for X number of VM's* > *-then the vm's get work assigned to them crunch the work and return the > results to the scheduler for aggregation* > * > * > * > * > what do you think of this project? > > Is it feasible? > > Thanks in advance for your help. > The VM's by themselves are just simple OS boxes. To run some tasks on them you will need a job execution environment. There are plenty of solutions that could be used for that purpose. I'm personally looking at using IPython [1] and UNICORE [2] for accessing the computing resources provided in cloud. There is also an idea to use QosCosGrid [3] software stack but all this requires experiments with setups. We need some way to provision required resources in cloud with specially prepared VMs. This could be achieved through CloudStack API or with a help of BOSH [4]. These are just my thoughts on the subject. See how Amazon provides HPC resources [5, 6] #Serge [1] http://ipython.org/ipython-doc/rel-0.13.1/parallel/parallel_intro.html [2] http://www.unicore.eu/ [3] https://wiki.egi.eu/wiki/QosCosGrid_Platform [4] https://github.com/cloudfoundry/bosh [5] http://aws.amazon.com/hpc-applications/ [6] http://www.youtube.com/embed/YfCgK1bmCjw