deltacloud-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Xavier Naveira <xavier.nave...@ongame.com>
Subject Re: Deltacloud - VMWare performance
Date Wed, 24 Oct 2012 08:09:05 GMT
Hi,

I'm trying to speed up some processes that imply a high number of 
queries to the api (currently 48 at a time) by running these queries in 
parallel. I see that sometimes get (xml)parser errors and I was 
wondering, is there any default max for concurrent connections to the API?

Thank you!

Xavier

On 10/08/2012 09:47 AM, Xavier Naveira wrote:
> Hi,
>
> I completely understand that you need some extra info, I was just
> checking if there was room for improvement on your side.
>
> My application and deltacloud are in the same server, the vsphere server
> is another machine but located on the same network segment.
>
> I use different strategies depending on what I want to show. This tool
> I'm working on creates a set of 48 machines. When I want to show details
> on one machine I access the instance details, I followed the same
> strategy when I wanted to show a list with 48 machines but I realized
> this was too slow so instead I get the whole list and I filter it
> locally on my code. This is slightly faster than getting the details for
> the 48 machines one by one but still too slow, we are talking of about
> 10 secs for listing 48 machines when using the deltaclouds web interface.
>
> Right now I'm thinking of using some AJAX on my app in order to smooth
> it a little bit but I'm afraid this won't be enough when the system is
> on production and the list I'm getting from vpshere grows to the hundreds.
>
> I haven't compared this response times with querying directly to the
> vsphere server (that's why I chose deltacloud in the first place) but
> I'll be happy to do it if you can give me some directions on how to do it.
>
> Xavier
>
>
>
> On 10/05/2012 08:06 PM, David Lutterkort wrote:
>> Hi Xavier,
>>
>> On Fri, 2012-10-05 at 10:19 +0200, Xavier Naveira wrote:
>>> I hope that I'm not completely offtopic here but I'm implementing a
>>> django application that uses deltacloud to retrieve data from a vSphere
>>> 5.1 installation. Everything is working fine but I find that the time it
>>> takes to get info about the instances and the instance list itself is
>>> too long to be used in as "online polling" from my web application.
>>> Maybe it's a bit naive of me to ask but, is there any plans on improving
>>> performance of this queries? Maybe it depends on the VMWare hosts poor
>>> performace... Is there any tip on caching or paralleling or something
>>> else achievable in python to improve performance on my side?
>> what operations exactly are slow ? Are you listing all VM's or just
>> looking up the details of specific VM's ? Do you have any comparisons
>> between how long these operations take via Deltacloud and via the
>> vSphere API directly ?
>>
>> Also, how do you have the various pieces deployed ? To avoid additional
>> network overhead, your Deltacloud server should either be running close
>> to your vSphere installation or close to your app in terms of network
>> topology.
>>
>> It might well be that there are things we can do in the vSphere driver
>> to speed things up, but we'd need some more details.
>>
>> David
>>
>>
>

Mime
View raw message