Ok, good. Based on the comparison of perf numbers, and Ted's experience
with large instances on ec2 running zk, this makes sense to me. A large
is about half (very roughly) the horsepower of what I was using for my
tests. Ted mentioned that he hasn't seen issues on ec2 running with
large instances and that correlates to these numbers (again, this is all
rough back of the envelope type stuff but good enough imo).
Anyone have a small that they could run the same cpu/disk/network tests?
I'd be interested to see how that stacks up.
Ted, could you provide your configuration information for the cluster
(incl the client timeout you use), if you're willing I'd be happy to put
this up on the wiki for others interested in running in EC2.
Thanks!
Patrick
Ted Dunning wrote:
> I only have one large instance live. My impression from previously is that
> between host bandwidth is generally about what you saw. We have been able
> to sustain 20-30MB/s into EC2 to a single node which should be harder than
> moving data between nodes. I have heard rumors that others were able to get
> double what I got for incoming transfer.
>
> On Mon, Nov 9, 2009 at 9:47 PM, Patrick Hunt <phunt@apache.org> wrote:
>
>> Could you test networking - scping data between hosts? (I was seeing
>> 64.1MB/s for a 512mb file - the one created by dd, random data)
>>
>
>
>
|