Is There An Elephant In The Cloud?
Cloud computing is currently one of the hottest areas in technology. In recent days, we’ve seen new cloud computing announcements from both Amazon (with upgrades to its EC2 computing platform) and Rackspace (who announced some acquisitions, and a whole new offering going forward). Google is in the market already with its App Engine platform. Today, Microsoft announced its cloud computing offering, called Windows Azure. Next year, Sun Microsystems will announce its cloud computing plans codenamed “Project Hydrazine” (assuming the problems the company has with its share price don’t lead to some kind of event that changes their plans). Cloud computing is an interesting value proposition for developers, and they’re are starting to use parts of these services in significant numbers. The big question is: do any cloud computing vendors have an offering that provides a complete solution for enabling people to build scalable web businesses?
The Test
Here’s what I think the test is of whether a cloud computing offering provides a complete solution. It needs to provide:
- All the hardware and software infrastructure required to serve up complex web-sites with fast load times (say less than two hundred milliseconds load time for a simple page)
- The ability to add and remove server capacity automatically and dynamically as demand rises and falls (and of course to pay only for what you use)
- To be highly available (think better than 99.5% availability)
- And… critically, to do so in a way that is much cheaper for people than buying and running their own hardware
Or, to put it more simply: would it be both possible and cost-effective to build the next Google on a given cloud computing platform, without running any hardware yourself?
If that’s the test, then – do any of the current cloud computing vendors pass? As far as I can see, they don’t. How do I know this? Simple. Sizeable Internet companies such as Digg and Facebook; and even small, ambitious start-ups such as FriendFeeed and Mahalo haven’t been rushing to move/build their entire infrastructures to/using cloud vendors. Why? For two reasons: firstly, from a technical point of view, the cloud vendors simply can’t meet their needs; secondly, even if they could, using cloud vendors would be much more expensive than running their own hardware. To be fair, Microsoft’s offering is too new to evaluate, and we don’t know what Sun’s offering will look like yet, so the situation may yet change.
Is There An Elephant In The Room Cloud?
I’m pretty sure that cloud computing vendors would want to offer all of the above if they could. Today, however, cloud computing services offer neither the required performance, nor competitive prices for running a complete web business infrastructure. The absolute best-case is they offer a good deal for some parts of operations running at particular levels of scale.
This, then, begs the question: is there an elephant in the room? That is, is the truth that there actually aren’t any significant general economies of scale in building really large virtualized compute offerings? In other words, are we witnessing a huge amount of hype around what will actually turn out, in the end, to be less than a zero sum game? I don’t know the answer. What I do know is that the cloud computing vendors seem to be some away from being where I think they need to be. They can’t even seem to get the price of RAM competitive, and that’s just a matter of buying sticks of RAM and putting them in a box. If I’m wrong on that, by the way, please point me to a cloud computing vendor that offers virtual servers with 32 or 64 GB RAM at a reasonable price; “reasonable” being, over a three year period, much less than the cost of buying the RAM outright (actually, forget about cheaper, getting close to the price would be a good start).

Mr X wrote:
Isn’t the attractive part of some of these business models that you can effectively try for free and assuming your revenue matches or exceeds the costs of the increasing scale if your successful then you need no capital to grow.
ie it’s like an alternative VC funding – they give you initial hosting for free and if you grow they get they get the money back.
There is also another interesting part of the proposition – these clouds potentially enable a long tail of web sites that make little or no money for the authors ( but who get free hosting ) but make money for Google etc.
Microsoft is different in that they are more obviously targetting enterprise and strong integration with their other offerings. You could see business related ASP being hosted on this. Obviously the worry with MS is that once you prove your onto a winner, MS copy and displace.
I haven’t looked into the details of any of these providers – the perform issue maybe be a big problem if generally true.
Finally the rise of clouds ( and yes it remains to be seen whether they will evaporate ) is critical in the future of hardware companies – apparently Dell has a division that sells to these sort of customers – if it were a separate company it would be in the top 5 of server shippers. So it’s big business, but more importantly it’s reducing the diversity of buyers – a few cloud providers rather than thousands of companies – so they will be some big winners, and big losers in the hardware provider game. Who wins may well determine who buys who – Dell buying Sun for example.
Sun are potentially well positioned but they have to execute. Will Sun rise above the clouds or will it be eclipsed?
Posted 31 Oct 2008 at 11:38 am ¶
Mr X wrote:
I do like your idea of handing off capacity to the cloud – a hybrid approach – for the standard load you do it yourself but your in a position to push traffic onto EC2 etc if you’re capacity is exceeded for some reason.
That would allow you to handle peak load smoothly without needing idle capacity that can handle that occasional spike.
Posted 31 Oct 2008 at 11:44 am ¶
simon wrote:
The problem is: the free/pay as you go cloud offerings don’t actually work well enough; and they’re not price-competitive when you need to do anything slightly serious.
From what I understand, the response time for handling requests on EC2 is just too slow if you’re serious about a responsive web-site; and also the price of systems that want to be fast by keeping loads of data in core memory (that’s why you’d want 64GB RAM in a server) isn’t competitive with any cloud vendor.
My guess is the way to get the best out of something like Amazon is:
- use S3 for some aspects of storage
- use EC2 for processing requests that don’t have to happen in real time
- push excess traffic onto EC2 if demand peaks (better to be slow than to to just have your site collapse).
I’m quite intrigued by Sun’s chip multi-threading systems. I have a feeling it’s possible to do a hell of a lot with those quite cost-effectively, but haven’t figured out the practicalities of that yet (don’t need it at the moment).
That’s where my thinking is at the moment – it could end up being wrong, and these services are changing/improving all the time. It’s still early days.
Posted 31 Oct 2008 at 12:31 pm ¶