Load Balancing & Redundancy in the Cloud

Stephen Spector, Cloud Evangelist, Dell | 5/18/2012 | 23 comments

Stephen Spector
In my recent blog on how virtualization is the building block of cloud computing, I was asked a question about how load balancing and redundancy work if a server in the cloud crashes. This is an excellent question -- and a useful one in seeing how cloud suppliers can provide high levels of uptime while running commodity hardware.

A load balancer is a physical device or machine running in the cloud that receives requests from clients to supply a Website or application running in the cloud and must choose a server in the cloud running the requested Website or application. Most clients have multiple virtual machines running on several servers for the load balancer to choose from. Users want to avoid having all the virtual machines running on one server, because they would lose all access should that server crash. The load balancer would look for the server with the least amount of CPU or memory use (settings determined by administrator) and select a VM on that machine to ensure the best performance for the client from a given server.

The image below from Cavemans's blog shows the load balancing concept with the addition of a firewall in front of the load balancer.

A Firewall in Front of a Load Balancer

As for redundancy, you can easily see how a set of virtual machines being load balanced across multiple servers is always available, regardless of the status of a given server. Should one of the servers go down, clients will still have access to the VM. It will be available on other servers and can be started on new servers easily to keep the number of available VMs constant.

A good, simple overview of load balancing in the cloud is presented in this four-minute video. The presenters use the term "horizontal scaling" to describe the results of a load balanced set of virtual machines.

View Comments: Newest First | Oldest First | Threaded View
Page 1 / 3   >   >>
batye   Load Balancing & Redundancy in the Cloud   8/1/2012 8:42:36 AM
Re: Load Balancing
I'm agree with you 110%... :) same in my book's - you are right
DBK   Load Balancing & Redundancy in the Cloud   6/5/2012 12:28:46 PM
Re: what's the bigger benefit
Stephen – those are good drivers for Cloud but I also believe that access to data from various platforms and from anywhere is another.  Using the cloud as a centralized repository is one area that seems to be gaining the most acceptance.  Teams collaborating to develop an end product that is built up from many elements.  A project that I am currently working on uses a Cloud solution.  The architect drops in the CAD files and then we can add in the appropriate layers to the file and upload the modified CAD file.  Once approved the installation teams down load the approved documents and use them to build out the space.  Each is done with permissions and approvals but this is a great way to collaborate.
Stephen Spector   Load Balancing & Redundancy in the Cloud   6/1/2012 10:15:51 AM
Re: what's the bigger benefit
LB is an important featue for cloud but is not a driver for cloud acceptance. The business drivers in terms of scalability, cost savings, meeting customer demand, etc
User Ranking: Blogger
Sara Peters   Load Balancing & Redundancy in the Cloud   5/31/2012 9:42:04 PM
what's the bigger benefit
I've always thought that the superior load balancing capabilities of the cloud (particularly the public cloud) is one of its major selling points. Question for Stephen and the group: is load balancing tempting enough on its own to get an organization to move to the cloud, or are its other potential benefits more important to the to-cloud-or-not-to-cloud decision?
Sara Peters   Load Balancing & Redundancy in the Cloud   5/31/2012 9:35:41 PM
Re: Load Balancing
Aww shucks, guys. You're going to make all of us blush. But we can't argue: you guys rock.

DBK   Load Balancing & Redundancy in the Cloud   5/31/2012 1:41:19 PM
Re: Load Balancing
Ashish - Couldn't have said it better myself.  I am currently listening to the Dell application virtualization webcaste.  and at the same time preparing do to a network assesment that will prepare a site for voice virtualization and data virtualization.
eethtworkz   Load Balancing & Redundancy in the Cloud   5/31/2012 1:06:31 PM
Re: Load Balancing

You need critical Disaster Recovery Tools today.

Our IT Universe depends on it!!!

We cannot understate this critical feature one bit.

No disputing the fact that the E2 Community Rocks!!!

We all learn a lot every single day form each other.


DBK   Load Balancing & Redundancy in the Cloud   5/31/2012 10:16:56 AM
Re: Load Balancing
Maybe I am missing something but I don't think this is appropriate for this site.  I am all for shameless self promotion, but this seems a little over the top.
geeky   Load Balancing & Redundancy in the Cloud   5/31/2012 8:09:22 AM
Re: Load Balancing
I'm not sure on this can't we integrate another platform for back up purposes ? If so there will be less issues
DBK   Load Balancing & Redundancy in the Cloud   5/29/2012 7:55:56 PM
Re: Load Balancing
Technocrat - I resently hosted a Health Care breifing at Polycom.  Our own Dave Wangner was able to partcipate and he had some great insight.  Nice to be able to share with the group and continue to expand our horizons.
Page 1 / 3   >   >>

The blogs and comments posted on EnterpriseEfficiency.com do not reflect the views of TechWeb, EnterpriseEfficiency.com, or its sponsors. EnterpriseEfficiency.com, TechWeb, and its sponsors do not assume responsibility for any comments, claims, or opinions made by authors and bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.

More Enterprise Delliberation
Stephen Spector   5/16/2012   8 comments
In my last blog, I discussed the basic idea of virtualization and how cloud computing is enabled by this concept. In this post, I will present more details on the technology within ...
Stephen Spector   5/7/2012   10 comments
As part of my series on the basics of cloud computing, I thought I would introduce the basic concepts of virtualization to enhance your understanding of cloud computing.
Stephen Spector   4/26/2012   8 comments
As part of my series introducing cloud basics, I want to take a break from the technology and discuss some ideas on selecting a cloud vendor. Understanding all the various cloud ...
Stephen Spector   4/9/2012   5 comments
In my recent Direct2Dell blog post, I discussed the current trend of enterprises running private clouds starting to engage in the public cloud concept via a hybrid cloud. As part of my ...
Latest Archived Broadcast
We talk with Bernard Golden about accelerating application delivery in the cloud.
On-demand Video with Chat
Register for this video discussion to learn how tablets can provide true business usability and productivity.
4/29/2014 - Join Dell and Intel for an interactive discussion about implementing, refining and improving your virtual environment. Specifically we’ll discuss pain points virtualization can solve and those that it can create and how to prevent them.
E2 IT Migration Zones
IT Migration Zone - UK
Why PowerShell Is Important
Reduce the Windows 8 Footprint for VDI
Rethinking Storage Management
IT Migration Zone - FR
SQL Server : 240 To de mémoire flash pour votre data warehouse
Quand Office vient booster les revenus Cloud et Android de Microsoft
Windows Phone : Nokia veut davantage d'applications (et les utilisateurs aussi)
IT Migration Zone - DE
Cloud Computing: Warum Unternehmen trotz NSA auf die „private“ Wolke setzen sollten
Cloud Computing bleibt Wachstumsmarkt – Windows Azure ist Vorreiter
Like Us on Facebook
Twitter Feed
Enterprise Efficiency Twitter Feed
Site Moderators Wanted
Enterprise Efficiency is looking for engaged readers to moderate the message boards on this site. Engage in high-IQ conversations with IT industry leaders; earn kudos and perks. Interested? E-mail:
Dell's Efficiency Modeling Tool
The major problem facing the CIO is how to measure the effectiveness of the IT department. Learn how Dell’s Efficiency Modeling Tool gives the CIO two clear, powerful numbers: Efficiency Quotient and Impact Quotient. These numbers can be transforma¬tive not only to the department, but to the entire enterprise.

Read the full report
The State of Enterprise Efficiency in the Virtual Era: Virtualization – Smart Approaches to Maximize Gains
Virtualization is a presence in nearly all enterprise data centers. But not all companies are using it to its best effect. Learn the common characteristics of success, what barriers companies face, and how to get the most from your efforts.

Read the full report
Informed CIO: Dollars & Sense: Virtual Desktop Infrastructure
Cut through the VDI hype and get the full picture -- including ROI and the impact on your Data Center -- to make an informed decision about your virtual desktop infrastructure deployments.

Read the full report
A Video Case Study – Translational Genomics Research Institute
e2 Video

On the Case
TGen IT: Where We're Going Next

7|11|12   |   08:12   |   10 comments

Now that TGen has broken new ground in genomic research by using Dell's storage, cloud, and high-performance computing solutions, the company discusses what will come next for it and for personalized medicine.
On the Case
Better Care Through Better Communications

6|6|12   |   02:24   |   12 comments

The achievements of the TGen/Dell project could improve how all people receive healthcare, because they are creating ways to improve end-to-end communication of medical data.
On the Case
TGen IT: Where We Are Now

5|15|12   |   06:58   |   5 comments

TGen is breaking new ground in genomic research by using Dell's storage, cloud, and high-performance computing solutions.
On the Case
TGen IT: Where We Were

4|27|12   |   06:45   |   10 comments

The Translational Genomics Research Institute wanted to save lives, but its efforts were hobbled by immense computing challenges related to collecting, processing, sharing, and storing enormous amounts of data.
On the Case
1,200% Faster

4|18|12   |   02:27   |   12 comments

Through their partnership, Dell and TGen have increased the speed of TGen’s medical research by 1,200 percent.
On the Case
IT May Improve Children's Chances of Survival

4|17|12   |   02:12   |   8 comments

IT is helping medical researchers reach breakthroughs in a way and pace never seen before.
On the Case
Medical Advances in the Cloud

4|10|12   |   1:25   |   5 comments

TGen and Dell are pushing the boundaries of computing, and harnessing the power of the cloud to improve healthcare.
On the Case
TGen: Living the Mission

4|9|12   |   2:25   |   3 comments

TGen's CIO puts the organizational mission at the heart of everything the IT staff does.
On the Case
TGen Speeding Up Biomedical Research to Save More Lives

4|5|12   |   1:59   |   8 comments

The Translational Genomics Research Institute is revamping its computing to improve speed, storage, and collaboration – and, most importantly, to save lives.
On the Case
Computing Power Helping to Save Children's Lives

3|28|12   |   2:13   |   3 comments

The Translational Genomics Institute’s partnership with Dell is enabling them to treat kids with neuroblastoma more quickly and save more lives.
Tom Nolle
The Big Reason to Use Office

3|18|14   |   02:24   |   19 comments

Office and personal productivity tools come in a first-class and coach flavor set, but what makes the difference is primarily little things that most users won't encounter. What's the big issue in using something other than Office, and can you get around it?
E2 Editors
SPONSORED: Mobile Security — A Use Case

3|4|14   |   04:27   |   6 comments

New mobile security solutions can accommodate a wide array of needs, including those of a complex university environment.
Tom Nolle
Killing Net Neutrality Might Save You Money

1|16|14   |   2:13   |   11 comments

The DC Court of Appeals voided most of the Neutrality Order, and whatever it might mean for the Internet overall, it might mean better and cheaper Internet VPNs for businesses.
Tom Nolle
The Internet of Everythinguseful

1|10|14   |   2:18   |   19 comments

We really don't want an "Internet of Everything" but even building an Internet of Everythinguseful means setting some ground rules to insure there's value in the process and that costs and risks are minimized.
Tom Nolle
Maturing Google Chrome

12|30|13   |   2.18   |   25 comments

Google's Chrome OS has a lot of potential value and a lot of recent press, but it still needs something to make it more than a thin client. It needs cloud integration, it needs extended APIs via web services, and it needs to suck it up and support a hard drive.
Sara Peters
No More Cookie-Cutter IT

12|23|13   |   03.58   |   21 comments

Creating the right combination of technology, people, and processes for your IT organization is a lot like baking Christmas cookies.
Sara Peters
Smart Wigs Not a Smart Idea

12|5|13   |   3:01   |   46 comments

Sony is seeking a patent for wigs that contain computing devices.
Tom Nolle
Cloud in the Wild

12|4|13   |   02:23   |   15 comments

On a recent African trip I saw examples of the value of the cloud in developing nations, for educational and community development programs. We could build on this, but not only in developing economies, because these same programs are often under-supported even in first-world countries.
E2 Editors
SPONSORED: Is Malware Evading Your IPS?

11|18|13   |   03:16   |   4 comments

Intrusion prevention software is supposed to detect and block malware intrusions, but clever malware authors can evade your IPS in these five main ways.
Sara Peters
Where Have All the Mentors Gone?

9|27|13   |   3:15   |   38 comments

A good professional mentor can change your life for the better... but where do you find one?
Tom Nolle
SDN Wars & You Could Win

9|17|13   |   2:10   |   5 comments

VMware's debate with Cisco on SDN might finally create a fusion between an SDN view that's all about software and another that's all about network equipment. That would be good for every enterprise considering the cloud and SDN.
Ivan Schneider
The Future of the Smart Watch

9|12|13   |   3:19   |   39 comments

Wearing a bulky, oversized watch is good training for the next phase in wristwatches: the Internet-enabled, connected watch. Why the smartphone-tethered connected watch makes sense, plus Ivan demos an entirely new concept for the "smart watch."
Tom Nolle
Cutting Your Cloud Storage Costs

9|4|13   |   2:06   |   3 comments

Cloud storage costs are determined primarily by the rate at which files are changed and the possibility of concurrent access/update. If you can structure your storage use to optimize these factors you can cut costs, perhaps to zero.
Sara Peters
Do CIOs Need an IT Background?

8|29|13   |   2:11   |   23 comments

Most of the CIOs interviewed in the How to Become a CIO series did not start their careers as IT professionals. So is an IT background essential?
Ivan Schneider
The Internet Loves Birthdays

8|27|13   |   3:25   |   69 comments

The Internet has evolved into a machine for drumming up a chorus of "Happy Birthday" messages, from family, friends, friends of friends who you added on Facebook, random people that you circled on G+, and increasingly, automated bots. Enough already.