Load Balancing & Redundancy in the Cloud

Stephen Spector, Cloud Evangelist, Dell | 5/18/2012 | 23 comments

Stephen Spector
In my recent blog on how virtualization is the building block of cloud computing, I was asked a question about how load balancing and redundancy work if a server in the cloud crashes. This is an excellent question -- and a useful one in seeing how cloud suppliers can provide high levels of uptime while running commodity hardware.

A load balancer is a physical device or machine running in the cloud that receives requests from clients to supply a Website or application running in the cloud and must choose a server in the cloud running the requested Website or application. Most clients have multiple virtual machines running on several servers for the load balancer to choose from. Users want to avoid having all the virtual machines running on one server, because they would lose all access should that server crash. The load balancer would look for the server with the least amount of CPU or memory use (settings determined by administrator) and select a VM on that machine to ensure the best performance for the client from a given server.

The image below from Cavemans's blog shows the load balancing concept with the addition of a firewall in front of the load balancer.

A Firewall in Front of a Load Balancer

As for redundancy, you can easily see how a set of virtual machines being load balanced across multiple servers is always available, regardless of the status of a given server. Should one of the servers go down, clients will still have access to the VM. It will be available on other servers and can be started on new servers easily to keep the number of available VMs constant.

A good, simple overview of load balancing in the cloud is presented in this four-minute video. The presenters use the term "horizontal scaling" to describe the results of a load balanced set of virtual machines.

View Comments: Newest First | Oldest First | Threaded View
Page 1 / 3   >   >>
batye   Load Balancing & Redundancy in the Cloud   8/1/2012 8:42:36 AM
Re: Load Balancing
I'm agree with you 110%... :) same in my book's - you are right
DBK   Load Balancing & Redundancy in the Cloud   6/5/2012 12:28:46 PM
Re: what's the bigger benefit
Stephen – those are good drivers for Cloud but I also believe that access to data from various platforms and from anywhere is another.  Using the cloud as a centralized repository is one area that seems to be gaining the most acceptance.  Teams collaborating to develop an end product that is built up from many elements.  A project that I am currently working on uses a Cloud solution.  The architect drops in the CAD files and then we can add in the appropriate layers to the file and upload the modified CAD file.  Once approved the installation teams down load the approved documents and use them to build out the space.  Each is done with permissions and approvals but this is a great way to collaborate.
Stephen Spector   Load Balancing & Redundancy in the Cloud   6/1/2012 10:15:51 AM
Re: what's the bigger benefit
LB is an important featue for cloud but is not a driver for cloud acceptance. The business drivers in terms of scalability, cost savings, meeting customer demand, etc
User Ranking: Blogger
Sara Peters   Load Balancing & Redundancy in the Cloud   5/31/2012 9:42:04 PM
what's the bigger benefit
I've always thought that the superior load balancing capabilities of the cloud (particularly the public cloud) is one of its major selling points. Question for Stephen and the group: is load balancing tempting enough on its own to get an organization to move to the cloud, or are its other potential benefits more important to the to-cloud-or-not-to-cloud decision?
Sara Peters   Load Balancing & Redundancy in the Cloud   5/31/2012 9:35:41 PM
Re: Load Balancing
Aww shucks, guys. You're going to make all of us blush. But we can't argue: you guys rock.

DBK   Load Balancing & Redundancy in the Cloud   5/31/2012 1:41:19 PM
Re: Load Balancing
Ashish - Couldn't have said it better myself.  I am currently listening to the Dell application virtualization webcaste.  and at the same time preparing do to a network assesment that will prepare a site for voice virtualization and data virtualization.
eethtworkz   Load Balancing & Redundancy in the Cloud   5/31/2012 1:06:31 PM
eethtworkz
Re: Load Balancing
DBK,

You need critical Disaster Recovery Tools today.

Our IT Universe depends on it!!!

We cannot understate this critical feature one bit.

No disputing the fact that the E2 Community Rocks!!!

We all learn a lot every single day form each other.

Regards

Ashish.
DBK   Load Balancing & Redundancy in the Cloud   5/31/2012 10:16:56 AM
Re: Load Balancing
Maybe I am missing something but I don't think this is appropriate for this site.  I am all for shameless self promotion, but this seems a little over the top.
geeky   Load Balancing & Redundancy in the Cloud   5/31/2012 8:09:22 AM
Re: Load Balancing
I'm not sure on this can't we integrate another platform for back up purposes ? If so there will be less issues
DBK   Load Balancing & Redundancy in the Cloud   5/29/2012 7:55:56 PM
Re: Load Balancing
Technocrat - I resently hosted a Health Care breifing at Polycom.  Our own Dave Wangner was able to partcipate and he had some great insight.  Nice to be able to share with the group and continue to expand our horizons.
Page 1 / 3   >   >>


The blogs and comments posted on EnterpriseEfficiency.com do not reflect the views of TechWeb, EnterpriseEfficiency.com, or its sponsors. EnterpriseEfficiency.com, TechWeb, and its sponsors do not assume responsibility for any comments, claims, or opinions made by authors and bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.

More Enterprise Delliberation
Stephen Spector   5/16/2012   8 comments
In my last blog, I discussed the basic idea of virtualization and how cloud computing is enabled by this concept. In this post, I will present more details on the technology within ...
Stephen Spector   5/7/2012   10 comments
As part of my series on the basics of cloud computing, I thought I would introduce the basic concepts of virtualization to enhance your understanding of cloud computing.
Stephen Spector   4/26/2012   8 comments
As part of my series introducing cloud basics, I want to take a break from the technology and discuss some ideas on selecting a cloud vendor. Understanding all the various cloud ...
Stephen Spector   4/9/2012   5 comments
In my recent Direct2Dell blog post, I discussed the current trend of enterprises running private clouds starting to engage in the public cloud concept via a hybrid cloud. As part of my ...
Latest Archived Broadcast
Data visualization can make complex data easier to grasp. Our expert guest will talk about the hows, whys, and whats of bringing the big picture to your enterprise.
May 28th 2pm EDT Tuesday
On-demand Video with Chat
NBA CIO Michael Gliedman will tell us why the NBA decided to create NBA.com/stats
6/18/2013 -   Please join us for the "IT Convergence Strategies: Why, When and How " to learn more about: • 5 truths about infrastructure convergence today that go beyond the hype • How to exploit the 4 phases of convergence maximum efficiency and agility • Key milestones to plan for on the convergence journey • Why integrated management is a critical component of convergence plans • The importance of an open, modular approach, such as Dell’s active infrastructure, to building a converged data center
E2 IT Migration Zones
IT Migration Zone - UK
Application Audits Simplify Migration
Hardware Refresh Cycles Are Outdated
Office 365 Finds Fans
IT Migration Zone - FR
Windows Blue attendu en juin
Comment profiter d’une nouvelle expérience User Virtualization
S’équiper ou non d’un logiciel anti-virus ?
IT Migration Zone - DE
Leap Motion zeigt Gestensteuerung für Windows 8
Microsofts Surface Pro kommt nach Deutschland
Like Us on Facebook
Twitter Feed
Enterprise Efficiency Twitter Feed
Dell IT Insights
Dell Market Response Twitter Feed
E2 Linked-in Group Ad
Site Moderators Wanted
Enterprise Efficiency is looking for engaged readers to moderate the message boards on this site. Engage in high-IQ conversations with IT industry leaders; earn kudos and perks. Interested? E-mail:
moderators@enterpriseefficiency.com
Dell's Efficiency Modeling Tool
The major problem facing the CIO is how to measure the effectiveness of the IT department. Learn how Dell’s Efficiency Modeling Tool gives the CIO two clear, powerful numbers: Efficiency Quotient and Impact Quotient. These numbers can be transforma¬tive not only to the department, but to the entire enterprise.

Read the full report
The State of Enterprise Efficiency in the Virtual Era: Virtualization – Smart Approaches to Maximize Gains
Virtualization is a presence in nearly all enterprise data centers. But not all companies are using it to its best effect. Learn the common characteristics of success, what barriers companies face, and how to get the most from your efforts.

Read the full report
Informed CIO: Dollars & Sense: Virtual Desktop Infrastructure
Cut through the VDI hype and get the full picture -- including ROI and the impact on your Data Center -- to make an informed decision about your virtual desktop infrastructure deployments.

Read the full report
SPONSORED BY DELL
BRIEFINGS
CASE STUDIES
EBOOKS
PUBLIC SECTOR RESOURCES
VIDEOS
WHITE PAPERS
A Video Case Study – Translational Genomics Research Institute
e2 Video
On the Case
TGen IT: Where We're Going Next

7|11|12   |   08:12   |   10 comments


Now that TGen has broken new ground in genomic research by using Dell's storage, cloud, and high-performance computing solutions, the company discusses what will come next for it and for personalized medicine.
On the Case
Better Care Through Better Communications

6|6|12   |   02:24   |   12 comments


The achievements of the TGen/Dell project could improve how all people receive healthcare, because they are creating ways to improve end-to-end communication of medical data.
On the Case
TGen IT: Where We Are Now

5|15|12   |   06:58   |   5 comments


TGen is breaking new ground in genomic research by using Dell's storage, cloud, and high-performance computing solutions.
On the Case
TGen IT: Where We Were

4|27|12   |   06:45   |   10 comments


The Translational Genomics Research Institute wanted to save lives, but its efforts were hobbled by immense computing challenges related to collecting, processing, sharing, and storing enormous amounts of data.
On the Case
1,200% Faster

4|18|12   |   02:27   |   12 comments


Through their partnership, Dell and TGen have increased the speed of TGen’s medical research by 1,200 percent.
On the Case
IT May Improve Children's Chances of Survival

4|17|12   |   02:12   |   8 comments


IT is helping medical researchers reach breakthroughs in a way and pace never seen before.
On the Case
Medical Advances in the Cloud

4|10|12   |   1:25   |   5 comments


TGen and Dell are pushing the boundaries of computing, and harnessing the power of the cloud to improve healthcare.
On the Case
TGen: Living the Mission

4|9|12   |   2:25   |   3 comments


TGen's CIO puts the organizational mission at the heart of everything the IT staff does.
On the Case
TGen Speeding Up Biomedical Research to Save More Lives

4|5|12   |   1:59   |   8 comments


The Translational Genomics Research Institute is revamping its computing to improve speed, storage, and collaboration – and, most importantly, to save lives.
On the Case
Computing Power Helping to Save Children's Lives

3|28|12   |   2:13   |   3 comments


The Translational Genomics Institute’s partnership with Dell is enabling them to treat kids with neuroblastoma more quickly and save more lives.
Tom Nolle
VMWare & the Bicameral Model of MDM

5|22|13   |   2:14   |   No comments


VMware has a new solution to the MDM problem, two virtual phones inside a real phone, at least for Android phones. Currently limited to two models, the idea could expand and provide a way of letting companies harmonize their need to manage corporate use of phones while preserving BYOD.
Ivan Schneider
Clash of the Tableau 8: Release the Kraken!

5|17|13   |   2:42   |   No comments


Tableau 8 has some great data visualization and presentation capabilities, but it's best paired with a strong data analysis framework.
Tom Nolle
Using Virtualization – for Real!

5|13|13   |   2:10   |   2 comments


There's a lot of hype about virtualization of networks, NaaS, and SDN, but there's a couple of proven applications that enterprises could adopt right now and potentially save money and improve operations.
Tom Nolle
Is UC Becoming Oxymoronic or Just Moronic?

5|9|13   |   2:12   |   No comments


Skype/Outlook UC integration means we're going to have competition and fragmentation of UC client architectures, but is that bad? Modern devices can support IM, email, voice, and video clients, so maybe it's the back end of UC we need to be worried about.
E2 Editors
Windows vs. Integrated Circuit CPUs

4|17|13   |   4:45   |   5 comments


The editors make their predictions about what will win the next match-up in the E2 Tournament of IT Revolutionaries.
E2 Editors
Radio vs. Public Internet Access

4|17|13   |   4:34   |   14 comments


The editors make their predictions about what will win the next match-up in the E2 Tournament of IT Revolutionaries.
E2 Editors
Mainframes vs. Servers

4|17|13   |   4:34   |   16 comments


The editors make their predictions about what will win the next match-up in the E2 Tournament of IT Revolutionaries.
E2 Editors
TCP/IP vs. Printing Press

4|17|13   |   3:07   |   5 comments


The editors make their predictions about what will win the next match-up in the E2 Tournament of IT Revolutionaries.
E2 Editors
BYOD vs. E-Commerce

4|12|13   |   3:12   |   11 comments


The editors make their predictions about what will win the next match-up in the E2 Tournament of IT Revolutionaries.
E2 Editors
Telecommuting vs. Outsourcing

4|12|13   |   4:19   |   7 comments


The editors make their predictions about what will win the next match-up in the E2 Tournament of IT Revolutionaries.
E2 Editors
Personal Computer vs. Mobile Devices

4|12|13   |   4:28   |   20 comments


The editors make their predictions about what will win the next match-up in the E2 Tournament of IT Revolutionaries.
E2 Editors
Smartphones vs. Productivity Software

4|12|13   |   3:09   |   13 comments


The editors make their predictions about what will win the next match-up in the E2 Tournament of IT Revolutionaries.
Tom Nolle
There's More to Mobility Than the Mobile Worker

4|9|13   |   2:03   |   5 comments


Workers are now used to portable device support throughout their everyday lives. We should be looking at the policy of providing fixed-desk devices to support stationary workers. Could portable support be smarter?
Ivan Schneider
From Kim Jong-Un's Trackball to Nuance Voice Ads

4|5|13   |   3:21   |   9 comments


Input devices run the gamut, from the humble Missile Command-style trackball to advanced speech recognition. Unfortunately, these input devices can be used for evil as well as good. Case in point: mobile ads that want you to talk to them.
Tom Nolle
Data/Storage Wish List for Enterprises

4|3|13   |   2:19   |   1 comment


Enterprises want three things in storage systems: First is some speech-recognition way of capturing videoconference data for indexing; second is semantic/AI analysis of emails and IM for content indexing; third is a better system for managing hierarchical layers of storage.