VMware vSphere 5.1 Feature Spotlight: vSphere Data Protection

VMware has added some really great features with their vSphere Data Protection product that ships with the vSphere 5.1 environment. By leveraging the vSphere API – Data Protection (VADP) it allows for reduced load on the vSphere hosts which is great news for resource utilization.

So What does vSphere Data Protection Do?

The new vSphere Data Protection 5.1 does some exciting things. This is a newly developed product which came from a partnership with EMC (VMware’s parent company) by adding the EMC Avamar software enhancements into the vSphere Data Protection suite allowing backup and de-duplication of up to 2TB of VM data for up to 100 VM guests into a VMware Storage Appliance specifically designed for the Data Protection Suite.

By using the Avamar technology, vSphere Data Protection can make use of the variable length de-duplication and Changed Block Tracking that will help to reach potential of 99% de-duplication and allow for single step restores.

No…Avamar, not Avatar.

Just how Free is Free?

What is great about this feature is that it is free to all vSphere licenses which are Essentials Plus or higher. The question only comes with scalability caveats. If you choose to grow outside of the 2TB storage or the 100 VM limit, you are most likely going to have to go to a third party product to backup in your current method or using a similar style, but with a different product in front of it.

Why 100 VMs and 2TB?

Great question. The folks at VMware have built the vSphere Data Protection to be used in a small to medium business environment to allow you to protect your VMs to a virtual SAN appliance. For this reason they have engineered it to work within reasonable limits of the vSphere and vCenter product. If you need additional capabilities like writing to tape or off-disk archival storage of some kind, or to maintain larger environments, you are probably in need of a more “enterprise” backup and restore solution.

While there is a cap on each VDP appliance, you can have up to 10 instances per vCenter installation in your datacenter. This allows you to grow to protect more machines. The limitation for total storage is a per-VDP appliance limit. What that means is that you cannot migrate backup images from one VDP appliance to another, nor can you share the VDP destinations to create a larger repository.

How can I best make use of vSphere Data Protection

As I’ve written about with my article on Belt and Suspenders, you may want to add the vSphere Data Protection into your suite of protection tools and potentially take some of the weight off of your current backup and restore products. If you have a group of VM guests that see limited change, or potentially your test and development boxes, they may be perfectly suited to be backed up using the vSphere Data Protection and then your traditional Tier 1 and Tier 2 servers will have more of your backup window available to them.

Backup and server protection is always a hot topic. This tool may not replace your current backup technology, but it may augment your current environment and free up resources. By creating a new method to achieve data protection without more licenses, you may add some cost savings to the ongoing management of your datacenter. Now that is what I like to hear.

The product comes as a pre-configured Linux based vSphere appliance so deployment is simple and the simple web based management tool gives you everything you need in the browser to backup, restore and configure the overall protection and retention for the appliance.

What do I need to deploy VDP?

The VDP appliance requires that you are using vCenter 5.1 which can be either the Windows based installation, or the Linux based vCenter Server Virtual Appliance (VCVA). The VDP product will be released with the general availability release of vSphere 5.1 on September 11th, 2012.

For more information, take a look at the vSphere Data Protection feature PDF: http://www.vmware.com/files/pdf/techpaper/Introduction-to-Data-Protection.pdf


VMware vSphere 5.1 Feature Spotlight: Storage

Storage is an important, if not one of the most important sector of a successful virtualization and/or cloud environment. We often take storage for granted as we see the prices dropping significantly compared to previous decades. What makes great storage even better is great tools to utilize, manage and truly amplify the awesomeness that existing and upcoming storage platforms have to offer.

Throughout the vSphere versions we have seen interesting leaps in how the hypervisor is able to leverage the storage layer. What makes vSphere 5.1 even more awesome is the introduction of a number of really cool features such as:

  • Space reclaim
  • Increase VMFS host access limits from 8 to 32
  • APD (All Path Down) condition handling
  • 16 Gb FC support
  • VAAI improvements
  • Datastore correlation
  • Parallel Storage vMotion

These are just a few of the new features and enhancements but they certainly stand out as breakout features for the vSphere 5.1 environment which will add more versatility to your vSphere 5.1 and vCloud Director solutions.

Space Reclaim

vSphere has given us the ability to dynamically grow our storage since version 4.x and with 5.0 we were introduced to VMFS-5 which added the unified block size for volumes which allowed a much more efficient layout for VMFS volumes.

With vSphere 5.1 VMware has added the space reclaim features which will now let us use the Space-Efficient Sparse Disks (SE Sparse Disks) feature to mark unused blocks in the guest file-systems and allow vSphere to wrestle back that space to re-thin the volume allocated to the guest OS.

For file servers and database servers with highly randomized I/O and lots of fragmentation, this will be a great way to leverage Thin Provisioning and let you get the most out of your storage platform.

Increase VMFS host access limits from 8 to 32

While this may not have affected your systems just yet, it is something that frees up future limits if you are looking towards VDI and vCloud deployments. Currently, with a VMFS file-system you are capped at 8 hosts sharing a read-only file. When you begin ramping up your VDI environment and put vCloud together to fully utilize its scale out capability, this could be a problem.

Now with the vSphere 5.1 implementation of VMFS-5 (note that it is only available with 5.1 hosts access VMFS-5) you open the door for a better multi-host implementation to spread the load and add more resiliency and redundancy for your organization.

APD (All Path Down) condition handling

Have you had a situation where you lost all paths to your storage? Not a problem anymore…well, less of a problem. The issue with APD situations is that vSphere 4 and earlier could often run into I/O path query threads that took priority over other host threads. If that

We’ve got a piper down…I mean path down!!

happens,  a Permanent Device Loss (PDL) condition should trigger the restarting of guest resources on hosts with available paths, but because of queuing of thread requests it could result in guest outages or even worse, host disconnections from vCenter.

Enter vSphere 5.0 with better handling of APD and PDL situations, and now with the 5.1 VMware has added better handling of APD and PDL by letting the hosts communicate more deeply to the storage environments to query for path status and look for PDL conditions more effectively. It has also added those functions to single LUN targets which allows iSCSI target loss to be re-queried and confirmed as PDL before marking it as unavailable.

16 Gb FC support

While your environment may have contained and supported the hosting of 16 Gb FC HBAs with vSphere 5.0, they were actually running in 8Gb mode for all intents and purposes. Now your entire storage chain can operate at the full 16 Gb to enjoy the full bandwidth that your hardware can give.

VAAI improvements

For those who have been able to leverage VAAI support for their storage it has been a great feature. With vSphere 5.0 there were great enhancements for VMware View. Now with vSphere 5.1 you will extend those enhancements into your vCloud Director environment to make more gains with I/O efficiency for vApps and Linked Clones.

Datastore Correlation

Datastore clusters were cool. Storage DRS in vSphere 5.0, even cooler. Being able to set storage affinity to force guests to different datastores was (and still is) a massive feature to have for best performance.

Now VMware has extended the datastore toolkit to include Datastore Correlation. This is a feature where the I/O injector not issues load to datastores and measures if other datastores experience latency. So now the storage layer is not just volume aware, but extends its awareness to detect if multiple volumes are sharing back-end spindles on the physical array. Now that is pretty awesome.

Parallel Storage vMotion

Up to now, Storage vMotion has been a serial function. If you have had to migrate a number of machines at the same time, this was painfully obvious. Now with vSphere 5.1 Storage vMotion you will have up to 4 parallel migrations happening simultaneously, and just as importantly, it will perform parallel migrations only on distinct datastores which means that it won’t overload a single area of storage.

Much, much more

There are a number of really cool features and enhancements, and if you are running in VMFS-3 at the moment you will really love when you migrate to VMFS-5 and vSphere 5.1 in the future.

There are lots of really great resources on storage in VMware, and with VASA and VAAI integrated storage it just gets more and more awesome with every step. Keep your eyes on the VMware site and monitor the Twitterverse for the storage gurus. Even more importantly, keep watching your storage vendor for some exciting features that they will be offering to better integrate with vSphere going forward.

Here is the VMware vSphere 5.1 Storage Whitepaper that was introduced at VMworld 2012: http://www.vmware.com/files/pdf/techpaper/Whats-New-VMware-vSphere-51-Storage-Technical-Whitepaper.pdf

If you are like me, you are counting down the days to release date. Purchase of vSphere 5.1 is available on September 10th with download access beginning on the 11th. Can’t wait!!