Research Note: RDMA Performance in Virtual Machines using QDR InfiniBand on VMware vSphere 5

ibrn.pngOur research note exploring the use of InfiniBand in Red Hat guests with VM DirectPath I/O is now available for your reading pleasure here. In it, we present the results of bandwidth and latency tests run using two hosts connected back-to-back with Mellanox quad data rate (QDR) InfiniBand. We show that bandwidths over a wide range of messages sizes are comparable to those achievable in the non-virtualized case and that low latencies (under 2us) are achievable as well.


This paper represents our first performance results using RDMA. We expect to publish further papers examining the performance of full MPI applications as well as results related to Bhavesh’s work on a virtualized RDMA device that would support RDMA while also maintaining the ability to perform vMotion and Snapshot operations.

Other posts by

vSphere Scale-Out for HPC and Big Data

I’m very excited that we’ve announced vSphere Scale-Out this week at VMworld here in Las Vegas. This new vSphere edition is specifically and exclusively designed for running HPC and Big Data workloads. This is an important development in our work to offer compelling virtualization solutions for these two emerging workload classes. Our strategy for addressing […]

Three Extreme Performance Talks from the Office of the CTO at VMworld USA

The Office of the CTO will be presenting three talks in the unofficial “Extreme Performance” series at the upcoming VMworld 2017 conference in Las Vegas. In addition, one of these talks will be delivered at VMworld Europe in Barcelona. Each of these talks focuses on important aspects of pushing the envelope to achieve high performance […]

How to Enable Compute Accelerators on vSphere 6.5 for Machine Learning and Other HPC Workloads

As our CTO Ray O’Farrell recently mentioned, VMware is committed to helping customers build intelligent infrastructure, which includes the ability to take advantage of Machine Learning within their private and hybrid cloud environments. As part of delivering this vision, the Office of the CTO collaborates with customers and with VMware R&D teams to ensure the […]