Enhancing the performance of GPU acceleration in virtual environments: Thoroughly benchmarking the rigidity of mediated device passthrough
[EN] Virtualization has been the key element for the growth of cloud computing. Historically, GPUs have been complex devices to virtualize efficiently. The mediated passthrough mechanism is usually leveraged. However, it implies a rigid association between the virtual domain and the virtual GPU, whi...
| Autores: | , , |
|---|---|
| Tipo de documento: | artigo |
| Data de publicação: | 2026 |
| País: | España |
| Recursos: | Universitat Politècnica de València (UPV) |
| Repositório: | RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia |
| Idioma: | inglês |
| OAI Identifier: | oai:riunet.upv.es:10251/228369 |
| Acesso em linha: | https://riunet.upv.es/handle/10251/228369 |
| Access Level: | Acceso aberto |
| Palavra-chave: | CUDA GPU acceleration Virtualization NVIDIA vGPU NGS RCUDA Mediated device passthrough |
| Resumo: | [EN] Virtualization has been the key element for the growth of cloud computing. Historically, GPUs have been complex devices to virtualize efficiently. The mediated passthrough mechanism is usually leveraged. However, it implies a rigid association between the virtual domain and the virtual GPU, which impairs overall system GPU performance. In this paper we propose the use of Network GPGPU system (NGS) to improve the performance of GPUs in virtual domains. Our proposal is compared to NVIDIA vGPU, the most widely used mechanism for virtualizing CUDA-enabled GPUs today. Results show throughput benefits of approximately 20%, speedup of up to 28% in the execution time of the applications, improved overall GPU utilization (over 85%), and lower energy consumption per job (up to 15.34%). |
|---|