Open-Source "GreenBoost" Driver Aims To Augment NVIDIA GPUs vRAM With System…

Open-Source “GreenBoost” Driver Aims To Augment NVIDIA GPUs vRAM With System RAM & NVMe To Handle Larger LLMs

An open-source, independently developed Linux kernel module called GreenBoost aims to augment the dedicated video memory on NVIDIA discrete GPUs with system memory and NVMe storage. The intent here with GreenBoost is a CUDA caching layer to more easily run larger AI models for LLMs that otherwise won’t fit solely in your graphics card’s dedicated vRAM… https://www.phoronix.com/news/Open-Source-GreenBoost-NVIDIA