Technical impact
The vulnerability resides in ExLlamaV2’s QMatrix::make_sequential function, where an incorrectly validated argument g_idx permits an out-of-bounds write. This memory corruption can overwrite adjacent data structures, potentially leading to application instability, data loss, or further exploitation by a local attacker. The flaw is a classic buffer overrun (CWE-119/CWE-787).
Affected Systems
Affected systems are installations of the turboderp-org ExLlamaV2 library up to and including version 0.3.2. The vulnerability is confined to the component that implements the GPTQ Index Handler, specifically the q_matrix.cu file within the cuda extension.
Risk and Exploitability
The CVSS score of 4.8 indicates moderate severity, and no EPSS data or KEV listing suggests low public exploitation activity at present. The attack vector requires local code execution; therefore the exploit would be limited to a user with access to the host running ExLlamaV2. No known public exploits exist, but a memory corruption flaw poses a risk if an attacker can influence input arguments.