Description
NVIDIA TensorRT-LLM contains a vulnerability in the OpenAI-compatible inference API where an attacker could trigger a reachable assertion in the sampler thread. A successful exploit of this vulnerability might lead to denial of service.
Published: 2026-07-14
Score: 6.2 Medium
EPSS: < 1% Very Low
KEV: No
Impact: n/a
Action: n/a
AI Analysis

Impact

NVIDIA TensorRT‑LLM includes a defect in its OpenAI‑compatible inference API that permits an attacker to trigger a reachable assertion failure in the sampler thread. This flaw forces the sampling process to abort, resulting in a disruption of the inference service and a denial of service. The weakness aligns with CWE‑617, indicating improper handling of recursion or control flow that can lead to assertion violations. The impact is confined to the availability of the inference endpoint, as no data exfiltration or unauthorized access is described.

Affected Systems

The affected product is NVIDIA TensorRT‑LLM. No specific version information is included in the data; therefore, all released builds of TensorRT‑LLM that expose the OpenAI‑compatible inference API should be considered potentially vulnerable until a vendor fix is issued.

Risk and Exploitability

The CVSS score of 6.2 suggests a moderate severity, while the EPSS score of less than 1% indicates a low likelihood of widespread exploitation as of now. The vulnerability is not listed in the CISA KEV catalog. The likely attack vector is via the publicly exposed inference API; an attacker would need the ability to send inference requests to trigger the assertion. No prerequisite conditions are stated, so the exploitation could be performed remotely by sending crafted requests to the vulnerable endpoint.

Generated by OpenCVE AI on July 31, 2026 at 04:59 UTC.

Remediation

No vendor fix or workaround currently provided.

OpenCVE Recommended Actions

  • Update to a patched version of TensorRT‑LLM once NVIDIA releases a fix.
  • Restrict access to the OpenAI‑compatible inference API trusted network segments or authenticated users to reduce exposure.
  • Continuously monitor system logs for assertion failures or crashes that may indicate attempted exploitation.
  • If a temporary workaround is published by NVIDIA, apply it as a stopgap measure until a permanent patch is available.

Generated by OpenCVE AI on July 31, 2026 at 04:59 UTC.

Tracking

Sign in to view the affected projects.

Advisories

No advisories yet.

History

Tue, 28 Jul 2026 04:45:00 +0000

Type Values Removed Values Added
Title Inference API Assertion Failure in NVIDIA TensorRT-LLM Causes Denial of Service

Sun, 26 Jul 2026 11:00:00 +0000

Type Values Removed Values Added
Title TensorRT‑LLM Denial of Service via OpenAI-Compatible API Assertion Failure

Wed, 22 Jul 2026 08:45:00 +0000

Type Values Removed Values Added
Title TensorRT‑LLM Denial of Service via OpenAI-Compatible API Assertion Failure

Mon, 20 Jul 2026 21:45:00 +0000

Type Values Removed Values Added
Title TensorRT-LLM OpenAI API Assertion Failure Denial of Service

Fri, 17 Jul 2026 05:30:00 +0000

Type Values Removed Values Added
Metrics ssvc

{'options': {'Automatable': 'no', 'Exploitation': 'none', 'Technical Impact': 'partial'}, 'version': '2.0.3'}


Thu, 16 Jul 2026 13:45:00 +0000

Type Values Removed Values Added
Title TensorRT-LLM OpenAI API Assertion Failure Denial of Service

Wed, 15 Jul 2026 16:00:00 +0000

Type Values Removed Values Added
First Time appeared Nvidia
Nvidia tensorrt-llm
Vendors & Products Nvidia
Nvidia tensorrt-llm

Tue, 14 Jul 2026 20:30:00 +0000

Type Values Removed Values Added
Description NVIDIA TensorRT-LLM contains a vulnerability in the OpenAI-compatible inference API where an attacker could trigger a reachable assertion in the sampler thread. A successful exploit of this vulnerability might lead to denial of service.
Weaknesses CWE-617
References
Metrics cvssV3_1

{'score': 6.2, 'vector': 'CVSS:3.1/AV:L/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:H'}


Subscriptions

Nvidia Tensorrt-llm
cve-icon MITRE

Status: PUBLISHED

Assigner: nvidia

Published:

Updated: 2026-07-15T14:18:36.942Z

Reserved: 2026-05-19T19:55:38.728Z

Link: CVE-2026-47475

cve-icon Vulnrichment

Updated: 2026-07-15T14:18:34.171Z

cve-icon NVD

No data.

cve-icon Redhat

No data.

cve-icon OpenCVE Enrichment

Updated: 2026-07-31T05:00:05Z

Weaknesses