NuAxi
NuAxiSemiconductor trade intelligence

Concurrent HBM And Host Memory Access Improves LLM Inference Throughput (Georgia Tech, Nvidia, Stanford)

What happened

Researchers from Georgia Tech, Nvidia Research, and Stanford University introduced 'BOOST,' a runtime system enabling concurrent access to HBM and host memory to accelerate LLM inference. This technical paper outlines a method to utilize combined bandwidth for improved performance. Neutral impact on current trading.

Impact and signal

Low impactImpact score: 10/100

Affected components and suppliers

HBMHost Memory
NvidiaGeorgia TechStanford University
R&DHBMLLMArchitecture

Source and time

Source: Semiconductor Engineering · 9/21/2026 · View original source

Open the NuAxi live feed →

Real-time pricing, supply signals and AI analysis for semiconductor traders