Search Results: "VLLM"

Found 6 articles

Intel Releases llm-scaler-vllm 0.14.0-b8, Talks Up 1.49x Performance With BMG-G31
AI

Intel Releases llm-scaler-vllm 0.14.0-b8, Talks Up 1.49x Performance With BMG-G31

3/2/2026
Inside Nano-vLLM: How Modern Inference Engines Transform Prompts into Tokens
LLMs

Inside Nano-vLLM: How Modern Inference Engines Transform Prompts into Tokens

2/2/2026
Intel Expands LLM Support in LLM-Scaler-vLLM Beta 0.11.1-b7
LLMs

Intel Expands LLM Support in LLM-Scaler-vLLM Beta 0.11.1-b7

1/16/2026
vLLM Achieves 2.2k Tokens/Second per H200 GPU with Wide-EP Architecture
LLMs

vLLM Achieves 2.2k Tokens/Second per H200 GPU with Wide-EP Architecture

1/14/2026
AI

Cascade's Predicted Outputs Turbocharges VLLM: Skip Regeneration, Not Tokens

The Token Regeneration Bottleneck Anyone who’s watched an LLM laboriously regenerate entire code blocks to insert a si...

10/10/2025
Building the AI Cathedral: How Google Cloud Scales Inference for Billions of Agents and Users
AI

Building the AI Cathedral: How Google Cloud Scales Inference for Billions of Agents and Users

When NVIDIA CEO Jensen Huang declared AI is having its "iPhone moment," he captured the transformative potential of the ...

7/26/2025