vLLM

#vLLM

7 articles tagged
Intel Expands LLM Support on Arc GPUs with New Qwen Model Integration
LLMs

Intel Expands LLM Support on Arc GPUs with New Qwen Model Integration

3/13/2026
Intel Releases llm-scaler-vllm 0.14.0-b8, Talks Up 1.49x Performance With BMG-G31
AI

Intel Releases llm-scaler-vllm 0.14.0-b8, Talks Up 1.49x Performance With BMG-G31

3/2/2026
From 24 to 216: A Systematic Performance Engineering Journey for LLM-based TTS
LLMs

From 24 to 216: A Systematic Performance Engineering Journey for LLM-based TTS

1/25/2026
vLLM Achieves 2.2k Tokens/Second per H200 GPU with Wide-EP Architecture
LLMs

vLLM Achieves 2.2k Tokens/Second per H200 GPU with Wide-EP Architecture

1/14/2026
A Memcached for Attention: Inside the Cross-GPU KV Cache Marketplace for LLM Inference
AI

A Memcached for Attention: Inside the Cross-GPU KV Cache Marketplace for LLM Inference

11/12/2025
AI

Cascade's Predicted Outputs Turbocharges VLLM: Skip Regeneration, Not Tokens

10/10/2025
Building the AI Cathedral: How Google Cloud Scales Inference for Billions of Agents and Users
AI

Building the AI Cathedral: How Google Cloud Scales Inference for Billions of Agents and Users

7/26/2025

Popular Tags

#AI (2747)#Security (910)#Open Source (691)#privacy (639)#Hardware (625)#Apple (618)#API (598)#Reddit (520)#regulation (472)#Windows (465)#Microsoft (457)#Infrastructure (446)#Trends (442)#Remote Code Execution (439)#Cybersecurity (416)#Linux (410)#Gaming (377)#Business (359)#Cloud (355)#Performance (342)#Vulnerabilities (336)#OpenAI (334)#Supply Chain (286)#Samsung (278)#Rust (277)#Automation (268)#Developer Tools (266)#Authentication (260)#Battery (256)#Nvidia (252)#Anthropic (252)#Android (251)#Machine Learning (244)#Developer (232)#Azure (231)#LLMs (226)#China (225)#AMD (219)#Productivity (213)#Funding (206)#Intel (203)#DevOps (200)#Camera (198)#GPU (193)#Linux kernel (190)#mobile (187)#Patch Management (182)#Patch (174)#iOS (174)#CISA (173)