vLLM

#vLLM

9 articles tagged
Realtime and Batch GPU Workloads: How SS&C Built an AI‑as‑a‑Service Platform on Private Cloud
Infrastructure

Realtime and Batch GPU Workloads: How SS&C Built an AI‑as‑a‑Service Platform on Private Cloud

5/26/2026
Intel llm-scaler-vllm PV 1.4 Brings Linux 6.17 Kernel, Arc Pro B70 Support, and Ubuntu 24.04 Installer
AI

Intel llm-scaler-vllm PV 1.4 Brings Linux 6.17 Kernel, Arc Pro B70 Support, and Ubuntu 24.04 Installer

5/20/2026
Intel Expands LLM Support on Arc GPUs with New Qwen Model Integration
LLMs

Intel Expands LLM Support on Arc GPUs with New Qwen Model Integration

3/13/2026
Intel Releases llm-scaler-vllm 0.14.0-b8, Talks Up 1.49x Performance With BMG-G31
AI

Intel Releases llm-scaler-vllm 0.14.0-b8, Talks Up 1.49x Performance With BMG-G31

3/2/2026
From 24 to 216: A Systematic Performance Engineering Journey for LLM-based TTS
LLMs

From 24 to 216: A Systematic Performance Engineering Journey for LLM-based TTS

1/25/2026
vLLM Achieves 2.2k Tokens/Second per H200 GPU with Wide-EP Architecture
LLMs

vLLM Achieves 2.2k Tokens/Second per H200 GPU with Wide-EP Architecture

1/14/2026
A Memcached for Attention: Inside the Cross-GPU KV Cache Marketplace for LLM Inference
AI

A Memcached for Attention: Inside the Cross-GPU KV Cache Marketplace for LLM Inference

11/12/2025
AI

Cascade's Predicted Outputs Turbocharges VLLM: Skip Regeneration, Not Tokens

10/10/2025
Building the AI Cathedral: How Google Cloud Scales Inference for Billions of Agents and Users
AI

Building the AI Cathedral: How Google Cloud Scales Inference for Billions of Agents and Users

7/26/2025

Popular Tags

#AI (3695)#Security (1352)#Open Source (1012)#privacy (879)#Hardware (869)#Apple (786)#Remote Code Execution (775)#API (750)#Microsoft (725)#Windows (699)#Infrastructure (679)#regulation (665)#Reddit (627)#Cloud (589)#Trends (580)#Cybersecurity (563)#Linux (557)#Gaming (513)#Business (490)#Performance (489)#Vulnerabilities (452)#Supply Chain (451)#OpenAI (398)#Developer Tools (387)#Android (382)#Rust (376)#Machine Learning (374)#Automation (373)#Samsung (370)#Azure (354)#Nvidia (342)#LLMs (342)#Battery (342)#Authentication (329)#DevOps (312)#Anthropic (307)#China (306)#Patch (302)#AMD (297)#Productivity (295)#Developer (295)#Patch Management (290)#GPU (287)#LLM (282)#iOS (274)#Camera (273)#Intel (271)#Linux kernel (270)#Cloudflare (259)#CVE (257)