LLM inference

#LLM inference

7 articles tagged
Zero-Copy GPU Inference from WebAssembly on Apple Silicon
Hardware

Zero-Copy GPU Inference from WebAssembly on Apple Silicon

4/19/2026
ZSE: A Memory-Efficient LLM Inference Engine with Smart Resource Orchestration
LLMs

ZSE: A Memory-Efficient LLM Inference Engine with Smart Resource Orchestration

2/26/2026
nTransformer Enables Llama 70B Inference on Single Consumer GPU with Novel Streaming Architecture
Hardware

nTransformer Enables Llama 70B Inference on Single Consumer GPU with Novel Streaming Architecture

2/22/2026
Beyond the Data Center: Taalas and the Path to Ubiquitous AI
Chips

Beyond the Data Center: Taalas and the Path to Ubiquitous AI

2/20/2026
Continuous Batching: Optimizing LLM Inference Throughput from First Principles
LLMs

Continuous Batching: Optimizing LLM Inference Throughput from First Principles

2/16/2026
Memory Walls and Interconnect Bottlenecks: New Research Charts Path for Efficient LLM Inference Hardware
Hardware

Memory Walls and Interconnect Bottlenecks: New Research Charts Path for Efficient LLM Inference Hardware

1/25/2026
The End of One-Size-Fits-All LLM APIs: Why Workload-Specific Inference Is Taking Over
LLMs

The End of One-Size-Fits-All LLM APIs: Why Workload-Specific Inference Is Taking Over

1/22/2026

Popular Tags

#AI (2714)#Security (893)#Open Source (682)#privacy (628)#Hardware (619)#Apple (612)#API (594)#Reddit (516)#regulation (462)#Windows (452)#Infrastructure (441)#Microsoft (437)#Trends (434)#Remote Code Execution (428)#Cybersecurity (414)#Linux (402)#Gaming (373)#Business (355)#Cloud (349)#Performance (337)#OpenAI (331)#Vulnerabilities (328)#Supply Chain (282)#Rust (275)#Samsung (268)#Automation (265)#Developer Tools (265)#Battery (255)#Authentication (254)#Anthropic (251)#Android (249)#Nvidia (248)#Machine Learning (239)#Developer (229)#Azure (227)#China (222)#LLMs (221)#AMD (217)#Productivity (212)#Funding (204)#Intel (201)#DevOps (199)#Camera (195)#GPU (190)#Linux kernel (187)#mobile (184)#Patch Management (178)#iOS (173)#CISA (172)#Patch (171)