inference

#inference

14 articles tagged
Visualizing Mixture of Experts: Inside the Black Box of Modern AI Models
Machine Learning

Visualizing Mixture of Experts: Inside the Black Box of Modern AI Models

4/13/2026
TurboQuant is a big deal, but it won't end the memory crunch • The Register
AI

TurboQuant is a big deal, but it won't end the memory crunch • The Register

4/2/2026
Meta Accelerates AI Chip Development: Four New MTIA Generations Planned by 2027
Chips

Meta Accelerates AI Chip Development: Four New MTIA Generations Planned by 2027

3/13/2026
Meta Accelerates AI Hardware Roadmap with MTIA 400/450/500 Generations
Chips

Meta Accelerates AI Hardware Roadmap with MTIA 400/450/500 Generations

3/13/2026
AI

Enterprise LLM Inference: The Capital Allocation Problem You Can't Ignore

3/3/2026
Machine Learning

Timber: AOT Compiling Classical ML Models to Native C for Microsecond Inference

3/2/2026
Microsoft and NVIDIA Achieve Breakthrough DeepSeek-V3.2 Inference Performance with Blackwell Platform
Hardware

Microsoft and NVIDIA Achieve Breakthrough DeepSeek-V3.2 Inference Performance with Blackwell Platform

2/28/2026
SambaNova Unveils SN50 AI Accelerator, Partners with Intel for Xeon-Based Inference Infrastructure
Hardware

SambaNova Unveils SN50 AI Accelerator, Partners with Intel for Xeon-Based Inference Infrastructure

2/25/2026
AWS Brings Custom Nova Models to SageMaker Inference
AI

AWS Brings Custom Nova Models to SageMaker Inference

2/16/2026
Two Different Tricks for Fast LLM Inference: Anthropic vs OpenAI's Approaches
LLMs

Two Different Tricks for Fast LLM Inference: Anthropic vs OpenAI's Approaches

2/14/2026
Positron's Asimov AI Accelerator Takes on Nvidia with Laptop RAM and CXL Expansion
Chips

Positron's Asimov AI Accelerator Takes on Nvidia with Laptop RAM and CXL Expansion

2/4/2026
Inside Nano-vLLM: How Modern Inference Engines Transform Prompts into Tokens
LLMs

Inside Nano-vLLM: How Modern Inference Engines Transform Prompts into Tokens

2/2/2026
Hardware

OpenAI to serve ChatGPT on Cerebras' AI dinner plates • The Register

1/15/2026

Popular Tags

#AI (2604)#Security (856)#Open Source (660)#privacy (600)#Hardware (591)#Apple (589)#API (577)#Reddit (503)#regulation (445)#Windows (437)#Trends (421)#Infrastructure (420)#Microsoft (419)#Remote Code Execution (402)#Cybersecurity (399)#Linux (378)#Gaming (358)#Business (343)#Cloud (329)#Performance (322)#OpenAI (314)#Vulnerabilities (310)#Rust (268)#Supply Chain (265)#Automation (258)#Samsung (255)#Developer Tools (255)#Battery (248)#Authentication (247)#Nvidia (243)#Android (237)#Anthropic (231)#Machine Learning (230)#Developer (221)#China (218)#Azure (218)#LLMs (217)#AMD (206)#Productivity (205)#Funding (199)#DevOps (192)#Camera (186)#Intel (186)#GPU (185)#Linux kernel (175)#mobile (174)#Patch Management (170)#iOS (166)#Patch (165)#Malware (157)