AI inference

#AI inference

22 articles tagged
llamafile's Technical Achievements and the Challenges of Open Source AI Development
AI

llamafile's Technical Achievements and the Challenges of Open Source AI Development

5/29/2026
Supermicro SYS-112D-36C-FN3P Review – 36‑Core Intel Xeon 6 SoC Server with Dual 100 GbE
Hardware

Supermicro SYS-112D-36C-FN3P Review – 36‑Core Intel Xeon 6 SoC Server with Dual 100 GbE

5/25/2026
AMD's Lemonade SDK 10.5 Elevates macOS to GA Status, Integrates ROCm 7.13 for Enhanced AI Performance
AI

AMD's Lemonade SDK 10.5 Elevates macOS to GA Status, Integrates ROCm 7.13 for Enhanced AI Performance

5/18/2026
AWS Deploys M3 Ultra Mac Studios with 256 GB Unified Memory – What It Means for Homelab Builders
Hardware

AWS Deploys M3 Ultra Mac Studios with 256 GB Unified Memory – What It Means for Homelab Builders

5/15/2026
Hardware

$200 Socketed Nvidia V100 Revived as a PCIe Card Beats Modern Mid‑Range GPUs in AI Inference

5/10/2026
Building an 8-Node NVIDIA GB10 Cluster for Local Kimi K2 Inference: Power, Networking, and Lessons Learned
Hardware

Building an 8-Node NVIDIA GB10 Cluster for Local Kimi K2 Inference: Power, Networking, and Lessons Learned

4/28/2026
Intel and SambaNova Partner on Heterogeneous AI Inference Platform to Challenge Nvidia's Dominance
Hardware

Intel and SambaNova Partner on Heterogeneous AI Inference Platform to Challenge Nvidia's Dominance

4/9/2026
Intel Arc Pro B70: 32GB GDDR6 Professional GPU Targets AI Workloads
Hardware

Intel Arc Pro B70: 32GB GDDR6 Professional GPU Targets AI Workloads

3/26/2026
Nvidia's $20B Groq Acquisition Accelerates AI Response Times with LPX Racks
Hardware

Nvidia's $20B Groq Acquisition Accelerates AI Response Times with LPX Racks

3/17/2026
Nvidia's Groq 3 LPX: 256 LPUs in a Single Rack for AI Inference
Hardware

Nvidia's Groq 3 LPX: 256 LPUs in a Single Rack for AI Inference

3/16/2026
Meta's MTIA Chips Signal Hyperscaler Push to Break Nvidia's AI Dominance
Chips

Meta's MTIA Chips Signal Hyperscaler Push to Break Nvidia's AI Dominance

3/16/2026
AWS Partners with Cerebras to Deploy Wafer-Scale AI Chips for High-Performance Inference
Cloud

AWS Partners with Cerebras to Deploy Wafer-Scale AI Chips for High-Performance Inference

3/13/2026
AI

IonRouter Enters AI Inference Market with Custom IonAttention Stack

3/12/2026

Popular Tags

#AI (3554)#Security (1278)#Open Source (930)#privacy (841)#Hardware (826)#Apple (748)#API (731)#Remote Code Execution (707)#Microsoft (656)#Windows (648)#regulation (646)#Infrastructure (630)#Reddit (616)#Cloud (560)#Trends (559)#Cybersecurity (537)#Linux (521)#Gaming (486)#Business (474)#Performance (445)#Vulnerabilities (439)#Supply Chain (413)#OpenAI (388)#Developer Tools (364)#Android (362)#Automation (355)#Rust (354)#Machine Learning (350)#Samsung (350)#Battery (324)#Azure (321)#LLMs (319)#Authentication (316)#Nvidia (311)#DevOps (294)#Anthropic (292)#China (287)#AMD (282)#Developer (281)#Patch (276)#Productivity (276)#Camera (263)#GPU (262)#LLM (258)#Intel (257)#iOS (255)#Linux kernel (254)#mobile (243)#Patch Management (243)#CISA (237)