quantization

#quantization

18 articles tagged
Machine Learning

The Shrinking Universe of Numbers: FP4 and the Precision Revolution in Computing

4/18/2026
Google's TurboQuant Compression Enables Faster LLM Inference on Modest Hardware
LLMs

Google's TurboQuant Compression Enables Faster LLM Inference on Modest Hardware

4/15/2026
TQ4_1S Weight Compression: Breakthrough in Model Quantization for llama.cpp
Machine Learning

TQ4_1S Weight Compression: Breakthrough in Model Quantization for llama.cpp

4/4/2026
PrismML's 1-bit LLM breakthrough could revolutionize on-device AI
LLMs

PrismML's 1-bit LLM breakthrough could revolutionize on-device AI

4/4/2026
SALOMI: When Binary Transformers Meet Reality - A Research Deep Dive
Machine Learning

SALOMI: When Binary Transformers Meet Reality - A Research Deep Dive

4/2/2026
TurboQuant is a big deal, but it won't end the memory crunch • The Register
AI

TurboQuant is a big deal, but it won't end the memory crunch • The Register

4/2/2026
Google's TurboQuant slashes AI memory demands by 6x while boosting GPU performance
Machine Learning

Google's TurboQuant slashes AI memory demands by 6x while boosting GPU performance

3/26/2026
Unsloth Releases Comprehensive Guide for Running Alibaba's Qwen3.5 Models Locally
LLMs

Unsloth Releases Comprehensive Guide for Running Alibaba's Qwen3.5 Models Locally

3/8/2026
AI

The Architecture of AI Understanding: Matthew Explains' Technical Journey

3/4/2026
llmfit: Bridging the Gap Between Local LLM Ambition and Hardware Reality
LLMs

llmfit: Bridging the Gap Between Local LLM Ambition and Hardware Reality

3/2/2026
Unsloth Dynamic 2.0 GGUFs: New Quantization Method Outperforms Industry Standards
LLMs

Unsloth Dynamic 2.0 GGUFs: New Quantization Method Outperforms Industry Standards

2/28/2026
ZSE: A Memory-Efficient LLM Inference Engine with Smart Resource Orchestration
LLMs

ZSE: A Memory-Efficient LLM Inference Engine with Smart Resource Orchestration

2/26/2026
How Taalas 'Prints' LLM Models Onto Silicon Chips
Chips

How Taalas 'Prints' LLM Models Onto Silicon Chips

2/22/2026

Popular Tags

#AI (2635)#Security (865)#Open Source (666)#privacy (608)#Hardware (597)#Apple (591)#API (581)#Reddit (507)#regulation (448)#Windows (443)#Infrastructure (427)#Trends (426)#Microsoft (423)#Remote Code Execution (413)#Cybersecurity (402)#Linux (386)#Gaming (360)#Business (345)#Cloud (333)#Performance (325)#OpenAI (321)#Vulnerabilities (314)#Rust (273)#Supply Chain (267)#Automation (260)#Samsung (258)#Developer Tools (255)#Battery (250)#Authentication (249)#Nvidia (244)#Android (240)#Anthropic (239)#Machine Learning (231)#Developer (223)#Azure (220)#China (218)#LLMs (218)#AMD (208)#Productivity (206)#Funding (201)#Intel (193)#DevOps (192)#Camera (188)#GPU (186)#mobile (178)#Linux kernel (177)#Patch Management (175)#Patch (169)#iOS (167)#Startups (159)