quantization

#quantization

28 articles tagged
Machine Learning

PrismML launches 1‑bit and ternary Bonsai Image 4B models for on‑device diffusion generation

5/31/2026
BitCPM-CANN: 1.58-Bit Training Framework Opens New Path for Memory-Efficient AI on Domestic Hardware
Machine Learning

BitCPM-CANN: 1.58-Bit Training Framework Opens New Path for Memory-Efficient AI on Domestic Hardware

5/26/2026
Qwen 3.7 Max: Evaluating Alibaba's Long-Running LLM Claims
LLMs

Qwen 3.7 Max: Evaluating Alibaba's Long-Running LLM Claims

5/25/2026
ByteDance's Lance: A Multimodal Model for Local AI Workloads
AI

ByteDance's Lance: A Multimodal Model for Local AI Workloads

5/25/2026
Zhipu AI’s GLM‑5.1‑highspeed API claims 400 tokens/s – what the numbers really mean
AI

Zhipu AI’s GLM‑5.1‑highspeed API claims 400 tokens/s – what the numbers really mean

5/22/2026
AI

Redis Creator's DS4 Project Brings Frontier AI to Local Hardware

5/15/2026
antirez’s ds4: A Narrow, Metal-Only Inference Engine for DeepSeek V4 Flash
LLMs

antirez’s ds4: A Narrow, Metal-Only Inference Engine for DeepSeek V4 Flash

5/7/2026
sectorllm: Pushing the Boundaries of Minimalist AI with a 1369-Byte Llama2 Engine
AI

sectorllm: Pushing the Boundaries of Minimalist AI with a 1369-Byte Llama2 Engine

5/5/2026
LLMs vs. SLMs: Practical Trade-offs in Modern NLP Applications
LLMs

LLMs vs. SLMs: Practical Trade-offs in Modern NLP Applications

4/27/2026
Gaussian Precision: How NF4 Quantization Transforms LLM Weight Distribution
Machine Learning

Gaussian Precision: How NF4 Quantization Transforms LLM Weight Distribution

4/19/2026
Machine Learning

The Shrinking Universe of Numbers: FP4 and the Precision Revolution in Computing

4/18/2026
Google's TurboQuant Compression Enables Faster LLM Inference on Modest Hardware
LLMs

Google's TurboQuant Compression Enables Faster LLM Inference on Modest Hardware

4/15/2026
TQ4_1S Weight Compression: Breakthrough in Model Quantization for llama.cpp
Machine Learning

TQ4_1S Weight Compression: Breakthrough in Model Quantization for llama.cpp

4/4/2026

Popular Tags

#AI (3659)#Security (1330)#Open Source (964)#privacy (865)#Hardware (856)#Apple (765)#Remote Code Execution (756)#API (743)#Microsoft (689)#Windows (689)#regulation (656)#Infrastructure (653)#Reddit (623)#Cloud (584)#Trends (575)#Cybersecurity (554)#Linux (542)#Gaming (500)#Business (483)#Performance (465)#Vulnerabilities (449)#Supply Chain (430)#OpenAI (392)#Android (371)#Developer Tools (369)#Machine Learning (367)#Automation (365)#Rust (363)#Samsung (361)#Nvidia (338)#Battery (336)#Azure (334)#LLMs (330)#Authentication (319)#DevOps (309)#China (297)#Anthropic (296)#Patch (296)#Developer (293)#Productivity (289)#AMD (289)#GPU (277)#LLM (273)#Camera (270)#Intel (266)#iOS (264)#Linux kernel (262)#Cloudflare (250)#mobile (250)#Patch Management (249)