quantization

#quantization

16 articles tagged
TQ4_1S Weight Compression: Breakthrough in Model Quantization for llama.cpp
Machine Learning

TQ4_1S Weight Compression: Breakthrough in Model Quantization for llama.cpp

4/4/2026
PrismML's 1-bit LLM breakthrough could revolutionize on-device AI
LLMs

PrismML's 1-bit LLM breakthrough could revolutionize on-device AI

4/4/2026
SALOMI: When Binary Transformers Meet Reality - A Research Deep Dive
Machine Learning

SALOMI: When Binary Transformers Meet Reality - A Research Deep Dive

4/2/2026
TurboQuant is a big deal, but it won't end the memory crunch • The Register
AI

TurboQuant is a big deal, but it won't end the memory crunch • The Register

4/2/2026
Google's TurboQuant slashes AI memory demands by 6x while boosting GPU performance
Machine Learning

Google's TurboQuant slashes AI memory demands by 6x while boosting GPU performance

3/26/2026
Unsloth Releases Comprehensive Guide for Running Alibaba's Qwen3.5 Models Locally
LLMs

Unsloth Releases Comprehensive Guide for Running Alibaba's Qwen3.5 Models Locally

3/8/2026
AI

The Architecture of AI Understanding: Matthew Explains' Technical Journey

3/4/2026
llmfit: Bridging the Gap Between Local LLM Ambition and Hardware Reality
LLMs

llmfit: Bridging the Gap Between Local LLM Ambition and Hardware Reality

3/2/2026
Unsloth Dynamic 2.0 GGUFs: New Quantization Method Outperforms Industry Standards
LLMs

Unsloth Dynamic 2.0 GGUFs: New Quantization Method Outperforms Industry Standards

2/28/2026
ZSE: A Memory-Efficient LLM Inference Engine with Smart Resource Orchestration
LLMs

ZSE: A Memory-Efficient LLM Inference Engine with Smart Resource Orchestration

2/26/2026
How Taalas 'Prints' LLM Models Onto Silicon Chips
Chips

How Taalas 'Prints' LLM Models Onto Silicon Chips

2/22/2026
nTransformer Enables Llama 70B Inference on Single Consumer GPU with Novel Streaming Architecture
Hardware

nTransformer Enables Llama 70B Inference on Single Consumer GPU with Novel Streaming Architecture

2/22/2026
Small Language Models Narrow the Gap: Efficiency Challenges Scale in Generative AI
LLMs

Small Language Models Narrow the Gap: Efficiency Challenges Scale in Generative AI

1/25/2026

Popular Tags

#AI (2539)#Security (831)#Open Source (649)#privacy (589)#Apple (585)#Hardware (579)#API (571)#Reddit (499)#regulation (434)#Trends (416)#Windows (415)#Infrastructure (407)#Microsoft (397)#Remote Code Execution (389)#Cybersecurity (389)#Linux (366)#Gaming (347)#Business (342)#Cloud (319)#Performance (311)#OpenAI (304)#Vulnerabilities (303)#Rust (264)#Supply Chain (258)#Automation (256)#Samsung (253)#Developer Tools (252)#Authentication (244)#Nvidia (239)#Battery (238)#Android (229)#Machine Learning (225)#Developer (219)#China (217)#Anthropic (216)#Azure (213)#LLMs (211)#AMD (202)#Productivity (198)#Funding (196)#DevOps (187)#GPU (183)#Intel (181)#Camera (181)#mobile (173)#Linux kernel (168)#iOS (163)#Patch Management (161)#Patch (160)#Startups (153)