quantization

#quantization

9 articles tagged
llmfit: Bridging the Gap Between Local LLM Ambition and Hardware Reality
LLMs

llmfit: Bridging the Gap Between Local LLM Ambition and Hardware Reality

3/2/2026
Unsloth Dynamic 2.0 GGUFs: New Quantization Method Outperforms Industry Standards
LLMs

Unsloth Dynamic 2.0 GGUFs: New Quantization Method Outperforms Industry Standards

2/28/2026
ZSE: A Memory-Efficient LLM Inference Engine with Smart Resource Orchestration
LLMs

ZSE: A Memory-Efficient LLM Inference Engine with Smart Resource Orchestration

2/26/2026
How Taalas 'Prints' LLM Models Onto Silicon Chips
Chips

How Taalas 'Prints' LLM Models Onto Silicon Chips

2/22/2026
nTransformer Enables Llama 70B Inference on Single Consumer GPU with Novel Streaming Architecture
Hardware

nTransformer Enables Llama 70B Inference on Single Consumer GPU with Novel Streaming Architecture

2/22/2026
Small Language Models Narrow the Gap: Efficiency Challenges Scale in Generative AI
LLMs

Small Language Models Narrow the Gap: Efficiency Challenges Scale in Generative AI

1/25/2026
Voyage AI's Multimodal 3.5 Model Brings Video Retrieval to Production
AI

Voyage AI's Multimodal 3.5 Model Brings Video Retrieval to Production

1/24/2026
The End of One-Size-Fits-All LLM APIs: Why Workload-Specific Inference Is Taking Over
LLMs

The End of One-Size-Fits-All LLM APIs: Why Workload-Specific Inference Is Taking Over

1/22/2026
Black Forest Labs Releases FLUX.2 [klein] Models for Real-Time Visual Intelligence
AI

Black Forest Labs Releases FLUX.2 [klein] Models for Real-Time Visual Intelligence

1/17/2026

Popular Tags

#AI (1735)#Security (560)#Open Source (444)#privacy (433)#API (400)#Apple (391)#Hardware (382)#Reddit (352)#regulation (324)#Trends (297)#Cybersecurity (284)#Infrastructure (284)#Business (251)#Cloud (244)#Microsoft (238)#Linux (233)#Gaming (228)#OpenAI (223)#Remote Code Execution (216)#Performance (215)#Windows (212)#Rust (198)#Vulnerabilities (195)#Developer Tools (194)#Automation (174)#Android (171)#Supply Chain (168)#Samsung (167)#China (158)#Battery (156)#Machine Learning (155)#LLMs (153)#Productivity (148)#Azure (147)#Nvidia (146)#Anthropic (144)#Funding (139)#Developer (136)#mobile (131)#DevOps (131)#AMD (127)#Authentication (126)#Intel (122)#rate-limiting (121)#Linux kernel (121)#iOS (117)#GPU (117)#LLM (113)#Camera (112)#CISA (105)