quantization

#quantization

18 articles tagged
nTransformer Enables Llama 70B Inference on Single Consumer GPU with Novel Streaming Architecture
Hardware

nTransformer Enables Llama 70B Inference on Single Consumer GPU with Novel Streaming Architecture

2/22/2026
Small Language Models Narrow the Gap: Efficiency Challenges Scale in Generative AI
LLMs

Small Language Models Narrow the Gap: Efficiency Challenges Scale in Generative AI

1/25/2026
Voyage AI's Multimodal 3.5 Model Brings Video Retrieval to Production
AI

Voyage AI's Multimodal 3.5 Model Brings Video Retrieval to Production

1/24/2026
The End of One-Size-Fits-All LLM APIs: Why Workload-Specific Inference Is Taking Over
LLMs

The End of One-Size-Fits-All LLM APIs: Why Workload-Specific Inference Is Taking Over

1/22/2026
Black Forest Labs Releases FLUX.2 [klein] Models for Real-Time Visual Intelligence
AI

Black Forest Labs Releases FLUX.2 [klein] Models for Real-Time Visual Intelligence

1/17/2026

Popular Tags

#AI (2635)#Security (865)#Open Source (666)#privacy (608)#Hardware (597)#Apple (591)#API (581)#Reddit (507)#regulation (448)#Windows (443)#Infrastructure (427)#Trends (426)#Microsoft (423)#Remote Code Execution (413)#Cybersecurity (402)#Linux (386)#Gaming (360)#Business (345)#Cloud (333)#Performance (325)#OpenAI (321)#Vulnerabilities (314)#Rust (273)#Supply Chain (267)#Automation (260)#Samsung (258)#Developer Tools (255)#Battery (250)#Authentication (249)#Nvidia (244)#Android (240)#Anthropic (239)#Machine Learning (231)#Developer (223)#Azure (220)#China (218)#LLMs (218)#AMD (208)#Productivity (206)#Funding (201)#Intel (193)#DevOps (192)#Camera (188)#GPU (186)#mobile (178)#Linux kernel (177)#Patch Management (175)#Patch (169)#iOS (167)#Startups (159)