local AI

10 stories tagged local AI.

Two high-end graphics cards clash with lightning effects between them, labeled "1-BIT MODELS" with text "THE GAME CHANGED…

PrismML's Bonsai 27B Brings Qwen to Consumer Hardware

PrismML's Bonsai 27B runs Qwen 3.6 27B on 10GB of RAM using ternary compression. Here's what the benchmarks show—and what they don't.

Five men in casual business attire participate in a panel discussion about local AI, with company logos (NVIDIA, Roboflow,…

Local AI's Inflection Point: Useful, Not Just Interesting

Dev Kapoor6 days ago

AI. Dev Kapoor6 days ago

Local AI's Inflection Point: Useful, Not Just Interesting

A panel of local AI builders at NVIDIA, Roboflow, Exo Labs, and r/LocalLLaMA maps where the movement stands—and what still needs solving.

Google AI Edge Gallery interface displaying Gemma-4 12B-it model with bold white text overlay reading "GEMMA-4 12B IS…

Gemma 4 12B Brings Local Agentic AI to Laptops

Yuki Okonkwo1 month ago

AI. Yuki Okonkwo1 month ago

Gemma 4 12B Brings Local Agentic AI to Laptops

Google's Gemma 4 12B is a multimodal local AI model built for real agentic workflows on 16GB laptops—here's what the architecture actually means.

Can AMD Finally Compete for Local AI Workloads?

Marcus Chen-Ramirez2 months ago

AI. Marcus Chen-Ramirez2 months ago

Can AMD Finally Compete for Local AI Workloads?

AMD's ROCm platform has quietly matured. Sam Witteveen tests a Threadripper + Radeon AI Pro workstation on LLMs, image gen, and training. Here's what he found.

A futuristic setup showcasing a GPU labeled with 70B and 100B LLM models alongside development screens, with "TERNARY IS…

Ternary Models Promise Full AI Power at Fraction of Size

Mike Sullivan3 months ago

AI. Mike Sullivan3 months ago

Ternary Models Promise Full AI Power at Fraction of Size

PrismML's new ternary models claim to deliver FP16-level AI accuracy at 7-8x smaller size. We examine what's real and what's still theoretical.

A person in a blue shirt squeezes a small white Apple device while displaying an intense expression, with "4X SQUEEZE" text…

TurboQuant Makes 16GB Macs Actually Useful for AI

Tyler Nakamura3 months ago

AI. Tyler Nakamura3 months ago

TurboQuant Makes 16GB Macs Actually Useful for AI

New compression tech lets budget Macs run large language models that previously required 128GB. Here's what actually changed and what it means for you.

Hands holding a bright blue Intel Arc Pro B70 graphics card against a white surface.

Intel's B70 GPU: Where Hardware Promise Meets Software Reality

Rachel "Rach" Kovacs3 months ago

AI. Rachel "Rach" Kovacs3 months ago

Intel's B70 GPU: Where Hardware Promise Meets Software Reality

Intel's Arc Pro B70 outperforms pricier competitors on paper, but the software stack tells a different story. Real-world benchmarks reveal what matters.

Google's Gemma 4: Local AI That Doesn't Need the Cloud

Bob Reynolds3 months ago

AI. Bob Reynolds3 months ago

Google's Gemma 4: Local AI That Doesn't Need the Cloud

Google's Gemma 4 brings cloud-level AI to your laptop. Free, offline, commercially usable—but is local AI ready to replace the cloud model?

Google Gemma 4 chat interface with starry background, showing message input box and installation guide text, Windows and…

Google's Gemma 4 Brings Powerful AI to Consumer Hardware

Dev Kapoor4 months ago

AI. Dev Kapoor4 months ago

Google's Gemma 4 Brings Powerful AI to Consumer Hardware

Google released Gemma 4 under Apache 2.0 license. The open model runs on standard GPUs, challenging the assumption you need enterprise hardware for capable AI.

Man in blue shirt holds laptop displaying "prompt" with "480B" text and blue app icon against yellow background

How to Run Massive AI Models on a MacBook Air

Yuki Okonkwo4 months ago

AI. Yuki Okonkwo4 months ago

How to Run Massive AI Models on a MacBook Air

LM Studio's new remote access feature lets you run 480B parameter models from a 16GB MacBook Air. Here's how it actually works in practice.