local LLM

8 stories tagged local LLM.

Bold “One File, Eight Sizes” text beside a glowing, smiling hugging emoji on a fiery red-black background

Qwen3.8-27B Fits a 12GB Card, Except When It Can See

A 27B multimodal model now ships as an 11.8GB download, but the byte math shows a 12GB GPU has almost no context left once images load.

A bright yellow potion bottle illustration with red cork on black background, displaying bold text "BOTTLENECKED SOLVED"…

Qwen3.8-Flash-Next Puts 180B Parameters on Laptop Hardware

Yuki Okonkwo2 weeks ago

AI. Yuki Okonkwo2 weeks ago

Qwen3.8-Flash-Next Puts 180B Parameters on Laptop Hardware

Qwen3.8-Flash-Next uses a 51B engram lookup table in system RAM to run 180B parameters on modest hardware. Here's what the architecture actually means.

Glowing neon cubes with colorful lights and text asking "How are these free?" against a dark background

Self-Hosted AI Tools That Replace Paid SaaS

Dev Kapoor4 weeks ago

AI. Dev Kapoor4 weeks ago

Self-Hosted AI Tools That Replace Paid SaaS

Ten open-source AI tools—from Tesseract OCR to OpenHands—that run locally, protect your data, and eliminate SaaS subscriptions. Here's what works and what doesn't.

Two developers collaborate at a desk with GitHub interface displayed on monitor, surrounded by green neon lighting and code…

July 2026 GitHub Trending: What Developers Actually Built

Dev Kapoor2 months ago

AI. Dev Kapoor2 months ago

July 2026 GitHub Trending: What Developers Actually Built

35 projects topped GitHub's trending list in July 2026. The patterns they form say more about developer priorities than any roadmap ever could.

Man in blue shirt displays open computer case with RGB fans and "748GB" label at DGX Station desk setup

Nvidia's DGX Station GB300: Desktop AI Agent Testing

Bob Reynolds2 months ago

AI. Bob Reynolds2 months ago

Nvidia's DGX Station GB300: Desktop AI Agent Testing

Alex Ziskind tests Nvidia's GB300-powered DGX Station desktop, running 128 simultaneous AI agents. Here's what the numbers actually reveal about on-premise AI.

Developer at triple-monitor setup with code displayed, purple ambient lighting, GitHub trending projects theme with yellow…

35 Trending GitHub Projects Reshaping AI Dev

Yuki Okonkwo4 months ago

AI. Yuki Okonkwo4 months ago

35 Trending GitHub Projects Reshaping AI Dev

From hallucinating browsers to retro Rust IDEs, GitHub's trending list this week is a real-time snapshot of where AI tooling is actually heading.

Perplexica: Free AI Search Engine That Runs on Your Laptop

Marcus Chen-Ramirez6 months ago

AI. Marcus Chen-Ramirez6 months ago

Perplexica: Free AI Search Engine That Runs on Your Laptop

Perplexica is an open-source alternative to Perplexity that runs locally. But do you actually want an AI search engine that never leaves your machine?

Bold "ONE TOOL" text with icons for AI, linking, and databases pointing to a modern app interface icon

AnythingLLM Wants to Replace Your Entire Local AI Stack

Dev Kapoor7 months ago

AI. Dev Kapoor7 months ago

AnythingLLM Wants to Replace Your Entire Local AI Stack

AnythingLLM promises to consolidate Ollama, LangChain, and vector databases into one workspace. Does it solve local LLM workflow problems or just hide them?