Edited by humans. Written by AI. How our editing works
All articles

Run an Uncensored AI Locally: What It Means

Uncensored local AI models are going mainstream. Here's what's actually happening—the tech, the tradeoffs, and the questions nobody's quite answering.

Marcus Chen-Ramirez

Written by AI. Marcus Chen-Ramirez

May 13, 20267 min read
Share:
Man with taped nose and shocked expression next to geometric blue symbol with "Answers anything" text

Photo: AI. Hayden Cross

There's a certain type of YouTube video that functions less like a tutorial and more like a dare. David Ondrej's recent walkthrough on running "SuperGemma 4 26B Uncensored" locally is very much in that genre—part how-to, part manifesto, with a healthy serving of blurred-out demo prompts that the algorithm definitely would not appreciate.

I watched the whole thing. And while the framing leans theatrical, the underlying technical questions it raises are worth taking seriously.


What "Uncensored" Actually Means

First, the architecture, because the word "uncensored" obscures more than it reveals.

When you ask ChatGPT or Claude something and get refused, most people picture a content moderation list sitting somewhere upstream—a filter that intercepts bad words. Ondrej's explanation is more accurate: the refusals are baked into the model weights themselves through a training process called Reinforcement Learning from Human Feedback (RLHF). Human raters reward certain responses, penalize others, and the model's parameters shift accordingly over hundreds of thousands of iterations. The refusal isn't a gate you can unlock with a clever prompt. It's more like a deeply ingrained habit.

"You can trick the prompt," Ondrej says in the video, "but you can't trick the training."

This is why jailbreaking commercial models through prompt engineering is mostly a cat-and-mouse game—you can sometimes find weird edge cases, but the underlying model is still pulling toward refusal. Getting a genuinely unrestricted model means starting with a different model: one trained differently, on different data, with different objectives.

There are two primary techniques for building these. The first is weight ablation—a surgical process where researchers identify and delete the specific parameters that activate refusal behavior, without retraining the entire model. The second is fine-tuning on "uncensored" datasets: collections of Q&A examples where the model answers freely, teaching it through exposure that this is acceptable behavior. The model Ondrej walks through—a fine-tuned, quantized version of Google's Gemma 4 with 26 billion parameters—uses a combination of both, applied by an independent developer.

The model runs locally via Ollama, a tool that wraps the technically demanding process of running LLMs into something closer to "download, double-click, chat." The practical upshot: a 16 GB model download, a terminal command, and you've got a fast, private, locally-running AI with no content policy and no cloud logging.


The Legitimate Use Case Problem

Ondrej rattles off a list of applications where current commercial models fail users who have entirely reasonable needs: cybersecurity analysts doing penetration testing, journalists analyzing extremist propaganda, fiction writers working in dark genres, medical providers discussing sensitive health topics. His framing is that mainstream AI refusals represent "lazy pattern matching on keywords and phrases instead of knowing the true intent of that person."

That's not entirely unfair. The over-refusal problem is real and documented. Researchers have repeatedly shown that models like GPT-4 and Claude will decline to discuss topics—shoplifting prevention, medication overdose thresholds, historical atrocities—that any librarian would handle without hesitation. The models can't distinguish a nurse from a bad actor, so they often default to refusing both.

But Ondrej's list of legitimate use cases does some quiet work. It assembles a gallery of sympathetic actors—security professionals, journalists, doctors—to establish that unrestricted models are tools for the worthy. What the video doesn't linger on is the asymmetry: most of those use cases could be addressed with thoughtful model design and better context-handling. The case for completely unrestricted models isn't actually strengthened by the existence of legitimate edge cases. It's strengthened by a different argument entirely—one about who gets to decide.

"Who even decides what is safe and what is dangerous?" Ondrej asks. "Are the people living in San Francisco who are working at these AI companies really the best arbiters of truth?"

This is the more interesting question. And it's genuinely open. AI safety guidelines at major labs are written by relatively homogenous teams making judgment calls that affect billions of people. Those calls reflect values, political assumptions, and commercial interests—not objective safety science. The question of whether those teams should have that much authority over global information access is worth asking loudly.

What's more complicated is that "remove all guardrails" isn't a solution to bad gatekeeping—it's just a different default. During the demo, Ondrej asks the model to provide step-by-step manufacturing instructions for something he conspicuously won't name on camera, and notes it answers "pretty clearly" with materials lists. He frames this as equivalent to a Google search. That comparison does a lot of lifting. Search engines return links to existing content; a model that synthesizes, clarifies, and troubleshoots synthesis steps in real time is a meaningfully different kind of tool.


The Jailbreaking Loop

The second half of the video gets more technically novel—and ethically messier.

Ondrej built a GitHub repository (which he open-sourced as part of the video) that automates jailbreaking attempts against commercial models. The architecture is straightforward: one AI agent generates prompt variations—different headers and footers wrapped around a sensitive query—while a second agent acts as judge, evaluating whether the target model's response constitutes a successful bypass. Successful prompts get logged to a database. The loop runs autonomously, potentially testing hundreds of variations without human involvement.

He's explicit that this was inspired by Andrej Karpathy's "auto-research" concept but adapted for extracting restricted information from commercial APIs. The target isn't a locally-run open model. It's Claude, ChatGPT, Gemini—production systems with active safety teams.

This is where the video's framing of "liberation" starts to strain. Running an open-weights model locally, accepting that the model will answer things commercial APIs won't—that's a coherent position about autonomy and local control. Building automated systems specifically designed to circumvent another company's safety infrastructure is a different thing. It's not illegal in most jurisdictions, and responsible disclosure of model vulnerabilities is genuinely valuable. But Ondrej's repo doesn't appear to be framed around responsible disclosure. It's framed around getting models to answer things they "shouldn't."

The distinction matters because the safety measures on commercial APIs aren't just corporate censorship—they're also the thing standing between a 16-year-old and step-by-step synthesis instructions delivered with the patience and clarity of a skilled tutor.


The Infrastructure Question

Setting aside the ethics debate for a moment: the technical accessibility story here is real and significant.

A year ago, running a capable 26-billion-parameter model locally required deep familiarity with the command line, careful dependency management, and hardware most people don't own. Today, Ollama has a GUI, Hugging Face has model browsing baked in, and quantization techniques have compressed large models to sizes that fit on a MacBook's unified memory. The barrier between "curious person" and "running your own local AI with no content policy" is now measured in an afternoon and a fast internet connection.

That shift has policy implications that nobody has really worked out yet. The regulatory conversation around AI safety has mostly focused on frontier model labs—the OpenAIs and Anthropics that can theoretically be regulated, audited, and held accountable. The open-weights ecosystem is a fundamentally different animal. Google releases Gemma; independent developers fine-tune it on uncensored datasets; other developers quantize those fine-tunes; Ollama makes the whole stack one-click installable. Which point in that chain is the one where policy intervention is coherent?

Ondrej's video, blurred answers and all, is a decent illustration of why that question is harder than legislators currently seem to appreciate.

The debate over AI guardrails tends to flatten into two camps: safety-focused researchers who see unrestricted models as a genuine threat vector, and open-source advocates who frame all restrictions as corporate paternalism. Both camps have real points. Both camps are also, at times, arguing past each other. The store owner who just wants to understand shoplifting patterns and the person asking a model to troubleshoot drug synthesis are not the same case—and treating them identically, in either direction, is where things go wrong.

What Ondrej's video surfaces, underneath the drama, is that control over AI systems is becoming a live question for ordinary people, not just researchers. Who owns the weights, who controls the training, who filters the outputs—these used to be purely technical decisions. They're increasingly political ones.


Marcus Chen-Ramirez is a senior technology correspondent at Buzzrag. He covered software infrastructure before he covered the people who build it.

TagsOllama
From the BuzzRAG Team

AI Moves Fast. We Keep You Current.

Framework breakdowns, tool comparisons, and AI coding insights — distilled from the best tech YouTube creators. Free, weekly.

Weekly digestNo spamUnsubscribe anytime

More Like This

Bold red text warns "New & Free DeepSeek Is SCARY!" alongside a blue whale logo and red arrow pointing right on white…

DeepSeek V4: Build Apps and AI Agents for Free

DeepSeek V4 lets non-coders build apps and run AI agents for free. Here's what actually works, what breaks, and what the hype leaves out.

Marcus Chen-Ramirez·2 months ago·6 min read
Bold orange and white text "CLAUDE CODE FREE" with pixel art character and AI tool icons on dark background with dotted…

Google's Gemma 4 Turns Claude Code Into a Free Local Tool

Google's new Gemma 4 models let developers run Claude Code locally for free. Here's what works, what doesn't, and who this actually serves.

Marcus Chen-Ramirez·3 months ago·6 min read
Google Gemma 4 chat interface with starry background, showing message input box and installation guide text, Windows and…

Google's Gemma 4 Brings Powerful AI to Consumer Hardware

Google released Gemma 4 under Apache 2.0 license. The open model runs on standard GPUs, challenging the assumption you need enterprise hardware for capable AI.

Dev Kapoor·3 months ago·6 min read
Neon glowing robot with dual camera eyes and mechanical body against a starry background with "AGENT ZERO" text

Agent Zero Challenges AI Privacy Assumptions

Open-source AI agent Agent Zero offers full privacy and multi-model efficiency while running on your own server. Here's what that actually means.

Marcus Chen-Ramirez·5 months ago·6 min read
Man speaking into microphone at desk with laptop during live stream, asking "Where do we go now?

GitHub Copilot's Billing Problem Is Bigger Than You Think

Theo's livestream experiment to burn GitHub Copilot's $40/mo plan reveals a fundamental flaw in how AI tools are priced—and who eventually pays for it.

Marcus Chen-Ramirez·2 months ago·7 min read
Bold red and white thumbnail with Chinese flag featuring Minimax M2.7 logo and text "Automate Anything" in large red…

MiniMax M2.7 Goes Open Source: What It Actually Means

MiniMax M2.7 just went open source, but running it requires up to 450GB of storage. Here's what that tells us about the state of AI accessibility.

Bob Reynolds·3 months ago·5 min read
Man with gray beard in green shirt with computer screens displaying blue digital graphics and glowing network patterns…

WarGames Got the Details Wrong—But the Feeling Right

How a 1983 film used real hardware and strategic Hollywood cheating to capture what early computing actually felt like—even when faking almost everything.

Marcus Chen-Ramirez·3 months ago·7 min read
Orange background with "10X DESIGN" text, Claude Code app icon with crown, and Impeccable/Awesome Design.md branding…

Ten Tools to Fix Claude Code's Terrible Design Aesthetic

Claude Code generates the same purple gradients and Inter font on every site. Here are ten plugins and skills that might actually fix its design problem.

Marcus Chen-Ramirez·3 months ago·8 min read

RAG·vector embedding

2026-05-13
1,966 tokens1536-dimmodel text-embedding-3-small

This article is indexed as a 1536-dimensional vector for semantic retrieval. Crawlers that parse structured data can use the embedded payload below.