on-device AI

8 stories tagged on-device AI.

Gemini Nano Gets Faster on Pixel Without Retraining

Google's frozen Multi-Token Prediction retrofits speed gains onto existing Gemini Nano models—no retraining needed. Here's what that means for on-device AI.

Person wearing glasses against Earth backdrop with AI model comparison chart showing Qwen and Llama parameters, AI Engineer…

When Small AI Models Beat Frontier Ones on Your Tasks

Dev Kapoor4 weeks ago

AI. Dev Kapoor4 weeks ago

When Small AI Models Beat Frontier Ones on Your Tasks

RL Nabors walks through a real eval framework for replacing frontier model calls with local SLMs—and the results are more nuanced than the pitch suggests.

Man with glasses presenting AI research papers about text-guided image editing and Google DeepMind technology against dark…

Text Diffusion AI: Speed, Privacy, and Ambient Risk

Rachel "Rach" Kovacs2 months ago

AI. Rachel "Rach" Kovacs2 months ago

Text Diffusion AI: Speed, Privacy, and Ambient Risk

Google DeepMind's text diffusion model generates AI responses differently—and faster. Here's what that architectural shift means for privacy and everyday users.

Woman with brown hair in front of AI architecture diagrams showing attention mechanisms and MoE layers, with AI Engineer…

Google's Gemma 4 Makes Powerful AI Run on Your Phone

Yuki Okonkwo3 months ago

AI. Yuki Okonkwo3 months ago

Google's Gemma 4 Makes Powerful AI Run on Your Phone

Gemma 4 brings multimodal AI models to phones and laptops with clever architecture tricks that make 5B parameters perform like much larger models.

Phone displaying Google AI Edge Gallery interface with Gemma 4 options, alongside text promoting local AI model running…

Google Just Made Running LLMs on Your Phone Actually Simple

Dev Kapoor4 months ago

AI. Dev Kapoor4 months ago

Google Just Made Running LLMs on Your Phone Actually Simple

Google's AI Edge Gallery lets anyone run large language models locally on their phone—no developer account, no cloud, no data sharing. Here's what that means.

Bold red and blue text announcing Google's 100x release with "Gemma 4" highlighted in a white rounded box below

Google's Gemma 4: Running Frontier AI on Your Phone

Mike Sullivan4 months ago

AI. Mike Sullivan4 months ago

Google's Gemma 4: Running Frontier AI on Your Phone

Google's Gemma 4 brings frontier-level AI to consumer devices. Free, open-source, and offline-capable—but does it deliver on the promise?

Quinn 3.5 Runs AI Models On Your Phone Without Internet

Rachel "Rach" Kovacs5 months ago

AI. Rachel "Rach" Kovacs5 months ago

Quinn 3.5 Runs AI Models On Your Phone Without Internet

The Qwen 3.5 AI model runs entirely on your iPhone with zero internet connection. We tested how well local AI works when privacy actually matters.

Blue gradient background with "THIS IS INSANE!" headline and Google AI Edge branding showing four key features: on-device,…

Google's AI Edge: Revolution or Just Hype?

Marcus Chen-Ramirez6 months ago

AI. Marcus Chen-Ramirez6 months ago

Google's AI Edge: Revolution or Just Hype?

Google AI Edge lets AI models run on phones sans cloud, sparking debates on privacy and performance.