We Got Claude to Fine-Tune an Open Source LLM

kept by eddie dec 05, 25

Hugging Face released an open-source 'skill' that lets Claude Code, Codex, and Gemini CLI autonomously fine-tune LLMs on cloud GPUs and push models to the Hub.

9 Observations from Building with AI Agents
Building AI agents reveals nine lessons including using best models for prototyping, fine-tuning for stable tasks, static typing to reduce hallucinated code, and closed-loop prompt optimization.
also on #fine-tuning, #developer-tools
Can I run AI locally?
The site canirun.ai estimates which local AI models a given machine can run based on hardware specs, but commenters found its RAM detection and speed predictions inaccurate for modern hardware.
also on Llama.cpp, Hugging Face, #open-source, #developer-tools
GitHub - RunanywhereAI/RCLI: Talk to your Mac, query your docs, no cloud required. On-device voice AI + RAG
RCLI is an open-source, on-device voice AI for macOS that runs STT, LLM, TTS, and VLM entirely locally on Apple Silicon, with sub-200ms latency and no cloud dependency.
also on Llama.cpp, #cli, #open-source, #developer-tools
Google's new Gemma 4 12B model is designed to run on any laptop with 16GB of RAM - Ars Technica
Google's Gemma 4 12B model uses Multi-Token Prediction and a streamlined multimodal encoder to run efficiently on laptops with 16GB RAM, matching larger models.
also on Hugging Face, #generative-ai, #open-source, #developer-tools
Gemma 4 WebGPU Kernels - a Hugging Face Space by webml-community
Gemma 4 E2B runs locally in-browser via WebGPU, letting users prompt the model directly without server-side inference.
also on Hugging Face, #generative-ai, #open-source