Reading up on Qwen
25 deep · digging since nov 26, 25
- Local Qwen isn't a worse Opus, it's a different tool
Local Qwen models are a different tool from frontier LLMs, offering privacy and fixed costs but suffering from looping and hallucination issues.
- Running local models is good now
Local agentic coding models have reached surprising quality and usability over the past six months, now offering ~75% of frontier-model accuracy for many development tasks on a 64GB M2 Mac.
- GitHub - ideogram-oss/ideogram4: Ideogram 4: Open image model at the forefront of design
Ideogram 4 is an open-weight text-to-image foundation model with structured JSON prompting, best-in-class text rendering, and state-of-the-art design generation performance.
- Using AI to write better code more slowly
Hacker News commenters consistently report that using AI for code review and iterative refinement yields better code, but takes significantly longer than manual coding.
- Local AI needs to be the norm
Commenters argue local AI is already viable for many tasks and will become the norm, driven by open-weights models and privacy concerns, not just cloud convenience.
- AI's Plummeting Prices Are a Software Story, Not a Hardware One
The rapid decline in AI inference costs is driven by software innovations rather than hardware, enabling local open-weight models to compete with frontier APIs.
- Localmaxxing | Tomasz Tunguz
About half of agent tasks succeed on a local 35B model, with 2.1x faster latency than cloud models, making local inference advantageous for routine work.
- Long AI Short AGI - by Ramy Adeeb - 1984 Newsletter
The piece argues that AI models will commoditize like past technologies, making customer relationships and workflows more valuable than owning the base model.
- Unsloth Studio | Hacker News
Unsloth launches Unsloth Studio, an open-source, no-code web UI for locally running, training, and exporting 500+ open models with 2x faster training and 70% less VRAM.
- How to run Qwen 3.5 locally
Hacker News commenters share experiences and benchmarks for running Qwen 3.5 locally, covering hardware choices, quantization trade-offs, and practical coding performance.
- No, it doesn't cost Anthropic $5k per Claude Code user - Martin Alderson
The viral claim that Anthropic loses $5,000 per Claude Code Max subscriber confuses retail API prices with actual inference costs, which are roughly 10x lower.
- Something is afoot in the land of Qwen
Alibaba's Qwen team lead Junyang Lin and several other key researchers resigned, potentially losing the team behind the impressive open-weight Qwen 3.5 models.
- THE 2028 GLOBAL INTELLIGENCE CRISIS
Rapid AI-driven automation of white-collar work could trigger a deflationary spiral by destroying consumer demand faster than productivity gains can compensate.
- AI #156 Part 1: They Do Mean The Effect On Jobs
AI is now visible in US productivity statistics as job growth revises down but GDP stays strong, indicating a structural shift from AI-driven automation.
- Show HN: isometric.nyc – giant isometric pixel art map of NYC
An isometric pixel-art map of NYC was created by using a few dozen hand-tuned AI outputs to fine-tune Qwen, enabling seamless tile generation at massive scale with zero handwritten code.
- GitHub - THUDM/CaRR: This repository contains the code and data for the paper "Chaining the Evidence: Robust Reinforcement Learning for Deep Search Agents with Citation-Aware Rubric Rewards".
Citation-aware rubric rewards (CaRR) and C-GRPO training improve deep search agents' reasoning quality and factual grounding over standard binary outcome rewards.
- 8 plots that explain the state of open models
Qwen dominates open-model downloads and finetunes globally, while DeepSeek leads in large-scale models and GPT-OSS is the only Western contender gaining adoption.
- 2025: The year in LLMs
The 2025 LLM landscape was defined by reasoning models, coding agents, Chinese open weight models, prompt-driven image editing, CLI tools, and OpenAI losing its lead.
- A guide to local coding models
Local coding models are not yet worth the hardware cost for most users, as proprietary cloud models offer better quality and lower upfront investment.
- State of AI | OpenRouter
An empirical study of over 100 trillion LLM tokens on OpenRouter reveals rising open-weight adoption, dominant roleplay and coding tasks, and a 'Glass Slipper' retention effect.
- AI infrastructure in the "Era of experience"
As open-source LLMs commoditize due to fierce Chinese competition, companies can build defensible moats through custom RL models trained on proprietary environments using LoRA and GRPO.
- LLMs can invent their own compression - Rajan Agarwal
Co-training a summarizer and generator via RL lets an LLM learn its own text compression scheme, achieving ~9.5% context size with minimal prediction loss.
Takes
This is a killer stack I just started using Wafer to serve my qwen3.6-27b custom fine tuned llm and it's excellent
@garrytan
This is a glimpse of big changes ahead of us. If you’re betting on big central models you should think twice. I run the exact same setup (M5 MacBook, qwen3.6-27B, pi, ollama) and while its not as fast or good as one of the big central models, it’s past the line of “cool demo” into “truly useful.” Kind of where the big frontier models were in late 2025. In ~24 months we might have local models that are fast and good enough for most tasks.
@rsms
We’ve post trained a model on top of Qwen that achieves Pareto optimality on accuracy-cost curves. Unlike our previous post trained models, this model has been trained to be good at search and tool calls simultaneously, allowing us to unify the tool call router and summarization together in one model. The resulting model performs better than GPT and Sonnet in terms of cost efficiency to serve daily Perplexity queries in production. The production model runs on our own inference platform. We’re already serving a significant chunk of our daily traffic with this model and intend to have it serve all of default traffic pretty soon. More research to follow soon on models we’re training and deploying for Comet and Computer.
@AravSrinivas