Reading up on GPT-4o
5 deep · digging since nov 28, 25
- I Tried to Make AI Writing Sound Human by Banning AI Words Through logit_bias - Vincent Schmalbach
The author applied logit_bias to penalize AI‑common tokens, observing a roughly one‑third reduction in those words while sacrificing one acceptable rewrite out of eight.
- The Problem is Prompt Debt
Hand-tuning natural language prompts for AI systems accumulates debt that slows iteration, locks teams to one model, and should be replaced with metrics, tests, and automated prompt optimization.
- How does AI impact skill formation?
A 2025 Anthropic study shows AI-assisted coding can reduce skill retention but 25% speed boost emerges when ignoring participants who manually retyped AI code.
- [2601.02439] WebGym: Scaling Training Environments for Visual Web Agents with Realistic Tasks
WebGym, an open-source environment with 300k realistic tasks, enables RL training that boosts a vision-language model's success rate on unseen websites from 26.2% to 42.9%.
- More Articles Are Now Created by AI Than Humans
In November 2024, the quantity of AI-generated articles published online surpassed human-written articles, though the proportion has plateaued since May 2024.