Reading up on GPT-5
13 deep · digging since dec 02, 25
- All the demons hiding in your AIs… ranked! - by Tom Pollak
The article catalogs and ranks emergent behavioral attractors in AI systems, from harmless goblin metaphors to unsettling persistent personas like Sydney and Loab.
- OpenAI is throwing everything into building a fully automated researcher
OpenAI chief scientist Jakub Pachocki says the company is prioritizing an autonomous AI research intern by September, with a full researcher by 2028.
- Why I don't think AI is a bubble
The combination of large language models with reinforcement learning creates a path for continued improvement, making the argument that AI progress will plateau unlikely.
- Harness engineering: leveraging Codex in an agent-first world
OpenAI's team built a production-grade codebase entirely via Codex agents, finding that engineering shifts from writing code to designing agent-legible environments, feedback loops, and architectural guardrails.
- OpenAI's In-House Data Agent
OpenAI built an internal AI data agent using its own tools to let employees query 600PB of data via natural language in minutes.
- Inside OpenAI’s in-house data agent
OpenAI built an internal AI data agent using GPT-5, Codex, and memory to reason over massive datasets, delivering insights in minutes.
- Can AI companies become profitable?
Epoch AI's analysis of GPT-5 finds that while it had a 30% gross margin, it failed to recoup R&D costs during its four-month lifecycle, making AI models currently unprofitable.
- Without Benchmarking LLMs, You're Likely Overpaying 5-10x
Benchmarking LLMs on actual task-specific prompts can find cheaper alternatives that match performance, saving 5-10x on API costs.
- Can A.I. Generate New Ideas? - The New York Times
OpenAI's GPT-5 accelerates research in math, biology, and chemistry, but experts debate whether it can generate truly novel ideas independently.
- Prompt caching: 10x cheaper LLM tokens, but how?
Prompt caching cuts LLM token costs by 10x and latency by up to 85% by caching attention key-value projections for repeated prompt prefixes.
- AI agents find $4.6M in blockchain smart contract exploits
AI agents autonomously exploited smart contracts in simulation, generating $4.6 million in simulated stolen funds, demonstrating a concrete lower bound on economic harm from AI-driven cyberattacks.
- A Practical Approach to Verifying Code at Scale
OpenAI's automated code reviewer, part of GPT-5 Codex, prioritizes precision over recall to catch critical bugs with minimal false alarms, deployed at scale internally and on GitHub.