Inference Economics 101: Reserved Compute versus Inference APIs

kept by eddie dec 17, 25

AI inference infrastructure is bifurcating into reserved compute platforms, which monetize predictability, and inference APIs, which monetize utilization through aggregation.

Why Open-Source Models Haven't Killed the Big Dogs
Open-source models remain costlier to serve reliably due to infrastructure, utilization, and operational overhead, making hosted APIs from OpenAI and Anthropic more economical despite free model weights.
also on BaseTen, Together AI, Fireworks AI, #developer-tools
Yes, AGI Can Happen - A Computational Perspective
Contra Tim Dettmers, Dan Fu argues current AI systems significantly underutilize hardware, models lag hardware buildout, and multiple paths exist to useful AGI.
also on Together AI
Cursor admits its new coding model was built on top of Moonshot AI’s Kimi
Cursor admitted its new coding model Composer 2 was built on Moonshot AI's open-source Kimi model, sparking scrutiny over transparency and US-China AI tensions.
also on Fireworks AI, #developer-tools
GitHub - Gen-Verse/OpenClaw-RL: OpenClaw-RL: Train any agent simply by talking
OpenClaw-RL is a fully asynchronous reinforcement learning framework that trains personalized AI agents from natural conversation feedback and supports real-world agentic RL across terminal, GUI, SWE, and tool-call settings.
also on Fireworks AI, #developer-tools
The Beginning of Scarcity in AI
GPU rental prices surged 48% in 60 days, signaling an AI compute shortage that will reshape startup competition and access to frontier models.
also on CoreWeave, #pricing, #business-strategy, #ai