Reading up on BaseTen
2 deep · digging since dec 17, 25
- Why Open-Source Models Haven't Killed the Big Dogs
Open-source models remain costlier to serve reliably due to infrastructure, utilization, and operational overhead, making hosted APIs from OpenAI and Anthropic more economical despite free model weights.
- Inference Economics 101: Reserved Compute versus Inference APIs
AI inference infrastructure is bifurcating into reserved compute platforms, which monetize predictability, and inference APIs, which monetize utilization through aggregation.