Reading up on Together AI

Open-source models remain costlier to serve reliably due to infrastructure, utilization, and operational overhead, making hosted APIs from OpenAI and Anthropic more economical despite free model weights.

AI inference infrastructure is bifurcating into reserved compute platforms, which monetize predictability, and inference APIs, which monetize utilization through aggregation.

Contra Tim Dettmers, Dan Fu argues current AI systems significantly underutilize hardware, models lag hardware buildout, and multiple paths exist to useful AGI.