AI Retrospective, Predictions

kept by eddie mar 06

AI is shifting from chat interfaces to asynchronous agents and lower latency, reshaping software engineering, SaaS, and white-collar work.

Two different tricks for fast LLM inference
Anthropic's fast mode uses low-batch-size inference on the full model, while OpenAI's uses a smaller distilled model on Cerebras chips for much higher speed.
also on Cerebras, Claude, OpenAI, Anthropic, #ai, #developer-tools
Software engineering at a proprietary trading company: Optiver
Optiver, a proprietary trading firm, has evolved from latency-focused trading to AI-driven models, building custom hardware and full-stack systems while maintaining high engineering ownership and risk-averse speed.
also on Cerebras, OpenAI, Anthropic, #ai-agents, #software-engineering, #developer-tools