How To Use Decision Models for Evals – Hamel’s Blog

kept by eddie oct 21

The article demonstrates that decision models need careful threshold tuning and cost-performance evaluation, with OpenAI's model outperforming others at a premium.

Introducing System One Models & Jev - TypeSafe AI Blog
TypeSafe AI releases Jev, a System One model that provides structured, hallucination-free decisions at sub-500ms speeds, aiming to replace LLMs for automation workflows.
also on Jev, #performance, #ai, #developer-tools
Introducing Clairic, a new System One class of extraction models
Cloudflare introduces Clairic, a fast, cheap System One extraction model for extracting, computing, estimating, and forecasting values from unstructured data.
also on Jev, #machine-learning, #ai, #developer-tools
Mac mini alternatives for local LLMs: M6, M5 and Strix Halo
For local LLMs, memory bandwidth and size determine token speed and model capacity; Strix Halo offers more memory per dollar, while Apple Macs with higher bandwidth generate tokens faster.
also on #benchmarks, #performance, #machine-learning, #ai