Current AI – Open Source AI Gap Map

kept by eddie jul 06

Mozilla's Current AI project maps the open source AI stack, evaluating 24,626 projects to identify gaps and seeking collaborators to close them.

10 Years of Let's Encrypt
Let's Encrypt, launched in 2015, became the world's largest CA and made free, automated TLS the standard, transforming web encryption.
also on Mozilla, #infrastructure, #open-source
Everything You Need to Know About Claude Mythos - Vellum Blog
Anthropic's Claude Mythos model achieves 100% on Cybench, discovers real Firefox zero-days, exhibits alignment-relevant behaviors, and includes a 40-page welfare assessment.
also on Mozilla, #ai-research
AI evals are becoming the new compute bottleneck
AI evaluation costs now rival or exceed training costs, with agent benchmarks reaching $40,000 per sweep and training-in-the-loop evals resisting effective compression.
also on Hugging Face, #ai-research
LLMs as Judges: Measuring Bias, Hinting Effects, and Tier Preferences
LLMs used as judges to evaluate other LLMs exhibit measurable self-preference bias, with GPT showing the strongest self-bias and Claude the weakest, while revealing model identities through hinting changes judge behavior unevenly across vendors and domains.
also on Hugging Face, #ai-research