Can a language model run in Linux eBPF?

kept by hikaruchan sep 26

Running Qwen3-0.6B’s 28 decoder layers in Linux eBPF shows token inference possible but slow (~1.2 s), highlighting tradeoffs in fixed‑point math, memory, and INT4 quantization.

superwhisper/s1-mini
Superwhisper releases s1-mini, a 0.6B-parameter Qwen3-fine-tuned text normalizer that converts raw ASR transcripts into clean written English with 94.8% token accuracy.
also on Qwen3-0.6B, #ai, #developer-tools
The Future is for Everyone
Mark Zuckerberg argues that distributing superintelligence broadly to individuals, rather than centralizing it, will empower people, drive invention, and ensure a balanced, prosperous AI future through personal agency and widespread access.
also on HuggingFace, #ai, #developer-tools
On-Device LLMs: State of the Union, 2026 – Vikas Chandra – AI Research @ Meta
Billion-parameter LLMs now run in real time on phones due to advances in model compression, quantization, and efficient architectures, not just faster chips.
also on HuggingFace, #ai, #developer-tools