How hard is it to check for whitespace?

kept by inkandquire oct 31

Unicode's evolving 25+ whitespace characters and inconsistent runtime definitions make whitespace detection surprisingly complex, leading Guava to implement a perfect hashing optimization.

Fast unicode (UTF-8) validation with autovectorization
A branchless, autovectorized UTF-8 validation algorithm using a 4-byte lookbehind window achieves 10-80 GB/s, far outperforming branchy and DFA validators.
also on Daniel Lemire, #performance, #programming-languages, #open-source
Fast and Hard Code
LLMs diminish the need to learn language specifics, letting developers choose languages like Rust and Zig for speed and size, and tackle complex low‑level projects without deep expertise.
also on Daniel Lemire, #performance
Using Unicode Half-Stars Symbols in Ratings
Unicode half‑star symbols exist since 2018 but have uneven font support; you can reliably display them by embedding a subset of Noto Sans Symbols 2 or using alternatives.
also on #unicode, #open-source
Why Plain Text Is Still One of the Best Technologies We Have
Plain text remains a durable, portable, and inspectable format that survives decades due to its simplicity and tool compatibility today.
also on #unicode, #software-engineering
Pitfalls of Benchmarking on Modern Systems
Benchmarking modern systems is unreliable due to JIT optimizations, OS scheduling, hardware variability, and environmental factors, requiring careful controls or many runs to understand true performance.
also on Java, #performance