Reading up on Qwen3

Open-weight LLMs now uniformly use Mixture-of-Experts transformers, with key differences in attention mechanisms, expert count, post-training via RL, and permissible licenses.

NVIDIA's Nemotron-Terminal models, trained on a new open-source synthetic dataset, dramatically boost terminal task accuracy, with the 32B parameter version matching much larger models on Terminal-Bench 2.0.