Reading up on GPT-5.3-Codex-Spark
2 deep · digging since feb 13
- Two different tricks for fast LLM inference
Anthropic's fast mode uses low-batch-size inference on the full model, while OpenAI's uses a smaller distilled model on Cerebras chips for much higher speed.
- Introducing GPT-5.3-Codex-Spark
OpenAI releases GPT-5.3-Codex-Spark, a real-time coding model with 1000+ tokens per second via Cerebras hardware, available in research preview for ChatGPT Pro users.