How we raised mobile end-to-end test stability to 98% (2026) - Shopify

kept by eddie sep 04

Shopify rebuilt its mobile E2E testing framework using a strict builder API and computer vision, raising test stability from 50% to 98%.

Pi, Minimal and Performant
Pi's minimal coding harness improves cost and performance by using fewer tools and less context, validated by Databricks' benchmark and Shopify's extensible pi-autoresearch extension.
also on Shopify, #open-source, #software-engineering, #developer-tools
Shopify/liquid: Performance: 53% faster parse+render, 61% fewer allocations
Shopify CEO Tobias Lütke used the autoresearch pattern with a coding agent to achieve 53% faster parse+render and 61% fewer allocations in the Liquid template engine.
also on Shopify, #open-source, #developer-tools