Building a Magic Mirror: AI retail experiences with Remix (2026) - Shopify

What this post added

This post details the development of a 'magic mirror' concept for physical retail experiences, leveraging AI and Remix. It describes the architecture, including a Remix route file that handles both server-side actions (LLM calls, SSE broadcasts) and client-side components. Key technical aspects include prompt engineering for LLMs (using vision input, JSON output schema, and product catalog as plain text), product matching logic, Server-Sent Events (SSE) for remote control, a client-side state machine for managing the user experience, and detailed prompt tuning strategies for safety and consistency. The implementation emphasizes a configurable approach, allowing for easy adaptation to different brands and events.