NEWS · COMPANIES · #2826
DoorDash cuts grocery reorder latency from ~16s to ~2s using AI agents
DoorDash reduced latency in its AI-powered grocery reorder flow from about 16 seconds to 2 seconds by precomputing recurring purchase candidates (from 90 days of history) with batch LLM inference, applying deterministic validation, and storing reusable shopping-list data; the serving path then resolves items against the live catalog. The change doubled shopping-list views and increased the flow’s order rate by roughly 34%, and it builds on DoorDash’s shared agent platform and grounded shopping interface (Ask DoorDash).
KEY POINTS
- DoorDash reduced latency in its AI-powered grocery reorder flow from about 16 seconds to 2 seconds by precomputing recurring purchase candidates (from 90 days of history) with batch LLM inference, applying deterministic validation, and storing reusable shopping-list data; the serving path then resolves items against the live catalog.
- The change doubled shopping-list views and increased the flow’s order rate by roughly 34%, and it builds on DoorDash’s shared agent platform and grounded shopping interface (Ask DoorDash).
- This shows an effective agent-architecture tradeoff—moving historical reasoning offline with batch LLMs while resolving live catalog state at request time can dramatically cut latency and improve conversion for conversational shopping.
WHY IT MATTERS
This shows an effective agent-architecture tradeoff—moving historical reasoning offline with batch LLMs while resolving live catalog state at request time can dramatically cut latency and improve conversion for conversational shopping.