When Prompt Caching Costs More Than No Caching
Prompt caching bills writes at a premium and reads at a discount, so a cache that never reads back is strictly more expensive than not caching at all. How I found one deployment doing exactly that, and what made it visible.