@simon This is an exciting evolution! DeepSeek started offering this as well in the last couple of weeks, though there's no cost for storage and you just get a lower charge based on any hits in the cache https://platform.deepseek.com/api-docs/news/news0802/ This has advantages, but of course leaves your cache hit rate dependent on how long DeepSeek choose to keep the cache around.
For individual personal usage I'd probably prefer the DeepSeek "do your best and don't make me think about it" pricing model.
@asb wow their offering is so much simpler!