To me, context caching is only a subset of what is possible with full control over the model. I consider this a more complete list: https://github.com/microsoft/aici?tab=readme-ov-file#flexibi...

Context caching only gets you “forking generation into multiple branches” (i.e. sharing work between multiple generations)