Thanks @rahst12 for the enthusiasm. The old risteretto cache, couldn’t handle when there were updates. At every update the cache is invalidated. The new cache that we are implementing updates the cache instead. So hopefully when your live data ingest is on, the new cache would still perform good.
In the new PR, even the ristretto cache is almost as fast as the new cache, signifying in general performance improvements with cache. The new cache is jepsen tested and till now we haven’t seen any consistency issues by using it. Hopefully we get these PRs soon, we are still in the process of fine tuning.