Is it because of caching? If the context changes arbitrarily every turn then you... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		esperent 37 days ago \| parent \| context \| favorite \| on: MCP server that reduces Claude Code context consum... Is it because of caching? If the context changes arbitrarily every turn then you would have to throw away the cache.

FuckButtons 37 days ago [–]

So use a block based cache and tune the block size to maximize the hit rate? This isn’t rocket science.

wonnage 37 days ago | [–]

This seems misguided, you have to cache a prefix due to attention.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact