ChatGPT's new memory upgrade is powerful - and could poison every answer it gives you ...
LCLMs compress LLM context before decode — 8.8x faster at 16x compression, beating every KV cache method tested. Open-sourced by NYU and Columbia.