Pruna OSS Community Spotlight: KVPress by kschwethelm
KVPress makes 20 KV cache compression strategies available for causal language models. KVPress compresses the key-value cache during the pre-fill phase, reducing memory usage for long-context inference.
