Contributing to Pruna is now easier! Whether you’re an OSS expert or contributing for the first time, we’ve improved our contribution guide to make the process clearer.
Here’s how to get started 👇
Pruna OSS Community Spotlight: KVPress by kschwethelm
KVPress makes 20 KV cache compression strategies available for causal language models. KVPress compresses the key-value cache during the pre-fill phase, reducing memory usage for long-context inference.
1. Create or pick an issue. Ping us if you have any questions.
2. Read our contribution guide to learn how to:
- use AI in your contribution
- set up the environment
- implement an algorithm, dataset, or metric step by step
- test your contribution
3. Open your PR.
And don’t hesitate to contact or ping us if you have any doubts.
👉 How to contribute: docs.pruna.ai/en/stable/do...
🌍 Join us on Discord: discord.com/invite/JFQmt...
⭐️ Star our OSS: buff.ly/Y9j29GO
You can find extended usage guides here: docs.pruna.ai/en/stable/do...
www.youtube.com
This is a collection of generated AI content with Pruna AI Performance models: https://www.pruna.ai/all-models.
Learn how to contribute to Pruna AI’s open source project. Setup guide, contribution guidelines, and ways to help improve the AI model optimization framework.
Learn how to contribute to Pruna AI’s open source project. Setup guide, contribution guidelines, and ways to help improve the AI model optimization framework.
💜 Simply make AI models faster, cheaper, smaller, greener!
The toolkit is designed with simplicity in mind - requiring just a few lines of code to optimize your models. It supports various model types, including LLMs, Diffusion, and more!
⭐️ Give us a star: github.com/PrunaAI/pruna
Make sure to read our documentation docs.pruna.ai/en/stable/se...
Pruna AI
Video
Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead. - PrunaAI/pruna
Test and validate our performand, fast and cheap Performance models for AI content generation.
pruna-playground-production-861e.up.railway.app
docs.pruna.ai
Pruna AI is a model laboratory and inference provider—we create performance models and host models with partner platforms. This section covers our open-source optimization framework for developers…