What a great week for Gemma users!
A 12b model
And today qat weights for all sizes!
Imagine running Gemma on a small board?
Coral Board is here to help you! you can run Gemma 270M (yes, M as in million, not B as in Billion)
www.youtube.com/watch?v=o2rU...
thanks @maartengr.bsky.social for the beautiful post!!!
Gemma 4 quantization-aware training (QAT) models are now available, bringing AI performance directly to edge devices and consumer GPUs. These checkpoints are optimized with quantization-aware training to dramatically reduce memory requirements and unlock high-speed local inference. 🧵