Excited to share Sakana AI’s new #ICML2026 paper in collaboration with NVIDIA: "Sparser, Faster, Lighter Transformer Language Models" arxiv.org/abs/2603.23198
This work introduces new open-source GPU kernels and data formats for faster inference and training of sparse transformer LLMs:
🧵 Thread 👇
