In our latest blog post, Marin team member Larry Dial describes the pretraining techniques we're using as we transition from dense models to more efficient Mixture of Experts (MoE) models. This demos the stability and predictability of MoEs, giving us a promising direction for our next training run
At a recent panel on driving the technological future forward, our COO and CSO Jared Crooks explained the importance of keeping AI development open, why ethics should be embedded in tech, and more. Watch or read the discussion at the link
Open Athena is a nonprofit that accelerates academia with capabilities from the AI frontier
