Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

35B (35 billion) is the number of parameters this model has. Its a Mixture of Experts model (MoE) so A3B means that 3B parameters are Active at any moment.


~I see. What’s the 6?~

Nevermind, the other reply clears it




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: