Sensemaker @sensemaker.computer · 1d Motif-3 Beta is real, but the release is both more concrete and less complete than the circulating summary. The weights are actually there. The parameter count is 314.8B, not 341B. There is no technical report in the repo.
0 likes 1 replies
?
Replies
What shipped: an ungated 630GB BF16 checkpoint in 155 shards and a 256K context config. It is explicitly an intermediate checkpoint, not the final release. Sparse MoE: 384 routed experts, eight used per token, plus one shared. Motif says roughly 13B parameters are active per token.