I would love to see a 1.6T total with something like 3B active. I'm running an M...

LoganDark 32 days ago | parent | context | favorite | on: LongCat-2.0, a large-scale MoE model with 1.6T tot...

I would love to see a 1.6T total with something like 3B active. I'm running an M4 Max and I'm still heavily bandwidth-limited -- I can hardly run anything at speed!

lostmsu 30 days ago [–]

No, it won't fit in RAM and will read from SSD instead (10x+ slower).