Inference engine WASTE opens source: enabling Kimi K3 to fully operate on 64GB of MacBook memory
2026-07-31 17:46:07
According to CoinMeta, the inference engine WASTE has been open-sourced and is capable of running Kimi K3 seamlessly on a 64GB MacBook Pro device. The transformed model occupies approximately 1TB of space and processes token at a rate of 0.49 to 0.54 per second. WASTE retains about 27GB of the model's core structure in memory, with over 80,000 experts stored within its built-in SSD. Only the experts currently in use are fetched from the hard drive when each token is generated. This version does not involve distillation, pruning, or deletion of experts; however, the weights of these experts have been re-quantized to a range of 3-, while the model's core structure uses 4- and 8- bit formats.
Source:Internet
This content is for market information only and does not constitute investment advice.
Follow HQYC official accounts to stay updated
Hot Articles
Refresh

Web3: Circle obtains New York trust license, expanding USDC custody business.
3h ago

Tesla reportedly plans to divest its China business to pave the way for integration with SpaceX.
3h ago

web3: Foreign media: RWA perpetual contracts may expand faster than tokenization
3h ago

Web3: Foreign media: Analysts say the real catalyst for XRP is not the Clarity Act.
4h ago

Foreign media: Trump's children's accounts are unlikely to replace comprehensive family financial planning
4h ago

