You are viewing a single comment's thread from:

RE: LeoThread 2025-01-31 00:32

in LeoFinancelast month

Part 2/8:

The Deep Seek R1 model stands out for its sheer size and capability. However, the challenge of running such a model typically requires substantial hardware resources. Fortunately, thanks to the innovative work of the team at UNS sloth AI, the original size of the model has been significantly reduced. The original model stood at a staggering 720 GB, but through an advanced technique known as dynamic quantization, it has been shrunk down to a more manageable 131 GB, without sacrificing too much performance.

Understanding Dynamic Quantization