RE: LeoThread 2024-10-28 03:27

[taskmaster4450le]

Pruning can be done using various algorithms, including:

1. L1 norm pruning: Removing weights with a low L1 norm (i.e., weights with a small absolute value).
2. L2 norm pruning: Removing weights with a low L2 norm (i.e., weights with a small magnitude).
3. Relu pruning: Removing neurons with a low ReLU (i.e., neurons with a small output value).
4. Gelu pruning: Removing neurons with a low Gelu (i.e., neurons with a small output value).