We previewed this AI democratization technology in late 2021 ... Here is an example of running the facebook/opt-13b model with Zero-Inference using 16-bit model weights and offloading kv cache to CPU: ...
Some results have been hidden because they may be inaccessible to you
Feedback