I have recently, forSmall size AI big modelMore interested. Previously, domestic and foreign technology companies in the field of large models, generally increasing the model parameters to enhance the model capacity, from 700 million, 1.3 billion, 7 billion or even more than 20 billion, it is true that more and more powerful, but this will also make everyone's own home computer basically can not run.
Recently, Microsoft released only 270 million parameters of thePhi-2Large Model, Ali also released only 180 million parameters of theThousand Questions on TongyiSuper Miniature Big Model. Not only do these small-sized large models outperform some of the larger models with 700 million or even 1.3 billion parameters in performance reviews, but because of their small size, they can basically run fast in sub-3G video memory or even CPU mode, so that theYou can play on an old computer from 5 years ago. Today, we're sharing aLazy pack for Tongyi Qianqian 1.8B super miniature big modelLet's go and see.
Tongyi Qianwen 1.8B Big ModelIntroduction
Offline lazy bag is here
The old rules, we deployed on their own locally is more trouble, has made a good offline integration package for the ball everyone, download to the local unzip that is used.
Please download and unzip it locally.
①Double-click "One-Click-Boot-Qwen_1.8B.exe”.
②After double-clicking the one-click startup program, a command prompt window will open and the project will run automatically. After loading successfully, please copy the following URL by yourself to open " http://127.0.0.1:8000/ " in your browser.
③Open the link and you can seeQwen-1.8B Big Model Visualization ChatMain Interface:
The interface has already been Chineseized for you ~ it's very easy to use and you can get started in 10 seconds.
- Input prompts: In the "input" field, enter prompts directly.
- Send: Click on the "Submit" button.
Wait a few moments and you can get a reply from the Tongyi Thousand Questions 1.8B Big Model to you now:
From my own experience, the response is very quick and the answers are reliable, so you can try it out for yourself~
Caveats:
①This project is recommended to use NVIDIA graphics card to run, only need 3G video memory, CPU can also run, but slow
②Please make sure the installation path does not contain Chinese, otherwise it may cause strange adaptation problems
That's all for today, I'm Glen, thank you for reading my articles and I welcome your continued support, pleaseLiking, Watching, SharingLet's go for a three-legged walk.
Qwen-1.8B large modelOffline Lazybag
https://drive.uc.cn/s/e2872d9ba88c4