#BananaPi BPI-F3 Now this is the model of #ChatGLMTV2-6b, the model size is 3.6G, the performance is 0.7t/s in Chinese, 1.3T/s in English.such as #minicpm, #qwen2, #phi3, #llama3, #qwen1.5, #chatglm, etc.
https://forum.banana-pi.org/t/bpi-f3-large-model-demo/18541
#ai #llm
https://forum.banana-pi.org/t/bpi-f3-large-model-demo/18541
#ai #llm
BPI-F3 large model Demo
BPI-F3 large model Demo has been put into github source code after V1.0.8, you can experience the following installation:\ sudo apt-get update sudo apt-get install inferllm-chatglm; sudo apt-get install inferllm-chatglm; Now this is the model of ChatGLMTV2-6b, the model size is 3.6G, the performance is 0.7t/s in Chinese, 1.3T/s in English; SpacemiT Key Stone™ K1 implements local operation of many mainstream miniaturized large models such as minicpm, qwen2, phi3, llama3, qwen1.5, chatglm, e...
