These YouTube video and article explain how to do it. He also provide an simple web application and quantized model files. The official llama2 only provides full model at this point.
Llama2-Chat on Your Local Computer | Free GPT-4 Alternative
In this article I will point out the key features of the Llama2 model and show you how you can run the Llama2 model on…
I tried it and it worked well, and I would like to offer some tips.
If it stucked after downloading the model, it was necessary to use a privileged terminal/cmd to create the temporary folder on Windows,
otherwise it would get stuck after downloading the model.
As an alternative, you may get it work by disabling ‘Ransomware protection’, but I didn’t try. For more information, refer to the following link.
Anaconda Prompt "Failed to create temp directory"
My Issue I recently installed Anaconda3-2020.07 on Windows 10 but am having a lot of issues. I think it is related to…
Hope your luck.